Personal tools

Difference between revisions of "IBM Research"

From iis-projects

Jump to: navigation, search
(Available Projects)
(Contact)
 
(27 intermediate revisions by 4 users not shown)
Line 23: Line 23:
  
 
[[File:NatureElectronics20.jpg|thumb|right|200px]]
 
[[File:NatureElectronics20.jpg|thumb|right|200px]]
Neither symbolic AI nor neural networks alone has produced the kind of intelligence expressed in human and animal behavior. Why? Each has a long and rich history, but has addressed a relatively narrow aspect of the problem. Symbolic AI focuses on solving cognitive problems, drawing upon the rich framework of symbolic computation to manipulate internal representations in order to perform reasoning and inference. But it suffers from being non-adaptive, lacking the ability to learn from example or by direct observation of the world. Neural networks on the other hand have the ability to learn from data, and derive much of their power from nonlinear function approximation combined with stochastic gradient descent. But intelligence requires more than modeling input-output relationships. Without the richness of symbolic computation, neural nets lack the simple but powerful operations such as variable binding that allow for analogy making and reasoning, which underlie the ability to generalize from few examples.
+
Neither symbolic AI nor neural networks alone has produced the kind of intelligence expressed in human and animal behavior. Why? Each has a long and rich history, but has addressed a relatively narrow aspect of the problem. Symbolic AI focuses on solving cognitive problems, drawing upon the rich framework of symbolic computation to manipulate internal representations in order to perform reasoning and inference. But it suffers from being non-adaptive, lacking the ability to learn from example or by direct observation of the world (aka symbol grounding problem). Neural networks on the other hand have the ability to learn from data, and derive much of their power from nonlinear function approximation combined with stochastic gradient descent. But intelligence requires more than modeling input-output relationships. Without the richness of symbolic computation, neural nets lack the simple but powerful operations such as variable binding that allow for analogy making and reasoning, which underlie the ability to generalize from few examples. To address this gap, '''neurosymbolic AI''' aims to combine the best of both worlds to approach human-level intelligence.
  
 
We approach the problem from a very different perspective, inspired by the brain’s high-dimensional circuits and the unique mathematical properties of high-dimensional spaces. ''It leads us to a novel information processing architecture that combines the strengths of symbolic AI and neural networks, and yet has novel emergent properties of its own.'' By combining a small set of basic operations on high-dimensional vectors, we obtain hybrid AI system (HAS) that makes it possible to represent and manipulate data in ways familiar to us from symbolic AI, and to learn from the statistics of data in ways familiar to us from artificial neural networks and deep learning. Further, principles of such HAS allow few-shot learning capabilities, and extremely robust operations against failures, defects, variations, and noise, all of which are complementary to ultra-low energy computation on nanoscale fabrics such as phase-change memory devices. Exciting further research (listed in below table) awaiting in this direction spans high-level algorithmic exploration all the way to efficient hardware design for emerging computational fabrics.
 
We approach the problem from a very different perspective, inspired by the brain’s high-dimensional circuits and the unique mathematical properties of high-dimensional spaces. ''It leads us to a novel information processing architecture that combines the strengths of symbolic AI and neural networks, and yet has novel emergent properties of its own.'' By combining a small set of basic operations on high-dimensional vectors, we obtain hybrid AI system (HAS) that makes it possible to represent and manipulate data in ways familiar to us from symbolic AI, and to learn from the statistics of data in ways familiar to us from artificial neural networks and deep learning. Further, principles of such HAS allow few-shot learning capabilities, and extremely robust operations against failures, defects, variations, and noise, all of which are complementary to ultra-low energy computation on nanoscale fabrics such as phase-change memory devices. Exciting further research (listed in below table) awaiting in this direction spans high-level algorithmic exploration all the way to efficient hardware design for emerging computational fabrics.
  
 
===Useful Reading===
 
===Useful Reading===
 +
*[https://www.youtube.com/watch?v=HhymId8dr5Q Neurosymbolic AI Explained, IBM-Research]
 +
*[https://www.youtube.com/watch?v=CYbkoAP5dME Neurosymbolic AI, Invited Talk by David Cox, IAAI /AAAI 2020]
 +
*[https://www.nature.com/articles/s41928-020-0410-3 In-memory hyperdimensional computing], Nature Electronics, 2020.
 
*[https://www.nature.com/articles/s41467-021-22364-0 Robust high-dimensional memory-augmented neural networks], Nature Communications, 2021.
 
*[https://www.nature.com/articles/s41467-021-22364-0 Robust high-dimensional memory-augmented neural networks], Nature Communications, 2021.
*[https://www.nature.com/articles/s41928-020-0410-3 In-memory hyperdimensional computing], Nature Electronics, 2020.
+
*[https://www.nature.com/articles/s41565-023-01357-8 In-memory factorization of holographic perceptual representations], Nature Nanotechnology, 2023.
*[https://www.nature.com/articles/s41928-020-00510-8 A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition], Nature Electronics, 2020.
 
*[https://link.springer.com/article/10.1007/s12559-009-9009-8 Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors], Cognitive Computation, 2009.
 
  
 
===Prerequisites===
 
===Prerequisites===
Line 39: Line 40:
 
*VLSI I (''recommended'')
 
*VLSI I (''recommended'')
  
==In-Memory Computing (IMC)==
+
<!-- ==In-Memory Computing (IMC)==
  
 
[[File:NNcover_imc.jpg|thumb|right|200px]]
 
[[File:NNcover_imc.jpg|thumb|right|200px]]
Line 52: Line 53:
 
*General interest in Deep Learning and memory/system design
 
*General interest in Deep Learning and memory/system design
 
*VLSI I and VLSI II (''recommended'')
 
*VLSI I and VLSI II (''recommended'')
*Analog Circuit Design (''recommended'')
 
 
Specific requirements for the different projects vary and are generally negotiable.
 
Specific requirements for the different projects vary and are generally negotiable.
 +
--->
  
 
==Available Projects==
 
==Available Projects==
We are inviting applications from students to conduct their master’s thesis work or an internship project at the IBM Research lab in Zurich on this exciting new topic.  
+
We are inviting applications from students to conduct their thesis (bachelor, semester, and master) or an internship project at the IBM Research lab in Zurich on this exciting new topic.  
 
<!--
 
<!--
 
The work performed could span low-level hardware experiments on phase-change memory chips comprising more than 1 million devices to high-level algorithmic development in a deep learning framework such as TensorFlow or PyTorch. It also involves interactions with several researchers across IBM research focusing on various aspects of the project. The ideal candidate should have a multi-disciplinary background, strong mathematical aptitude and programming skills. Prior knowledge on emerging memory technologies such as phase-change memory is a bonus but not necessary.
 
The work performed could span low-level hardware experiments on phase-change memory chips comprising more than 1 million devices to high-level algorithmic development in a deep learning framework such as TensorFlow or PyTorch. It also involves interactions with several researchers across IBM research focusing on various aspects of the project. The ideal candidate should have a multi-disciplinary background, strong mathematical aptitude and programming skills. Prior knowledge on emerging memory technologies such as phase-change memory is a bonus but not necessary.
Line 63: Line 64:
 
{| class="wikitable" style="text-align: center;"
 
{| class="wikitable" style="text-align: center;"
 
|-
 
|-
! style="width: 5%;"|Type !! style="width: 20%"|Project !! style="width: 60%"|Description !! style="width: 5%"|Topic !! style="width: 15%"|Workload Type  
+
! style="width: 5%;"|Type !! style="width: 20%"|Project !! style="width: 60%"|Description !! style="width: 5%"|Workload Type  
 
|-
 
|-
  
| MA || Accelerating Mixers with Computational Memory || [http://iis-projects.ee.ethz.ch/images/e/e8/IBM_Mixer.pdf Link to description] || HAS || Hardware design and experiments
+
 
 +
 
 +
| MA|| Code Generation for Analog In- Memory Computing SoCs || [https://iis-projects.ee.ethz.ch/images/4/48/Y2024_IBM_CodeGen_MasterThesis.pdf Link to description] || algorithmic design  
 
|-
 
|-
  
| MA || Accelerating Transformers with Computational Memory || [http://iis-projects.ee.ethz.ch/images/b/be/IBM_TransfAcc.pdf Link to description]  || HAS || Hardware/algorithmic design
+
 
 +
 
 +
| MA || Neurosymbolic Architectures to Approach Human-like AI || [https://iis-projects.ee.ethz.ch/images/c/cc/IBM_Neurosymbolic.pdf Link to description]  || algorithmic design
 
|-
 
|-
  
| MA/SA/BA || Face Recognition at Scale ||  [http://iis-projects.ee.ethz.ch/images/3/3d/IBM_FaceRec_at_Scale.pdf Link to description]  || HAS || algorithmic design
+
 
 +
 
 +
| MA || Developing Efficient Models for Solving Intelligence Quotient (IQ) Test ||  [https://iis-projects.ee.ethz.ch/images/4/4b/IBM_RPM.pdf Link to description]  || algorithmic/hardware design
 
|-
 
|-
  
| MA || Developing Efficient Models of Strong AI for Intelligence Quotient (IQ) Test || [http://iis-projects.ee.ethz.ch/images/4/4b/IBM_RPM.pdf Link to description] || HAS || algorithmic design
+
 
 +
| MA|| Crytography meets in-memory computing || [https://iis-projects.ee.ethz.ch/images/6/62/Y2021_10_Advertisement_VME.pdf Link to description] || algorithmic design and hardware experiments
 
|-
 
|-
  
| MA|| Lifelong learning challenge || [http://iis-projects.ee.ethz.ch/images/0/01/IBM_MANN_Y2020.pdf Link to description] || HAS || algorithmic/hardware design
+
 
 +
| MA|| Optimal routing for 2D Mesh-based Analog Compute-In-Memory Accelerator Architecture || [https://iis-projects.ee.ethz.ch/images/8/83/ADS_Routing.pdf Link to description] || hardware design  
 
|-
 
|-
  
  
| MA || Accurate deep learning inference using computational memory ||  [https://www.zurich.ibm.com/careers/2020_027.html Project description and application]  || IMC || algorithmic design
+
 
|-
 
 
|}
 
|}
  
Line 89: Line 97:
 
: Thesis will be at IBM Zurich in Rüschlikon
 
: Thesis will be at IBM Zurich in Rüschlikon
 
; Hybrid AI Systems (HAS) projects
 
; Hybrid AI Systems (HAS) projects
: Contact (at ETH Zurich): [[:User:kgf | Dr. Frank K. Gurkaynak]], [[:User:Herschmi | Michael Hersche]]
+
: Contact (at ETH Zurich): [[:User:kgf | Dr. Frank K. Gurkaynak]]
 +
: Contact (at IBM): [mailto:ibo@zurich.ibm.com Dr. Irem Boybat]
 +
: Contact (at IBM): [mailto:anu@zurich.ibm.com Dr. Manuel Le Gallo]  
 
: Contact (at IBM): [mailto:ase@zurich.ibm.com Dr. Abu Sebastian]  
 
: Contact (at IBM): [mailto:ase@zurich.ibm.com Dr. Abu Sebastian]  
 
: Contact (at IBM): [mailto:abr@zurich.ibm.com Dr. Abbas Rahimi]
 
: Contact (at IBM): [mailto:abr@zurich.ibm.com Dr. Abbas Rahimi]
: Professor: [http://www.iis.ee.ethz.ch/portrait/staff/lbenini.en.html Luca Benini]
+
: Professor: [https://iis.ee.ethz.ch/people/person-detail.html?persid=194234 Luca Benini]

Latest revision as of 14:20, 15 March 2024

IBM ZRLab.png

Short Description

Today, we are entering the era of cognitive computing, which holds great promise in deriving intelligence and knowledge from huge volumes of data. In today’s computers based on von Neumann architecture, huge amounts of data need to be shuttled back and forth at high speeds, a task at which this architecture is inefficient.

It is becoming increasingly clear that to build efficient cognitive computers, we need to transition to non-von Neumann architectures in which memory and processing coexist in some form. At IBM Research–Zurich in the Neuromorphic and In-memory Computing Group, we explore various such computing paradigms from in-memory computing to brain-inspired neuromorphic computing. Our research spans from devices and architectures to algorithms and applications.

About the IBM Research–Zurich

The location in Zurich is one of IBM’s 12 global research labs. IBM has maintained a research laboratory in Switzerland since 1956. As the first European branch of IBM Research, the mission of the Zurich Lab, in addition to pursuing cutting-edge research for tomorrow’s information technology, is to cultivate close relationships with academic and industrial partners, be one of the premier places to work for world-class researchers, to promote women in IT and science, and to help drive Europe’s innovation agenda. Download factsheet

Hybrid AI Systems (HAS)

NatureElectronics20.jpg

Neither symbolic AI nor neural networks alone has produced the kind of intelligence expressed in human and animal behavior. Why? Each has a long and rich history, but has addressed a relatively narrow aspect of the problem. Symbolic AI focuses on solving cognitive problems, drawing upon the rich framework of symbolic computation to manipulate internal representations in order to perform reasoning and inference. But it suffers from being non-adaptive, lacking the ability to learn from example or by direct observation of the world (aka symbol grounding problem). Neural networks on the other hand have the ability to learn from data, and derive much of their power from nonlinear function approximation combined with stochastic gradient descent. But intelligence requires more than modeling input-output relationships. Without the richness of symbolic computation, neural nets lack the simple but powerful operations such as variable binding that allow for analogy making and reasoning, which underlie the ability to generalize from few examples. To address this gap, neurosymbolic AI aims to combine the best of both worlds to approach human-level intelligence.

We approach the problem from a very different perspective, inspired by the brain’s high-dimensional circuits and the unique mathematical properties of high-dimensional spaces. It leads us to a novel information processing architecture that combines the strengths of symbolic AI and neural networks, and yet has novel emergent properties of its own. By combining a small set of basic operations on high-dimensional vectors, we obtain hybrid AI system (HAS) that makes it possible to represent and manipulate data in ways familiar to us from symbolic AI, and to learn from the statistics of data in ways familiar to us from artificial neural networks and deep learning. Further, principles of such HAS allow few-shot learning capabilities, and extremely robust operations against failures, defects, variations, and noise, all of which are complementary to ultra-low energy computation on nanoscale fabrics such as phase-change memory devices. Exciting further research (listed in below table) awaiting in this direction spans high-level algorithmic exploration all the way to efficient hardware design for emerging computational fabrics.

Useful Reading

Prerequisites

  • Python
  • Background in machine learning (recommended)
  • Experience with any deep learning framework such as TensorFlow or PyTorch (recommended)
  • VLSI I (recommended)


Available Projects

We are inviting applications from students to conduct their thesis (bachelor, semester, and master) or an internship project at the IBM Research lab in Zurich on this exciting new topic.

Type Project Description Workload Type
MA Code Generation for Analog In- Memory Computing SoCs Link to description algorithmic design
MA Neurosymbolic Architectures to Approach Human-like AI Link to description algorithmic design
MA Developing Efficient Models for Solving Intelligence Quotient (IQ) Test Link to description algorithmic/hardware design
MA Crytography meets in-memory computing Link to description algorithmic design and hardware experiments
MA Optimal routing for 2D Mesh-based Analog Compute-In-Memory Accelerator Architecture Link to description hardware design

Contact

Thesis will be at IBM Zurich in Rüschlikon
Hybrid AI Systems (HAS) projects
Contact (at ETH Zurich): Dr. Frank K. Gurkaynak
Contact (at IBM): Dr. Irem Boybat
Contact (at IBM): Dr. Manuel Le Gallo
Contact (at IBM): Dr. Abu Sebastian
Contact (at IBM): Dr. Abbas Rahimi
Professor: Luca Benini