Personal tools

Difference between revisions of "Gomeza old project4"

From iis-projects

Jump to: navigation, search
Line 3: Line 3:
 
==Short Description==
 
==Short Description==
  
In recent years, computer vision has become more accessible to performance constrained, low power platforms. This is mostly due to the development of novel brain-inspired computer vision algorithms. Convolutional neural networks (CNN), for example, are designed to imitate the deep, layered structure of the brain’s visual cortex and its capability to link low-level features and derive higher level concepts in each new layer. In this way, they can often achieve better efficiency and generality than traditional computer vision techniques. With that in mind, we want to explore their effectiveness on batteryless (e.g. solar-powered) platforms. These systems must be designed with tight energy constraints, and usually contain only memory-constrained, ultra-low power microcontrollers. An example for such a platform can be the NXP LPC54000. It features two cores: a slow but low-energy ARM Cortex M0 and a faster but more energy-consuming ARM Cortex M4. We have developed an energy burst scheme can execute different tasks using only a small energy storage (e.g. SMD capacitor), and can tolerate volatile harvesting conditions. Your Project: During this project, which is a collaboration between TIK and IIS, you will learn about convolutional neural networks, multi-core programming frameworks, and energy harvesting. Your task will be to specify a CNN using a high-level multi-core parallel programming framework that was developed at our group. The goal is to have a functional, batteryless prototype based on the NXP LPC54000. Depending on your interests and type of the thesis, this might consist of the following steps:
+
In recent years, computer vision has become more accessible to performance constrained, low power platforms. This is mostly due to the development of novel brain-inspired computer vision algorithms. Convolutional neural networks (CNN), for example, are designed to imitate the deep, layered structure of the brain’s visual cortex and its capability to link low-level features and derive higher level concepts in each new layer. In this way, they can often achieve better efficiency and generality than traditional computer vision techniques. With that in mind, we want to explore their effectiveness on batteryless (e.g. solar-powered) platforms. These systems must be designed with tight energy constraints, and usually contain only memory-constrained, ultra-low power microcontrollers. An example for such a platform can be the NXP LPC54000. It features two cores: a slow but low-energy ARM Cortex M0 and a faster but more energy-consuming ARM Cortex M4. We have developed an energy burst scheme can execute different tasks using only a small energy storage (e.g. SMD capacitor), and can tolerate volatile harvesting conditions.  
 +
 
 +
'''Your Project:''' During this project, which is a collaboration between TIK and IIS, you will learn about convolutional neural networks, multi-core programming frameworks, and energy harvesting. Your task will be to specify a CNN using a high-level multi-core parallel programming framework that was developed at our group. The goal is to have a functional, batteryless prototype based on the NXP LPC54000. Depending on your interests and type of the thesis, this might consist of the following steps:
 
# Get acquainted with the concepts of CNN and parallel programming.
 
# Get acquainted with the concepts of CNN and parallel programming.
 
# Write a first CNN implementation for a PC.
 
# Write a first CNN implementation for a PC.
Line 11: Line 13:
 
===Status: Available ===
 
===Status: Available ===
 
: Looking for 1-2 Master students
 
: Looking for 1-2 Master students
: Contact: [[:User:Gomeza | Andres Gomez]]
+
: Contact: [[:User:Gomeza | Andres Gomez]], [[:User:Fconti | Francesco Conti]]
  
 
===Prerequisites===
 
===Prerequisites===

Revision as of 12:52, 4 June 2016

People Detection CNN.png

Short Description

In recent years, computer vision has become more accessible to performance constrained, low power platforms. This is mostly due to the development of novel brain-inspired computer vision algorithms. Convolutional neural networks (CNN), for example, are designed to imitate the deep, layered structure of the brain’s visual cortex and its capability to link low-level features and derive higher level concepts in each new layer. In this way, they can often achieve better efficiency and generality than traditional computer vision techniques. With that in mind, we want to explore their effectiveness on batteryless (e.g. solar-powered) platforms. These systems must be designed with tight energy constraints, and usually contain only memory-constrained, ultra-low power microcontrollers. An example for such a platform can be the NXP LPC54000. It features two cores: a slow but low-energy ARM Cortex M0 and a faster but more energy-consuming ARM Cortex M4. We have developed an energy burst scheme can execute different tasks using only a small energy storage (e.g. SMD capacitor), and can tolerate volatile harvesting conditions.

Your Project: During this project, which is a collaboration between TIK and IIS, you will learn about convolutional neural networks, multi-core programming frameworks, and energy harvesting. Your task will be to specify a CNN using a high-level multi-core parallel programming framework that was developed at our group. The goal is to have a functional, batteryless prototype based on the NXP LPC54000. Depending on your interests and type of the thesis, this might consist of the following steps:

  1. Get acquainted with the concepts of CNN and parallel programming.
  2. Write a first CNN implementation for a PC.
  3. Adapt the implementation to the LPC54000, paying attention to the severe memory constraints.
  4. Evaluate the performance of your LPC54000 implementation and optimize it.

Status: Available

Looking for 1-2 Master students
Contact: Andres Gomez, Francesco Conti

Prerequisites

You should have experience with Matlab and be familiar with embedded C programming.
Knowledge about microcontrollers would be an asset.


Character

30% Theory
50-60% Implementation
20-10% Testing

Professor

Luca Benini

↑ top

Practical Details

Results

Links

↑ top