Personal tools

Difference between revisions of "Deep Learning-based Global Local Planner for Autonomous Nano-drones"

From iis-projects

Jump to: navigation, search
Line 1: Line 1:
[[Category:Hot]] [[Category:Energy Efficient Autonomous UAVs]] [[Category:Software]] [[Category:Digital]] [[Category:PULP]] [[Category:Available]] [[Category:Semester Thesis]] [[Category:Dpalossi]]
<!-- Deep Learning-based Global + Local Planner for Autonomous Nano-drones -->
[[Category:Hot]] [[Category:Energy Efficient Autonomous UAVs]] [[Category:Software]] [[Category:Digital]] [[Category:PULP]] [[Category:Available]] [[Category:Semester Thesis]] [[Category:Master Thesis]] [[Category:Dpalossi]]
[[File:GL_dpalossi.png|thumb|right|1000px|Overview of the cyber-physical system.]]
[[File:GL_dpalossi.png|thumb|right|1000px|Overview of the cyber-physical system.]]

Revision as of 21:27, 26 January 2022

Overview of the cyber-physical system.


Autonomous unmanned aerial vehicles (UAVs) are increasingly getting smaller and smarter. Their tiny form factor can be a game-changer in many practical applications such as aerial inspection or assistance in natural disaster areas, to name a few.

A common approach in the state-of-the-art (SoA) of autonomous driving systems is represented by the combination of global and local planning [1]. On the one hand, global planning sees “the whole picture” (for example ensuring the robot is passing through pre-defined check-points given as GPS coordinates), while the local planning takes care of close-proximity maneuvers (e.g., avoiding obstacles).

In this context, the project aims at enabling such a planning paradigm aboard small flying robots (i.e., nano-drones with 10cm in diameter and a few tens of grams in weight). This class of vehicles is particularly appealing but also challenging given all their constraints, e.g., form-factor, payload, power envelope. For this ambitious goal, we envision leveraging a “computationally cheap” deep neural network to act as the global planner [2], ensuring high-level semantic information is captured from the environment and a more precise local planner based on a novel time-of-flight (ToF) sensor [3] that output small-size (8x8) depth maps.

A key aspect of this project is represented by the deployment of all sensors and computational modules aboard a Crazyflie 2.1 nano-drone [4], equipped with a powerful AI-deck [5] companion board that enables the onboard execution of multiple workloads thanks to a parallel ultra-low power octa-core (PULP) GAP8 System-on-Chip [6].

Status: Available

Available as Master/Semester Thesis
Tutor: Dr. Daniele Palossi
Supervisor: Prof. Dr. Luca Benini


  • Familiarity with C programming.
  • Knowledge of basic python programming and deep learning frameworks (e.g., PyTorch)
  • Basic knowledge of parallel programming and Host/Accelerator paradigm, or willing to learn
  • Basic knowledge/experience in embedded programming favorable


15% Literature and theory study, familarization with existing code
30% Python programming, convolutional neural network training
30% C embedded programming (STM MCU and PULP programming/optimization)
15% In-field test and verification
10% Report writing

Detailed Task Description

Meetings & Presentations

Weekly meetings will be held between the student and the assistants. The exact time and location of these meetings will be determined within the first week of the project. These meetings will be used to evaluate the status and progress of the project. Besides these regular meetings, additional meetings can be organized to address urgent issues as well.


Practical Details

↑ top