Personal tools

Autonomous Obstacle Avoidance with Nano-Drones and Novel Depth Sensors

From iis-projects

Revision as of 14:07, 10 March 2022 by Vladn (talk | contribs) (Project Description)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Status: Available

Project Description

Mapping the environment using the novel ToF matrix sensor (VL53L5CX). Figure adapted from [6]

One reason for the high research interest in the field of UAVs is their potential to autonomously navigate indoors while avoiding obstacles. Performing this task includes several challenges, such as online perception, control, trajectory optimization, and localization. The small form-factor category represents an even more promising class of UAVs. The UAVs in this class (i.e., nano-UAVs) measure a few centimeters in size and weigh a few tens of grams. They are considered the ideal candidates for navigating in very narrow indoor areas for monitoring and inspection purposes.

Vision-based perception algorithms used routinely on standard-size drones are based on simultaneous localization and mapping (SLAM) – a perception technique that builds a 3D local map of the environment – or end-to-end convolutional neural networks (CNNs). However, due to the large number of pixels typically associated with images, this approach still requires a large number of computations per frame.

However, novel sensors provide an alternative to vision-based solutions, such as the VL53L5CX from STMicroelectronics, a miniaturized, and lightweight optical multi-zone time-of-flight sensor targeted for indoor perception and autonomous navigation purposes. The VL53L5CX features a matrix of 8x8 ToF elements in a compact integrated solution that represents a negligible payload even for a nano-drone. Indeed, the nature of navigation algorithms intrinsically requires extracting the depth, which is directly provided by the optical sensor. Due to this fact, obstacle avoidance and navigation can be performed with a reduced number of pixels (i.e., 64 pixels).

Your goal is to develop an effective and robust obstacle avoidance algorithm that runs entirely on-board. The algorithm will acquire and interpret the depth frames and it will steer the drone accordingly so that it does not collide with the obstacles. Furthermore, to further extend the capabilities of the system, you will have to implement a path planning solution that optimally drives the drone to a target point based on a local occupancy map that the drone can construct using the depth information.

A preliminary version of such an algorithm has already been implemented.

Video 1:

Video 2:

The Crazyflie 2.1 featuring our custom deck based on the multi-zone ToF sensor


  • 30% Literature and algorithm development
  • 30% FreeRTOS C programming (STM32 Platform)
  • 40% In-field evaluation and testing


  • Strong interest in embedded systems
  • Experience with data acquisition and analysis
  • Experience with low-level C programming