Back to search

Cornell University

Neuromorphic Sensing and Control of Autonomous Micro-Aerial Vehicles

Abstract

dc:description.abstract

Recent developments in manufacturing, processing capabilities, and sensor design point to a future in which sensor-equipped robots will assist humans by autonomously performing difficult, hazardous tasks such as visually inspecting utilities and infrastructure, locating a missing person, or monitoring potentially hazardous environmental conditions. To achieve this, perception algorithms must be developed which use data from on-board exteroceptive sensors to gather information on targets while navigating autonomously through unknown environments. Often, these tasks are best performed by highly maneuverable aerial robots which can easily avoid obstacles and access unique vantage points, but also require computationally efficient perception algorithms and power-efficient sensors due to their limited power budgets. Insect-scale flapping-wing robots represent an extreme, motivating example of aerial robots which, although highly maneuverable due to their extreme reduction in size and weight, also require high frequency sensing and control loops that operate on just milliwatts of power. However, conventional sensing and perception frameworks operate using too much data to operate at the high frequencies required by these robots. Energy-efficient, biologically inspired neuromorphic processors and sensors present a potential solution to this challenge. Neuromorphic chips and their software analog, spiking neural networks (SNNs), can be trained to approximate arbitrary functions while learning and adapting online. Neuromorphic cameras consume only milliwatts of power despite operating with microsecond temporal precision. However, existing neuromorphic perception algorithms either collect only sparse information about the environment or do not account for a moving sensor and are thus inapplicable to flapping-wing robot navigation. This work presents a framework of computationally efficient methods for neuromorphic perception and control to enable autonomous obstacle avoidance and target detection using highly agile micro aerial vehicles (MAVs). The SNN-based control method presented here is developed using a comprehensive, full-envelope flapping-wing flight dynamics model also presented in this work. This approach models flapping flight based on blade-element theory and is used to determine a broad class of set points, trim conditions, and quasi-steady maneuvers including coordinated turns. The model, analysis, and stability results are successfully validated experimentally for both stable and unstable modes. The SNN-based control approach is shown to be capable of controlling maneuvers including takeoff, landing, and coordinated turns throughout the flight envelope while adapting online to account for unmodeled parameter variations and disturbances. Computationally efficient neuromorphic visual perception techniques for obstacle avoidance and target detection are also developed comprising methods for dense optical flow estimation, dense monocular depth estimation, and independent motion detection. These methods leverage the high sensing rate of neuromorphic cameras to enable simple, linear assumptions which lead to improved accuracy and reduced computational cost compared with existing methods. In total, the methods presented here represent a computationally efficient framework for target tracking and obstacle avoidance with autonomous micro aerial vehicles.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Aerospace Engineering
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Aerospace Engineering
Year dc:date.issued
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Clawson, Taylor Scott
Chair dc:contributor.chair
  • Ferrari, Silvia
Committee members dc:contributor.committeemember
  • Ruina, Andy
  • Wang, Z. Jane

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
13119723
Dc Identifier Other
ProQuest Submission ID: 11790
ProQuest Publication ID: 27545839

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Clawson, Taylor Scott. Neuromorphic Sensing and Control of Autonomous Micro-Aerial Vehicles. Doctor of Philosophy thesis, 2019. https://hdl.handle.net/1813/70049