The paper introduces a novel framework for safe and autonomous aerial physical interaction in industrial settings. It comprises two main components: a neural network-based target detection system enhanced with edge computing for reduced onboard computational load, and a control barrier function (CBF)-based controller for safe and precise maneuvering. The target detection system is trained on a dataset under challenging visual conditions and evaluated for accuracy across various unseen data with changing lighting conditions. Depth features are utilized for target pose estimation, with the entire detection framework offloaded into low-latency edge computing. The CBF-based controller enables the UAV to converge safely to the target for precise contact. Simulated evaluations of both the controller and target detection are presented, alongside an analysis of real-world detection performance.

Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers / Berra, Andrea; Sankaranarayanan, Viswa Narayanan; Seisa, Achilleas Santi; Mellet, Julien; Gamage, Udayanga G. W. K. N.; Satpute, Sumeet Gajanan; Ruggiero, Fabio; Lippiello, Vincenzo; Tolu, Silvia; Fumagalli, Matteo; Nikolakopoulos, George; Soto, Miguel Ángel Trujillo; Heredia, Guillermo. - (2024), pp. 1354-1361. ( 2024 International Conference on Unmanned Aircraft Systems, ICUAS 2024 grc 2024) [10.1109/icuas60882.2024.10557050].

Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers

Mellet, Julien;Ruggiero, Fabio;Lippiello, Vincenzo;
2024

Abstract

The paper introduces a novel framework for safe and autonomous aerial physical interaction in industrial settings. It comprises two main components: a neural network-based target detection system enhanced with edge computing for reduced onboard computational load, and a control barrier function (CBF)-based controller for safe and precise maneuvering. The target detection system is trained on a dataset under challenging visual conditions and evaluated for accuracy across various unseen data with changing lighting conditions. Depth features are utilized for target pose estimation, with the entire detection framework offloaded into low-latency edge computing. The CBF-based controller enables the UAV to converge safely to the target for precise contact. Simulated evaluations of both the controller and target detection are presented, alongside an analysis of real-world detection performance.
2024
Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers / Berra, Andrea; Sankaranarayanan, Viswa Narayanan; Seisa, Achilleas Santi; Mellet, Julien; Gamage, Udayanga G. W. K. N.; Satpute, Sumeet Gajanan; Ruggiero, Fabio; Lippiello, Vincenzo; Tolu, Silvia; Fumagalli, Matteo; Nikolakopoulos, George; Soto, Miguel Ángel Trujillo; Heredia, Guillermo. - (2024), pp. 1354-1361. ( 2024 International Conference on Unmanned Aircraft Systems, ICUAS 2024 grc 2024) [10.1109/icuas60882.2024.10557050].
File in questo prodotto:
File Dimensione Formato  
C52.pdf

accesso aperto

Tipologia: Altro materiale allegato
Licenza: Dominio pubblico
Dimensione 13.17 MB
Formato Adobe PDF
13.17 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/993622
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact