UAS-based autonomous visual inspection of airplane surface defects

Mark Tappe; Daniel Dose; Martin Oelsch; Mojtaba Karimi; Leonhard Hösch; Leon Heller; Jan Knufinke; Mirco Alpen; Joachim Horn; Christian Bachmeir

doi:10.1117/12.2612579

18 April 2022 UAS-based autonomous visual inspection of airplane surface defects

Mark Tappe, Daniel Dose, Martin Oelsch, Mojtaba Karimi, Leonhard Hösch, Leon Heller, Jan Knufinke, Mirco Alpen, Joachim Horn, Christian Bachmeir

Author Affiliations +

Proceedings Volume 12049, NDE 4.0, Predictive Maintenance, and Communication and Energy Systems in a Globally Networked World; 1204903 (2022) https://doi.org/10.1117/12.2612579
Event: SPIE Smart Structures + Nondestructive Evaluation, 2022, Long Beach, California, United States

Abstract

Today’s maintenance tasks are time-consuming and therefore cost-intensive, in particular the manual inspection of commercial airliners. The joint project ”AI-Inspection Drone” aims to provide a complete process chain for the surface damage detection of airliners based on an unmanned aerial system (UAS). To achieve this goal, visual data is gathered, which can later be evaluated by artificial intelligence models. The process chain is explained in detail, beginning with the simulation of the hangar environment, followed by insights about the indoor navigation of the UAS. Finally, it is validated through test flights around the airplane, respecting strict security and safety requirements. The 3D-simulation based on Gazebo was expanded with hardware-in-the-loop testing functionality by utilizing a camera-based motion capture system to track the UAS’s position in real-time and feed the position data back into the simulation, to test different inspection tasks. For the deployment of the UAS in the hangar, a 3D-LiDAR based SLAM algorithm is used to provide position and orientation data in relation to the airplane. Using a 3D model, which can be gathered beforehand with LiDAR scans, the airplane’s surface area is estimated to determine the mission waypoints and the corresponding inspection views for a high-resolution camera. A path planning algorithm controls the procedure of the inspection by evaluating an efficient path based on these waypoints and enables obstacle avoidance based on LiDAR data. With the proposed autonomous aerial inspection platform, the ground time of airplanes can be reduced, thus increasing the efficiency of the airplane inspection process.

Conference Presentation

Citation Download Citation

Mark Tappe, Daniel Dose, Martin Oelsch, Mojtaba Karimi, Leonhard Hösch, Leon Heller, Jan Knufinke, Mirco Alpen, Joachim Horn, and Christian Bachmeir "UAS-based autonomous visual inspection of airplane surface defects", Proc. SPIE 12049, NDE 4.0, Predictive Maintenance, and Communication and Energy Systems in a Globally Networked World, 1204903 (18 April 2022); https://doi.org/10.1117/12.2612579

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available