3 March 2020 Hybridization of deep and prototypical neural network for rare defect classification on aircraft fuselage images acquired by an unmanned aerial vehicle
Julien Miranda, Jannic Veith, Stanislas Larnier, Ariane Herbulot, Michel Devy
Author Affiliations +
Abstract

To ease visual inspections of exterior aircraft fuselage, new technical approaches have been recently deployed. Automated unmanned aerial vehicles (UAVs) are now acquiring high-quality images of aircraft in order to perform offline analysis. At first, some acquisitions are annotated by human operators in order to provide a large dataset required to train machine learning methods, especially for critical defect detection. An intrinsic problem of this dataset is its extreme imbalance (i.e., there is an unequal distribution between classes). The rarest and most valuable samples represent few elements among thousands of annotated objects. Deep learning (DL)-only based approaches have proven to be very effective when a sufficient amount of data are available for each desired class, whereas few-shot learning (FSL)-dedicated methods (matching network, prototypical network, etc.) can learn from only few samples. In a previous work, those approaches were compared on our applicative case and it was demonstrated that combining DL model and prototypical neural network in a hybrid architecture improves the results. We extend this work by questioning the interface between models in such a hybrid architecture. We show that by carefully selecting the data from the well-represented class when using FSL techniques, it is possible to enhance the previously proposed solution.

© 2020 SPIE and IS&T 1017-9909/2020/$28.00 © 2020 SPIE and IS&T
Julien Miranda, Jannic Veith, Stanislas Larnier, Ariane Herbulot, and Michel Devy "Hybridization of deep and prototypical neural network for rare defect classification on aircraft fuselage images acquired by an unmanned aerial vehicle," Journal of Electronic Imaging 29(4), 041010 (3 March 2020). https://doi.org/10.1117/1.JEI.29.4.041010
Received: 3 October 2019; Accepted: 18 February 2020; Published: 3 March 2020
Lens.org Logo
CITATIONS
Cited by 3 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data modeling

Neural networks

Prototyping

Image classification

Unmanned aerial vehicles

Machine learning

3D modeling

Back to Top