Object detection in satellite images based on human cooperative semi-self-training

Kazuki Uehara; Hirokazu Nosato; Masahiro Murakawa; Hidenori Sakanashi

doi:10.1117/12.2533004

7 October 2019 Object detection in satellite images based on human cooperative semi-self-training

Kazuki Uehara, Hirokazu Nosato, Masahiro Murakawa, Hidenori Sakanashi

Proceedings Volume 11155, Image and Signal Processing for Remote Sensing XXV; 111550P (2019) https://doi.org/10.1117/12.2533004
Event: SPIE Remote Sensing, 2019, Strasbourg, France

Abstract

Convolutional neural networks (CNNs) can effectively detect objects in satellite images. They use a large number of labeled samples for training appropriate feature extractor. However, creating labels requires significant concentration and increases the workload of users, because satellite images cover quite large areas relative to the scale of the objects. We propose a human cooperative semi-self-training (SST) framework to reduce users' burden for training a CNN. The SST cooperatively collects training samples from unlabeled samples by repeating the following two phases: self-training and user intervention. The self-training automatically constructs the training dataset and trains the CNN, while the user intervention expands the number of accurately labeled samples. Notably, the SST requests users to label samples only if the automatic training stagnates. We improve the self-training phase to reduce the frequency of user intervention through the following two modules: intelligent dataset construction and pre-training. The intelligent dataset construction module automatically collects only effective training samples based on automatic labeling and evaluation of the collected samples utilizing tentatively trained CNN, while the pre-training module facilitates training of feature extractor in the CNN by allowing the CNN to learn handcrafted image features. Introducing the pre-training module into the dataset construction can effectively improve the self-training because the quality of the automatic labeling based on the pre-trained CNN can be enhanced. The experimental results demonstrated that the CNN trained by the proposed method yielded 92% of performance with only 2.6% of the labeled samples relative to the model trained with the complete dataset.

Conference Presentation

Citation Download Citation

Kazuki Uehara, Hirokazu Nosato, Masahiro Murakawa, and Hidenori Sakanashi "Object detection in satellite images based on human cooperative semi-self-training", Proc. SPIE 11155, Image and Signal Processing for Remote Sensing XXV, 111550P (7 October 2019); https://doi.org/10.1117/12.2533004

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available