Data pipeline of a multi-spectral satellite experiment for object detection and artificial intelligence-based processing

Markus C. Müller; Sanjay Swami; Benjamin Haser; Mohd Bilal; Artur Kinzel; Roger Förstner; Christian Mundt

doi:10.1117/12.2663468

13 June 2023 Data pipeline of a multi-spectral satellite experiment for object detection and artificial intelligence-based processing

Markus C. Müller, Sanjay Swami, Benjamin Haser, Mohd Bilal, Artur Kinzel, Roger Förstner, Christian Mundt

Author Affiliations +

Proceedings Volume 12521, Automatic Target Recognition XXXIII; 125210N (2023) https://doi.org/10.1117/12.2663468
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Recent developments in the military domain introduce the need to detect and track hypersonic glide vehicles in Earth’s atmosphere. The Multispectral Object Sensing by Artificial Intelligence-processed Cameras (MOSAIC) experiment is part of the small-satellite ATHENE-1 of the Universit¨at der Bundeswehr M¨unchen. The primary scientific objective of MOSAIC is to demonstrate reliable detection, identification and tracking of hypersonic glide vehicles using primarily a cooled infrared camera and complementary a visual camera. To cope with a large amount of data from both high-resolution cameras in real-time, state-of-the-art computer vision on-board processing methods are used for detection and tracking. The secondary scientific objective is to investigate the efficiency and reliability of Artificial Intelligence (AI) based image processing algorithms and data compression for space applications. This is of particular importance given the high volumes and rates of data. The application of such algorithms requires a reliable and resource-efficient On-Board Computer (OBC) that can withstand the harsh space environment. The approach outlined in this paper envisions a dedicated OBC to manage the AI-based experiments of the satellite, called the Artificial Intelligence capable On-Board Computer (AI-OBC). The AI-OBC includes multiple hardware-based AI accelerators to meet the computational requirements and ensure real-time processing for object detection and tracking. This paper describes the structure of the data processing pipeline and includes the AI-OBC architecture with its connections to both the cameras and the platform’s OBC. Further, the study discusses the training and validation steps of the intended use-cases.

Conference Presentation

Citation Download Citation

Markus C. Müller, Sanjay Swami, Benjamin Haser, Mohd Bilal, Artur Kinzel, Roger Förstner, and Christian Mundt "Data pipeline of a multi-spectral satellite experiment for object detection and artificial intelligence-based processing", Proc. SPIE 12521, Automatic Target Recognition XXXIII, 125210N (13 June 2023); https://doi.org/10.1117/12.2663468

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available