Algorithm for stitching data from a pair of sensors in the thermal and visible range with free location cameras

Evgenii Semenishchev; Viacheslav Voronin; Aleksandr Larin; Ilia Khamidullin; Aleksandr Zelensky

doi:10.1117/12.2691391

26 November 2023 Algorithm for stitching data from a pair of sensors in the thermal and visible range with free location cameras

Evgenii Semenishchev, Viacheslav Voronin, Aleksandr Larin, Ilia Khamidullin, Aleksandr Zelensky

Author Affiliations +

Proceedings Volume 12776, Infrared, Millimeter-Wave, and Terahertz Technologies X; 127761B (2023) https://doi.org/10.1117/12.2691391
Event: SPIE/COS Photonics Asia, 2023, Beijing, China

Conference Poster

Abstract

The paper proposes a method of inter-frame data alignment, built on the operations of pre-processing and selection of object contours and based on the following basic operations: reading data from cameras, determining parameters and dimensions; solving the problem of contouring objects and simplifying them to form a mask for subsequent processing; filtering, using a multi-criteria method based on a combination of criteria, the standard deviation of the final differences of the generated estimates and the first difference of the deviation from the input implementation; the use of NS to search for animals or/and humans; parallel detection of objects located in the range of 34°C-42°C degrees Celsius (95°F-107.6°F); the use of NN to determine the type of object by analyzing the thermal portrait; use of a mask of live objects (visual data) and thermal imaging parameters as alignment centers; determining a thermal image transformation matrix; stitching a pair of images. On a set of test sequences, studies have been carried out to increase the degree of detection of living objects when a thermal imaging camera is included in the data detector. The studies were carried out on a pair of cameras of the visible spectrum (1920x1080, RGB, 8 bit) and thermal (240x180, RGB, 8 bit).

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Evgenii Semenishchev, Viacheslav Voronin, Aleksandr Larin, Ilia Khamidullin, and Aleksandr Zelensky "Algorithm for stitching data from a pair of sensors in the thermal and visible range with free location cameras", Proc. SPIE 12776, Infrared, Millimeter-Wave, and Terahertz Technologies X, 127761B (26 November 2023); https://doi.org/10.1117/12.2691391

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available