Evaluation of detection and tracking performance in imaging systems

Wyke Huizinga; Annegreet Van Opbroek; Raimon H. R. Pruim; Richard J. M. den Hollander; Sebastiaan P. van den Broek; Emma S. Schook; Klamer Schutte; Nanda van der Stap; Judith Dijk

doi:10.1117/1.OE.58.7.073103

11 July 2019 Evaluation of detection and tracking performance in imaging systems

Wyke Huizinga, Annegreet Van Opbroek, Raimon H. R. Pruim, Richard J. M. den Hollander, Sebastiaan P. van den Broek, Emma S. Schook, Klamer Schutte, Nanda van der Stap, Judith Dijk

Author Affiliations +

Optical Engineering, Vol. 58, Issue 7, 073103 (July 2019). https://doi.org/10.1117/1.OE.58.7.073103

Abstract

Imaging systems can be used to obtain situational awareness in maritime situations. Important tools for these systems are automatic detection and tracking of objects in the acquired imagery, in which numerous methods are being developed. When designing a detection or tracking algorithm, its quality should be ensured by a comparison with existing algorithms and/or with a ground truth. Detection and tracking methods are often designed for a specific task, so evaluation with respect to this task is crucial, which demands for different evaluation measures for different tasks. We, therefore, propose a variety of quantitative measures for the performance evaluation of detectors and trackers for a variety of tasks. The proposed measures are a rich set from which an algorithm designer can choose in order to optimally design and assess a detection or tracking algorithm for a specific task. We compare these different evaluation measures by using them to assess detection and tracking quality in different maritime detection and tracking situations, obtained from three real-life infrared video data sets. With the proposed set of evaluation measures, a user is able to quantitatively assess the performance of a detector or tracker, which enables an optimal design for his approach.

Citation Download Citation

Wyke Huizinga, Annegreet Van Opbroek, Raimon H. R. Pruim, Richard J. M. den Hollander, Sebastiaan P. van den Broek, Emma S. Schook, Klamer Schutte, Nanda van der Stap, and Judith Dijk "Evaluation of detection and tracking performance in imaging systems," Optical Engineering 58(7), 073103 (11 July 2019). https://doi.org/10.1117/1.OE.58.7.073103

Received: 23 April 2019; Accepted: 18 June 2019; Published: 11 July 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available