An automatic identification and monitoring system for coral reef fish

Joseph Wilder; Chetan Tonde; Ganesh Sundar; Ning Huang; Lev Barinov; Jigesh Baxi; James Bibby; Andrew Rapport; Edward Pavoni; Serena Tsang; Eri Garcia; Felix Mateo; Tanya M. Lubansky; Gareth J. Russell

doi:10.1117/12.928860

15 October 2012 An automatic identification and monitoring system for coral reef fish

Joseph Wilder, Chetan Tonde, Ganesh Sundar, Ning Huang, Lev Barinov, Jigesh Baxi, James Bibby, Andrew Rapport, Edward Pavoni, Serena Tsang, Eri Garcia, Felix Mateo, Tanya M. Lubansky, Gareth J. Russell

Author Affiliations +

Proceedings Volume 8499, Applications of Digital Image Processing XXXV; 84991H (2012) https://doi.org/10.1117/12.928860
Event: SPIE Optical Engineering + Applications, 2012, San Diego, California, United States

Abstract

To help gauge the health of coral reef ecosystems, we developed a prototype of an underwater camera module to automatically census reef fish populations. Recognition challenges include pose and lighting variations, complicated backgrounds, within-species color variations and within-family similarities among species. An open frame holds two cameras, LED lights, and two ‘background’ panels in an L-shaped configuration. High-resolution cameras send sequences of 300 synchronized image pairs at 10 fps to an on-shore PC. Approximately 200 sequences containing fish were recorded at the New York Aquarium’s Glover’s Reef exhibit. These contained eight ‘common’ species with 85–672 images, and eight ‘rare’ species with 5–27 images that were grouped into an ‘unknown/rare’ category for classification. Image pre-processing included background modeling and subtraction, and tracking of fish across frames for depth estimation, pose correction, scaling, and disambiguation of overlapping fish. Shape features were obtained from PCA analysis of perimeter points, color features from opponent color histograms, and ‘banding’ features from DCT of vertical projections. Images were classified to species using feedforward neural networks arranged in a three-level hierarchy in which errors remaining after each level are targeted by networks in the level below. Networks were trained and tested on independent image sets. Overall accuracy of species-specific identifications typically exceeded 96% across multiple training runs. A seaworthy version of our system will allow for population censuses with high temporal resolution, and therefore improved statistical power to detect trends. A network of such devices could provide an ‘early warning system’ for coral ecosystem collapse.

Citation Download Citation

Joseph Wilder, Chetan Tonde, Ganesh Sundar, Ning Huang, Lev Barinov, Jigesh Baxi, James Bibby, Andrew Rapport, Edward Pavoni, Serena Tsang, Eri Garcia, Felix Mateo, Tanya M. Lubansky, and Gareth J. Russell "An automatic identification and monitoring system for coral reef fish", Proc. SPIE 8499, Applications of Digital Image Processing XXXV, 84991H (15 October 2012); https://doi.org/10.1117/12.928860

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available