Towards three-dimensional point cloud reconstruction of fish swimming

Mert Karakaya; Chen Feng; Maurizio Porfiri

doi:10.1117/12.2558095

Translator Disclaimer

22 April 2020 Towards three-dimensional point cloud reconstruction of fish swimming

Mert Karakaya, Chen Feng, Maurizio Porfiri

Author Affiliations +

Proceedings Volume 11374, Bioinspiration, Biomimetics, and Bioreplication X; 1137407 (2020) https://doi.org/10.1117/12.2558095
Event: SPIE Smart Structures + Nondestructive Evaluation, 2020, Online Only

Abstract

Zebrafish is extensively used in behavioral, pharmacological, and neurological studies due to a number of method- ological and practical advantages, including genetic and neurobiological homologies with humans and a fully se- quenced genome. Critical to a biologically-based understanding of zebrafish behavior is the ability to reconstruct their complex behavioral repertoire in three-dimensions. Toward this aim, several efforts have been made to score their ethogram in three-dimensions, but most of these studies are constrained by a single-view imaging. A promising line of approach to extract refined information about the mechanosensory and perceptual systems of zebrafish is point cloud reconstruction. Here, we provide an initial review of the state of knowledge in zebrafish tracking and we propose a potential methodology that can capture the dynamic three-dimensional geometry of fish swimming. We utilize a stereo vision camera, calibrated with a pinhole camera model with refraction cor- rection to allow for multi-medium imaging. The corrected pinhole camera model accounts for refraction through multiple mediums and allows for more accurate point cloud reconstruction from two cameras. From the point cloud data, we could recreate the three-dimensional geometric model of the fish and analyze its swimming be- havior in three dimensions. The extracted dynamic fish geometry should allow for an improved understanding of mechanosensation and perception, which are critical to elucidate how zebrafish process visual cues and perceive flow structures.

Conference Presentation

Citation Download Citation

Mert Karakaya, Chen Feng, and Maurizio Porfiri "Towards three-dimensional point cloud reconstruction of fish swimming", Proc. SPIE 11374, Bioinspiration, Biomimetics, and Bioreplication X, 1137407 (22 April 2020); https://doi.org/10.1117/12.2558095

ACCESS THE FULL ARTICLE