Multimode hyperspectral data fusion for fish species identification using supervised and reinforcement learning

Ray Duran; Fartash Vasefi; Kouhyar Tavakolian; Nicholas MacKinnon; Alireza Akhbardeh; Jianwei Qin; Chansong Hwang; Insuck Baek; Walter F. Schmidt; Moon S. Kim; Rachel B. Isaacs; Ayse Gamze Yilmaz; Rosalee S. Hellberg

doi:10.1117/12.2559226

18 June 2020 Multimode hyperspectral data fusion for fish species identification using supervised and reinforcement learning

Ray Duran, Fartash Vasefi, Kouhyar Tavakolian, Nicholas MacKinnon, Alireza Akhbardeh, Jianwei Qin, Chansong Hwang, Insuck Baek, Walter F. Schmidt, Moon S. Kim, Rachel B. Isaacs , Ayse Gamze Yilmaz, Rosalee S. Hellberg

Author Affiliations +

Proceedings Volume 11421, Sensing for Agriculture and Food Quality and Safety XII; 114210L (2020) https://doi.org/10.1117/12.2559226
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

Our goal is to use multiple spectroscopy methods in a single system and develop novel multimode spectroscopic data fusion techniques for fish species identification in real-time. We collected spectral signatures of fish fillets from six fish species using four hyperspectral imaging systems: (1) Reflectance spectral imaging in the visible and NIR (VIS-NIR), (2) Reflectance spectral imaging in the short wave infrared (SWIR), (3) Fluorescence visible spectral imaging with UVA and violet excitation, (4) Raman imaging with a 785 nm laser excitation. All fish fillet samples were confirmed by DNA testing. We built multiple classification/ dimension reduction combination methods to calculate the average sensitivity and associated variance for each class and each spectroscopy mode. In our prototype, the derived statistics are used to form policies for Monte Carlo prediction reinforcement learning. We compared the results of our weighted fusion decisions against individual spectroscopy mode decisions to show an overall sensitivity improvement. We believe this is the first reported use of reinforcement learning applied to multimode spectroscopy data classification in food fraud applications.

Conference Presentation

Citation Download Citation

Ray Duran, Fartash Vasefi, Kouhyar Tavakolian, Nicholas MacKinnon, Alireza Akhbardeh, Jianwei Qin, Chansong Hwang, Insuck Baek, Walter F. Schmidt, Moon S. Kim, Rachel B. Isaacs , Ayse Gamze Yilmaz, and Rosalee S. Hellberg "Multimode hyperspectral data fusion for fish species identification using supervised and reinforcement learning", Proc. SPIE 11421, Sensing for Agriculture and Food Quality and Safety XII, 114210L (18 June 2020); https://doi.org/10.1117/12.2559226

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available