Automated plant-scale monitoring by a farmer robot using a consumer-grade RGB-D camera

R. P. Devanna; G. Matranga; M. Biddoccu; G. Reina; A. Milella

doi:10.1117/12.2673845

9 August 2023 Automated plant-scale monitoring by a farmer robot using a consumer-grade RGB-D camera

R. P. Devanna, G. Matranga, M. Biddoccu, G. Reina, A. Milella

Proceedings Volume 12621, Multimodal Sensing and Artificial Intelligence: Technologies and Applications III; 1262118 (2023) https://doi.org/10.1117/12.2673845
Event: SPIE Optical Metrology, 2023, Munich, Germany

Conference Poster

Abstract

This paper investigates the potential of a consumer-grade infrared stereo camera, i.e. the Intel RealSense D435, to automatically extract crop status information, such as Normalized Difference Vegetation Index (NDVI), in arable and permanent crops. The sensing device includes two infrared (IR) sensors for depth calculation and one colour sensor, which provide, for each point of the scene, both IR and visible light information thus making it possible pixel per pixel NDVI estimations. Measurements were performed on various arable crops including corn (Zea mays) and barley (Ordeum vulgare) and on two vine varieties, Freisa and Malvasia, and were compared to measurements taken by a Trimble GreenSeeker handheld crop sensor. Results show that the RealSense camera tends to underestimate NDVI values compared to the GreenSeeker, with squared correlation coefficient r2 = 0.68. The fitted regression equation is successively applied to correct new camera observations, resulting in good agreement with the GreenSeeker output. The use of the RGB-D camera to simultaneously provide canopy height measurements by a farmer robot is also demonstrated in a Malvasia field, showing that the proposed system can be effectively adopted for fully automated plant-scale monitoring of vineyards.

Citation Download Citation

R. P. Devanna, G. Matranga, M. Biddoccu, G. Reina, and A. Milella "Automated plant-scale monitoring by a farmer robot using a consumer-grade RGB-D camera", Proc. SPIE 12621, Multimodal Sensing and Artificial Intelligence: Technologies and Applications III, 1262118 (9 August 2023); https://doi.org/10.1117/12.2673845

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available