Assessing the Performance of RGB-D Sensors for 3D Fruit Crop Canopy Characterization under Different Operating and Lighting Conditions

The use of 3D sensors combined with appropriate data processing and analysis has provided tools to optimise agricultural management through the application of precision agriculture. The recent development of low-cost RGB-Depth cameras has presented an opportunity to introduce 3D sensors into the agr...

ver descrição completa

Detalhes bibliográficos
Autores: Gené Mola, Jordi, Llorens Calveras, Jordi, Rosell Polo, Joan Ramon, Gregorio López, Eduard, Arnó Satorra, Jaume, Solanelles Batlle, Francesc, Martínez Casasnovas, José Antonio, Escolà i Agustí, Alexandre
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2020
País:España
Recursos:Universitat de Lleida (UdL)
Repositorio:Repositori Obert UdL
OAI Identifier:oai:repositori.udl.cat:10459.1/70097
Acesso em linha:https://doi.org/10.3390/s20247072
http://hdl.handle.net/10459.1/70097
Access Level:acceso abierto
Palavra-chave:RGB-D cameras
Depth cameras
Precision agriculture
Plant phenotyping
Agricultural robotics
Descrição
Resumo:The use of 3D sensors combined with appropriate data processing and analysis has provided tools to optimise agricultural management through the application of precision agriculture. The recent development of low-cost RGB-Depth cameras has presented an opportunity to introduce 3D sensors into the agricultural community. However, due to the sensitivity of these sensors to highly illuminated environments, it is necessary to know under which conditions RGB-D sensors are capable of operating. This work presents a methodology to evaluate the performance of RGB-D sensors under different lighting and distance conditions, considering both geometrical and spectral (colour and NIR) features. The methodology was applied to evaluate the performance of the Microsoft Kinect v2 sensor in an apple orchard. The results show that sensor resolution and precision decreased significantly under middle to high ambient illuminance (>2000 lx). However, this effect was minimised when measurements were conducted closer to the target. In contrast, illuminance levels below 50 lx affected the quality of colour data and may require the use of artificial lighting. The methodology was useful for characterizing sensor performance throughout the full range of ambient conditions in commercial orchards. Although Kinect v2 was originally developed for indoor conditions, it performed well under a range of outdoor conditions.