Fruit detectability analysis for different camera positions in sweet-pepper

• Published in: Sensors (Basel, Switzerland) Switzerland), 2014-03, Vol.14 (4), p.6032-6044
• Main Authors: Hemming, Jochen, Ruizendaal, Jos, Hofstee, Jan Willem, van Henten, Eldert J
• Format: Article
• Language: English
• Subjects: Automation; Cameras; Capsicum - anatomy & histology; Crops, Agricultural - anatomy & histology; Fruit - anatomy & histology; fruit visibility; Fruits; Greenhouses; harvesting; Image detection; Image Processing, Computer-Assisted; occlusion; Photography - instrumentation; Recording; robot; Robotics; Sensors; sweet-pepper; view; Visibility; Vision systems; Zenith
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s140406032

For robotic harvesting of sweet-pepper fruits in greenhouses a sensor system is required to detect and localize the fruits on the plants. Due to the complex structure of the plant, most fruits are (partially) occluded when an image is taken from one viewpoint only. In this research the effect of multiple camera positions and viewing angles on fruit visibility and detectability was investigated. A recording device was built which allowed to place the camera under different azimuth and zenith angles and to move the camera horizontally along the crop row. Fourteen camera positions were chosen and the fruit visibility in the recorded images was manually determined for each position. For images taken from one position only with the criterion of maximum 50% occlusion per fruit, the fruit detectability (FD) was in no case higher than 69%. The best single positions were the front views and looking with a zenith angle of 60° upwards. The FD increased when a combination was made of multiple viewpoint positions. With a combination of five favourite positions the maximum FD was 90%.