High-Throughput Phenotyping of Soybean Maturity Using Time Series UAV Imagery and Convolutional Neural Networks

• Published in: Remote sensing (Basel, Switzerland) Switzerland), 2020-11, Vol.12 (21), p.3617
• Main Authors: Trevisan, Rodrigo, Pérez, Osvaldo, Schmitz, Nathan, Diers, Brian, Martin, Nicolas
• Format: Article
• Language: English
• Subjects: Agricultural production; Artificial neural networks; Automation; Cameras; computer vision; Costs; Cultivars; Datasets; Deep learning; Glycine max (L.) Merr; Ground truth; Growing season; Image acquisition; Information processing; machine learning; Management decisions; Maturation; Maturity; Neural networks; Phenotyping; physiological maturity; Physiology; Plant breeding; Ratings; Remote sensing; Senescence; Sensors; soybean phenology; Soybeans; Unmanned aerial vehicles
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs12213617

Soybean maturity is a trait of critical importance for the development of new soybean cultivars, nevertheless, its characterization based on visual ratings has many challenges. Unmanned aerial vehicles (UAVs) imagery-based high-throughput phenotyping methodologies have been proposed as an alternative to the traditional visual ratings of pod senescence. However, the lack of scalable and accurate methods to extract the desired information from the images remains a significant bottleneck in breeding programs. The objective of this study was to develop an image-based high-throughput phenotyping system for evaluating soybean maturity in breeding programs. Images were acquired twice a week, starting when the earlier lines began maturation until the latest ones were mature. Two complementary convolutional neural networks (CNN) were developed to predict the maturity date. The first using a single date and the second using the five best image dates identified by the first model. The proposed CNN architecture was validated using more than 15,000 ground truth observations from five trials, including data from three growing seasons and two countries. The trained model showed good generalization capability with a root mean squared error lower than two days in four out of five trials. Four methods of estimating prediction uncertainty showed potential at identifying different sources of errors in the maturity date predictions. The architecture developed solves limitations of previous research and can be used at scale in commercial breeding programs.