Adapting the Segment Anything Model for Plant Recognition and Automated Phenotypic Parameter Measurement

Traditional phenotyping relies on experts visually examining plants for physical traits like size, color, or disease presence. Measurements are taken manually using rulers, scales, or color charts, with all data recorded by hand. This labor-intensive and time-consuming process poses a significant ob...

Full description

Saved in:
Bibliographic Details
Published in:Horticulturae 2024-04, Vol.10 (4), p.398
Main Authors: Zhang, Wenqi, Dang, L. Minh, Nguyen, Le Quan, Alam, Nur, Bui, Ngoc Dung, Park, Han Yong, Moon, Hyeonjoon
Format: Article
Language:English
Subjects:
Accuracy
Algorithms
Automation
B spline functions
Calibration
Color
Computer vision
Corn
Crop diseases
Cultivars
Data collection
Datasets
Digital cameras
Drought
Environmental conditions
Flowers & plants
Food security
Identification and classification
Labor
Machine learning
measurement
Measurement techniques
Phenotype
Phenotypes
phenotypic parameters
Phenotyping
Plant breeding
Plant extracts
plant recognition
Plants
Recognition
segmentation
Segments
Smartphones
Sustainable agriculture
zero-shot
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Traditional phenotyping relies on experts visually examining plants for physical traits like size, color, or disease presence. Measurements are taken manually using rulers, scales, or color charts, with all data recorded by hand. This labor-intensive and time-consuming process poses a significant obstacle to the efficient breeding of new cultivars. Recent innovations in computer vision and machine learning offer potential solutions for accelerating the development of robust and highly effective plant phenotyping. This study introduces an efficient plant recognition framework that leverages the power of the Segment Anything Model (SAM) guided by Explainable Contrastive Language–Image Pretraining (ECLIP). This approach can be applied to a variety of plant types, eliminating the need for labor-intensive manual phenotyping. To enhance the accuracy of plant phenotype measurements, a B-spline curve is incorporated during the plant component skeleton extraction process. The effectiveness of our approach is demonstrated through experimental results, which show that the proposed framework achieves a mean absolute error (MAE) of less than 0.05 for the majority of test samples. Remarkably, this performance is achieved without the need for model training or labeled data, highlighting the practicality and efficiency of the framework.
ISSN:2311-7524
2311-7524
DOI:10.3390/horticulturae10040398