Fine hyperspectral classification of rice varieties based on attention module 3D-2DCNN

• Published in: Computers and electronics in agriculture 2022-12, Vol.203, p.107474, Article 107474
• Main Authors: Meng, Ying, Ma, Zheng, Ji, Zeguang, Gao, Rui, Su, Zhongbin
• Format: Article
• Language: English
• Subjects: agriculture; Attention module; canopy; Convolutional neural network; disease resistance; electronics; food crops; grain quality; humans; hybrids; Hyperspectral image classification; insect resistance; model validation; neural networks; precision agriculture; rice; Rice variety
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2022.107474

•An end-to-end rice varieties hyperspectral classification model based on hybrid CNN (3D-CSAM-2DCNN) was proposed.•Hyperspectral dataset of 14 rice varieties were collected by UAV platform, with clipping and manually labeling.•The channel and spatial attention modules were used to capture band correlation and extract deeper spatial features.•Patch size and the number of training samples were adjusted to guarantee the performance of model. Rice is an indispensable food crop for human beings. Rice varieties are closely related to disease resistance, insect resistance, lodging resistance, grain quality and yield. Different varieties of rice have similar appearance traits and change trends, which are difficult to distinguish. It is of great significance to classify and identify rice varieties with high precision in a wide range by objective and non-destructive detection methods. In this paper, the canopy hyperspectral images of rice varieties were obtained by using the S185 hyperspectral imaging device mounted on a UAV platform. And the spectral and spatial features of 14 rice varieties were automatically learned and deeply extracted by hybrid convolutional neural network structure. In addition, in order to improve the performance of the model, the article attempts to optimize the model with the end-to-end trainable attention module. Finally, extensive experiments are carried out to prove the validity of the model. Compared with the advanced methods, the 3D-CSAM-2DCNN proposed in this paper performed the best classification on fine classification of rice varieties. The overall accuracy of 98.93% and the accuracy of more than 98.22% for single variety has been achieved. The proposed model is conducive to automatic identification of fields and crop phenotypes research, and contributes new possibilities to promote the development of precision agriculture and smart agriculture.