Classification of jujube defects in small data sets based on transfer learning

• Published in: Neural computing & applications 2022-03, Vol.34 (5), p.3385-3398
• Main Authors: Ju, Jianping, Zheng, Hong, Xu, Xiaohang, Guo, Zhongyuan, Zheng, Zhaohui, Lin, Mingyu
• Format: Article
• Language: English
• Subjects: Accuracy; Artificial Intelligence; Artificial neural networks; Classification; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data Mining and Knowledge Discovery; Datasets; Defects; Feature extraction; Image classification; Image Processing and Computer Vision; Machine learning; Machine vision; Neural networks; Parameters; Probability and Statistics in Computer Science; Recognition; Special Issue on Multi-modal Information Learning and Analytics on Big Data; Training
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-021-05715-2

Although convolutional neural networks have achieved success in the field of image classification, there are still challenges in the field of agricultural product quality sorting such as machine vision-based jujube defects detection. The performance of jujube defect detection mainly depends on the feature extraction and the classifier used. Due to the diversity of the jujube materials and the variability of the testing environment, the traditional method of manually extracting the features often fails to meet the requirements of practical application. In this paper, a jujube sorting model in small data sets based on convolutional neural network and transfer learning is proposed to meet the actual demand of jujube defects detection. Firstly, the original images collected from the actual jujube sorting production line were pre-processed, and the data were augmented to establish a data set of five categories of jujube defects. The original CNN model is then improved by embedding the SE module and using the triplet loss function and the center loss function to replace the softmax loss function. Finally, the depth pre-training model on the ImageNet image data set was used to conduct training on the jujube defects data set, so that the parameters of the pre-training model could fit the parameter distribution of the jujube defects image, and the parameter distribution was transferred to the jujube defects data set to complete the transfer of the model and realize the detection and classification of the jujube defects. The classification results are visualized by heatmap through the analysis of classification accuracy and confusion matrix compared with the comparison models. The experimental results show that the SE-ResNet50-CL model optimizes the fine-grained classification problem of jujube defect recognition, and the test accuracy reaches 94.15%. The model has good stability and high recognition accuracy in complex environments.