Central Attention and a Dual Path Convolutional Neural Network in Real-World Tree Species Recognition

• Published in: International journal of environmental research and public health 2021-01, Vol.18 (3), p.961
• Main Authors: Chung, Yi, Chou, Chih-Ang, Li, Chih-Yang
• Format: Article
• Language: English
• Subjects: Attention; Databases, Factual; Neural Networks, Computer; Recognition, Psychology; Trees
• ISSN: 1660-4601; 1661-7827; 1660-4601
• DOI: 10.3390/ijerph18030961

Identifying plants is not only the job of professionals, but also useful or essential for the plant lover and the general public. Although deep learning approaches for plant recognition are promising, driven by the success of convolutional neural networks (CNN), their performances are still far from the requirements of an in-field scenario. First, we propose a central attention concept that helps focus on the target instead of backgrounds in the image for tree species recognition. It could prevent model training from confused vision by establishing a dual path CNN deep learning framework, in which the central attention model combined with the CNN model based on InceptionV3 were employed to automatically extract the features. These two models were then learned together with a shared classification layer. Experimental results assessed the effectiveness of our proposed approach which outperformed each uni-path alone, and existing methods in the whole plant recognition system. Additionally, we created our own tree image database where each photo contained a wealth of information on the entire tree instead of an individual plant organ. Lastly, we developed a prototype system of an online/offline available tree species identification working on a consumer mobile platform that can identify the tree species not only by image recognition, but also detection and classification in real-time remotely.