Convolutional Ordinal Regression Forest for Image Ordinal Estimation

• Published in: IEEE transaction on neural networks and learning systems 2022-08, Vol.33 (8), p.4084-4095
• Main Authors: Zhu, Haiping, Shan, Hongming, Zhang, Yuheng, Che, Lingfu, Xu, Xiaoyang, Zhang, Junping, Shi, Jianbo, Wang, Fei-Yue
• Format: Article
• Language: English
• Subjects: Age determination; Artificial neural networks; Chronology; Classifiers; Decision trees; Differentiable decision trees; Estimation; Forestry; image ordinal estimation; Learning; Neural networks; ordinal distribution learning; ordinal regression (OR); random forest; Random forests; Stability analysis; Support vector machines; Task analysis; Vegetation
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2021.3055816

Image ordinal estimation is to predict the ordinal label of a given image, which can be categorized as an ordinal regression (OR) problem. Recent methods formulate an OR problem as a series of binary classification problems. Such methods cannot ensure that the global ordinal relationship is preserved since the relationships among different binary classifiers are neglected. We propose a novel OR approach, termed convolutional OR forest (CORF), for image ordinal estimation, which can integrate OR and differentiable decision trees with a convolutional neural network for obtaining precise and stable global ordinal relationships. The advantages of the proposed CORF are twofold. First, instead of learning a series of binary classifiers independently , the proposed method aims at learning an ordinal distribution for OR by optimizing those binary classifiers simultaneously . Second, the differentiable decision trees in the proposed CORF can be trained together with the ordinal distribution in an end-to-end manner. The effectiveness of the proposed CORF is verified on two image ordinal estimation tasks, i.e., facial age estimation and image esthetic assessment, showing significant improvements and better stability over the state-of-the-art OR methods.