Balancing the encoder and decoder complexity in image compression for classification

• Published in: EURASIP journal on image and video processing 2024-10, Vol.2024 (1), p.38-20, Article 38
• Main Authors: Duan, Zhihao, Hossain, Md Adnan Faisal, He, Jiangpeng, Zhu, Fengqing
• Format: Article
• Language: English
• Subjects: Accuracy; Biometrics; Classification; Coders; Coding for machines; Complexity; Engineering; Image classification; Image coding; Image compression; Image Processing and Computer Vision; Learned image compression; Neural networks; Pattern Recognition; Rate–accuracy-complexity; Signal,Image and Speech Processing; Visual coding for humans and machines
• ISSN: 1687-5281; 1687-5176; 1687-5281
• DOI: 10.1186/s13640-024-00652-1

This paper presents a study on the computational complexity of coding for machines, with a focus on image coding for classification. We first conduct a comprehensive set of experiments to analyze the size of the encoder (which encodes images to bitstreams), the size of the decoder (which decodes bitstreams and predicts class labels), and their impact on the rate–accuracy trade-off in compression for classification. Through empirical investigation, we demonstrate a complementary relationship between the encoder size and the decoder size, i.e., it is better to employ a large encoder with a small decoder and vice versa. Motivated by this relationship, we introduce a feature compression-based method for efficient image compression for classification. By compressing features at various layers of a neural network-based image classification model, our method achieves adjustable rate, accuracy, and encoder (or decoder) size using a single model. Experimental results on ImageNet classification show that our method achieves competitive results with existing methods while being much more flexible. The code will be made publicly available.