A reversibility-gain model for integer Karhunen-Loeve transform design in video coding

• Published in: Frontiers of information technology & electronic engineering 2015-10, Vol.16 (10), p.883-891
• Main Authors: Zhu, Xing-guo, Yu, Lu
• Format: Article
• Language: English
• Subjects: Coding; Communications Engineering; Computer Hardware; Computer Science; Computer Systems Organization and Communication Networks; Distortion; Electrical Engineering; Electronics and Microelectronics; Instrumentation; Integers; Networks
• ISSN: 2095-9184; 2095-9230
• DOI: 10.1631/FITEE.1500071

Karhunen-Loeve transform （KLT） is the optimal transform that minimizes distortion at a given bit allocation for Gaussian source. As a KLT matrix usually contains non-integers, integer-KLT design is a classical problem. In this paper, a joint reversibility-gain （R-G） model is proposed for integer-KLT design in video coding. Specifically, the ＇reversibility＇ is modeled according to distortion analysis in using forward and inverse integer transform without quantization. It not only measures how invcrtible a transform is, but also bounds the distortion introduced by the non-orthonormal integer transform process. The ＇gain＇ means transform coding gain （TCG）, which is a widely used criterion for transform design in video coding. Since KLT maximizes the TCG under some assumptions, here we define the TCG loss ratio （LR） to measure how much coding gain an integer-KLT loses when compared with the original KLT. Thus, the R-G model can be explained as follows： subject to a certain TCG LR, an integer- KLT with the best reversibility is the optimal integer transform for a given non-integer-KLT. Experimental results show that the R-G model can guide the design of integer-KLTs with good performance.