Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN

• Published in: Sensors (Basel, Switzerland) Switzerland), 2023-09, Vol.23 (18), p.7923
• Main Authors: Wang, Ting, Wei, Geng, Li, Huayu, Bui, ThiOanh, Zeng, Qian, Wang, Ruliang
• Format: Article
• Language: English
• Subjects: Algorithms; Analysis; Classification; CNN; Coding standards; coding unit partition; Credit unions; Decision making; Efficiency; Heuristic; HEVC/H.265; Image coding; Machine learning; Neural networks; Optimization; Support vector machines; texture classification
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23187923

High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-distortion optimization method, which may result in high encoding complexity and hardware implementation challenges. To address this problem, this paper proposes a method that combines convolutional neural networks (CNN) with joint texture recognition to reduce encoding complexity. First, a classification decision method based on the global and local texture features of the CU is proposed, efficiently dividing the CU into smooth and complex texture regions. Second, for the CUs in smooth texture regions, the partition is determined by terminating early. For the CUs in complex texture regions, a proposed CNN is used for predictive partitioning, thus avoiding the traditional recursive approach. Finally, combined with texture classification, the proposed CNN achieves a good balance between the coding complexity and the coding performance. The experimental results demonstrate that the proposed algorithm reduces computational complexity by 61.23%, while only increasing BD-BR by 1.86% and decreasing BD-PSNR by just 0.09 dB.