FPGA-based implementation of the VVC low-frequency non-separable transform

• Published in: Journal of real-time image processing 2024-05, Vol.21 (3), p.94, Article 94
• Main Authors: Belghith, Fatma, Ben Jdidia, Sonda, Abdallah, Bouthaina, Masmoudi, Nouri
• Format: Article
• Language: English
• Subjects: Coding standards; Computer Graphics; Computer Science; Discrete cosine transform; Efficiency; Field programmable gate arrays; Frames per second; Hardware; High definition; Image Processing and Computer Vision; Multimedia Information Systems; Pattern Recognition; Resource allocation; Signal,Image and Speech Processing; Video compression
• ISSN: 1861-8200; 1861-8219
• DOI: 10.1007/s11554-024-01471-3

The Versatile Video Coding (VVC) standard, released in July 2020, brings better coding performance than the High-Efficiency Video Coding (HEVC) thanks to the introduction of new coding tools. The transform module in the VVC standard incorporates the Multiple Transform Selection (MTS) concept, which relies on separable Discrete Cosine Transform (DCT)/Discrete Sine Transform (DST) kernels, and the recently introduced Low-Frequency Non-Separable Transform (LFNST). This latter serves as a secondary transform process, enhancing coding efficiency by further decorrelating residual samples. However, it introduces heightened computational complexity and substantial resource allocation demands, potentially complicating its hardware implementation. This paper introduces an effective and cost-efficient hardware architecture for LFNST. The proposed design employs additions and bit-shifting operations preserving hardware logic usage. The synthesis results for an Arria 10 10AX115N1F45E1SG FPGA device demonstrate that the logic cost is only of 26% of the available hardware resources. Additionally, the proposed design is working at 204 MHz and can process Ultra High Definition (UHD) 4K videos at up to 60 frames per second (fps).