Dynamic convolutional capsule network for In‐loop filtering in HEVC video codec

Recently, several in‐loop filtering algorithms based on convolutional neural network (CNN) have been proposed to improve the efficiency of HEVC (High Efficiency Video Coding). Conventional CNN‐based filters only apply a single model to the whole image, which cannot adapt well to all local features f...

Full description

Saved in:
Bibliographic Details
Published in:IET image processing 2023-02, Vol.17 (2), p.439-449
Main Authors: Su, LiChao, Cao, Mengqing, Yu, Yue, Chen, Jian, Yang, XiuZhi, Wu, Dapeng
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Recently, several in‐loop filtering algorithms based on convolutional neural network (CNN) have been proposed to improve the efficiency of HEVC (High Efficiency Video Coding). Conventional CNN‐based filters only apply a single model to the whole image, which cannot adapt well to all local features from the image. To solve this problem, an in‐loop filtering algorithm based on a dynamic convolutional capsule network (DCC‐net) is proposed, which embeds localized dynamic routing and dynamic segmentation algorithms into capsule network, and integrate them into the HEVC hybrid video coding framework as a new in‐loop filter. The proposed method brings average 7.9% and 5.9% BD‐BR reductions under all intra (AI) and random access (RA) configurations, respectively, as well as, 0.4 dB and 0.2 dB BD‐PSNR gains, respectively. In addition, the proposed algorithm has an outstanding performance in terms of time efficiency.
ISSN:1751-9659
1751-9667
DOI:10.1049/ipr2.12644