Qualitative HD Image and Video Recovery via High-Order Tensor Augmentation and Completion

This paper presents a new framework for severely distorted image and video recovery via tensor augmentation and completion. By considering the task of representing a matrix by a high-order-n tensor as that of encoding the matrix's 2-D indices (i,j) by n-digit words i_1i_2\dots i_n, we develop a...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of selected topics in signal processing 2021-04, Vol.15 (3), p.688-701
Main Authors: Hoang, Pham Minh, Tuan, Hoang Duong, Son, Tran Thai, Poor, H. Vincent
Format: Article
Language:English
Subjects:
Augmentation
Color image and video recovery
Color imagery
Correlation
High definition
high order tensor augmentation
Image color analysis
image concatenation
Image processing
Indexes
Mathematical analysis
Matrix decomposition
Pixels
Quantum theory
Recovery
Sequences
Signal processing algorithms
tensor completion
tensor train rank
Tensors
Video
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents a new framework for severely distorted image and video recovery via tensor augmentation and completion. By considering the task of representing a matrix by a high-order-n tensor as that of encoding the matrix's 2-D indices (i,j) by n-digit words i_1i_2\dots i_n, we develop a new high order tensor augmentation to cast a third order tensor of color images or video sequences containing missing pixels into a higher order tensor, which is similar to the ket augmentation of quantum physics, is capable of capturing all correlations and entanglements between entries of the original third order tensor. Accordingly, the resuling high-order tensor is completed by our previously developed parallel matrix factorization via tensor train decomposition. Simulations are provided to show the clear advantages of our approach in enhancing important metrics of visual quality such as relative square error and structural similarity index in image and video processing that help to achieve high recovery rates even for high-definition images and videos with 95% missing pixels.
ISSN:1932-4553
1941-0484
DOI:10.1109/JSTSP.2020.3042063