Correlation-Based Motion Vector Processing With Adaptive Interpolation Scheme for Motion-Compensated Frame Interpolation

In this paper, we address the problems of unreliable motion vectors that cause visual artifacts but cannot be detected by high residual energy or bidirectional prediction difference in motion-compensated frame interpolation. A correlation-based motion vector processing method is proposed to detect a...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on image processing 2009-04, Vol.18 (4), p.740-752
Main Authors: HUANG, Ai-Mei, NGUYEN, Truong
Format: Article
Language:English
Subjects:
Applied sciences
Consumer electronics
Correlation
Decoding
Detection, estimation, filtering, equalization, prediction
Electronics industry
Exact sciences and technology
Frame rate up conversion
Frames
Image processing
Information, signal and communications theory
Interpolation
Mathematical analysis
Miscellaneous
Motion analysis
Motion detection
Motion estimation
motion vector correlation
motion vector processing
motion-compensated frame interpolation (MCFI)
Occlusion
Robustness
Signal and communications theory
Signal processing
Signal, noise
Studies
Telecommunications and information theory
Vector processing (computers)
Vectors (mathematics)
video occlusions
Video sequences
Visual
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we address the problems of unreliable motion vectors that cause visual artifacts but cannot be detected by high residual energy or bidirectional prediction difference in motion-compensated frame interpolation. A correlation-based motion vector processing method is proposed to detect and correct those unreliable motion vectors by explicitly considering motion vector correlation in the motion vector reliability classification, motion vector correction, and frame interpolation stages. Since our method gradually corrects unreliable motion vectors based on their reliability, we can effectively discover the areas where no motion is reliable to be used, such as occlusions and deformed structures. We also propose an adaptive frame interpolation scheme for the occlusion areas based on the analysis of their surrounding motion distribution. As a result, the interpolated frames using the proposed scheme have clearer structure edges and ghost artifacts are also greatly reduced. Experimental results show that our interpolated results have better visual quality than other methods. In addition, the proposed scheme is robust even for those video sequences that contain multiple and fast motions.
ISSN:1057-7149
1941-0042
DOI:10.1109/TIP.2008.2010206