Robust Region-of-Interest Determination Based on User Attention Model Through Visual Rhythm Analysis

Region-of-interest (ROI) determination is very important for video processing and it is desirable to find a simple method to identify the ROI. Along this direction, this paper investigates a user attention model based on visual rhythm analysis for automatic determination of ROI in a video. The visua...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 2009-07, Vol.19 (7), p.1025-1038
Main Authors: CHI, Ming-Chieh, YEH, Chia-Hung, CHEN, Mei-Juan
Format: Article
Language:English
Subjects:
Applied sciences
Automatic voltage control
Cameras
Coding
Computational complexity
Content analysis
Data mining
Exact sciences and technology
feature extraction
Hardware
Image processing
Image sampling
Information, signal and communications theory
Miscellaneous
Order disorder
Poetry
Position (location)
Preprocessing
region-of-interest (ROI)
Rhythm
Robustness
Sampling
Sampling, quantization
Signal and communications theory
Signal processing
Telecommunications and information theory
user attention
Video coding
Video sequences
Visual
visual rhythm
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Region-of-interest (ROI) determination is very important for video processing and it is desirable to find a simple method to identify the ROI. Along this direction, this paper investigates a user attention model based on visual rhythm analysis for automatic determination of ROI in a video. The visual rhythm, which is an abstraction of a video, is a thumbnail version of a video by a 2-D image that captures the temporal information of a video sequence. Four sampling lines, including diagonal, anti-diagonal, vertical, and horizontal lines, are employed to obtain four visual rhythm maps in order to analyze the location of the ROI from video data. Via the variation on visual rhythms, object and camera motions can be efficiently distinguished. As for hardware design consideration, the proposed scheme can accurately extract ROI with very low computational complexity for real-time applications. The promising results from the experiments demonstrate that the moving object is effectively and efficiently extracted. Finally, we present a way to use flexible macroblock ordering in combination with ROI determination as a preprocessing step for H.264/AVC video coding, and experimental results show the quality of ROI regions is significantly enhanced.
ISSN:1051-8215
1558-2205
DOI:10.1109/TCSVT.2009.2022822