State of the Art Report on Video-Based Graphics and Video Visualization

• Published in: Computer graphics forum 2012-12, Vol.31 (8), p.2450-2477
• Main Authors: Borgo, R., Chen, M., Daubney, B., Grundy, E., Heidemann, G., Höferlin, B., Höferlin, M., Leitte, H., Weiskopf, D., Xie, X.
• Format: Article
• Language: English
• Subjects: Analysis; Computer graphics; Digital video; Feature extraction; I.2.10 [Artificial Intelligence]: Vision and Scene Understanding; I.3.8 [Computer Graphics]: Applications; Image processing systems; Rendering; Representations; State of the art; Studies; Time-varying Imagery H.5.1 [Information Interface and Presentation]: Multimedia Information Systems-Video; Tracking; video abstraction; Video Analysis I.3.3 [Computer Graphics]: Picture/Image Generation; video processing; video retargeting; video summarization; video visualization; video-based graphics; video-based modelling; Visual; Visualization; Visualization I.4.8 [Image Processing and Computer Vision]: Scene Analysis
• ISSN: 0167-7055; 1467-8659
• DOI: 10.1111/j.1467-8659.2012.03158.x

In recent years, a collection of new techniques which deal with video as input data, emerged in computer graphics and visualization. In this survey, we report the state of the art in video‐based graphics and video visualization. We provide a review of techniques for making photo‐realistic or artistic computer‐generated imagery from videos, as well as methods for creating summary and/or visual representations to reveal important features and events in videos. We provide a new taxonomy to categorize the concepts and techniques in this newly emerged body of knowledge. To support this review, we also give a concise overview of the major advances in automated video analysis, as some techniques in this field (e.g. feature extraction, detection, tracking and so on) have been featured in video‐based modelling and rendering pipelines for graphics and visualization. In recent years, a collection of new techniques which deal with video as input data, emerged in computer graphics and visualization. In this survey, we report the state of the art in video‐based graphics and video visualization. We provide a review of techniques for making photo‐realistic or artistic computer‐generated imagery from videos, as well as methods for creating summary and/or visual representations to reveal important features and events in videos. We provide a new taxonomy to categorize the concepts and techniques in this newly‐emerged body of knowledge. To support this review, we also give a concise overview of the major advances in automated video analysis, as some techniques in this field (e.g., feature extraction, detection, tracking, and so on) have been featured in video‐based modeling and rendering pipelines for graphics and visualization.