Multiview Video Coding Using Video Game Context Information

Remote rendering of video games for 3DTV becomes a hot topic with the emergence of 3D-enabled mobile devices and cloud-based services. It is however a very challenging task that requires live encoding at very low latency for user interactivity as well as optimal encoding decisions for an acceptable...

Full description

Saved in:
Bibliographic Details
Main Authors: Pieters, B., Hollemeersch, C., De Cock, J., Lambert, P., Van de Walle, R., Alface, P. R., Stevens, C.
Format: Conference Proceeding
Language:English
Subjects:
Acceleration
Computer Graphics
Encoding
Games
H.264/AVC
Multiview Coding
Rendering (computer graphics)
Streaming media
Vectors
Video Encoding
Video Streaming
Weapons
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Remote rendering of video games for 3DTV becomes a hot topic with the emergence of 3D-enabled mobile devices and cloud-based services. It is however a very challenging task that requires live encoding at very low latency for user interactivity as well as optimal encoding decisions for an acceptable QoE. One key-aspect is that most video games make use of a 3D engine, which is typically accelerated on a GPU, containing information on the composition of the 3D scene and its objects as well as their motion. In this paper, we explore how to extract this information from the GPU and how to exploit it in order to successfully offload the most time consuming tasks of a multiview video encoder. We show that near-optimal encoding decisions can be taken while minimizing the encoder computational complexity as well as the total delay.
DOI:10.1109/ICMEW.2012.8