A system for real-time panorama generation and display in tele-immersive applications

Wide field-of-view (FOV) is necessary for many industrial applications, such as air traffic control, large vehicle driving and navigation. Unfortunately, the supporting structure/frame in most systems usually blocks part of the view, results in "blind spot" and raises the risk to the pilot...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on multimedia 2005-04, Vol.7 (2), p.280-292
Main Authors: Wai-Kwan Tang, Tien-Tsin Wong, Heng, P.-A.
Format: Article
Language:English
Subjects:
Air traffic control
Applied sciences
Artificial intelligence
Augmented reality
Blinds
Cameras
Computer science
control theory
systems
Devices
Electrical equipment industry
Exact sciences and technology
Frames
image mosaicing
immersive display
Industrial control
Large screen displays
Navigation
Pattern recognition. Digital image processing. Computational geometry
Pilots
Real time
Real time systems
real-time panorama
Risk
Safety
Streaming media
Vehicle driving
video streaming
Videos
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Wide field-of-view (FOV) is necessary for many industrial applications, such as air traffic control, large vehicle driving and navigation. Unfortunately, the supporting structure/frame in most systems usually blocks part of the view, results in "blind spot" and raises the risk to the pilot. In this paper, we introduce a video-based tele-immersive system, called the immersive cockpit. It captures live videos from the working site and recreates an immersive environment at the remote site where the pilot situates. It immerses the pilot at the remote site with a panoramic view of the environment, and hence improves interactivity and safety. The design goals of our system are real-time, live, low-cost, and scalable. We stitch multiple video streams captured from ordinary charged couple device cameras to generate a panoramic video. To avoid being blocked by the supporting frame, we allow a flexible placement of cameras. This approach trades the accuracy of the generated panoramic image for a larger FOV. To reduce the computation, parameters for stitching are determined once during the system initialization. The panoramic video is presented on an immersive display which covers the FOV of the viewer. We discuss how to correctly present the panoramic video on this nonplanar immersive display screen by sweet spot relocation. We also present the result and the performance evaluation of the system.
ISSN:1520-9210
1941-0077
DOI:10.1109/TMM.2005.843811