Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360° Camera

• Published in: IEEE access 2023, Vol.11, p.57574-57584
• Main Authors: Jung, Hyunmin, Lee, Hyuk-Jae, Rhee, Chae Eun
• Format: Article
• Language: English
• Subjects: Cameras; Data acquisition; Estimation; Frames per second; free viewpoint; Games; Immersive virtual reality; Light field; Light fields; Mowing; Rendering; Rendering (computer graphics); Three-dimensional displays; view navigation; view synthesis; Virtual reality
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2023.3279726

Light field (LF)-based virtual reality (VR) systems have been proposed to tackle the problem of 360° panoramic image based VR not being able to support viewpoint movements. LF-based approaches still have shortcomings in that the user's movement range is narrow and an extensive setup and high cost are required for data acquisition. This paper proposes lawn mowing pattern LF (LMP-LF) structure and presents a wide and free VR system utilizing an LMP-LF. The contributions of this paper are as follows. First, this paper proposes an LMP-LF in which several three-dimensional LFs (3DLFs) are arranged at uniform intervals. This simplifies the data acquisition process and widens the range of viewpoint movements. Second, this paper defines a light ray pair between two adjacent 3DLFs of the LMP-LF. The relationship between two light rays forming a light ray pair is expressed only with one-dimensional (1D) disparity, which greatly reduces the amount of disparity and the estimation complexity. Third, a real-time VR system using the LMP-LF is implemented and demonstrated. The proposed VR system achieves a high rendering speed of 125 frames-per-second (fps). In the prototype system, wide and free rendering performance was verified by building an LMP-LF for an automobile showroom at a size of 50m 2 .