Three-dimensional holographic communication system for the metaverse

We demonstrate a real-time three-dimensional communication system integrating the capture, hologram generation, transmission and display. The point cloud of a 3D scene is captured by a structured light camera and a light field camera. Phase-only computer-generated holograms are calculated by the lay...

Full description

Saved in:
Bibliographic Details
Published in:Optics communications 2023-01, Vol.526, p.128894, Article 128894
Main Authors: He, Lidan, Liu, Kexuan, He, Zehao, Cao, Liangcai
Format: Article
Language:English
Subjects:
Computer-generated holography
High bandwidth
Holographic communication
Light field
Structured light
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We demonstrate a real-time three-dimensional communication system integrating the capture, hologram generation, transmission and display. The point cloud of a 3D scene is captured by a structured light camera and a light field camera. Phase-only computer-generated holograms are calculated by the layer-based angular spectrum method based on rendered depth images and shading images. The dynamic reconstruction of phase-only holograms is realized by a dynamic 4K liquid crystal spatial light modulator. The framerate of 20 fps and the latency of 0.1 s are realized, which can be satisfied by the 5G network. We suggest that this system is a potential solution to telepresence in the metaverse. •The 3D communication technology provides an enhanced realistic immersion and reliable interaction for the metaverse.•The proposed holographic communication system integrates the 3D capture, hologram generation, transmission and 3D display.•The latest hardware and software are used for real-time communication with a framerate of 20 fps and a latency of 0.1s.
ISSN:0030-4018
1873-0310
DOI:10.1016/j.optcom.2022.128894