JPEG XS-A New Standard for Visually Lossless Low-Latency Lightweight Image Coding

• Published in: Proceedings of the IEEE 2021-09, Vol.109 (9), p.1559-1577
• Main Authors: Descampe, Antonin, Richter, Thomas, Ebrahimi, Touradj, Foessel, Siegfried, Keinert, Joachim, Bruylants, Tim, Pellegrin, Pascal, Buysschaert, Charles, Rouvroy, Gael
• Format: Article
• Language: English
• Subjects: Application specific integrated circuits; Automobile industry; Broadcast; Broadcasting; Central processing units; codec; Codecs; Coders; Compression ratio; CPUs; Ethernet; Field programmable gate arrays; Graphics processing units; Image coding; Image compression; Integrated circuits; IP (Internet Protocol); JPEG encoders-decoders; Lightweight; Network latency; Performance evaluation; Real time; Real-time systems; sensor compression; Standardization; Streaming media; Transform coding; uncompressed; video; Video compression; Wavelet transforms
• ISSN: 0018-9219; 1558-2256
• DOI: 10.1109/JPROC.2021.3080916

Joint Photographic Experts Group (JPEG) XS is a new International Standard from the JPEG Committee (formally known as ISO/International Electrotechnical Commission (IEC) JTC1/SC29/WG1). It defines an interoperable, visually lossless low-latency lightweight image coding that can be used for mezzanine compression within any AV market. Among the targeted use cases, one can cite video transport over professional video links (serial digital interface (SDI), internet protocol (IP), and Ethernet), real-time video storage, memory buffers, omnidirectional video capture and rendering, and sensor compression (for example, in cameras and the automotive industry). The core coding system is composed of an optional color transform, a wavelet transform, and a novel entropy encoder, processing groups of coefficients by coding their magnitude level and packing the magnitude refinement. Such a design allows for visually transparent quality at moderate compression ratios, scalable end-to-end latency that ranges from less than one line to a maximum of 32 lines of the image, and a low-complexity real-time implementation in application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), central processing unit (CPU), and graphics processing unit (GPU). This article details the key features of this new standard and the profiles and formats that have been defined so far for the various applications. It also gives a technical description of the core coding system. Finally, the latest performance evaluation results of recent implementations of the standard are presented, followed by the current status of the ongoing standardization process and future milestones.