Photonic diffractive generators through sampling noises from scattering media

• Published in: Nature communications 2024-12, Vol.15 (1), p.10643-9
• Main Authors: Zhan, Ziyu, Wang, Hao, Liu, Qiang, Fu, Xing
• Format: Article
• Language: English
• Subjects: 639/624/1107/510; 639/766/400; Accelerators; Accessibility; Computation; Configuration management; Data augmentation; Design standards; Energy efficiency; Feasibility; Hardware; Humanities and Social Sciences; Image enhancement; Image processing; Latency; Light scattering; multidisciplinary; Neural networks; Noise; Noise generation; Optical noise; Parallel processing; Photonics; Science; Science (multidisciplinary); Spatial data
• ISSN: 2041-1723; 2041-1723
• DOI: 10.1038/s41467-024-55058-4

Photonic computing, with potentials of high parallelism, low latency and high energy efficiency, have gained progressive interest at the forefront of neural network (NN) accelerators. However, most existing photonic computing accelerators concentrate on discriminative NNs. Large-scale generative photonic computing machines remain largely unexplored, partly due to poor data accessibility, accuracy and hardware feasibility. Here, we harness random light scattering in disordered media as a native noise source and leverage large-scale diffractive optical computing to generate images from above noise, thereby achieving hardware consistency by solely pursuing the spatial parallelism of light. To realize experimental data accessibility, we design two encoding strategies between images and optical noise latent space that effectively solves the training problem. Furthermore, we utilize advanced photonic NN architectures including cascaded and parallel configurations of diffraction layers to enhance the image generation performance. Our results show that the photonic generator is capable of producing clear and meaningful synthesized images across several standard public datasets. As a photonic generative machine, this work makes an important contribution to photonic computing and paves the way for more sophisticated applications such as real world data augmentation and multi modal generation. Large-scale generative photonic computing suffers from poor data accessibility, accuracy and hardware feasibility. Here, authors harness random light scattering in disordered media as a native noise source and leverage large-scale diffractive optical computing to generate images from above noise.