Restoration of infrared metalens images with deep learning

• Published in: Optics communications 2024-02, Vol.552, p.130069, Article 130069
• Main Authors: Li, Run-kun, Wei, Jing-yang, Wang, Le, Ma, Yao-guang, Li, Yang-hui
• Format: Article
• Language: English
• Subjects: Deep learning; Images restoration; Metalens; Transfer learning
• ISSN: 0030-4018; 1873-0310
• DOI: 10.1016/j.optcom.2023.130069

Aberrations and noise hinder the efficient use of infrared metalenses. We have developed a method to improve infrared metalens-produced images by incorporating transfer learning with a cycle generative adversarial network (CycleGAN). By simulating metalens-induced aberrations on images from the ImageNet dataset, we created a pre-training dataset for transfer learning, which improves the capabilities of the CycleGAN model. Our method enhances the peak signal-to-noise ratio (PSNR) and contrast of the images by an average of 5.07 dB and 63.81, respectively, in the spatial domain compared to the original images captured using the infrared metalens. Furthermore, the introduction of transfer learning improves the erratic translation and the model's ability to restore missing details, and enhances the edge intensity and similarity in the frequency domain by 8.85 % and 3.19 %, respectively. •Our method improves infrared metalens-produced images by using transfer learning with a cycle generative adversarial network (CycleGAN), which is trained on simulated metalens-induced aberrations from the ImageNet dataset.•Our method enhances the peak signal-to-noise ratio (PSNR) and contrast of the images by an average of 5.07 dB and 63.81, respectively, in the spatial domain compared to the original images captured using the infrared metalens. Furthermore, the introduction of transfer learning improves the erratic translation and the model's ability to restore missing details, and enhances the edge intensity and similarity in the frequency domain by 8.85 % and 3.19 %, respectively.•Our method can significantly improve the image quality of metalens and aid in the implementation of single-lens imaging in practical applications.