Image-to-image translation with Generative Adversarial Networks via retinal masks for realistic Optical Coherence Tomography imaging of Diabetic Macular Edema disorders

• Published in: Biomedical signal processing and control 2023-01, Vol.79, p.104098, Article 104098
• Main Authors: Vidal, Plácido L., de Moura, Joaquim, Novo, Jorge, Penedo, Manuel G., Ortega, Marcos
• Format: Article
• Language: English
• Subjects: Diabetic macular edema; Generative adversarial network; Image-to-image translation; Optical coherence tomography; Synthetic data
• ISSN: 1746-8094; 1746-8108
• DOI: 10.1016/j.bspc.2022.104098

One of the main issues with deep learning is the need of a significant number of samples. We intend to address this problem in the field of Optical Coherence Tomography (OCT), specifically in the context of Diabetic Macular Edema (DME). This pathology represents one of the main causes of blindness in developed countries and, due to the capturing difficulties and saturation of health services, the task of creating computer-aided diagnosis (CAD) systems is an arduous task. For this reason, we propose a solution to generate samples. Our strategy employs image-to-image Generative Adversarial Networks (GAN) to translate a binary mask into a realistic OCT image. Moreover, thanks to the clinical relationship between the retinal shape and the presence of DME fluid, we can generate both pathological and non-pathological samples by altering the binary mask morphology. To demonstrate the capabilities of our proposal, we test it against two classification strategies of the state-of-the-art. In the first one, we evaluate a system fully trained with generated images, obtaining 94.83% accuracy with respect to the state-of-the-art. In the second case, we tested it against a state-of-the-art expert model based on deep features, in which it also achieved successful results with a 98.23% of the accuracy of the original work. This way, our methodology proved to be useful in scenarios where data is scarce, and could be easily adapted to other imaging modalities and pathologies where key shape constraints in the image provide enough information to recreate realistic samples. [Display omitted] •Fully-automatic proposal able to generate labeled normal and DME retinal OCT images.•First methodology able to generate realistic labeled samples from retinal masks.•Deep learning strategy to palliate the issue of data scarcity in the medical field.•Validated as training strategy and expert model, with results akin to the original.•Easily transferable strategy to other pathologies and imaging modalities.