Unsupervised synthesis of realistic coronary artery X-ray angiogram

• Published in: International journal for computer assisted radiology and surgery 2023-12, Vol.18 (12), p.2329-2338
• Main Authors: Martin, Rémi, Segars, Paul, Samei, Ehsan, Miró, Joaquim, Duong, Luc
• Format: Article
• Language: English
• Subjects: Angiography; Computer Imaging; Computer Science; Coronary Angiography - methods; Coronary vessels; Coronary Vessels - diagnostic imaging; Fluoroscopy; Health Informatics; Humans; Image analysis; Image Processing, Computer-Assisted - methods; Imaging; Learning; Medical imaging; Medicine; Medicine & Public Health; Original Article; Pattern Recognition and Graphics; Radiography; Radiology; Realism; Simulation; Simulators; Structural integrity; Surgery; Three dimensional models; Topology; Veins & arteries; Vision; X-Rays
• ISSN: 1861-6429; 1861-6410; 1861-6429
• DOI: 10.1007/s11548-023-02982-3

Purpose Medical image analysis suffers from a sparsity of annotated data necessary in learning-based models. Cardiorespiratory simulators have been developed to counter the lack of data. However, the resulting data often lack realism. Hence, the proposed method aims to synthesize realistic and fully customizable angiograms of coronary arteries for the training of learning-based biomedical tasks, for cardiologists performing interventions, and for cardiologist trainees. Methods 3D models of coronary arteries are generated with a fully customizable realistic cardiorespiratory simulator. The transfer of X-ray angiography style to simulator-generated images is performed using a new vessel-specific adaptation of the CycleGAN model. The CycleGAN model is paired with a vesselness-based loss function that is designed as a vessel-specific structural integrity constraint. Results Validation is performed both on the style and on the preservation of the shape of the arteries of the images. The results show a PSNR of 14.125, an SSIM of 0.898, and an overlapping of 89.5% using the Dice coefficient. Conclusion We proposed a novel fluoroscopy-based style transfer method for the enhancement of the realism of simulated coronary artery angiograms. The results show that the proposed model is capable of accurately transferring the style of X-ray angiograms to the simulations while keeping the integrity of the structures of interest (i.e., the topology of the coronary arteries).