Between Generating Noise and Generating Images: Noise in the Correct Frequency Improves the Quality of Synthetic Histopathology Images for Digital Pathology

• Main Authors: Daniel, Nati, Aknin, Eliel, Larey, Ariel, Peretz, Yoni, Sela, Guy, Fisher, Yael, Savir, Yonatan
• Format: Conference Proceeding
• Language: English
• Subjects: Algorithms; Artificial Intelligence; Biopsy image generation; Carcinoma, Non-Small-Cell Lung; Deep learning; Digital pathology; Humans; Image translation; Lung; Lung cancer; Lung Neoplasms - diagnostic imaging; Measurement; Non-small cell lung carcinoma; Programmed death-ligand 1; Robustness; Semantics; Synthetic data
• ISSN: 2694-0604
• DOI: 10.1109/EMBC40787.2023.10341042

Artificial intelligence and machine learning techniques have the promise to revolutionize the field of digital pathology. However, these models demand considerable amounts of data, while the availability of unbiased training data is limited. Synthetic images can augment existing datasets, to improve and validate AI algorithms. Yet, controlling the exact distribution of cellular features within them is still challenging. One of the solutions is harnessing conditional generative adversarial networks that take a semantic mask as an input rather than a random noise. Unlike other domains, outlining the exact cellular structure of tissues is hard, and most of the input masks depict regions of cell types. This is also the case for non-small cell lung cancer, the most common type of lung cancer. Deciding whether a patient would receive immunotherapy depends on quantifying regions of stained cells. However, using polygon-based masks introduce inherent artifacts within the synthetic images - due to the mismatch between the polygon size and the single-cell size. In this work, we show that introducing random single-pixel noise with the appropriate spatial frequency into a polygon semantic mask can dramatically improve the quality of the synthetic images. We used our platform to generate synthetic images of immunohistochemistry-treated lung biopsies. We test the quality of the images using a three-fold validation procedure. First, we show that adding the appropriate noise frequency yields 87% of the similarity metrics improvement that is obtained by adding the actual single-cell features. Second, we show that the synthetic images pass the Turing test. Finally, we show that adding these synthetic images to the train set improves AI performance in terms of PD-L1 semantic segmentation performances. Our work suggests a simple and powerful approach for generating synthetic data on demand to unbias limited datasets to improve the algorithms' accuracy and validate their robustness.