Fetal Ultrasound Segmentation and Measurements Using Appearance and Shape Prior Based Density Regression with Deep CNN and Robust Ellipse Fitting

• Published in: Journal of digital imaging 2024-02, Vol.37 (1), p.247-267
• Main Authors: Dubey, Gaurav, Srivastava, Somya, Jayswal, Anant Kumar, Saraswat, Mala, Singh, Pooja, Memoria, Minakshi
• Format: Article
• Language: English
• Subjects: Accuracy; Artificial neural networks; Body measurements; Correlation coefficient; Correlation coefficients; Datasets; Deep learning; Density; Elliptic fitting; Estimation; Fetuses; Fluctuations; Image processing; Image segmentation; Machine learning; Neural networks; Regression; Robustness (mathematics); Segmentation; Ultrasonic imaging; Ultrasound
• ISSN: 2948-2933; 0897-1889; 2948-2933; 1618-727X
• DOI: 10.1007/s10278-023-00908-8

Accurately segmenting the structure of the fetal head (FH) and performing biometry measurements, including head circumference (HC) estimation, stands as a vital requirement for addressing abnormal fetal growth during pregnancy under the expertise of experienced radiologists using ultrasound (US) images. However, accurate segmentation and measurement is a challenging task due to image artifact, incomplete ellipse fitting, and fluctuations due to FH dimensions over different trimesters. Also, it is highly time-consuming due to the absence of specialized features, which leads to low segmentation accuracy. To address these challenging tasks, we propose an automatic density regression approach to incorporate appearance and shape priors into the deep learning-based network model (DR-ASPnet) with robust ellipse fitting using fetal US images. Initially, we employed multiple pre-processing steps to remove unwanted distortions, variable fluctuations, and a clear view of significant features from the US images. Then some form of augmentation operation is applied to increase the diversity of the dataset. Next, we proposed the hierarchical density regression deep convolutional neural network (HDR-DCNN) model, which involves three network models to determine the complex location of FH for accurate segmentation during the training and testing processes. Then, we used post-processing operations using contrast enhancement filtering with a morphological operation model to smooth the region and remove unnecessary artifacts from the segmentation results. After post-processing, we applied the smoothed segmented result to the robust ellipse fitting-based least square (REFLS) method for HC estimation. Experimental results of the DR-ASPnet model obtain 98.86% dice similarity coefficient (DSC) as segmentation accuracy, and it also obtains 1.67 mm absolute distance (AD) as measurement accuracy compared to other state-of-the-art methods. Finally, we achieved a 0.99 correlation coefficient (CC) in estimating the measured and predicted HC values on the HC18 dataset.