Automatic soil desiccation crack recognition using deep learning

• Published in: Géotechnique 2022-04, Vol.72 (4), p.337-349
• Main Authors: Xu, Jin-Jian, Zhang, Hao, Tang, Chao-Sheng, Cheng, Qing, Liu, Bo, Shi, Bin
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Coders; Cracks; Deep learning; Desiccation; Entropy; Hydraulic properties; Image processing; Image segmentation; Neural networks; Object recognition; Soil; Soil mechanics; Soil properties; Soil shrinkage; Soils; Surface cracks
• ISSN: 0016-8505; 1751-7656
• DOI: 10.1680/jgeot.20.P.091

Soil desiccation cracking is a common natural phenomenon. The existence of cracks can negatively impact both the mechanical and hydraulic properties of soil. Accurate acquisition of soil crack networks is not only the basis for obtaining the relevant geometrical parameters of crack networks, but also an important foundation and premise for further study about the formation mechanism of shrinkage and desiccation cracking. This study proposes a new automatic soil cracks recognition method based on a U-Net convolutional neural network (CNN) architecture for segmentation on soil desiccation crack images. The backbone of the U-Net encoder is selected as ResNet and a new loss function combining both binary cross-entropy (BCE) loss and dice loss is used during the training stage to fit an imbalance problem. Subsequently, the U-Net with an encoder based on ResNet and a decoder part is trained from end to end on a subset of 524 labelled crack images with 224 × 224 pixels for semantic segmentation. The U-Net architecture achieves 94·38%, 74·43% and 81·13% for precision, recall and dice scores on test sets, which are better than all results using the Otsu threshold method employed in the traditional crack image processing technique. Experimental results reveal that deep learning can achieve higher accuracy than the traditional method (binarisation by thresholding) in quantifying surface crack ratio, average crack width, total crack length and crack number. Moreover, deep learning can not only accurately identify cracks or spots by means of crack edge features, but also can accurately separate soil cracks and clod areas under a bad photographing condition (such as uneven illumination, a field environment or poor photographing angle). Overall, the proposed deep learning-based method presents a satisfactory performance in soil crack image recognition and quantification. It may also be applied to other materials with cracks.