Transfer and Unsupervised Learning: An Integrated Approach to Concrete Crack Image Analysis

• Published in: Sustainability 2023-02, Vol.15 (4), p.3653
• Main Authors: Gradišar, Luka, Dolenc, Matevž
• Format: Article
• Language: English
• Subjects: Accuracy; Analysis; Classification; Clustering; Concrete; Concrete structures; Cracks; Datasets; Engineering research; Equipment and supplies; Flaw detection; Image analysis; Image processing; Integrated approach; Machine vision; Mechanical properties; Methods; Neural networks; Prediction models; Surface roughness; Sustainability; Transfer learning; Unsupervised learning
• ISSN: 2071-1050; 2071-1050
• DOI: 10.3390/su15043653

The detection of cracks in concrete structures is crucial for the assessment of their structural integrity and safety. To this end, detection with deep neural convolutional networks has been extensively researched in recent years. Despite their success, these methods are limited in classifying concrete as cracked or non-cracked and disregard other characteristics, such as the severity of the cracks. Furthermore, the classification process can be affected by various sources of interference and noise in the images. In this paper, an integrated methodology for analysing concrete crack images is proposed using transfer and unsupervised learning. The method extracts image features using pre-trained networks and groups them based on similarity using hierarchical clustering. Three pre-trained networks are used for this purpose, with Inception v3 performing the best. The clustering results show the ability to divide images into different clusters based on image characteristics. In this way, various clusters are identified, such as clusters containing images of obstruction, background debris, edges, surface roughness, as well as cracked and uncracked concrete. In addition, dimensionality reduction is used to further separate and visualise the data, making it easier to analyse clustering results and identify misclassified images. This revealed several mislabelled images in the dataset used in this study. Additionally, a correlation was found between the principal components and the severity of cracks and surface imperfections. The results of this study demonstrate the potential of unsupervised learning for analysing concrete crack image data to distinguish between noisy images and the severity of cracks, which can provide valuable information for building more accurate predictive models.