An end-to-end computer vision system based on deep learning for pavement distress detection and quantification

• Published in: Construction & building materials 2024-02, Vol.416, p.135036, Article 135036
• Main Authors: Cano-Ortiz, Saúl, Lloret Iglesias, Lara, Martinez Ruiz del Árbol, Pablo, Lastra-González, Pedro, Castro-Fresno, Daniel
• Format: Article
• Language: English
• Subjects: Computer vision; Deep learning; Pavement condition index; Pavement distress detection; YOLOv5
• ISSN: 0950-0618; 1879-0526
• DOI: 10.1016/j.conbuildmat.2024.135036

The performance of deep learning-based computer vision systems for road infrastructure assessment is hindered by the scarcity of real-world, high-volume public datasets. Current research predominantly focuses on crack detection and segmentation, without devising end-to-end systems capable of effectively evaluating the most affected roads and assessing the out-of-sample performance. To address these limitations, this study proposes a public dataset with annotations of 7099 images and 13 types of defects, not only based on cracks, for the confrontation and development of deep learning models. These images are used to train and compare YOLOv5 sub-models based on pure detection efficiency, and standard object detection metrics, to select the optimum architecture. A novel post-processing filtering mechanism is then designed, which reduces the false positive detections by 20.5%. Additionally, a pavement condition index (ASPDI) is engineered for deep learning-based models to identify areas in need for immediate maintenance. To facilitate decision-making by road administrations, a software application is created, which integrates the ASPDI, geotagged images, and detections. This tool has allowed to detect two road sections in critical need of repair. The refined architecture is validated on open datasets, achieving mean average precision scores of 0.563 and 0.570 for RDD2022 and CPRI, respectively. •Open-source road distress dataset design with object detection annotations.•Comparative analysis of Deep Learning YOLOv5 models for pavement distress detection.•Novel rule-based post-processing with 20.5% reduction in false positives.•Development of road condition index and quantification of most damaged areas.•Validation of the best post-processed model across various open-source datasets.