Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8

• Published in: Infrastructures (Basel) 2024-01, Vol.9 (1), p.3
• Main Authors: Ameli, Zahra, Nesheli, Shabnam Jafarpoor, Landis, Eric N.
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; Annotations; Architecture; Artificial intelligence; Artificial neural networks; Bridge inspection; Bridges; Bridges, Iron and steel; Classification; Convolutional codes; Corrosion; corrosion condition rating; Damage detection; Datasets; Deep learning; Image annotation; Image segmentation; instance segmentation; Machine learning; Mask RCNN; Methods; Neural networks; Semantic segmentation; Steel; Steel bridges; Structural damage; Structural members; Testing; Unmanned aerial vehicles; YOLOv8
• ISSN: 2412-3811; 2412-3811
• DOI: 10.3390/infrastructures9010003

The application of deep learning (DL) algorithms has become of great interest in recent years due to their superior performance in structural damage identification, including the detection of corrosion. There has been growing interest in the application of convolutional neural networks (CNNs) for corrosion detection and classification. However, current approaches primarily involve detecting corrosion within bounding boxes, lacking the segmentation of corrosion with irregular boundary shapes. As a result, it becomes challenging to quantify corrosion areas and severity, which is crucial for engineers to rate the condition of structural elements and assess the performance of infrastructures. Furthermore, training an efficient deep learning model requires a large number of corrosion images and the manual labeling of every single image. This process can be tedious and labor-intensive. In this project, an open-source steel bridge corrosion dataset along with corresponding annotations was generated. This database contains 514 images with various corrosion severity levels, gathered from a variety of steel bridges. A pixel-level annotation was performed according to the Bridge Inspectors Reference Manual (BIRM) and the American Association of State Highway and Transportation Officials (AASHTO) regulations for corrosion condition rating (defect #1000). Two state-of-the-art semantic segmentation algorithms, Mask RCNN and YOLOv8, were trained and validated on the dataset. These trained models were then tested on a set of test images and the results were compared. The trained Mask RCNN and YOLOv8 models demonstrated satisfactory performance in segmenting and rating corrosion, making them suitable for practical applications.