Synthetic image data augmentation for fibre layup inspection processes: Techniques to enhance the data set

• Published in: Journal of intelligent manufacturing 2021-08, Vol.32 (6), p.1767-1789
• Main Authors: Meister, Sebastian, Möller, Nantwin, Stüve, Jan, Groves, Roger M
• Format: Article
• Language: English
• Subjects: Aerospace industry; Automated fiber placement; Business and Management; Computer architecture; Control; Data acquisition; Data augmentation; Datasets; Deep learning; Fiber placement; Generative adversarial networks; Image data augmentation; Image enhancement; Inline inspection; Inspection; Laser line scan sensor; Machine learning; Machines; Manufacturing; Manufacturing defects; Manufacturing industry; Mechatronics; Neural networks; Processes; Production; Production methods; Robotics; Synthetic data; Training
• ISSN: 1572-8145; 0956-5515; 1572-8145
• DOI: 10.1007/s10845-021-01738-7

In the aerospace industry, the Automated Fiber Placement process is an established method for producing composite parts. Nowadays the required visual inspection, subsequent to this process, typically takes up to 50% of the total manufacturing time and the inspection quality strongly depends on the inspector. A Deep Learning based classification of manufacturing defects is a possibility to improve the process efficiency and accuracy. However, these techniques require several hundreds or thousands of training data samples. Acquiring this huge amount of data is difficult and time consuming in a real world manufacturing process. Thus, an approach for augmenting a smaller number of defect images for the training of a neural network classifier is presented. Five traditional methods and eight deep learning approaches are theoretically assessed according to the literature. The selected conditional Deep Convolutional Generative Adversarial Network and Geometrical Transformation techniques are investigated in detail, with regard to the diversity and realism of the synthetic images. Between 22 and 166 laser line scan sensor images per defect class from six common fiber placement inspection cases are utilised for tests. The GAN-Train GAN-Test method was applied for the validation. The studies demonstrated that a conditional Deep Convolutional Generative Adversarial Network combined with a previous Geometrical Transformation is well suited to generate a large realistic data set from less than 50 actual input images. The presented network architecture and the associated training weights can serve as a basis for applying the demonstrated approach to other fibre layup inspection images.