Semi-Supervised Machine Condition Monitoring by Learning Deep Discriminative Audio Features

• Published in: Electronics (Basel) 2021-10, Vol.10 (20), p.2471
• Main Authors: Thoidis, Iordanis, Giouvanakis, Marios, Papanikolaou, George
• Format: Article
• Language: English
• Subjects: Acoustics; Anomalies; Artificial neural networks; Audio data; Classification; Deep learning; Feature extraction; Machine learning; Machinery; Machinery condition monitoring; Methods; Neural networks; Noise
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics10202471

In this study, we aim to learn highly descriptive representations for a wide set of machinery sounds and exploit this knowledge to perform condition monitoring of mechanical equipment. We propose a comprehensive feature learning approach that operates on raw audio, by supervising the formation of salient audio embeddings in latent states of a deep temporal convolutional neural network. By fusing the supervised feature learning approach with an unsupervised deep one-class neural network, we are able to model the characteristics of each source and implicitly detect anomalies in different operational states of industrial machines. Moreover, we enable the exploitation of spatial audio information in the learning process, by formulating a novel front-end processing strategy for circular microphone arrays. Experimental results on the MIMII dataset demonstrate the effectiveness of the proposed method, reaching a state-of-the-art mean AUC score of 91.0%. Anomaly detection performance is significantly improved by incorporating multi-channel audio data in the feature extraction process, as well as training the convolutional neural network on the spatially invariant front-end. Finally, the proposed semi-supervised approach allows the concise modeling of normal machine conditions and accurately detects system anomalies, compared to existing anomaly detection methods.