Booster-Driven Consistency Training Framework for Semi-Supervised Learning

• Published in: Journal of physics. Conference series 2023-12, Vol.2665 (1), p.12021
• Main Authors: Ma, Menghao, Xiong, Feng, Xu, Ye, Gao, Luxiong, Yang, Huafang, Zou, Bingyu
• Format: Article
• Language: English
• Subjects: Consistency; consistency training; Deep learning; Effectiveness; Feedback loops; network difference constraint; Networks; Physics; Semi-supervised learning; Smoothness; smoothness enforcing
• ISSN: 1742-6588; 1742-6596
• DOI: 10.1088/1742-6596/2665/1/012021

The paper proposes an inductive semi-supervised learning method, called Booster-Driven Consistency Training (BDCT). In our work, we extend consistency training by designing a “booster” module for aggregating multi-view information, preventing the networks from collapsing into each other, and constructing better targets in parallel with the existing consistency training method. By booster, we mean that the one network is treated as the booster to help the training of the other two co-trained and superior networks, “spacecraft”. Furthermore, BDCT integrates smoothness enforcing into the designed fast feedback loop to ensure the effectiveness and the robustness of training. Meanwhile, adversarial examples are exploited to maintain the diversity among the networks that are learned to be smooth on the low dimensional manifold. BDCT demonstrates satisfactory performance in comparison with state-of-the-art semi-supervised deep learning methods and extensive experiments validate the effectiveness of the “booster” module.