A Survey on Deep Active Learning: Recent Advances and New Frontiers

• Published in: IEEE transaction on neural networks and learning systems 2024-05, Vol.PP, p.1-21
• Main Authors: Li, Dongyuan, Wang, Zhen, Chen, Yankai, Jiang, Renhe, Ding, Weiping, Okumura, Manabu
• Format: Article
• Language: English
• Subjects: Active learning; adaptive sampling; Annotations; computer vision (CV); Deep learning; Electronic mail; natural language processing (NLP); sequential optimal design; Surveys; Task analysis; Taxonomy; Training; uncertainty quantification
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2024.3396463

Active learning seeks to achieve strong performance with fewer training samples. It does this by iteratively asking an oracle to label newly selected samples in a human-in-the-loop manner. This technique has gained increasing popularity due to its broad applicability, yet its survey papers, especially for deep active learning (DAL), remain scarce. Therefore, we conduct an advanced and comprehensive survey on DAL. We first introduce reviewed paper collection and filtering. Second, we formally define the DAL task and summarize the most influential baselines and widely used datasets. Third, we systematically provide a taxonomy of DAL methods from five perspectives, including annotation types, query strategies, deep model architectures, learning paradigms, and training processes, and objectively analyze their strengths and weaknesses. Then, we comprehensively summarize the main applications of DAL in natural language processing (NLP), computer vision (CV), data mining (DM), and so on. Finally, we discuss challenges and perspectives after a detailed analysis of current studies. This work aims to serve as a useful and quick guide for researchers in overcoming difficulties in DAL. We hope that this survey will spur further progress in this burgeoning field.