Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers

Deep learning has recently seen rapid development and received significant attention due to its state-of-the-art performance on previously-thought hard problems. However, because of the internal complexity and nonlinear structure of deep neural networks, the underlying decision making processes for...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on visualization and computer graphics 2019-08, Vol.25 (8), p.2674-2693
Main Authors: Hohman, Fred, Kahng, Minsuk, Pienta, Robert, Chau, Duen Horng
Format: Article
Language:English
Subjects:
Analytics
Artificial neural networks
Computational modeling
Conferences
Data visualization
Debugging
Decision making
Deep learning
Domains
information visualization
Machine learning
Mathematical analysis
Neural networks
Toolkits
Visual analytics
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep learning has recently seen rapid development and received significant attention due to its state-of-the-art performance on previously-thought hard problems. However, because of the internal complexity and nonlinear structure of deep neural networks, the underlying decision making processes for why these models are achieving such performance are challenging and sometimes mystifying to interpret. As deep learning spreads across domains, it is of paramount importance that we equip users of deep learning with tools for understanding when a model works correctly, when it fails, and ultimately how to improve its performance. Standardized toolkits for building neural networks have helped democratize deep learning; visual analytics systems have now been developed to support model explanation, interpretation, debugging, and improvement. We present a survey of the role of visual analytics in deep learning research, which highlights its short yet impactful history and thoroughly summarizes the state-of-the-art using a human-centered interrogative framework, focusing on the Five W's and How (Why, Who, What, How, When, and Where). We conclude by highlighting research directions and open research problems. This survey helps researchers and practitioners in both visual analytics and deep learning to quickly learn key aspects of this young and rapidly growing body of research, whose impact spans a diverse range of domains.
ISSN:1077-2626
1941-0506
DOI:10.1109/TVCG.2018.2843369