NFT-K: Non-Fungible Tangent Kernels

Deep neural networks have become essential for numerous applications due to their strong empirical performance such as vision, RL, and classification. Unfortunately, these networks are quite difficult to interpret, and this limits their applicability in settings where interpretability is important f...

Full description

Saved in:
Bibliographic Details
Main Authors: Alemohammad, Sina, Babaei, Hossein, Barberan, Cj, Liu, Naiming, Luzi, Lorenzo, Mason, Blake, Baraniuk, Richard G.
Format: Conference Proceeding
Language:English
Subjects:
Acoustics
Conferences
Deep learning
Deep neural network
interpretability
multi-layer perception
Neural networks
neural tangent kernel
Predictive models
Safety
Signal processing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep neural networks have become essential for numerous applications due to their strong empirical performance such as vision, RL, and classification. Unfortunately, these networks are quite difficult to interpret, and this limits their applicability in settings where interpretability is important for safety, such as medical imaging. One type of deep neural network is neural tangent kernel that is similar to a kernel machine that provides some aspect of interpretability. To further contribute interpretability with respect to classification and the layers, we develop a new network as a combination of multiple neural tangent kernels, one to model each layer of the deep neural network individually as opposed to past work which attempts to represent the entire network via a single neural tangent kernel. We demonstrate the interpretability of this model on two datasets, showing that the multiple kernels model elucidates the interplay between the layers and predictions.
ISSN:2379-190X
DOI:10.1109/ICASSP43922.2022.9747078