Loading…

From Clustering to Cluster Explanations via Neural Networks

A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, lab...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2021-12
Main Authors: Kauffmann, Jacob, Esders, Malte, Ruff, Lukas, Montavon, Grégoire, Samek, Wojciech, Klaus-Robert Müller
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Kauffmann, Jacob
Esders, Malte
Ruff, Lukas
Montavon, Grégoire
Samek, Wojciech
Klaus-Robert Müller
description A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.
doi_str_mv 10.48550/arxiv.1906.07633
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2243263172</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2243263172</sourcerecordid><originalsourceid>FETCH-LOGICAL-a522-c4c592993d6db5824d3e55bf6772f5906687675798c02dc5a69d2e74aa4e51563</originalsourceid><addsrcrecordid>eNo1js1Kw0AURgdBaKl9AHcB14kz986dH1xJaFUouum-TJNJSY2ZOpPUPr4B7erwbc53GLsXvJCGiD-6eGnPhbBcFVwrxBs2B0SRGwkwY8uUjpxzUBqIcM6e1jF8ZWU3psHHtj9kQ7iubHU5da53Qxv6lJ1bl737MbpuwvAT4me6Y7eN65Jf_nPBtuvVtnzNNx8vb-XzJncEkFeyIgvWYq3qPRmQNXqifaO0hoamTGW00qStqTjUFTlla_BaOic9CVK4YA9_2lMM36NPw-4YxthPjzsAiaBQaMBfj0pIHA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2243263172</pqid></control><display><type>article</type><title>From Clustering to Cluster Explanations via Neural Networks</title><source>Publicly Available Content Database (Proquest) (PQ_SDU_P3)</source><creator>Kauffmann, Jacob ; Esders, Malte ; Ruff, Lukas ; Montavon, Grégoire ; Samek, Wojciech ; Klaus-Robert Müller</creator><creatorcontrib>Kauffmann, Jacob ; Esders, Malte ; Ruff, Lukas ; Montavon, Grégoire ; Samek, Wojciech ; Klaus-Robert Müller</creatorcontrib><description>A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.1906.07633</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Algorithms ; Clustering ; Data points ; Neural networks ; Quality assessment</subject><ispartof>arXiv.org, 2021-12</ispartof><rights>2021. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2243263172?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,27925,37012,44590</link.rule.ids></links><search><creatorcontrib>Kauffmann, Jacob</creatorcontrib><creatorcontrib>Esders, Malte</creatorcontrib><creatorcontrib>Ruff, Lukas</creatorcontrib><creatorcontrib>Montavon, Grégoire</creatorcontrib><creatorcontrib>Samek, Wojciech</creatorcontrib><creatorcontrib>Klaus-Robert Müller</creatorcontrib><title>From Clustering to Cluster Explanations via Neural Networks</title><title>arXiv.org</title><description>A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.</description><subject>Algorithms</subject><subject>Clustering</subject><subject>Data points</subject><subject>Neural networks</subject><subject>Quality assessment</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNo1js1Kw0AURgdBaKl9AHcB14kz986dH1xJaFUouum-TJNJSY2ZOpPUPr4B7erwbc53GLsXvJCGiD-6eGnPhbBcFVwrxBs2B0SRGwkwY8uUjpxzUBqIcM6e1jF8ZWU3psHHtj9kQ7iubHU5da53Qxv6lJ1bl737MbpuwvAT4me6Y7eN65Jf_nPBtuvVtnzNNx8vb-XzJncEkFeyIgvWYq3qPRmQNXqifaO0hoamTGW00qStqTjUFTlla_BaOic9CVK4YA9_2lMM36NPw-4YxthPjzsAiaBQaMBfj0pIHA</recordid><startdate>20211216</startdate><enddate>20211216</enddate><creator>Kauffmann, Jacob</creator><creator>Esders, Malte</creator><creator>Ruff, Lukas</creator><creator>Montavon, Grégoire</creator><creator>Samek, Wojciech</creator><creator>Klaus-Robert Müller</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20211216</creationdate><title>From Clustering to Cluster Explanations via Neural Networks</title><author>Kauffmann, Jacob ; Esders, Malte ; Ruff, Lukas ; Montavon, Grégoire ; Samek, Wojciech ; Klaus-Robert Müller</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a522-c4c592993d6db5824d3e55bf6772f5906687675798c02dc5a69d2e74aa4e51563</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Clustering</topic><topic>Data points</topic><topic>Neural networks</topic><topic>Quality assessment</topic><toplevel>online_resources</toplevel><creatorcontrib>Kauffmann, Jacob</creatorcontrib><creatorcontrib>Esders, Malte</creatorcontrib><creatorcontrib>Ruff, Lukas</creatorcontrib><creatorcontrib>Montavon, Grégoire</creatorcontrib><creatorcontrib>Samek, Wojciech</creatorcontrib><creatorcontrib>Klaus-Robert Müller</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection (Proquest) (PQ_SDU_P3)</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database (Proquest) (PQ_SDU_P3)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kauffmann, Jacob</au><au>Esders, Malte</au><au>Ruff, Lukas</au><au>Montavon, Grégoire</au><au>Samek, Wojciech</au><au>Klaus-Robert Müller</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>From Clustering to Cluster Explanations via Neural Networks</atitle><jtitle>arXiv.org</jtitle><date>2021-12-16</date><risdate>2021</risdate><eissn>2331-8422</eissn><abstract>A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.1906.07633</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2021-12
issn 2331-8422
language eng
recordid cdi_proquest_journals_2243263172
source Publicly Available Content Database (Proquest) (PQ_SDU_P3)
subjects Algorithms
Clustering
Data points
Neural networks
Quality assessment
title From Clustering to Cluster Explanations via Neural Networks
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T16%3A19%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=From%20Clustering%20to%20Cluster%20Explanations%20via%20Neural%20Networks&rft.jtitle=arXiv.org&rft.au=Kauffmann,%20Jacob&rft.date=2021-12-16&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.1906.07633&rft_dat=%3Cproquest%3E2243263172%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a522-c4c592993d6db5824d3e55bf6772f5906687675798c02dc5a69d2e74aa4e51563%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2243263172&rft_id=info:pmid/&rfr_iscdi=true