Loading…
From Clustering to Cluster Explanations via Neural Networks
A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, lab...
Saved in:
Published in: | arXiv.org 2021-12 |
---|---|
Main Authors: | , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Kauffmann, Jacob Esders, Malte Ruff, Lukas Montavon, Grégoire Samek, Wojciech Klaus-Robert Müller |
description | A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations. |
doi_str_mv | 10.48550/arxiv.1906.07633 |
format | article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2243263172</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2243263172</sourcerecordid><originalsourceid>FETCH-LOGICAL-a522-c4c592993d6db5824d3e55bf6772f5906687675798c02dc5a69d2e74aa4e51563</originalsourceid><addsrcrecordid>eNo1js1Kw0AURgdBaKl9AHcB14kz986dH1xJaFUouum-TJNJSY2ZOpPUPr4B7erwbc53GLsXvJCGiD-6eGnPhbBcFVwrxBs2B0SRGwkwY8uUjpxzUBqIcM6e1jF8ZWU3psHHtj9kQ7iubHU5da53Qxv6lJ1bl737MbpuwvAT4me6Y7eN65Jf_nPBtuvVtnzNNx8vb-XzJncEkFeyIgvWYq3qPRmQNXqifaO0hoamTGW00qStqTjUFTlla_BaOic9CVK4YA9_2lMM36NPw-4YxthPjzsAiaBQaMBfj0pIHA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2243263172</pqid></control><display><type>article</type><title>From Clustering to Cluster Explanations via Neural Networks</title><source>Publicly Available Content Database (Proquest) (PQ_SDU_P3)</source><creator>Kauffmann, Jacob ; Esders, Malte ; Ruff, Lukas ; Montavon, Grégoire ; Samek, Wojciech ; Klaus-Robert Müller</creator><creatorcontrib>Kauffmann, Jacob ; Esders, Malte ; Ruff, Lukas ; Montavon, Grégoire ; Samek, Wojciech ; Klaus-Robert Müller</creatorcontrib><description>A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.1906.07633</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Algorithms ; Clustering ; Data points ; Neural networks ; Quality assessment</subject><ispartof>arXiv.org, 2021-12</ispartof><rights>2021. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2243263172?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,27925,37012,44590</link.rule.ids></links><search><creatorcontrib>Kauffmann, Jacob</creatorcontrib><creatorcontrib>Esders, Malte</creatorcontrib><creatorcontrib>Ruff, Lukas</creatorcontrib><creatorcontrib>Montavon, Grégoire</creatorcontrib><creatorcontrib>Samek, Wojciech</creatorcontrib><creatorcontrib>Klaus-Robert Müller</creatorcontrib><title>From Clustering to Cluster Explanations via Neural Networks</title><title>arXiv.org</title><description>A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.</description><subject>Algorithms</subject><subject>Clustering</subject><subject>Data points</subject><subject>Neural networks</subject><subject>Quality assessment</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNo1js1Kw0AURgdBaKl9AHcB14kz986dH1xJaFUouum-TJNJSY2ZOpPUPr4B7erwbc53GLsXvJCGiD-6eGnPhbBcFVwrxBs2B0SRGwkwY8uUjpxzUBqIcM6e1jF8ZWU3psHHtj9kQ7iubHU5da53Qxv6lJ1bl737MbpuwvAT4me6Y7eN65Jf_nPBtuvVtnzNNx8vb-XzJncEkFeyIgvWYq3qPRmQNXqifaO0hoamTGW00qStqTjUFTlla_BaOic9CVK4YA9_2lMM36NPw-4YxthPjzsAiaBQaMBfj0pIHA</recordid><startdate>20211216</startdate><enddate>20211216</enddate><creator>Kauffmann, Jacob</creator><creator>Esders, Malte</creator><creator>Ruff, Lukas</creator><creator>Montavon, Grégoire</creator><creator>Samek, Wojciech</creator><creator>Klaus-Robert Müller</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20211216</creationdate><title>From Clustering to Cluster Explanations via Neural Networks</title><author>Kauffmann, Jacob ; Esders, Malte ; Ruff, Lukas ; Montavon, Grégoire ; Samek, Wojciech ; Klaus-Robert Müller</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a522-c4c592993d6db5824d3e55bf6772f5906687675798c02dc5a69d2e74aa4e51563</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Clustering</topic><topic>Data points</topic><topic>Neural networks</topic><topic>Quality assessment</topic><toplevel>online_resources</toplevel><creatorcontrib>Kauffmann, Jacob</creatorcontrib><creatorcontrib>Esders, Malte</creatorcontrib><creatorcontrib>Ruff, Lukas</creatorcontrib><creatorcontrib>Montavon, Grégoire</creatorcontrib><creatorcontrib>Samek, Wojciech</creatorcontrib><creatorcontrib>Klaus-Robert Müller</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection (Proquest) (PQ_SDU_P3)</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database (Proquest) (PQ_SDU_P3)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kauffmann, Jacob</au><au>Esders, Malte</au><au>Ruff, Lukas</au><au>Montavon, Grégoire</au><au>Samek, Wojciech</au><au>Klaus-Robert Müller</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>From Clustering to Cluster Explanations via Neural Networks</atitle><jtitle>arXiv.org</jtitle><date>2021-12-16</date><risdate>2021</risdate><eissn>2331-8422</eissn><abstract>A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data, for example, its clusters. While powerful methods exist for extracting the cluster structure in data, they typically do not answer the question why a certain data point has been assigned to a given cluster. We propose a new framework that can, for the first time, explain cluster assignments in terms of input features in an efficient and reliable manner. It is based on the novel insight that clustering models can be rewritten as neural networks - or 'neuralized'. Cluster predictions of the obtained networks can then be quickly and accurately attributed to the input features. Several showcases demonstrate the ability of our method to assess the quality of learned clusters and to extract novel insights from the analyzed data and representations.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.1906.07633</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2021-12 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_2243263172 |
source | Publicly Available Content Database (Proquest) (PQ_SDU_P3) |
subjects | Algorithms Clustering Data points Neural networks Quality assessment |
title | From Clustering to Cluster Explanations via Neural Networks |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T16%3A19%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=From%20Clustering%20to%20Cluster%20Explanations%20via%20Neural%20Networks&rft.jtitle=arXiv.org&rft.au=Kauffmann,%20Jacob&rft.date=2021-12-16&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.1906.07633&rft_dat=%3Cproquest%3E2243263172%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a522-c4c592993d6db5824d3e55bf6772f5906687675798c02dc5a69d2e74aa4e51563%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2243263172&rft_id=info:pmid/&rfr_iscdi=true |