Loading…
Bridging cognitive gaps between user and model in interactive dimension reduction
Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents...
Saved in:
Published in: | Visual informatics (Online) 2021-06, Vol.5 (2), p.13-25 |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893 |
---|---|
cites | cdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893 |
container_end_page | 25 |
container_issue | 2 |
container_start_page | 13 |
container_title | Visual informatics (Online) |
container_volume | 5 |
creator | Wang, Ming Wenskovitch, John House, Leanna Polys, Nicholas North, Chris |
description | Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks. |
doi_str_mv | 10.1016/j.visinf.2021.03.002 |
format | article |
fullrecord | <record><control><sourceid>elsevier_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_4fdf27ef5e744a80941d9b6e32ca8d65</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S2468502X21000085</els_id><doaj_id>oai_doaj_org_article_4fdf27ef5e744a80941d9b6e32ca8d65</doaj_id><sourcerecordid>S2468502X21000085</sourcerecordid><originalsourceid>FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</originalsourceid><addsrcrecordid>eNp9kUFLJDEQhRvZBUX9B3tovE-bpJPu9EVQ0V1BEEFhb6GSVLc1zCSStCP--83Yy-JpoaCK4r2voF5V_eCs4Yx35-tmR5nC2AgmeMPahjFxUB0J2emVYuL3ty_zYXWa85oVhS5ezo-qx6tEfqIw1S5OgWbaYT3Ba64tzu-IoX7LmGoIvt5Gj5uaQqkZE7hPqacthkwx1An9W9nFcFJ9H2GT8fRvP66eb2-ern-t7h9-3l1f3q-clGpeDZbJlknrUAg1AOsVGzTyjgHwFloA6L2werDaWuSguNLeihE0qnZAPbTH1d3C9RHW5jXRFtKHiUDmcxHTZCDN5DZo5OhH0eOosJcSNBsk94PtsBUOtO9UYZ0trJhnMtnRjO7FxRDQzYb3WnWiLyK5iFyKOScc_x3lzOyjMGuzRGH2URjWmvLoYrtYbFiesSNMez4Gh57SHu8j_R_wBzZhlIM</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Bridging cognitive gaps between user and model in interactive dimension reduction</title><source>ScienceDirect Journals</source><creator>Wang, Ming ; Wenskovitch, John ; House, Leanna ; Polys, Nicholas ; North, Chris</creator><creatorcontrib>Wang, Ming ; Wenskovitch, John ; House, Leanna ; Polys, Nicholas ; North, Chris ; Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</creatorcontrib><description>Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.</description><identifier>ISSN: 2468-502X</identifier><identifier>EISSN: 2468-502X</identifier><identifier>DOI: 10.1016/j.visinf.2021.03.002</identifier><language>eng</language><publisher>United States: Elsevier B.V</publisher><subject>Cognitive gaps ; Dimension reduction ; Interactive machine learning ; MATHEMATICS AND COMPUTING ; Usability ; Visual analytics ; Visual analytics, human-computer interaction, interface design, dimension reduction</subject><ispartof>Visual informatics (Online), 2021-06, Vol.5 (2), p.13-25</ispartof><rights>2021 The Author(s)</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</citedby><cites>FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</cites><orcidid>0000000205736442</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S2468502X21000085$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,3549,27924,27925,45780</link.rule.ids><backlink>$$Uhttps://www.osti.gov/servlets/purl/1785627$$D View this record in Osti.gov$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Ming</creatorcontrib><creatorcontrib>Wenskovitch, John</creatorcontrib><creatorcontrib>House, Leanna</creatorcontrib><creatorcontrib>Polys, Nicholas</creatorcontrib><creatorcontrib>North, Chris</creatorcontrib><creatorcontrib>Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</creatorcontrib><title>Bridging cognitive gaps between user and model in interactive dimension reduction</title><title>Visual informatics (Online)</title><description>Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.</description><subject>Cognitive gaps</subject><subject>Dimension reduction</subject><subject>Interactive machine learning</subject><subject>MATHEMATICS AND COMPUTING</subject><subject>Usability</subject><subject>Visual analytics</subject><subject>Visual analytics, human-computer interaction, interface design, dimension reduction</subject><issn>2468-502X</issn><issn>2468-502X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>DOA</sourceid><recordid>eNp9kUFLJDEQhRvZBUX9B3tovE-bpJPu9EVQ0V1BEEFhb6GSVLc1zCSStCP--83Yy-JpoaCK4r2voF5V_eCs4Yx35-tmR5nC2AgmeMPahjFxUB0J2emVYuL3ty_zYXWa85oVhS5ezo-qx6tEfqIw1S5OgWbaYT3Ba64tzu-IoX7LmGoIvt5Gj5uaQqkZE7hPqacthkwx1An9W9nFcFJ9H2GT8fRvP66eb2-ern-t7h9-3l1f3q-clGpeDZbJlknrUAg1AOsVGzTyjgHwFloA6L2werDaWuSguNLeihE0qnZAPbTH1d3C9RHW5jXRFtKHiUDmcxHTZCDN5DZo5OhH0eOosJcSNBsk94PtsBUOtO9UYZ0trJhnMtnRjO7FxRDQzYb3WnWiLyK5iFyKOScc_x3lzOyjMGuzRGH2URjWmvLoYrtYbFiesSNMez4Gh57SHu8j_R_wBzZhlIM</recordid><startdate>20210601</startdate><enddate>20210601</enddate><creator>Wang, Ming</creator><creator>Wenskovitch, John</creator><creator>House, Leanna</creator><creator>Polys, Nicholas</creator><creator>North, Chris</creator><general>Elsevier B.V</general><general>Elsevier - Zhejiang University Press</general><general>Elsevier</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>OIOZB</scope><scope>OTOTI</scope><scope>DOA</scope><orcidid>https://orcid.org/0000000205736442</orcidid></search><sort><creationdate>20210601</creationdate><title>Bridging cognitive gaps between user and model in interactive dimension reduction</title><author>Wang, Ming ; Wenskovitch, John ; House, Leanna ; Polys, Nicholas ; North, Chris</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Cognitive gaps</topic><topic>Dimension reduction</topic><topic>Interactive machine learning</topic><topic>MATHEMATICS AND COMPUTING</topic><topic>Usability</topic><topic>Visual analytics</topic><topic>Visual analytics, human-computer interaction, interface design, dimension reduction</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Ming</creatorcontrib><creatorcontrib>Wenskovitch, John</creatorcontrib><creatorcontrib>House, Leanna</creatorcontrib><creatorcontrib>Polys, Nicholas</creatorcontrib><creatorcontrib>North, Chris</creatorcontrib><creatorcontrib>Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>OSTI.GOV - Hybrid</collection><collection>OSTI.GOV</collection><collection>Directory of Open Access Journals</collection><jtitle>Visual informatics (Online)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wang, Ming</au><au>Wenskovitch, John</au><au>House, Leanna</au><au>Polys, Nicholas</au><au>North, Chris</au><aucorp>Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Bridging cognitive gaps between user and model in interactive dimension reduction</atitle><jtitle>Visual informatics (Online)</jtitle><date>2021-06-01</date><risdate>2021</risdate><volume>5</volume><issue>2</issue><spage>13</spage><epage>25</epage><pages>13-25</pages><issn>2468-502X</issn><eissn>2468-502X</eissn><abstract>Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.</abstract><cop>United States</cop><pub>Elsevier B.V</pub><doi>10.1016/j.visinf.2021.03.002</doi><tpages>13</tpages><orcidid>https://orcid.org/0000000205736442</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2468-502X |
ispartof | Visual informatics (Online), 2021-06, Vol.5 (2), p.13-25 |
issn | 2468-502X 2468-502X |
language | eng |
recordid | cdi_doaj_primary_oai_doaj_org_article_4fdf27ef5e744a80941d9b6e32ca8d65 |
source | ScienceDirect Journals |
subjects | Cognitive gaps Dimension reduction Interactive machine learning MATHEMATICS AND COMPUTING Usability Visual analytics Visual analytics, human-computer interaction, interface design, dimension reduction |
title | Bridging cognitive gaps between user and model in interactive dimension reduction |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T06%3A05%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Bridging%20cognitive%20gaps%20between%20user%20and%20model%20in%20interactive%20dimension%20reduction&rft.jtitle=Visual%20informatics%20(Online)&rft.au=Wang,%20Ming&rft.aucorp=Pacific%20Northwest%20National%20Lab.%20(PNNL),%20Richland,%20WA%20(United%20States)&rft.date=2021-06-01&rft.volume=5&rft.issue=2&rft.spage=13&rft.epage=25&rft.pages=13-25&rft.issn=2468-502X&rft.eissn=2468-502X&rft_id=info:doi/10.1016/j.visinf.2021.03.002&rft_dat=%3Celsevier_doaj_%3ES2468502X21000085%3C/elsevier_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |