Loading…

Bridging cognitive gaps between user and model in interactive dimension reduction

Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents...

Full description

Saved in:
Bibliographic Details
Published in:Visual informatics (Online) 2021-06, Vol.5 (2), p.13-25
Main Authors: Wang, Ming, Wenskovitch, John, House, Leanna, Polys, Nicholas, North, Chris
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893
cites cdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893
container_end_page 25
container_issue 2
container_start_page 13
container_title Visual informatics (Online)
container_volume 5
creator Wang, Ming
Wenskovitch, John
House, Leanna
Polys, Nicholas
North, Chris
description Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.
doi_str_mv 10.1016/j.visinf.2021.03.002
format article
fullrecord <record><control><sourceid>elsevier_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_4fdf27ef5e744a80941d9b6e32ca8d65</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S2468502X21000085</els_id><doaj_id>oai_doaj_org_article_4fdf27ef5e744a80941d9b6e32ca8d65</doaj_id><sourcerecordid>S2468502X21000085</sourcerecordid><originalsourceid>FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</originalsourceid><addsrcrecordid>eNp9kUFLJDEQhRvZBUX9B3tovE-bpJPu9EVQ0V1BEEFhb6GSVLc1zCSStCP--83Yy-JpoaCK4r2voF5V_eCs4Yx35-tmR5nC2AgmeMPahjFxUB0J2emVYuL3ty_zYXWa85oVhS5ezo-qx6tEfqIw1S5OgWbaYT3Ba64tzu-IoX7LmGoIvt5Gj5uaQqkZE7hPqacthkwx1An9W9nFcFJ9H2GT8fRvP66eb2-ern-t7h9-3l1f3q-clGpeDZbJlknrUAg1AOsVGzTyjgHwFloA6L2werDaWuSguNLeihE0qnZAPbTH1d3C9RHW5jXRFtKHiUDmcxHTZCDN5DZo5OhH0eOosJcSNBsk94PtsBUOtO9UYZ0trJhnMtnRjO7FxRDQzYb3WnWiLyK5iFyKOScc_x3lzOyjMGuzRGH2URjWmvLoYrtYbFiesSNMez4Gh57SHu8j_R_wBzZhlIM</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Bridging cognitive gaps between user and model in interactive dimension reduction</title><source>ScienceDirect Journals</source><creator>Wang, Ming ; Wenskovitch, John ; House, Leanna ; Polys, Nicholas ; North, Chris</creator><creatorcontrib>Wang, Ming ; Wenskovitch, John ; House, Leanna ; Polys, Nicholas ; North, Chris ; Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</creatorcontrib><description>Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.</description><identifier>ISSN: 2468-502X</identifier><identifier>EISSN: 2468-502X</identifier><identifier>DOI: 10.1016/j.visinf.2021.03.002</identifier><language>eng</language><publisher>United States: Elsevier B.V</publisher><subject>Cognitive gaps ; Dimension reduction ; Interactive machine learning ; MATHEMATICS AND COMPUTING ; Usability ; Visual analytics ; Visual analytics, human-computer interaction, interface design, dimension reduction</subject><ispartof>Visual informatics (Online), 2021-06, Vol.5 (2), p.13-25</ispartof><rights>2021 The Author(s)</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</citedby><cites>FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</cites><orcidid>0000000205736442</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S2468502X21000085$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,3549,27924,27925,45780</link.rule.ids><backlink>$$Uhttps://www.osti.gov/servlets/purl/1785627$$D View this record in Osti.gov$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Ming</creatorcontrib><creatorcontrib>Wenskovitch, John</creatorcontrib><creatorcontrib>House, Leanna</creatorcontrib><creatorcontrib>Polys, Nicholas</creatorcontrib><creatorcontrib>North, Chris</creatorcontrib><creatorcontrib>Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</creatorcontrib><title>Bridging cognitive gaps between user and model in interactive dimension reduction</title><title>Visual informatics (Online)</title><description>Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.</description><subject>Cognitive gaps</subject><subject>Dimension reduction</subject><subject>Interactive machine learning</subject><subject>MATHEMATICS AND COMPUTING</subject><subject>Usability</subject><subject>Visual analytics</subject><subject>Visual analytics, human-computer interaction, interface design, dimension reduction</subject><issn>2468-502X</issn><issn>2468-502X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>DOA</sourceid><recordid>eNp9kUFLJDEQhRvZBUX9B3tovE-bpJPu9EVQ0V1BEEFhb6GSVLc1zCSStCP--83Yy-JpoaCK4r2voF5V_eCs4Yx35-tmR5nC2AgmeMPahjFxUB0J2emVYuL3ty_zYXWa85oVhS5ezo-qx6tEfqIw1S5OgWbaYT3Ba64tzu-IoX7LmGoIvt5Gj5uaQqkZE7hPqacthkwx1An9W9nFcFJ9H2GT8fRvP66eb2-ern-t7h9-3l1f3q-clGpeDZbJlknrUAg1AOsVGzTyjgHwFloA6L2werDaWuSguNLeihE0qnZAPbTH1d3C9RHW5jXRFtKHiUDmcxHTZCDN5DZo5OhH0eOosJcSNBsk94PtsBUOtO9UYZ0trJhnMtnRjO7FxRDQzYb3WnWiLyK5iFyKOScc_x3lzOyjMGuzRGH2URjWmvLoYrtYbFiesSNMez4Gh57SHu8j_R_wBzZhlIM</recordid><startdate>20210601</startdate><enddate>20210601</enddate><creator>Wang, Ming</creator><creator>Wenskovitch, John</creator><creator>House, Leanna</creator><creator>Polys, Nicholas</creator><creator>North, Chris</creator><general>Elsevier B.V</general><general>Elsevier - Zhejiang University Press</general><general>Elsevier</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>OIOZB</scope><scope>OTOTI</scope><scope>DOA</scope><orcidid>https://orcid.org/0000000205736442</orcidid></search><sort><creationdate>20210601</creationdate><title>Bridging cognitive gaps between user and model in interactive dimension reduction</title><author>Wang, Ming ; Wenskovitch, John ; House, Leanna ; Polys, Nicholas ; North, Chris</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Cognitive gaps</topic><topic>Dimension reduction</topic><topic>Interactive machine learning</topic><topic>MATHEMATICS AND COMPUTING</topic><topic>Usability</topic><topic>Visual analytics</topic><topic>Visual analytics, human-computer interaction, interface design, dimension reduction</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Ming</creatorcontrib><creatorcontrib>Wenskovitch, John</creatorcontrib><creatorcontrib>House, Leanna</creatorcontrib><creatorcontrib>Polys, Nicholas</creatorcontrib><creatorcontrib>North, Chris</creatorcontrib><creatorcontrib>Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>OSTI.GOV - Hybrid</collection><collection>OSTI.GOV</collection><collection>Directory of Open Access Journals</collection><jtitle>Visual informatics (Online)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wang, Ming</au><au>Wenskovitch, John</au><au>House, Leanna</au><au>Polys, Nicholas</au><au>North, Chris</au><aucorp>Pacific Northwest National Lab. (PNNL), Richland, WA (United States)</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Bridging cognitive gaps between user and model in interactive dimension reduction</atitle><jtitle>Visual informatics (Online)</jtitle><date>2021-06-01</date><risdate>2021</risdate><volume>5</volume><issue>2</issue><spage>13</spage><epage>25</epage><pages>13-25</pages><issn>2468-502X</issn><eissn>2468-502X</eissn><abstract>Interactive machine learning (ML) systems are difficult to design because of the “Two Black Boxes” problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These black boxes create cognitive gaps between the user and the interactive ML model. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda, but are also representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making usability improvements to the original Andromeda system. These include designing new visual features to help people better understand how Andromeda processes and interacts with data, as well as improving the underlying algorithm so that the system can better implement the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis, and the results confirm that the improved Andromeda system outperforms the original version in a series of high-dimensional data analysis tasks.</abstract><cop>United States</cop><pub>Elsevier B.V</pub><doi>10.1016/j.visinf.2021.03.002</doi><tpages>13</tpages><orcidid>https://orcid.org/0000000205736442</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2468-502X
ispartof Visual informatics (Online), 2021-06, Vol.5 (2), p.13-25
issn 2468-502X
2468-502X
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_4fdf27ef5e744a80941d9b6e32ca8d65
source ScienceDirect Journals
subjects Cognitive gaps
Dimension reduction
Interactive machine learning
MATHEMATICS AND COMPUTING
Usability
Visual analytics
Visual analytics, human-computer interaction, interface design, dimension reduction
title Bridging cognitive gaps between user and model in interactive dimension reduction
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T06%3A05%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Bridging%20cognitive%20gaps%20between%20user%20and%20model%20in%20interactive%20dimension%20reduction&rft.jtitle=Visual%20informatics%20(Online)&rft.au=Wang,%20Ming&rft.aucorp=Pacific%20Northwest%20National%20Lab.%20(PNNL),%20Richland,%20WA%20(United%20States)&rft.date=2021-06-01&rft.volume=5&rft.issue=2&rft.spage=13&rft.epage=25&rft.pages=13-25&rft.issn=2468-502X&rft.eissn=2468-502X&rft_id=info:doi/10.1016/j.visinf.2021.03.002&rft_dat=%3Celsevier_doaj_%3ES2468502X21000085%3C/elsevier_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c445t-9b04304bce2259a075098e160aa13a3aaa7d2b89b8bbe1a5158db2fa8e539e893%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true