Loading…

Initial validation of the trust of automated systems test (TOAST)

Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current resear...

Full description

Saved in:
Bibliographic Details
Published in:The Journal of social psychology 2020-11, Vol.160 (6), p.735-750
Main Authors: Wojton, Heather M., Porter, Daniel, T. Lane, Stephanie, Bieber, Chad, Madhavan, Poornima
Format: Article
Language:English
Subjects:
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c394t-9eeae147c736890596aa95458f9a3ba2e039be2b1da77d6ee888eb543050ba293
cites
container_end_page 750
container_issue 6
container_start_page 735
container_title The Journal of social psychology
container_volume 160
creator Wojton, Heather M.
Porter, Daniel
T. Lane, Stephanie
Bieber, Chad
Madhavan, Poornima
description Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current research and theory on trust formation, which we refer to as the Trust in Automated Systems Test (TOAST). We evaluated both the reliability of the scale structure and criterion validity using independent, military-affiliated and civilian samples. In both studies we found that the TOAST exhibited a two-factor structure, measuring system understanding and performance (respectively), and that factor scores significantly predicted scores on theoretically related constructs demonstrating clear criterion validity. We discuss the implications of our findings for advancing the empirical literature and in improving interface design.
doi_str_mv 10.1080/00224545.2020.1749020
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2426561117</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2390648273</sourcerecordid><originalsourceid>FETCH-LOGICAL-c394t-9eeae147c736890596aa95458f9a3ba2e039be2b1da77d6ee888eb543050ba293</originalsourceid><addsrcrecordid>eNp9kE1r3DAQhkVoyG4-fkKKoZfNwYm-bEm3LqFNFwI5ZHMWY3tMHGxrK8kp--8rs5secqgugzTPjF4eQq4ZvWVU0ztKOZeFLG455elJSZPqCVkyI2nOmBZfyHJm8hlakPMQ3mg6yrAzshCcG6WlXJL1ZuxiB332Dn3XQOzcmLk2i6-YRT-FOF9gim6AiE0W9iHiELKIqbPaPq2ftzeX5LSFPuDVsV6Ql58_tve_8senh839-jGvhZExN4iATKpaiVIbWpgSwKRoujUgKuBIhamQV6wBpZoSUWuNVSEFLWhqG3FBVoe9O-9-TymAHbpQY9_DiG4KlgtDS6m5Egn99gl9c5MfUzrLJS-LkjGmElUcqNq7EDy2due7AfzeMmpnx_bDsZ0d26PjNPf1uH2qBmz-TX1ITcD3A9CNrfMD_HG-b2yEfe9862Gsu2DF___4C4Z7iIY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2426561117</pqid></control><display><type>article</type><title>Initial validation of the trust of automated systems test (TOAST)</title><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><source>International Bibliography of the Social Sciences (IBSS)</source><source>BSC - Ebsco (Business Source Ultimate)</source><source>Sociological Abstracts</source><source>SPORTDiscus with Full Text</source><source>Taylor and Francis Social Sciences and Humanities Collection</source><creator>Wojton, Heather M. ; Porter, Daniel ; T. Lane, Stephanie ; Bieber, Chad ; Madhavan, Poornima</creator><creatorcontrib>Wojton, Heather M. ; Porter, Daniel ; T. Lane, Stephanie ; Bieber, Chad ; Madhavan, Poornima</creatorcontrib><description>Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current research and theory on trust formation, which we refer to as the Trust in Automated Systems Test (TOAST). We evaluated both the reliability of the scale structure and criterion validity using independent, military-affiliated and civilian samples. In both studies we found that the TOAST exhibited a two-factor structure, measuring system understanding and performance (respectively), and that factor scores significantly predicted scores on theoretically related constructs demonstrating clear criterion validity. We discuss the implications of our findings for advancing the empirical literature and in improving interface design.</description><identifier>ISSN: 0022-4545</identifier><identifier>EISSN: 1940-1183</identifier><identifier>DOI: 10.1080/00224545.2020.1749020</identifier><identifier>PMID: 32297844</identifier><language>eng</language><publisher>United States: Routledge</publisher><subject>Adult ; Armed forces ; Automation ; Confirmatory Factor Analysis ; Female ; Human-Machine Trust ; Humans ; Male ; Man-Machine Systems ; Measures ; Military Personnel - psychology ; Reliability ; Reproducibility of Results ; Surveys and Questionnaires ; Trust ; Trust - psychology ; Trust in Automation ; Trust Scale ; Validity</subject><ispartof>The Journal of social psychology, 2020-11, Vol.160 (6), p.735-750</ispartof><rights>2020 Taylor &amp; Francis 2020</rights><rights>2020 Taylor &amp; Francis</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c394t-9eeae147c736890596aa95458f9a3ba2e039be2b1da77d6ee888eb543050ba293</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925,30999,33223,33774</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/32297844$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Wojton, Heather M.</creatorcontrib><creatorcontrib>Porter, Daniel</creatorcontrib><creatorcontrib>T. Lane, Stephanie</creatorcontrib><creatorcontrib>Bieber, Chad</creatorcontrib><creatorcontrib>Madhavan, Poornima</creatorcontrib><title>Initial validation of the trust of automated systems test (TOAST)</title><title>The Journal of social psychology</title><addtitle>J Soc Psychol</addtitle><description>Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current research and theory on trust formation, which we refer to as the Trust in Automated Systems Test (TOAST). We evaluated both the reliability of the scale structure and criterion validity using independent, military-affiliated and civilian samples. In both studies we found that the TOAST exhibited a two-factor structure, measuring system understanding and performance (respectively), and that factor scores significantly predicted scores on theoretically related constructs demonstrating clear criterion validity. We discuss the implications of our findings for advancing the empirical literature and in improving interface design.</description><subject>Adult</subject><subject>Armed forces</subject><subject>Automation</subject><subject>Confirmatory Factor Analysis</subject><subject>Female</subject><subject>Human-Machine Trust</subject><subject>Humans</subject><subject>Male</subject><subject>Man-Machine Systems</subject><subject>Measures</subject><subject>Military Personnel - psychology</subject><subject>Reliability</subject><subject>Reproducibility of Results</subject><subject>Surveys and Questionnaires</subject><subject>Trust</subject><subject>Trust - psychology</subject><subject>Trust in Automation</subject><subject>Trust Scale</subject><subject>Validity</subject><issn>0022-4545</issn><issn>1940-1183</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><sourceid>8BJ</sourceid><sourceid>BHHNA</sourceid><recordid>eNp9kE1r3DAQhkVoyG4-fkKKoZfNwYm-bEm3LqFNFwI5ZHMWY3tMHGxrK8kp--8rs5secqgugzTPjF4eQq4ZvWVU0ztKOZeFLG455elJSZPqCVkyI2nOmBZfyHJm8hlakPMQ3mg6yrAzshCcG6WlXJL1ZuxiB332Dn3XQOzcmLk2i6-YRT-FOF9gim6AiE0W9iHiELKIqbPaPq2ftzeX5LSFPuDVsV6Ql58_tve_8senh839-jGvhZExN4iATKpaiVIbWpgSwKRoujUgKuBIhamQV6wBpZoSUWuNVSEFLWhqG3FBVoe9O-9-TymAHbpQY9_DiG4KlgtDS6m5Egn99gl9c5MfUzrLJS-LkjGmElUcqNq7EDy2due7AfzeMmpnx_bDsZ0d26PjNPf1uH2qBmz-TX1ITcD3A9CNrfMD_HG-b2yEfe9862Gsu2DF___4C4Z7iIY</recordid><startdate>20201101</startdate><enddate>20201101</enddate><creator>Wojton, Heather M.</creator><creator>Porter, Daniel</creator><creator>T. Lane, Stephanie</creator><creator>Bieber, Chad</creator><creator>Madhavan, Poornima</creator><general>Routledge</general><general>Taylor &amp; Francis Inc</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>7U4</scope><scope>8BJ</scope><scope>BHHNA</scope><scope>DWI</scope><scope>FQK</scope><scope>JBE</scope><scope>K9.</scope><scope>WZK</scope><scope>7X8</scope></search><sort><creationdate>20201101</creationdate><title>Initial validation of the trust of automated systems test (TOAST)</title><author>Wojton, Heather M. ; Porter, Daniel ; T. Lane, Stephanie ; Bieber, Chad ; Madhavan, Poornima</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c394t-9eeae147c736890596aa95458f9a3ba2e039be2b1da77d6ee888eb543050ba293</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Adult</topic><topic>Armed forces</topic><topic>Automation</topic><topic>Confirmatory Factor Analysis</topic><topic>Female</topic><topic>Human-Machine Trust</topic><topic>Humans</topic><topic>Male</topic><topic>Man-Machine Systems</topic><topic>Measures</topic><topic>Military Personnel - psychology</topic><topic>Reliability</topic><topic>Reproducibility of Results</topic><topic>Surveys and Questionnaires</topic><topic>Trust</topic><topic>Trust - psychology</topic><topic>Trust in Automation</topic><topic>Trust Scale</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wojton, Heather M.</creatorcontrib><creatorcontrib>Porter, Daniel</creatorcontrib><creatorcontrib>T. Lane, Stephanie</creatorcontrib><creatorcontrib>Bieber, Chad</creatorcontrib><creatorcontrib>Madhavan, Poornima</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>Sociological Abstracts (pre-2017)</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>Sociological Abstracts</collection><collection>Sociological Abstracts</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Sociological Abstracts (Ovid)</collection><collection>MEDLINE - Academic</collection><jtitle>The Journal of social psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wojton, Heather M.</au><au>Porter, Daniel</au><au>T. Lane, Stephanie</au><au>Bieber, Chad</au><au>Madhavan, Poornima</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Initial validation of the trust of automated systems test (TOAST)</atitle><jtitle>The Journal of social psychology</jtitle><addtitle>J Soc Psychol</addtitle><date>2020-11-01</date><risdate>2020</risdate><volume>160</volume><issue>6</issue><spage>735</spage><epage>750</epage><pages>735-750</pages><issn>0022-4545</issn><eissn>1940-1183</eissn><abstract>Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current research and theory on trust formation, which we refer to as the Trust in Automated Systems Test (TOAST). We evaluated both the reliability of the scale structure and criterion validity using independent, military-affiliated and civilian samples. In both studies we found that the TOAST exhibited a two-factor structure, measuring system understanding and performance (respectively), and that factor scores significantly predicted scores on theoretically related constructs demonstrating clear criterion validity. We discuss the implications of our findings for advancing the empirical literature and in improving interface design.</abstract><cop>United States</cop><pub>Routledge</pub><pmid>32297844</pmid><doi>10.1080/00224545.2020.1749020</doi><tpages>16</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0022-4545
ispartof The Journal of social psychology, 2020-11, Vol.160 (6), p.735-750
issn 0022-4545
1940-1183
language eng
recordid cdi_proquest_journals_2426561117
source Applied Social Sciences Index & Abstracts (ASSIA); International Bibliography of the Social Sciences (IBSS); BSC - Ebsco (Business Source Ultimate); Sociological Abstracts; SPORTDiscus with Full Text; Taylor and Francis Social Sciences and Humanities Collection
subjects Adult
Armed forces
Automation
Confirmatory Factor Analysis
Female
Human-Machine Trust
Humans
Male
Man-Machine Systems
Measures
Military Personnel - psychology
Reliability
Reproducibility of Results
Surveys and Questionnaires
Trust
Trust - psychology
Trust in Automation
Trust Scale
Validity
title Initial validation of the trust of automated systems test (TOAST)
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T19%3A42%3A01IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Initial%20validation%20of%20the%20trust%20of%20automated%20systems%20test%20(TOAST)&rft.jtitle=The%20Journal%20of%20social%20psychology&rft.au=Wojton,%20Heather%20M.&rft.date=2020-11-01&rft.volume=160&rft.issue=6&rft.spage=735&rft.epage=750&rft.pages=735-750&rft.issn=0022-4545&rft.eissn=1940-1183&rft_id=info:doi/10.1080/00224545.2020.1749020&rft_dat=%3Cproquest_cross%3E2390648273%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c394t-9eeae147c736890596aa95458f9a3ba2e039be2b1da77d6ee888eb543050ba293%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2426561117&rft_id=info:pmid/32297844&rfr_iscdi=true