Loading…

Next steps for workplace‐based assessments of entrustable professional activities

Background Florida International University Herbert Wertheim College of Medicine (FIU‐HWCOM) participated in the AAMC Core Entrustable Professional Activities (EPA) implementation pilot. Entrustment decision processes based on data from workplace‐based assessments (WBAs) were piloted. Outcomes illus...

Full description

Saved in:
Bibliographic Details
Published in:The clinical teacher 2024-08, Vol.21 (4), p.e13739-n/a
Main Authors: Stumbar, Sarah E., Eliason, Sarah, Toonkel, Rebecca, Amie, Katrina, Bonnin, Rodolfo, Gralnik, Leonard, Kantor, Julie, Minor, Suzanne
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c2859-3c40bd9d158ecccbf0a0a979b3a5118fc1a8c77b209988a48d9d0fb71c877f343
container_end_page n/a
container_issue 4
container_start_page e13739
container_title The clinical teacher
container_volume 21
creator Stumbar, Sarah E.
Eliason, Sarah
Toonkel, Rebecca
Amie, Katrina
Bonnin, Rodolfo
Gralnik, Leonard
Kantor, Julie
Minor, Suzanne
description Background Florida International University Herbert Wertheim College of Medicine (FIU‐HWCOM) participated in the AAMC Core Entrustable Professional Activities (EPA) implementation pilot. Entrustment decision processes based on data from workplace‐based assessments (WBAs) were piloted. Outcomes illustrated challenges including variability across EPAs with regards to learner level alignment and feasibility of data collection in the form of WBAs. In addition, students reported discomfort requesting WBA completion by preceptors and dissatisfaction with associated feedback. Approach To guide future directions, we conducted a survey of third‐year students to better understand their experience with and perceptions of WBAs used to evaluate EPAs at FIU‐HWCOM. Evaluation Survey response was 96% (n = 107/112). Most (84%) reported that WBAs were not valuable to their development and that preceptors often did not complete WBAs in a timely fashion. Many (47%) reported not receiving verbal feedback. Most students (78%) used language in written responses demonstrating confusion between the EPAs and the WBAs used to assess them. Implications The use of WBAs to assess EPAs did not have its intended impact at FIU‐HWCOM. For future classes, WBA forms will consist of paper cards with questions directly assessing performance of skills aligned with EPAs 1, 5 and 6 only. To continue to promote feedback, students will be required to collect WBAs on all clerkships, but the number of required WBAs will be less than prior and no entrustment decisions will be made.
doi_str_mv 10.1111/tct.13739
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2922450943</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2922450943</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2859-3c40bd9d158ecccbf0a0a979b3a5118fc1a8c77b209988a48d9d0fb71c877f343</originalsourceid><addsrcrecordid>eNp1kE1OwzAQRi0EoqWw4ALIS1ik2HEi20tU8SdVsKBI7CzbsaVA0oSMQ-mOI3BGToIhpTtm8400T59GD6FjSqY0znmwYUoZZ3IHjSnPWJJJ8bS73TkdoQOAZ0IYoZLuoxETjFIp8jF6uHPvAUNwLWDfdHjVdC9tpa37-vg0GlyBNYADqN0yAG48jtn1ELSpHG67xsdb2Sx1hbUN5VsZSgeHaM_rCtzRJifo8epyMbtJ5vfXt7OLeWJTkcuE2YyYQhY0F85aazzRREsuDdM5pcJbqoXl3KRESiF0JiJLvOHUCs49y9gEnQ698Y_X3kFQdQnWVZVeuqYHlco0zXIiMxbRswG1XQPQOa_arqx1t1aUqB-HKjpUvw4je7Kp7U3tii35Jy0C5wOwKiu3_r9JLWaLofIbo4d-Gg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2922450943</pqid></control><display><type>article</type><title>Next steps for workplace‐based assessments of entrustable professional activities</title><source>Wiley-Blackwell Read &amp; Publish Collection</source><creator>Stumbar, Sarah E. ; Eliason, Sarah ; Toonkel, Rebecca ; Amie, Katrina ; Bonnin, Rodolfo ; Gralnik, Leonard ; Kantor, Julie ; Minor, Suzanne</creator><creatorcontrib>Stumbar, Sarah E. ; Eliason, Sarah ; Toonkel, Rebecca ; Amie, Katrina ; Bonnin, Rodolfo ; Gralnik, Leonard ; Kantor, Julie ; Minor, Suzanne</creatorcontrib><description>Background Florida International University Herbert Wertheim College of Medicine (FIU‐HWCOM) participated in the AAMC Core Entrustable Professional Activities (EPA) implementation pilot. Entrustment decision processes based on data from workplace‐based assessments (WBAs) were piloted. Outcomes illustrated challenges including variability across EPAs with regards to learner level alignment and feasibility of data collection in the form of WBAs. In addition, students reported discomfort requesting WBA completion by preceptors and dissatisfaction with associated feedback. Approach To guide future directions, we conducted a survey of third‐year students to better understand their experience with and perceptions of WBAs used to evaluate EPAs at FIU‐HWCOM. Evaluation Survey response was 96% (n = 107/112). Most (84%) reported that WBAs were not valuable to their development and that preceptors often did not complete WBAs in a timely fashion. Many (47%) reported not receiving verbal feedback. Most students (78%) used language in written responses demonstrating confusion between the EPAs and the WBAs used to assess them. Implications The use of WBAs to assess EPAs did not have its intended impact at FIU‐HWCOM. For future classes, WBA forms will consist of paper cards with questions directly assessing performance of skills aligned with EPAs 1, 5 and 6 only. To continue to promote feedback, students will be required to collect WBAs on all clerkships, but the number of required WBAs will be less than prior and no entrustment decisions will be made.</description><identifier>ISSN: 1743-4971</identifier><identifier>ISSN: 1743-498X</identifier><identifier>EISSN: 1743-498X</identifier><identifier>DOI: 10.1111/tct.13739</identifier><identifier>PMID: 38311985</identifier><language>eng</language><publisher>England</publisher><subject>Clinical Competence ; Competency-Based Education ; Education, Medical, Undergraduate ; Educational Measurement - methods ; Educational Measurement - standards ; Florida ; Humans ; Pilot Projects ; Preceptorship - standards ; Students, Medical - psychology ; Workplace</subject><ispartof>The clinical teacher, 2024-08, Vol.21 (4), p.e13739-n/a</ispartof><rights>2024 Association for the Study of Medical Education and John Wiley &amp; Sons Ltd.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c2859-3c40bd9d158ecccbf0a0a979b3a5118fc1a8c77b209988a48d9d0fb71c877f343</cites><orcidid>0000-0003-3238-1226 ; 0000-0002-0736-5622</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38311985$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Stumbar, Sarah E.</creatorcontrib><creatorcontrib>Eliason, Sarah</creatorcontrib><creatorcontrib>Toonkel, Rebecca</creatorcontrib><creatorcontrib>Amie, Katrina</creatorcontrib><creatorcontrib>Bonnin, Rodolfo</creatorcontrib><creatorcontrib>Gralnik, Leonard</creatorcontrib><creatorcontrib>Kantor, Julie</creatorcontrib><creatorcontrib>Minor, Suzanne</creatorcontrib><title>Next steps for workplace‐based assessments of entrustable professional activities</title><title>The clinical teacher</title><addtitle>Clin Teach</addtitle><description>Background Florida International University Herbert Wertheim College of Medicine (FIU‐HWCOM) participated in the AAMC Core Entrustable Professional Activities (EPA) implementation pilot. Entrustment decision processes based on data from workplace‐based assessments (WBAs) were piloted. Outcomes illustrated challenges including variability across EPAs with regards to learner level alignment and feasibility of data collection in the form of WBAs. In addition, students reported discomfort requesting WBA completion by preceptors and dissatisfaction with associated feedback. Approach To guide future directions, we conducted a survey of third‐year students to better understand their experience with and perceptions of WBAs used to evaluate EPAs at FIU‐HWCOM. Evaluation Survey response was 96% (n = 107/112). Most (84%) reported that WBAs were not valuable to their development and that preceptors often did not complete WBAs in a timely fashion. Many (47%) reported not receiving verbal feedback. Most students (78%) used language in written responses demonstrating confusion between the EPAs and the WBAs used to assess them. Implications The use of WBAs to assess EPAs did not have its intended impact at FIU‐HWCOM. For future classes, WBA forms will consist of paper cards with questions directly assessing performance of skills aligned with EPAs 1, 5 and 6 only. To continue to promote feedback, students will be required to collect WBAs on all clerkships, but the number of required WBAs will be less than prior and no entrustment decisions will be made.</description><subject>Clinical Competence</subject><subject>Competency-Based Education</subject><subject>Education, Medical, Undergraduate</subject><subject>Educational Measurement - methods</subject><subject>Educational Measurement - standards</subject><subject>Florida</subject><subject>Humans</subject><subject>Pilot Projects</subject><subject>Preceptorship - standards</subject><subject>Students, Medical - psychology</subject><subject>Workplace</subject><issn>1743-4971</issn><issn>1743-498X</issn><issn>1743-498X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp1kE1OwzAQRi0EoqWw4ALIS1ik2HEi20tU8SdVsKBI7CzbsaVA0oSMQ-mOI3BGToIhpTtm8400T59GD6FjSqY0znmwYUoZZ3IHjSnPWJJJ8bS73TkdoQOAZ0IYoZLuoxETjFIp8jF6uHPvAUNwLWDfdHjVdC9tpa37-vg0GlyBNYADqN0yAG48jtn1ELSpHG67xsdb2Sx1hbUN5VsZSgeHaM_rCtzRJifo8epyMbtJ5vfXt7OLeWJTkcuE2YyYQhY0F85aazzRREsuDdM5pcJbqoXl3KRESiF0JiJLvOHUCs49y9gEnQ698Y_X3kFQdQnWVZVeuqYHlco0zXIiMxbRswG1XQPQOa_arqx1t1aUqB-HKjpUvw4je7Kp7U3tii35Jy0C5wOwKiu3_r9JLWaLofIbo4d-Gg</recordid><startdate>202408</startdate><enddate>202408</enddate><creator>Stumbar, Sarah E.</creator><creator>Eliason, Sarah</creator><creator>Toonkel, Rebecca</creator><creator>Amie, Katrina</creator><creator>Bonnin, Rodolfo</creator><creator>Gralnik, Leonard</creator><creator>Kantor, Julie</creator><creator>Minor, Suzanne</creator><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-3238-1226</orcidid><orcidid>https://orcid.org/0000-0002-0736-5622</orcidid></search><sort><creationdate>202408</creationdate><title>Next steps for workplace‐based assessments of entrustable professional activities</title><author>Stumbar, Sarah E. ; Eliason, Sarah ; Toonkel, Rebecca ; Amie, Katrina ; Bonnin, Rodolfo ; Gralnik, Leonard ; Kantor, Julie ; Minor, Suzanne</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2859-3c40bd9d158ecccbf0a0a979b3a5118fc1a8c77b209988a48d9d0fb71c877f343</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Clinical Competence</topic><topic>Competency-Based Education</topic><topic>Education, Medical, Undergraduate</topic><topic>Educational Measurement - methods</topic><topic>Educational Measurement - standards</topic><topic>Florida</topic><topic>Humans</topic><topic>Pilot Projects</topic><topic>Preceptorship - standards</topic><topic>Students, Medical - psychology</topic><topic>Workplace</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Stumbar, Sarah E.</creatorcontrib><creatorcontrib>Eliason, Sarah</creatorcontrib><creatorcontrib>Toonkel, Rebecca</creatorcontrib><creatorcontrib>Amie, Katrina</creatorcontrib><creatorcontrib>Bonnin, Rodolfo</creatorcontrib><creatorcontrib>Gralnik, Leonard</creatorcontrib><creatorcontrib>Kantor, Julie</creatorcontrib><creatorcontrib>Minor, Suzanne</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>The clinical teacher</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Stumbar, Sarah E.</au><au>Eliason, Sarah</au><au>Toonkel, Rebecca</au><au>Amie, Katrina</au><au>Bonnin, Rodolfo</au><au>Gralnik, Leonard</au><au>Kantor, Julie</au><au>Minor, Suzanne</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Next steps for workplace‐based assessments of entrustable professional activities</atitle><jtitle>The clinical teacher</jtitle><addtitle>Clin Teach</addtitle><date>2024-08</date><risdate>2024</risdate><volume>21</volume><issue>4</issue><spage>e13739</spage><epage>n/a</epage><pages>e13739-n/a</pages><issn>1743-4971</issn><issn>1743-498X</issn><eissn>1743-498X</eissn><abstract>Background Florida International University Herbert Wertheim College of Medicine (FIU‐HWCOM) participated in the AAMC Core Entrustable Professional Activities (EPA) implementation pilot. Entrustment decision processes based on data from workplace‐based assessments (WBAs) were piloted. Outcomes illustrated challenges including variability across EPAs with regards to learner level alignment and feasibility of data collection in the form of WBAs. In addition, students reported discomfort requesting WBA completion by preceptors and dissatisfaction with associated feedback. Approach To guide future directions, we conducted a survey of third‐year students to better understand their experience with and perceptions of WBAs used to evaluate EPAs at FIU‐HWCOM. Evaluation Survey response was 96% (n = 107/112). Most (84%) reported that WBAs were not valuable to their development and that preceptors often did not complete WBAs in a timely fashion. Many (47%) reported not receiving verbal feedback. Most students (78%) used language in written responses demonstrating confusion between the EPAs and the WBAs used to assess them. Implications The use of WBAs to assess EPAs did not have its intended impact at FIU‐HWCOM. For future classes, WBA forms will consist of paper cards with questions directly assessing performance of skills aligned with EPAs 1, 5 and 6 only. To continue to promote feedback, students will be required to collect WBAs on all clerkships, but the number of required WBAs will be less than prior and no entrustment decisions will be made.</abstract><cop>England</cop><pmid>38311985</pmid><doi>10.1111/tct.13739</doi><tpages>7</tpages><orcidid>https://orcid.org/0000-0003-3238-1226</orcidid><orcidid>https://orcid.org/0000-0002-0736-5622</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1743-4971
ispartof The clinical teacher, 2024-08, Vol.21 (4), p.e13739-n/a
issn 1743-4971
1743-498X
1743-498X
language eng
recordid cdi_proquest_miscellaneous_2922450943
source Wiley-Blackwell Read & Publish Collection
subjects Clinical Competence
Competency-Based Education
Education, Medical, Undergraduate
Educational Measurement - methods
Educational Measurement - standards
Florida
Humans
Pilot Projects
Preceptorship - standards
Students, Medical - psychology
Workplace
title Next steps for workplace‐based assessments of entrustable professional activities
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T12%3A42%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Next%20steps%20for%20workplace%E2%80%90based%20assessments%20of%20entrustable%20professional%20activities&rft.jtitle=The%20clinical%20teacher&rft.au=Stumbar,%20Sarah%20E.&rft.date=2024-08&rft.volume=21&rft.issue=4&rft.spage=e13739&rft.epage=n/a&rft.pages=e13739-n/a&rft.issn=1743-4971&rft.eissn=1743-498X&rft_id=info:doi/10.1111/tct.13739&rft_dat=%3Cproquest_cross%3E2922450943%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c2859-3c40bd9d158ecccbf0a0a979b3a5118fc1a8c77b209988a48d9d0fb71c877f343%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2922450943&rft_id=info:pmid/38311985&rfr_iscdi=true