Loading…

Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees

SIMPL is a workplace-based operative performance assessment tool which allows for dictated feedback (DF). To better understand the value of DF, we sought to characterize the type and quality of DF generated during SIMPL evaluations. Thematic analysis of DF from SIMPL assessments between June 2017 an...

Full description

Saved in:
Bibliographic Details
Published in:The American journal of surgery 2021-02, Vol.221 (2), p.303-308
Main Authors: Zendejas, Benjamin, Toprak, Ayca, Harrington, Amanda W., Lillehei, Craig W., Modi, Biren P.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63
cites cdi_FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63
container_end_page 308
container_issue 2
container_start_page 303
container_title The American journal of surgery
container_volume 221
creator Zendejas, Benjamin
Toprak, Ayca
Harrington, Amanda W.
Lillehei, Craig W.
Modi, Biren P.
description SIMPL is a workplace-based operative performance assessment tool which allows for dictated feedback (DF). To better understand the value of DF, we sought to characterize the type and quality of DF generated during SIMPL evaluations. Thematic analysis of DF from SIMPL assessments between June 2017 and December 2018 at a single pediatric surgery fellowship program was performed. Comments were categorized as specific, encouraging or corrective. Categories were combined to determine DF quality as effective, mediocre or ineffective. Of 781 SIMPL assessments (21 faculty, 5 trainees), 451 (57%) had DF. Most comments were encouraging (93%) and specific (65%). Only 21% were corrective, 17% had entrustment features, and 8% had an explicit learning plan. Feedback quality was deemed mediocre (45%), ineffective (33%) and effective (21%). SIMPL dictated feedback was mostly encouraging and specific. To improve quality, feedback should incorporate learning plans as well as corrective and entrustment features. •Dictated feedback from SIMPL assessments is predominantly encouraging and specific•Trainees prefer feedback with learning plans, corrective and entrustment features•Efforts to improve feedback quality from SIMPL assessments are needed•SIMPL rater training should incorporate teaching of effective feedback strategies
doi_str_mv 10.1016/j.amjsurg.2020.10.014
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2451132285</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0002961020306255</els_id><sourcerecordid>2555116580</sourcerecordid><originalsourceid>FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63</originalsourceid><addsrcrecordid>eNqFkUtv1DAUha2Kqp0-fkJRJDZsMviZ8awqVBVaaVBbFdaWc31TnOYx2E5R_z0OM7Bgw8ry8XcfPoeQC0aXjLLqQ7u0fRun8LTklM_akjJ5QBZMr9Yl01q8IQtKKS_XFaPH5CTGNl8Zk-KIHAtBFaPVakGeHibb-fRajE3hPCSb0BUNoqstPBc2xhH8b-2nT9-Lx9sv95ti3GKwyb_g_I4x9jikODfYostw8FDMi3mwXZGC9QNiPCOHje0inu_PU_Lt0_XXq5tyc_f59urjpgSxFqmUEkDJtdBQSUVlTYWua9esKqcV2PwB0dQVdRy5tAqErJ2WVGkpqGaIUIlT8n7XdxvGHxPGZHofAbvODjhO0XCpGBOca5XRd_-g7TiFIW9nuFIZq5SmmVI7CsIYY8DGbIPvbXg1jJo5CdOafRJmTmKWcxK57u2--1T36P5W_bE-A5c7ALMdLx6DieBxgOxhQEjGjf4_I34B1VWciQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2555116580</pqid></control><display><type>article</type><title>Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees</title><source>ScienceDirect Freedom Collection</source><creator>Zendejas, Benjamin ; Toprak, Ayca ; Harrington, Amanda W. ; Lillehei, Craig W. ; Modi, Biren P.</creator><creatorcontrib>Zendejas, Benjamin ; Toprak, Ayca ; Harrington, Amanda W. ; Lillehei, Craig W. ; Modi, Biren P.</creatorcontrib><description>SIMPL is a workplace-based operative performance assessment tool which allows for dictated feedback (DF). To better understand the value of DF, we sought to characterize the type and quality of DF generated during SIMPL evaluations. Thematic analysis of DF from SIMPL assessments between June 2017 and December 2018 at a single pediatric surgery fellowship program was performed. Comments were categorized as specific, encouraging or corrective. Categories were combined to determine DF quality as effective, mediocre or ineffective. Of 781 SIMPL assessments (21 faculty, 5 trainees), 451 (57%) had DF. Most comments were encouraging (93%) and specific (65%). Only 21% were corrective, 17% had entrustment features, and 8% had an explicit learning plan. Feedback quality was deemed mediocre (45%), ineffective (33%) and effective (21%). SIMPL dictated feedback was mostly encouraging and specific. To improve quality, feedback should incorporate learning plans as well as corrective and entrustment features. •Dictated feedback from SIMPL assessments is predominantly encouraging and specific•Trainees prefer feedback with learning plans, corrective and entrustment features•Efforts to improve feedback quality from SIMPL assessments are needed•SIMPL rater training should incorporate teaching of effective feedback strategies</description><identifier>ISSN: 0002-9610</identifier><identifier>EISSN: 1879-1883</identifier><identifier>DOI: 10.1016/j.amjsurg.2020.10.014</identifier><identifier>PMID: 33051067</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><subject>Assessment ; Clinical Competence - standards ; Collaboration ; Employee Performance Appraisal - methods ; Entrustment ; Feedback ; Formative Feedback ; Humans ; Internship and Residency - organization &amp; administration ; Internship and Residency - standards ; Learning ; Narratives ; Pediatrics ; Pediatrics - education ; Pediatrics - standards ; Performance assessment ; Qualitative Research ; Quality ; Quality Improvement ; Specialties, Surgical - education ; Specialties, Surgical - standards ; Surgeons ; Surgery ; Surgical Procedures, Operative - education ; Surgical Procedures, Operative - standards</subject><ispartof>The American journal of surgery, 2021-02, Vol.221 (2), p.303-308</ispartof><rights>2020 Elsevier Inc.</rights><rights>Copyright © 2020 Elsevier Inc. All rights reserved.</rights><rights>2020. Elsevier Inc.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63</citedby><cites>FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63</cites><orcidid>0000-0002-1231-5283</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33051067$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Zendejas, Benjamin</creatorcontrib><creatorcontrib>Toprak, Ayca</creatorcontrib><creatorcontrib>Harrington, Amanda W.</creatorcontrib><creatorcontrib>Lillehei, Craig W.</creatorcontrib><creatorcontrib>Modi, Biren P.</creatorcontrib><title>Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees</title><title>The American journal of surgery</title><addtitle>Am J Surg</addtitle><description>SIMPL is a workplace-based operative performance assessment tool which allows for dictated feedback (DF). To better understand the value of DF, we sought to characterize the type and quality of DF generated during SIMPL evaluations. Thematic analysis of DF from SIMPL assessments between June 2017 and December 2018 at a single pediatric surgery fellowship program was performed. Comments were categorized as specific, encouraging or corrective. Categories were combined to determine DF quality as effective, mediocre or ineffective. Of 781 SIMPL assessments (21 faculty, 5 trainees), 451 (57%) had DF. Most comments were encouraging (93%) and specific (65%). Only 21% were corrective, 17% had entrustment features, and 8% had an explicit learning plan. Feedback quality was deemed mediocre (45%), ineffective (33%) and effective (21%). SIMPL dictated feedback was mostly encouraging and specific. To improve quality, feedback should incorporate learning plans as well as corrective and entrustment features. •Dictated feedback from SIMPL assessments is predominantly encouraging and specific•Trainees prefer feedback with learning plans, corrective and entrustment features•Efforts to improve feedback quality from SIMPL assessments are needed•SIMPL rater training should incorporate teaching of effective feedback strategies</description><subject>Assessment</subject><subject>Clinical Competence - standards</subject><subject>Collaboration</subject><subject>Employee Performance Appraisal - methods</subject><subject>Entrustment</subject><subject>Feedback</subject><subject>Formative Feedback</subject><subject>Humans</subject><subject>Internship and Residency - organization &amp; administration</subject><subject>Internship and Residency - standards</subject><subject>Learning</subject><subject>Narratives</subject><subject>Pediatrics</subject><subject>Pediatrics - education</subject><subject>Pediatrics - standards</subject><subject>Performance assessment</subject><subject>Qualitative Research</subject><subject>Quality</subject><subject>Quality Improvement</subject><subject>Specialties, Surgical - education</subject><subject>Specialties, Surgical - standards</subject><subject>Surgeons</subject><subject>Surgery</subject><subject>Surgical Procedures, Operative - education</subject><subject>Surgical Procedures, Operative - standards</subject><issn>0002-9610</issn><issn>1879-1883</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNqFkUtv1DAUha2Kqp0-fkJRJDZsMviZ8awqVBVaaVBbFdaWc31TnOYx2E5R_z0OM7Bgw8ry8XcfPoeQC0aXjLLqQ7u0fRun8LTklM_akjJ5QBZMr9Yl01q8IQtKKS_XFaPH5CTGNl8Zk-KIHAtBFaPVakGeHibb-fRajE3hPCSb0BUNoqstPBc2xhH8b-2nT9-Lx9sv95ti3GKwyb_g_I4x9jikODfYostw8FDMi3mwXZGC9QNiPCOHje0inu_PU_Lt0_XXq5tyc_f59urjpgSxFqmUEkDJtdBQSUVlTYWua9esKqcV2PwB0dQVdRy5tAqErJ2WVGkpqGaIUIlT8n7XdxvGHxPGZHofAbvODjhO0XCpGBOca5XRd_-g7TiFIW9nuFIZq5SmmVI7CsIYY8DGbIPvbXg1jJo5CdOafRJmTmKWcxK57u2--1T36P5W_bE-A5c7ALMdLx6DieBxgOxhQEjGjf4_I34B1VWciQ</recordid><startdate>202102</startdate><enddate>202102</enddate><creator>Zendejas, Benjamin</creator><creator>Toprak, Ayca</creator><creator>Harrington, Amanda W.</creator><creator>Lillehei, Craig W.</creator><creator>Modi, Biren P.</creator><general>Elsevier Inc</general><general>Elsevier Limited</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7QO</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8FD</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>K9.</scope><scope>M0S</scope><scope>M1P</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P64</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-1231-5283</orcidid></search><sort><creationdate>202102</creationdate><title>Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees</title><author>Zendejas, Benjamin ; Toprak, Ayca ; Harrington, Amanda W. ; Lillehei, Craig W. ; Modi, Biren P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Assessment</topic><topic>Clinical Competence - standards</topic><topic>Collaboration</topic><topic>Employee Performance Appraisal - methods</topic><topic>Entrustment</topic><topic>Feedback</topic><topic>Formative Feedback</topic><topic>Humans</topic><topic>Internship and Residency - organization &amp; administration</topic><topic>Internship and Residency - standards</topic><topic>Learning</topic><topic>Narratives</topic><topic>Pediatrics</topic><topic>Pediatrics - education</topic><topic>Pediatrics - standards</topic><topic>Performance assessment</topic><topic>Qualitative Research</topic><topic>Quality</topic><topic>Quality Improvement</topic><topic>Specialties, Surgical - education</topic><topic>Specialties, Surgical - standards</topic><topic>Surgeons</topic><topic>Surgery</topic><topic>Surgical Procedures, Operative - education</topic><topic>Surgical Procedures, Operative - standards</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zendejas, Benjamin</creatorcontrib><creatorcontrib>Toprak, Ayca</creatorcontrib><creatorcontrib>Harrington, Amanda W.</creatorcontrib><creatorcontrib>Lillehei, Craig W.</creatorcontrib><creatorcontrib>Modi, Biren P.</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Biotechnology Research Abstracts</collection><collection>ProQuest Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Technology Research Database</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>PML(ProQuest Medical Library)</collection><collection>ProQuest_Research Library</collection><collection>Research Library (Corporate)</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><jtitle>The American journal of surgery</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zendejas, Benjamin</au><au>Toprak, Ayca</au><au>Harrington, Amanda W.</au><au>Lillehei, Craig W.</au><au>Modi, Biren P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees</atitle><jtitle>The American journal of surgery</jtitle><addtitle>Am J Surg</addtitle><date>2021-02</date><risdate>2021</risdate><volume>221</volume><issue>2</issue><spage>303</spage><epage>308</epage><pages>303-308</pages><issn>0002-9610</issn><eissn>1879-1883</eissn><abstract>SIMPL is a workplace-based operative performance assessment tool which allows for dictated feedback (DF). To better understand the value of DF, we sought to characterize the type and quality of DF generated during SIMPL evaluations. Thematic analysis of DF from SIMPL assessments between June 2017 and December 2018 at a single pediatric surgery fellowship program was performed. Comments were categorized as specific, encouraging or corrective. Categories were combined to determine DF quality as effective, mediocre or ineffective. Of 781 SIMPL assessments (21 faculty, 5 trainees), 451 (57%) had DF. Most comments were encouraging (93%) and specific (65%). Only 21% were corrective, 17% had entrustment features, and 8% had an explicit learning plan. Feedback quality was deemed mediocre (45%), ineffective (33%) and effective (21%). SIMPL dictated feedback was mostly encouraging and specific. To improve quality, feedback should incorporate learning plans as well as corrective and entrustment features. •Dictated feedback from SIMPL assessments is predominantly encouraging and specific•Trainees prefer feedback with learning plans, corrective and entrustment features•Efforts to improve feedback quality from SIMPL assessments are needed•SIMPL rater training should incorporate teaching of effective feedback strategies</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>33051067</pmid><doi>10.1016/j.amjsurg.2020.10.014</doi><tpages>6</tpages><orcidid>https://orcid.org/0000-0002-1231-5283</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0002-9610
ispartof The American journal of surgery, 2021-02, Vol.221 (2), p.303-308
issn 0002-9610
1879-1883
language eng
recordid cdi_proquest_miscellaneous_2451132285
source ScienceDirect Freedom Collection
subjects Assessment
Clinical Competence - standards
Collaboration
Employee Performance Appraisal - methods
Entrustment
Feedback
Formative Feedback
Humans
Internship and Residency - organization & administration
Internship and Residency - standards
Learning
Narratives
Pediatrics
Pediatrics - education
Pediatrics - standards
Performance assessment
Qualitative Research
Quality
Quality Improvement
Specialties, Surgical - education
Specialties, Surgical - standards
Surgeons
Surgery
Surgical Procedures, Operative - education
Surgical Procedures, Operative - standards
title Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T04%3A44%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Quality%20of%20dictated%20feedback%20associated%20with%20SIMPL%20operative%20assessments%20of%20pediatric%20surgical%20trainees&rft.jtitle=The%20American%20journal%20of%20surgery&rft.au=Zendejas,%20Benjamin&rft.date=2021-02&rft.volume=221&rft.issue=2&rft.spage=303&rft.epage=308&rft.pages=303-308&rft.issn=0002-9610&rft.eissn=1879-1883&rft_id=info:doi/10.1016/j.amjsurg.2020.10.014&rft_dat=%3Cproquest_cross%3E2555116580%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c393t-44cc54938c64504b038bbdf76d85ca0003fb60d2e24a5c34bd8405843081eec63%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2555116580&rft_id=info:pmid/33051067&rfr_iscdi=true