Loading…

The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills

Competency-based medical education surgical curriculums will require frequent, recorded trainee performance evaluations. It is our hypothesis that written feedback after each operation can be used to chart surgical progress, can identify underperforming trainees, and will prove beneficial for reside...

Full description

Saved in:
Bibliographic Details
Published in:The Journal of surgical research 2019-07, Vol.239, p.261-268
Main Authors: Harriman, David, Singla, Rohit, Nguan, Christopher
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413
cites cdi_FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413
container_end_page 268
container_issue
container_start_page 261
container_title The Journal of surgical research
container_volume 239
creator Harriman, David
Singla, Rohit
Nguan, Christopher
description Competency-based medical education surgical curriculums will require frequent, recorded trainee performance evaluations. It is our hypothesis that written feedback after each operation can be used to chart surgical progress, can identify underperforming trainees, and will prove beneficial for resident learning. The resident report card (RRC) is an online, easy-to-use evaluation tool designed to facilitate the creation and distribution of resident technical assessments. RRC data were collected from urologic trainees and analyzed using ANOVA and post hoc testing to confirm our hypothesis. A standardized survey was sent to residents, gauging their views on the RRC. Over a 5-y period, 958 RRCs with the resident listed as the primary operator were collected across 29 different procedures. Resident cohort and individual performance scores stratified by postgraduate year (PGY) were shown to significantly improve when all procedures (cohort, 6.5 ± 1.9 [PGY-1] to 9.1 ± 1.0 [PGY-5]; individual [resident M], 8.8 ± 1.8 [PGY-3] to 9.4 ± 0.7 [PGY-5], P 
doi_str_mv 10.1016/j.jss.2019.02.006
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2194135264</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0022480419300836</els_id><sourcerecordid>2194135264</sourcerecordid><originalsourceid>FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413</originalsourceid><addsrcrecordid>eNp9kE1rGzEQhkVoSZyPH5BL0bGX3Y6klVbbnoJJ0kIg0LqXXIQsjYic9cqV1ob--yo47bGn-eCZF-Yh5JpBy4CpT5t2U0rLgQ0t8BZAnZAFg0E2WvXiHVkAcN50Grozcl7KBuo89OKUnAnQuhOaL8jT6hnpdyzR4zTXZpfyTJc2-8_0hq5SGmlImT7uMNs5HpDeIfq1dS_UTp7eHuy4r_s00RToCt3zFJ0d6Y-XOI7lkrwPdix49VYvyM-729Xya_PweP9tefPQOCHF3AglBBu063otAIINgUmtpQpu0CwEzhR3OMhhrVUFGGNe-R5BSi973XVMXJCPx9xdTr_2WGazjcXhONoJ074YzoZKSa66irIj6nIqJWMwuxy3Nv82DMyrUrMxVal5VWqAm6q03nx4i9-vt-j_Xfx1WIEvRwDrk4eI2RQXcXLoY0Y3G5_if-L_AKEnhG0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2194135264</pqid></control><display><type>article</type><title>The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills</title><source>ScienceDirect Freedom Collection</source><creator>Harriman, David ; Singla, Rohit ; Nguan, Christopher</creator><creatorcontrib>Harriman, David ; Singla, Rohit ; Nguan, Christopher</creatorcontrib><description>Competency-based medical education surgical curriculums will require frequent, recorded trainee performance evaluations. It is our hypothesis that written feedback after each operation can be used to chart surgical progress, can identify underperforming trainees, and will prove beneficial for resident learning. The resident report card (RRC) is an online, easy-to-use evaluation tool designed to facilitate the creation and distribution of resident technical assessments. RRC data were collected from urologic trainees and analyzed using ANOVA and post hoc testing to confirm our hypothesis. A standardized survey was sent to residents, gauging their views on the RRC. Over a 5-y period, 958 RRCs with the resident listed as the primary operator were collected across 29 different procedures. Resident cohort and individual performance scores stratified by postgraduate year (PGY) were shown to significantly improve when all procedures (cohort, 6.5 ± 1.9 [PGY-1] to 9.1 ± 1.0 [PGY-5]; individual [resident M], 8.8 ± 1.8 [PGY-3] to 9.4 ± 0.7 [PGY-5], P &lt; 0.01) and specific procedures (laparoscopic donor nephrectomy: cohort, 7.3 ± 1.3 [PGY-3] to 8.9 ± 1.0 [PGY-5]; individual [resident I], 7.2 ± 1.3 [PGY-3] to 9.5 ± 0.6 [PGY-5], P &lt; 0.01) were analyzed. Individual residents were able to be compared to their own peer group and to the average scores across all evaluated residents. Surveyed residents were overwhelmingly positive about the RRC. The RRC adds further evidence to the fact that standardized, formative, and timely assessment can capture trainee performance over time and against comparator cohorts in an acceptable format to residents and academic training programs.</description><identifier>ISSN: 0022-4804</identifier><identifier>EISSN: 1095-8673</identifier><identifier>DOI: 10.1016/j.jss.2019.02.006</identifier><identifier>PMID: 30884382</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><subject>Clinical Competence ; Cohort Studies ; Competency-Based Education - organization &amp; administration ; Competency-Based Education - standards ; Educational Measurement - methods ; Educational Measurement - standards ; Feedback ; Female ; General Surgery - education ; Humans ; Internet ; Internship and Residency - organization &amp; administration ; Internship and Residency - standards ; Male ; Operative skills ; Resident training ; Surgery ; Surgical education ; Technical assessment ; Urology</subject><ispartof>The Journal of surgical research, 2019-07, Vol.239, p.261-268</ispartof><rights>2019 Elsevier Inc.</rights><rights>Copyright © 2019 Elsevier Inc. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413</citedby><cites>FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413</cites><orcidid>0000-0002-8876-654X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/30884382$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Harriman, David</creatorcontrib><creatorcontrib>Singla, Rohit</creatorcontrib><creatorcontrib>Nguan, Christopher</creatorcontrib><title>The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills</title><title>The Journal of surgical research</title><addtitle>J Surg Res</addtitle><description>Competency-based medical education surgical curriculums will require frequent, recorded trainee performance evaluations. It is our hypothesis that written feedback after each operation can be used to chart surgical progress, can identify underperforming trainees, and will prove beneficial for resident learning. The resident report card (RRC) is an online, easy-to-use evaluation tool designed to facilitate the creation and distribution of resident technical assessments. RRC data were collected from urologic trainees and analyzed using ANOVA and post hoc testing to confirm our hypothesis. A standardized survey was sent to residents, gauging their views on the RRC. Over a 5-y period, 958 RRCs with the resident listed as the primary operator were collected across 29 different procedures. Resident cohort and individual performance scores stratified by postgraduate year (PGY) were shown to significantly improve when all procedures (cohort, 6.5 ± 1.9 [PGY-1] to 9.1 ± 1.0 [PGY-5]; individual [resident M], 8.8 ± 1.8 [PGY-3] to 9.4 ± 0.7 [PGY-5], P &lt; 0.01) and specific procedures (laparoscopic donor nephrectomy: cohort, 7.3 ± 1.3 [PGY-3] to 8.9 ± 1.0 [PGY-5]; individual [resident I], 7.2 ± 1.3 [PGY-3] to 9.5 ± 0.6 [PGY-5], P &lt; 0.01) were analyzed. Individual residents were able to be compared to their own peer group and to the average scores across all evaluated residents. Surveyed residents were overwhelmingly positive about the RRC. The RRC adds further evidence to the fact that standardized, formative, and timely assessment can capture trainee performance over time and against comparator cohorts in an acceptable format to residents and academic training programs.</description><subject>Clinical Competence</subject><subject>Cohort Studies</subject><subject>Competency-Based Education - organization &amp; administration</subject><subject>Competency-Based Education - standards</subject><subject>Educational Measurement - methods</subject><subject>Educational Measurement - standards</subject><subject>Feedback</subject><subject>Female</subject><subject>General Surgery - education</subject><subject>Humans</subject><subject>Internet</subject><subject>Internship and Residency - organization &amp; administration</subject><subject>Internship and Residency - standards</subject><subject>Male</subject><subject>Operative skills</subject><subject>Resident training</subject><subject>Surgery</subject><subject>Surgical education</subject><subject>Technical assessment</subject><subject>Urology</subject><issn>0022-4804</issn><issn>1095-8673</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNp9kE1rGzEQhkVoSZyPH5BL0bGX3Y6klVbbnoJJ0kIg0LqXXIQsjYic9cqV1ob--yo47bGn-eCZF-Yh5JpBy4CpT5t2U0rLgQ0t8BZAnZAFg0E2WvXiHVkAcN50Grozcl7KBuo89OKUnAnQuhOaL8jT6hnpdyzR4zTXZpfyTJc2-8_0hq5SGmlImT7uMNs5HpDeIfq1dS_UTp7eHuy4r_s00RToCt3zFJ0d6Y-XOI7lkrwPdix49VYvyM-729Xya_PweP9tefPQOCHF3AglBBu063otAIINgUmtpQpu0CwEzhR3OMhhrVUFGGNe-R5BSi973XVMXJCPx9xdTr_2WGazjcXhONoJ074YzoZKSa66irIj6nIqJWMwuxy3Nv82DMyrUrMxVal5VWqAm6q03nx4i9-vt-j_Xfx1WIEvRwDrk4eI2RQXcXLoY0Y3G5_if-L_AKEnhG0</recordid><startdate>201907</startdate><enddate>201907</enddate><creator>Harriman, David</creator><creator>Singla, Rohit</creator><creator>Nguan, Christopher</creator><general>Elsevier Inc</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-8876-654X</orcidid></search><sort><creationdate>201907</creationdate><title>The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills</title><author>Harriman, David ; Singla, Rohit ; Nguan, Christopher</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Clinical Competence</topic><topic>Cohort Studies</topic><topic>Competency-Based Education - organization &amp; administration</topic><topic>Competency-Based Education - standards</topic><topic>Educational Measurement - methods</topic><topic>Educational Measurement - standards</topic><topic>Feedback</topic><topic>Female</topic><topic>General Surgery - education</topic><topic>Humans</topic><topic>Internet</topic><topic>Internship and Residency - organization &amp; administration</topic><topic>Internship and Residency - standards</topic><topic>Male</topic><topic>Operative skills</topic><topic>Resident training</topic><topic>Surgery</topic><topic>Surgical education</topic><topic>Technical assessment</topic><topic>Urology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Harriman, David</creatorcontrib><creatorcontrib>Singla, Rohit</creatorcontrib><creatorcontrib>Nguan, Christopher</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>The Journal of surgical research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Harriman, David</au><au>Singla, Rohit</au><au>Nguan, Christopher</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills</atitle><jtitle>The Journal of surgical research</jtitle><addtitle>J Surg Res</addtitle><date>2019-07</date><risdate>2019</risdate><volume>239</volume><spage>261</spage><epage>268</epage><pages>261-268</pages><issn>0022-4804</issn><eissn>1095-8673</eissn><abstract>Competency-based medical education surgical curriculums will require frequent, recorded trainee performance evaluations. It is our hypothesis that written feedback after each operation can be used to chart surgical progress, can identify underperforming trainees, and will prove beneficial for resident learning. The resident report card (RRC) is an online, easy-to-use evaluation tool designed to facilitate the creation and distribution of resident technical assessments. RRC data were collected from urologic trainees and analyzed using ANOVA and post hoc testing to confirm our hypothesis. A standardized survey was sent to residents, gauging their views on the RRC. Over a 5-y period, 958 RRCs with the resident listed as the primary operator were collected across 29 different procedures. Resident cohort and individual performance scores stratified by postgraduate year (PGY) were shown to significantly improve when all procedures (cohort, 6.5 ± 1.9 [PGY-1] to 9.1 ± 1.0 [PGY-5]; individual [resident M], 8.8 ± 1.8 [PGY-3] to 9.4 ± 0.7 [PGY-5], P &lt; 0.01) and specific procedures (laparoscopic donor nephrectomy: cohort, 7.3 ± 1.3 [PGY-3] to 8.9 ± 1.0 [PGY-5]; individual [resident I], 7.2 ± 1.3 [PGY-3] to 9.5 ± 0.6 [PGY-5], P &lt; 0.01) were analyzed. Individual residents were able to be compared to their own peer group and to the average scores across all evaluated residents. Surveyed residents were overwhelmingly positive about the RRC. The RRC adds further evidence to the fact that standardized, formative, and timely assessment can capture trainee performance over time and against comparator cohorts in an acceptable format to residents and academic training programs.</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>30884382</pmid><doi>10.1016/j.jss.2019.02.006</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0002-8876-654X</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0022-4804
ispartof The Journal of surgical research, 2019-07, Vol.239, p.261-268
issn 0022-4804
1095-8673
language eng
recordid cdi_proquest_miscellaneous_2194135264
source ScienceDirect Freedom Collection
subjects Clinical Competence
Cohort Studies
Competency-Based Education - organization & administration
Competency-Based Education - standards
Educational Measurement - methods
Educational Measurement - standards
Feedback
Female
General Surgery - education
Humans
Internet
Internship and Residency - organization & administration
Internship and Residency - standards
Male
Operative skills
Resident training
Surgery
Surgical education
Technical assessment
Urology
title The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-27T01%3A37%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=The%20Resident%20Report%20Card:%20A%20Tool%20for%20Operative%20Feedback%20and%20Evaluation%20of%20Technical%20Skills&rft.jtitle=The%20Journal%20of%20surgical%20research&rft.au=Harriman,%20David&rft.date=2019-07&rft.volume=239&rft.spage=261&rft.epage=268&rft.pages=261-268&rft.issn=0022-4804&rft.eissn=1095-8673&rft_id=info:doi/10.1016/j.jss.2019.02.006&rft_dat=%3Cproquest_cross%3E2194135264%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c353t-3633198c478300faff158856fc981ff2162ce959b86830111d6d7e055d5784413%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2194135264&rft_id=info:pmid/30884382&rfr_iscdi=true