Loading…

Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists

Endoscopic outcomes are increasingly used in clinical trials and in routine practice for inflammatory bowel disease [IBD] in order to reach more objective patient evaluations than possible using only clinical features. However, reproducibility of endoscopic scoring systems used to categorize endosco...

Full description

Saved in:
Bibliographic Details
Published in:Journal of Crohn's and colitis 2017-05, Vol.11 (5), p.556
Main Authors: Daperno, Marco, Comberlato, Michele, Bossa, Fabrizio, Armuzzi, Alessandro, Biancone, Livia, Bonanomi, Andrea G, Cassinotti, Andrea, Cosintino, Rocco, Lombardi, Giovanni, Mangiarotti, Roberto, Papa, Alfredo, Pica, Roberta, Grassano, Luca, Pagana, Guido, D'Incà, Renata, Orlando, Ambrogio, Rizzello, Fernando
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue 5
container_start_page 556
container_title Journal of Crohn's and colitis
container_volume 11
creator Daperno, Marco
Comberlato, Michele
Bossa, Fabrizio
Armuzzi, Alessandro
Biancone, Livia
Bonanomi, Andrea G
Cassinotti, Andrea
Cosintino, Rocco
Lombardi, Giovanni
Mangiarotti, Roberto
Papa, Alfredo
Pica, Roberta
Grassano, Luca
Pagana, Guido
D'Incà, Renata
Orlando, Ambrogio
Rizzello, Fernando
description Endoscopic outcomes are increasingly used in clinical trials and in routine practice for inflammatory bowel disease [IBD] in order to reach more objective patient evaluations than possible using only clinical features. However, reproducibility of endoscopic scoring systems used to categorize endoscopic activity has been reported to be suboptimal. The aim of this study was to analyse the inter-rated agreement of non-dedicated gastroenterologists on IBD endoscopic scoring systems, and to explore the effects of a dedicated training programme on agreement. A total of 237 physicians attended training courses on IBD endoscopic scoring systems, and they independently scored a set of IBD endoscopic videos for ulcerative colitis [with Mayo endoscopic subscore], post-operative Crohn's disease [with Rutgeerts score] and luminal Crohn's disease (with the Simple Endoscopic Score for Crohn's Disease [SESCD] and Crohn's Endoscopic Index of Severity [CDEIS]). A second round of scoring was collected after discussion about determinants of discrepancy. Interobserver agreement was measured by means of the Fleiss' kappa [kappa] or intraclass correlation coefficient [ICC] as appropriate. The inter-rater agreement increased from kappa 0.51 (95% confidence interval [95% CI] 0.48-0.55) to 0.76 [95% CI 0.72-0.79] for the Mayo endoscopic subscore, and from 0.45 [95% CI 0.40-0.50] to 0.79 [0.74-0.83] for the Rutgeerts score before and after the training programme, respectively, and both differences were significant [P < 0.0001]. The ICC was 0.77 [95% CI 0.56-0.96] for SESCD and 0.76 [0.54- 0.96] for CDEIS, respectively, with only one measurement. The basal inter-rater agreement of inexperienced gastroenterologists focused on IBD management is moderate; however, a dedicated training programme can significantly impact on inter-rater agreement, increasing it to levels expected among expert central reviewers.
doi_str_mv 10.1093/ecco-jcc/jjw181
format article
fullrecord <record><control><sourceid>pubmed</sourceid><recordid>TN_cdi_pubmed_primary_28453758</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>28453758</sourcerecordid><originalsourceid>FETCH-LOGICAL-p108t-3f0545da1a3644e185e8e388a8c3f8bece6f1c0e03b9047e944fb5cb628c48853</originalsourceid><addsrcrecordid>eNo1kNFKwzAUhoMgbk6vvZO8QF2yJG16Oeecg4HC5vVIs9OS0iQliY69kw9pnXp1Dnzffw78CN1R8kBJyaagtc9aradte6SSXqAxlUWecV6UI3QdY0uIKEUhr9BoJrlghZBj9LULyjjjGvwWfBOUjdg7vHQHH7XvjcZb7cMP3p5igoHWPuC1qztlrUo-nPCjP0KHn0wEFQFvQB1w8ljhrWmcqY1WLg0BHc7YuGFPEHwVIXxCwPMmAFgYnLn1w5uFt_bDmXTCKxVT8HC2O9-YmOINuqxVF-H2b07Q-_Nyt3jJNq-r9WK-yXpKZMpYTQQXB0UVyzkHKgVIYFIqqVktK9CQ11QTIKwqCS-g5LyuhK7ymdRcSsEm6P73bv9RWTjs-2CsCqf9f23sG3Z9dAo</addsrcrecordid><sourcetype>Index Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists</title><source>Oxford Journals Online</source><creator>Daperno, Marco ; Comberlato, Michele ; Bossa, Fabrizio ; Armuzzi, Alessandro ; Biancone, Livia ; Bonanomi, Andrea G ; Cassinotti, Andrea ; Cosintino, Rocco ; Lombardi, Giovanni ; Mangiarotti, Roberto ; Papa, Alfredo ; Pica, Roberta ; Grassano, Luca ; Pagana, Guido ; D'Incà, Renata ; Orlando, Ambrogio ; Rizzello, Fernando</creator><creatorcontrib>Daperno, Marco ; Comberlato, Michele ; Bossa, Fabrizio ; Armuzzi, Alessandro ; Biancone, Livia ; Bonanomi, Andrea G ; Cassinotti, Andrea ; Cosintino, Rocco ; Lombardi, Giovanni ; Mangiarotti, Roberto ; Papa, Alfredo ; Pica, Roberta ; Grassano, Luca ; Pagana, Guido ; D'Incà, Renata ; Orlando, Ambrogio ; Rizzello, Fernando ; IGIBDEndo Group</creatorcontrib><description>Endoscopic outcomes are increasingly used in clinical trials and in routine practice for inflammatory bowel disease [IBD] in order to reach more objective patient evaluations than possible using only clinical features. However, reproducibility of endoscopic scoring systems used to categorize endoscopic activity has been reported to be suboptimal. The aim of this study was to analyse the inter-rated agreement of non-dedicated gastroenterologists on IBD endoscopic scoring systems, and to explore the effects of a dedicated training programme on agreement. A total of 237 physicians attended training courses on IBD endoscopic scoring systems, and they independently scored a set of IBD endoscopic videos for ulcerative colitis [with Mayo endoscopic subscore], post-operative Crohn's disease [with Rutgeerts score] and luminal Crohn's disease (with the Simple Endoscopic Score for Crohn's Disease [SESCD] and Crohn's Endoscopic Index of Severity [CDEIS]). A second round of scoring was collected after discussion about determinants of discrepancy. Interobserver agreement was measured by means of the Fleiss' kappa [kappa] or intraclass correlation coefficient [ICC] as appropriate. The inter-rater agreement increased from kappa 0.51 (95% confidence interval [95% CI] 0.48-0.55) to 0.76 [95% CI 0.72-0.79] for the Mayo endoscopic subscore, and from 0.45 [95% CI 0.40-0.50] to 0.79 [0.74-0.83] for the Rutgeerts score before and after the training programme, respectively, and both differences were significant [P &lt; 0.0001]. The ICC was 0.77 [95% CI 0.56-0.96] for SESCD and 0.76 [0.54- 0.96] for CDEIS, respectively, with only one measurement. The basal inter-rater agreement of inexperienced gastroenterologists focused on IBD management is moderate; however, a dedicated training programme can significantly impact on inter-rater agreement, increasing it to levels expected among expert central reviewers.</description><identifier>EISSN: 1876-4479</identifier><identifier>DOI: 10.1093/ecco-jcc/jjw181</identifier><identifier>PMID: 28453758</identifier><language>eng</language><publisher>England</publisher><subject>Colitis, Ulcerative - diagnosis ; Colitis, Ulcerative - pathology ; Colonoscopy - education ; Crohn Disease - diagnosis ; Crohn Disease - pathology ; Education, Medical, Continuing - methods ; Gastroenterologists - education ; Gastroenterologists - statistics &amp; numerical data ; Humans ; Inflammatory Bowel Diseases - diagnosis ; Inflammatory Bowel Diseases - pathology ; Observer Variation</subject><ispartof>Journal of Crohn's and colitis, 2017-05, Vol.11 (5), p.556</ispartof><rights>Copyright © 2016 European Crohn’s and Colitis Organisation (ECCO). Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28453758$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Daperno, Marco</creatorcontrib><creatorcontrib>Comberlato, Michele</creatorcontrib><creatorcontrib>Bossa, Fabrizio</creatorcontrib><creatorcontrib>Armuzzi, Alessandro</creatorcontrib><creatorcontrib>Biancone, Livia</creatorcontrib><creatorcontrib>Bonanomi, Andrea G</creatorcontrib><creatorcontrib>Cassinotti, Andrea</creatorcontrib><creatorcontrib>Cosintino, Rocco</creatorcontrib><creatorcontrib>Lombardi, Giovanni</creatorcontrib><creatorcontrib>Mangiarotti, Roberto</creatorcontrib><creatorcontrib>Papa, Alfredo</creatorcontrib><creatorcontrib>Pica, Roberta</creatorcontrib><creatorcontrib>Grassano, Luca</creatorcontrib><creatorcontrib>Pagana, Guido</creatorcontrib><creatorcontrib>D'Incà, Renata</creatorcontrib><creatorcontrib>Orlando, Ambrogio</creatorcontrib><creatorcontrib>Rizzello, Fernando</creatorcontrib><creatorcontrib>IGIBDEndo Group</creatorcontrib><title>Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists</title><title>Journal of Crohn's and colitis</title><addtitle>J Crohns Colitis</addtitle><description>Endoscopic outcomes are increasingly used in clinical trials and in routine practice for inflammatory bowel disease [IBD] in order to reach more objective patient evaluations than possible using only clinical features. However, reproducibility of endoscopic scoring systems used to categorize endoscopic activity has been reported to be suboptimal. The aim of this study was to analyse the inter-rated agreement of non-dedicated gastroenterologists on IBD endoscopic scoring systems, and to explore the effects of a dedicated training programme on agreement. A total of 237 physicians attended training courses on IBD endoscopic scoring systems, and they independently scored a set of IBD endoscopic videos for ulcerative colitis [with Mayo endoscopic subscore], post-operative Crohn's disease [with Rutgeerts score] and luminal Crohn's disease (with the Simple Endoscopic Score for Crohn's Disease [SESCD] and Crohn's Endoscopic Index of Severity [CDEIS]). A second round of scoring was collected after discussion about determinants of discrepancy. Interobserver agreement was measured by means of the Fleiss' kappa [kappa] or intraclass correlation coefficient [ICC] as appropriate. The inter-rater agreement increased from kappa 0.51 (95% confidence interval [95% CI] 0.48-0.55) to 0.76 [95% CI 0.72-0.79] for the Mayo endoscopic subscore, and from 0.45 [95% CI 0.40-0.50] to 0.79 [0.74-0.83] for the Rutgeerts score before and after the training programme, respectively, and both differences were significant [P &lt; 0.0001]. The ICC was 0.77 [95% CI 0.56-0.96] for SESCD and 0.76 [0.54- 0.96] for CDEIS, respectively, with only one measurement. The basal inter-rater agreement of inexperienced gastroenterologists focused on IBD management is moderate; however, a dedicated training programme can significantly impact on inter-rater agreement, increasing it to levels expected among expert central reviewers.</description><subject>Colitis, Ulcerative - diagnosis</subject><subject>Colitis, Ulcerative - pathology</subject><subject>Colonoscopy - education</subject><subject>Crohn Disease - diagnosis</subject><subject>Crohn Disease - pathology</subject><subject>Education, Medical, Continuing - methods</subject><subject>Gastroenterologists - education</subject><subject>Gastroenterologists - statistics &amp; numerical data</subject><subject>Humans</subject><subject>Inflammatory Bowel Diseases - diagnosis</subject><subject>Inflammatory Bowel Diseases - pathology</subject><subject>Observer Variation</subject><issn>1876-4479</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><recordid>eNo1kNFKwzAUhoMgbk6vvZO8QF2yJG16Oeecg4HC5vVIs9OS0iQliY69kw9pnXp1Dnzffw78CN1R8kBJyaagtc9aradte6SSXqAxlUWecV6UI3QdY0uIKEUhr9BoJrlghZBj9LULyjjjGvwWfBOUjdg7vHQHH7XvjcZb7cMP3p5igoHWPuC1qztlrUo-nPCjP0KHn0wEFQFvQB1w8ljhrWmcqY1WLg0BHc7YuGFPEHwVIXxCwPMmAFgYnLn1w5uFt_bDmXTCKxVT8HC2O9-YmOINuqxVF-H2b07Q-_Nyt3jJNq-r9WK-yXpKZMpYTQQXB0UVyzkHKgVIYFIqqVktK9CQ11QTIKwqCS-g5LyuhK7ymdRcSsEm6P73bv9RWTjs-2CsCqf9f23sG3Z9dAo</recordid><startdate>20170501</startdate><enddate>20170501</enddate><creator>Daperno, Marco</creator><creator>Comberlato, Michele</creator><creator>Bossa, Fabrizio</creator><creator>Armuzzi, Alessandro</creator><creator>Biancone, Livia</creator><creator>Bonanomi, Andrea G</creator><creator>Cassinotti, Andrea</creator><creator>Cosintino, Rocco</creator><creator>Lombardi, Giovanni</creator><creator>Mangiarotti, Roberto</creator><creator>Papa, Alfredo</creator><creator>Pica, Roberta</creator><creator>Grassano, Luca</creator><creator>Pagana, Guido</creator><creator>D'Incà, Renata</creator><creator>Orlando, Ambrogio</creator><creator>Rizzello, Fernando</creator><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope></search><sort><creationdate>20170501</creationdate><title>Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists</title><author>Daperno, Marco ; Comberlato, Michele ; Bossa, Fabrizio ; Armuzzi, Alessandro ; Biancone, Livia ; Bonanomi, Andrea G ; Cassinotti, Andrea ; Cosintino, Rocco ; Lombardi, Giovanni ; Mangiarotti, Roberto ; Papa, Alfredo ; Pica, Roberta ; Grassano, Luca ; Pagana, Guido ; D'Incà, Renata ; Orlando, Ambrogio ; Rizzello, Fernando</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p108t-3f0545da1a3644e185e8e388a8c3f8bece6f1c0e03b9047e944fb5cb628c48853</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Colitis, Ulcerative - diagnosis</topic><topic>Colitis, Ulcerative - pathology</topic><topic>Colonoscopy - education</topic><topic>Crohn Disease - diagnosis</topic><topic>Crohn Disease - pathology</topic><topic>Education, Medical, Continuing - methods</topic><topic>Gastroenterologists - education</topic><topic>Gastroenterologists - statistics &amp; numerical data</topic><topic>Humans</topic><topic>Inflammatory Bowel Diseases - diagnosis</topic><topic>Inflammatory Bowel Diseases - pathology</topic><topic>Observer Variation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Daperno, Marco</creatorcontrib><creatorcontrib>Comberlato, Michele</creatorcontrib><creatorcontrib>Bossa, Fabrizio</creatorcontrib><creatorcontrib>Armuzzi, Alessandro</creatorcontrib><creatorcontrib>Biancone, Livia</creatorcontrib><creatorcontrib>Bonanomi, Andrea G</creatorcontrib><creatorcontrib>Cassinotti, Andrea</creatorcontrib><creatorcontrib>Cosintino, Rocco</creatorcontrib><creatorcontrib>Lombardi, Giovanni</creatorcontrib><creatorcontrib>Mangiarotti, Roberto</creatorcontrib><creatorcontrib>Papa, Alfredo</creatorcontrib><creatorcontrib>Pica, Roberta</creatorcontrib><creatorcontrib>Grassano, Luca</creatorcontrib><creatorcontrib>Pagana, Guido</creatorcontrib><creatorcontrib>D'Incà, Renata</creatorcontrib><creatorcontrib>Orlando, Ambrogio</creatorcontrib><creatorcontrib>Rizzello, Fernando</creatorcontrib><creatorcontrib>IGIBDEndo Group</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><jtitle>Journal of Crohn's and colitis</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Daperno, Marco</au><au>Comberlato, Michele</au><au>Bossa, Fabrizio</au><au>Armuzzi, Alessandro</au><au>Biancone, Livia</au><au>Bonanomi, Andrea G</au><au>Cassinotti, Andrea</au><au>Cosintino, Rocco</au><au>Lombardi, Giovanni</au><au>Mangiarotti, Roberto</au><au>Papa, Alfredo</au><au>Pica, Roberta</au><au>Grassano, Luca</au><au>Pagana, Guido</au><au>D'Incà, Renata</au><au>Orlando, Ambrogio</au><au>Rizzello, Fernando</au><aucorp>IGIBDEndo Group</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists</atitle><jtitle>Journal of Crohn's and colitis</jtitle><addtitle>J Crohns Colitis</addtitle><date>2017-05-01</date><risdate>2017</risdate><volume>11</volume><issue>5</issue><spage>556</spage><pages>556-</pages><eissn>1876-4479</eissn><abstract>Endoscopic outcomes are increasingly used in clinical trials and in routine practice for inflammatory bowel disease [IBD] in order to reach more objective patient evaluations than possible using only clinical features. However, reproducibility of endoscopic scoring systems used to categorize endoscopic activity has been reported to be suboptimal. The aim of this study was to analyse the inter-rated agreement of non-dedicated gastroenterologists on IBD endoscopic scoring systems, and to explore the effects of a dedicated training programme on agreement. A total of 237 physicians attended training courses on IBD endoscopic scoring systems, and they independently scored a set of IBD endoscopic videos for ulcerative colitis [with Mayo endoscopic subscore], post-operative Crohn's disease [with Rutgeerts score] and luminal Crohn's disease (with the Simple Endoscopic Score for Crohn's Disease [SESCD] and Crohn's Endoscopic Index of Severity [CDEIS]). A second round of scoring was collected after discussion about determinants of discrepancy. Interobserver agreement was measured by means of the Fleiss' kappa [kappa] or intraclass correlation coefficient [ICC] as appropriate. The inter-rater agreement increased from kappa 0.51 (95% confidence interval [95% CI] 0.48-0.55) to 0.76 [95% CI 0.72-0.79] for the Mayo endoscopic subscore, and from 0.45 [95% CI 0.40-0.50] to 0.79 [0.74-0.83] for the Rutgeerts score before and after the training programme, respectively, and both differences were significant [P &lt; 0.0001]. The ICC was 0.77 [95% CI 0.56-0.96] for SESCD and 0.76 [0.54- 0.96] for CDEIS, respectively, with only one measurement. The basal inter-rater agreement of inexperienced gastroenterologists focused on IBD management is moderate; however, a dedicated training programme can significantly impact on inter-rater agreement, increasing it to levels expected among expert central reviewers.</abstract><cop>England</cop><pmid>28453758</pmid><doi>10.1093/ecco-jcc/jjw181</doi></addata></record>
fulltext fulltext
identifier EISSN: 1876-4479
ispartof Journal of Crohn's and colitis, 2017-05, Vol.11 (5), p.556
issn 1876-4479
language eng
recordid cdi_pubmed_primary_28453758
source Oxford Journals Online
subjects Colitis, Ulcerative - diagnosis
Colitis, Ulcerative - pathology
Colonoscopy - education
Crohn Disease - diagnosis
Crohn Disease - pathology
Education, Medical, Continuing - methods
Gastroenterologists - education
Gastroenterologists - statistics & numerical data
Humans
Inflammatory Bowel Diseases - diagnosis
Inflammatory Bowel Diseases - pathology
Observer Variation
title Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T11%3A47%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-pubmed&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Training%20Programs%20on%20Endoscopic%20Scoring%20Systems%20for%20Inflammatory%20Bowel%20Disease%20Lead%20to%20a%20Significant%20Increase%20in%20Interobserver%20Agreement%20Among%20Community%20Gastroenterologists&rft.jtitle=Journal%20of%20Crohn's%20and%20colitis&rft.au=Daperno,%20Marco&rft.aucorp=IGIBDEndo%20Group&rft.date=2017-05-01&rft.volume=11&rft.issue=5&rft.spage=556&rft.pages=556-&rft.eissn=1876-4479&rft_id=info:doi/10.1093/ecco-jcc/jjw181&rft_dat=%3Cpubmed%3E28453758%3C/pubmed%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-p108t-3f0545da1a3644e185e8e388a8c3f8bece6f1c0e03b9047e944fb5cb628c48853%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/28453758&rfr_iscdi=true