Loading…

The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation

To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings am...

Full description

Saved in:
Bibliographic Details
Published in:Clinical and experimental rheumatology 2020-07, Vol.38 Suppl 126 (4), p.180-188
Main Authors: Lucchesi, Davide, Pontarini, Elena, Donati, Valentina, Mandarano, Martina, Sidoni, Angelo, Bartoloni, Elena, Baldini, Chiara, Tappuni, Anwar R, Bombardieri, Michele
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page 188
container_issue 4
container_start_page 180
container_title Clinical and experimental rheumatology
container_volume 38 Suppl 126
creator Lucchesi, Davide
Pontarini, Elena
Donati, Valentina
Mandarano, Martina
Sidoni, Angelo
Bartoloni, Elena
Baldini, Chiara
Tappuni, Anwar R
Bombardieri, Michele
description To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement. Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement. For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off. A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_proquest_miscellaneous_2449179072</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2449179072</sourcerecordid><originalsourceid>FETCH-LOGICAL-p141t-cfd4af712cc5e51834b0cf30662b05b8e1a7c62e391770321757117d3a1b2a263</originalsourceid><addsrcrecordid>eNo1kE1OwzAQhbMA0VK4AvIONpH8k8TtElX8SZVYUCR21cSZpK6cpHicSjkYXICLYaBsZhbzvac37ySZcrWQ6Twv3ibJOdGOc1nkhT5LJkpxmc8Xcpp8rLfIBkLW16yyjQ3gmG2hQQYduJEsMduxEKGtpdC7vrEmIkCERC124Uf4svv6bDx218Ro7Crft8gInD2AH1njoKuiS7v3_QF_7AL61EOcDKIKf10iw2ow1sUEIVLt4II18eKRVRCAbcG3fWcJgu27i-S0Bkd4edyz5PX-br18TFfPD0_L21W6F5kIqamrDGotpDE55mKuspKbWvGikCXPyzkK0KaQqBZCa66k0LkWQlcKRClBFmqW3Pz5xuzvA1LYtJYMuvgS9gNtZJZF6YJrGdGrIzqULVabvY81-nHzX7X6BiPrfzs</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2449179072</pqid></control><display><type>article</type><title>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</title><source>Freely Accessible Journals</source><creator>Lucchesi, Davide ; Pontarini, Elena ; Donati, Valentina ; Mandarano, Martina ; Sidoni, Angelo ; Bartoloni, Elena ; Baldini, Chiara ; Tappuni, Anwar R ; Bombardieri, Michele</creator><creatorcontrib>Lucchesi, Davide ; Pontarini, Elena ; Donati, Valentina ; Mandarano, Martina ; Sidoni, Angelo ; Bartoloni, Elena ; Baldini, Chiara ; Tappuni, Anwar R ; Bombardieri, Michele</creatorcontrib><description>To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement. Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement. For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off. A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.</description><identifier>ISSN: 0392-856X</identifier><identifier>PMID: 33025892</identifier><language>eng</language><publisher>Italy</publisher><subject>Algorithms ; Humans ; Observer Variation ; Reproducibility of Results ; Salivary Glands - diagnostic imaging ; Sjogren's Syndrome - diagnosis</subject><ispartof>Clinical and experimental rheumatology, 2020-07, Vol.38 Suppl 126 (4), p.180-188</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33025892$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Lucchesi, Davide</creatorcontrib><creatorcontrib>Pontarini, Elena</creatorcontrib><creatorcontrib>Donati, Valentina</creatorcontrib><creatorcontrib>Mandarano, Martina</creatorcontrib><creatorcontrib>Sidoni, Angelo</creatorcontrib><creatorcontrib>Bartoloni, Elena</creatorcontrib><creatorcontrib>Baldini, Chiara</creatorcontrib><creatorcontrib>Tappuni, Anwar R</creatorcontrib><creatorcontrib>Bombardieri, Michele</creatorcontrib><title>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</title><title>Clinical and experimental rheumatology</title><addtitle>Clin Exp Rheumatol</addtitle><description>To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement. Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement. For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off. A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.</description><subject>Algorithms</subject><subject>Humans</subject><subject>Observer Variation</subject><subject>Reproducibility of Results</subject><subject>Salivary Glands - diagnostic imaging</subject><subject>Sjogren's Syndrome - diagnosis</subject><issn>0392-856X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNo1kE1OwzAQhbMA0VK4AvIONpH8k8TtElX8SZVYUCR21cSZpK6cpHicSjkYXICLYaBsZhbzvac37ySZcrWQ6Twv3ibJOdGOc1nkhT5LJkpxmc8Xcpp8rLfIBkLW16yyjQ3gmG2hQQYduJEsMduxEKGtpdC7vrEmIkCERC124Uf4svv6bDx218Ro7Crft8gInD2AH1njoKuiS7v3_QF_7AL61EOcDKIKf10iw2ow1sUEIVLt4II18eKRVRCAbcG3fWcJgu27i-S0Bkd4edyz5PX-br18TFfPD0_L21W6F5kIqamrDGotpDE55mKuspKbWvGikCXPyzkK0KaQqBZCa66k0LkWQlcKRClBFmqW3Pz5xuzvA1LYtJYMuvgS9gNtZJZF6YJrGdGrIzqULVabvY81-nHzX7X6BiPrfzs</recordid><startdate>202007</startdate><enddate>202007</enddate><creator>Lucchesi, Davide</creator><creator>Pontarini, Elena</creator><creator>Donati, Valentina</creator><creator>Mandarano, Martina</creator><creator>Sidoni, Angelo</creator><creator>Bartoloni, Elena</creator><creator>Baldini, Chiara</creator><creator>Tappuni, Anwar R</creator><creator>Bombardieri, Michele</creator><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>7X8</scope></search><sort><creationdate>202007</creationdate><title>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</title><author>Lucchesi, Davide ; Pontarini, Elena ; Donati, Valentina ; Mandarano, Martina ; Sidoni, Angelo ; Bartoloni, Elena ; Baldini, Chiara ; Tappuni, Anwar R ; Bombardieri, Michele</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p141t-cfd4af712cc5e51834b0cf30662b05b8e1a7c62e391770321757117d3a1b2a263</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Humans</topic><topic>Observer Variation</topic><topic>Reproducibility of Results</topic><topic>Salivary Glands - diagnostic imaging</topic><topic>Sjogren's Syndrome - diagnosis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lucchesi, Davide</creatorcontrib><creatorcontrib>Pontarini, Elena</creatorcontrib><creatorcontrib>Donati, Valentina</creatorcontrib><creatorcontrib>Mandarano, Martina</creatorcontrib><creatorcontrib>Sidoni, Angelo</creatorcontrib><creatorcontrib>Bartoloni, Elena</creatorcontrib><creatorcontrib>Baldini, Chiara</creatorcontrib><creatorcontrib>Tappuni, Anwar R</creatorcontrib><creatorcontrib>Bombardieri, Michele</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>MEDLINE - Academic</collection><jtitle>Clinical and experimental rheumatology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lucchesi, Davide</au><au>Pontarini, Elena</au><au>Donati, Valentina</au><au>Mandarano, Martina</au><au>Sidoni, Angelo</au><au>Bartoloni, Elena</au><au>Baldini, Chiara</au><au>Tappuni, Anwar R</au><au>Bombardieri, Michele</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</atitle><jtitle>Clinical and experimental rheumatology</jtitle><addtitle>Clin Exp Rheumatol</addtitle><date>2020-07</date><risdate>2020</risdate><volume>38 Suppl 126</volume><issue>4</issue><spage>180</spage><epage>188</epage><pages>180-188</pages><issn>0392-856X</issn><abstract>To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement. Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement. For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off. A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.</abstract><cop>Italy</cop><pmid>33025892</pmid><tpages>9</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0392-856X
ispartof Clinical and experimental rheumatology, 2020-07, Vol.38 Suppl 126 (4), p.180-188
issn 0392-856X
language eng
recordid cdi_proquest_miscellaneous_2449179072
source Freely Accessible Journals
subjects Algorithms
Humans
Observer Variation
Reproducibility of Results
Salivary Glands - diagnostic imaging
Sjogren's Syndrome - diagnosis
title The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T14%3A36%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=The%20use%20of%20digital%20image%20analysis%20in%20the%20histological%20assessment%20of%20Sj%C3%B6gren's%20syndrome%20salivary%20glands%20improves%20inter-rater%20agreement%20and%20facilitates%20multicentre%20data%20harmonisation&rft.jtitle=Clinical%20and%20experimental%20rheumatology&rft.au=Lucchesi,%20Davide&rft.date=2020-07&rft.volume=38%20Suppl%20126&rft.issue=4&rft.spage=180&rft.epage=188&rft.pages=180-188&rft.issn=0392-856X&rft_id=info:doi/&rft_dat=%3Cproquest_pubme%3E2449179072%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-p141t-cfd4af712cc5e51834b0cf30662b05b8e1a7c62e391770321757117d3a1b2a263%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2449179072&rft_id=info:pmid/33025892&rfr_iscdi=true