Loading…
The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation
To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings am...
Saved in:
Published in: | Clinical and experimental rheumatology 2020-07, Vol.38 Suppl 126 (4), p.180-188 |
---|---|
Main Authors: | , , , , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | 188 |
container_issue | 4 |
container_start_page | 180 |
container_title | Clinical and experimental rheumatology |
container_volume | 38 Suppl 126 |
creator | Lucchesi, Davide Pontarini, Elena Donati, Valentina Mandarano, Martina Sidoni, Angelo Bartoloni, Elena Baldini, Chiara Tappuni, Anwar R Bombardieri, Michele |
description | To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement.
Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement.
For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off.
A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation. |
format | article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_proquest_miscellaneous_2449179072</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2449179072</sourcerecordid><originalsourceid>FETCH-LOGICAL-p141t-cfd4af712cc5e51834b0cf30662b05b8e1a7c62e391770321757117d3a1b2a263</originalsourceid><addsrcrecordid>eNo1kE1OwzAQhbMA0VK4AvIONpH8k8TtElX8SZVYUCR21cSZpK6cpHicSjkYXICLYaBsZhbzvac37ySZcrWQ6Twv3ibJOdGOc1nkhT5LJkpxmc8Xcpp8rLfIBkLW16yyjQ3gmG2hQQYduJEsMduxEKGtpdC7vrEmIkCERC124Uf4svv6bDx218Ro7Crft8gInD2AH1njoKuiS7v3_QF_7AL61EOcDKIKf10iw2ow1sUEIVLt4II18eKRVRCAbcG3fWcJgu27i-S0Bkd4edyz5PX-br18TFfPD0_L21W6F5kIqamrDGotpDE55mKuspKbWvGikCXPyzkK0KaQqBZCa66k0LkWQlcKRClBFmqW3Pz5xuzvA1LYtJYMuvgS9gNtZJZF6YJrGdGrIzqULVabvY81-nHzX7X6BiPrfzs</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2449179072</pqid></control><display><type>article</type><title>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</title><source>Freely Accessible Journals</source><creator>Lucchesi, Davide ; Pontarini, Elena ; Donati, Valentina ; Mandarano, Martina ; Sidoni, Angelo ; Bartoloni, Elena ; Baldini, Chiara ; Tappuni, Anwar R ; Bombardieri, Michele</creator><creatorcontrib>Lucchesi, Davide ; Pontarini, Elena ; Donati, Valentina ; Mandarano, Martina ; Sidoni, Angelo ; Bartoloni, Elena ; Baldini, Chiara ; Tappuni, Anwar R ; Bombardieri, Michele</creatorcontrib><description>To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement.
Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement.
For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off.
A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.</description><identifier>ISSN: 0392-856X</identifier><identifier>PMID: 33025892</identifier><language>eng</language><publisher>Italy</publisher><subject>Algorithms ; Humans ; Observer Variation ; Reproducibility of Results ; Salivary Glands - diagnostic imaging ; Sjogren's Syndrome - diagnosis</subject><ispartof>Clinical and experimental rheumatology, 2020-07, Vol.38 Suppl 126 (4), p.180-188</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33025892$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Lucchesi, Davide</creatorcontrib><creatorcontrib>Pontarini, Elena</creatorcontrib><creatorcontrib>Donati, Valentina</creatorcontrib><creatorcontrib>Mandarano, Martina</creatorcontrib><creatorcontrib>Sidoni, Angelo</creatorcontrib><creatorcontrib>Bartoloni, Elena</creatorcontrib><creatorcontrib>Baldini, Chiara</creatorcontrib><creatorcontrib>Tappuni, Anwar R</creatorcontrib><creatorcontrib>Bombardieri, Michele</creatorcontrib><title>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</title><title>Clinical and experimental rheumatology</title><addtitle>Clin Exp Rheumatol</addtitle><description>To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement.
Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement.
For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off.
A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.</description><subject>Algorithms</subject><subject>Humans</subject><subject>Observer Variation</subject><subject>Reproducibility of Results</subject><subject>Salivary Glands - diagnostic imaging</subject><subject>Sjogren's Syndrome - diagnosis</subject><issn>0392-856X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNo1kE1OwzAQhbMA0VK4AvIONpH8k8TtElX8SZVYUCR21cSZpK6cpHicSjkYXICLYaBsZhbzvac37ySZcrWQ6Twv3ibJOdGOc1nkhT5LJkpxmc8Xcpp8rLfIBkLW16yyjQ3gmG2hQQYduJEsMduxEKGtpdC7vrEmIkCERC124Uf4svv6bDx218Ro7Crft8gInD2AH1njoKuiS7v3_QF_7AL61EOcDKIKf10iw2ow1sUEIVLt4II18eKRVRCAbcG3fWcJgu27i-S0Bkd4edyz5PX-br18TFfPD0_L21W6F5kIqamrDGotpDE55mKuspKbWvGikCXPyzkK0KaQqBZCa66k0LkWQlcKRClBFmqW3Pz5xuzvA1LYtJYMuvgS9gNtZJZF6YJrGdGrIzqULVabvY81-nHzX7X6BiPrfzs</recordid><startdate>202007</startdate><enddate>202007</enddate><creator>Lucchesi, Davide</creator><creator>Pontarini, Elena</creator><creator>Donati, Valentina</creator><creator>Mandarano, Martina</creator><creator>Sidoni, Angelo</creator><creator>Bartoloni, Elena</creator><creator>Baldini, Chiara</creator><creator>Tappuni, Anwar R</creator><creator>Bombardieri, Michele</creator><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>7X8</scope></search><sort><creationdate>202007</creationdate><title>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</title><author>Lucchesi, Davide ; Pontarini, Elena ; Donati, Valentina ; Mandarano, Martina ; Sidoni, Angelo ; Bartoloni, Elena ; Baldini, Chiara ; Tappuni, Anwar R ; Bombardieri, Michele</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p141t-cfd4af712cc5e51834b0cf30662b05b8e1a7c62e391770321757117d3a1b2a263</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Humans</topic><topic>Observer Variation</topic><topic>Reproducibility of Results</topic><topic>Salivary Glands - diagnostic imaging</topic><topic>Sjogren's Syndrome - diagnosis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lucchesi, Davide</creatorcontrib><creatorcontrib>Pontarini, Elena</creatorcontrib><creatorcontrib>Donati, Valentina</creatorcontrib><creatorcontrib>Mandarano, Martina</creatorcontrib><creatorcontrib>Sidoni, Angelo</creatorcontrib><creatorcontrib>Bartoloni, Elena</creatorcontrib><creatorcontrib>Baldini, Chiara</creatorcontrib><creatorcontrib>Tappuni, Anwar R</creatorcontrib><creatorcontrib>Bombardieri, Michele</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>MEDLINE - Academic</collection><jtitle>Clinical and experimental rheumatology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lucchesi, Davide</au><au>Pontarini, Elena</au><au>Donati, Valentina</au><au>Mandarano, Martina</au><au>Sidoni, Angelo</au><au>Bartoloni, Elena</au><au>Baldini, Chiara</au><au>Tappuni, Anwar R</au><au>Bombardieri, Michele</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation</atitle><jtitle>Clinical and experimental rheumatology</jtitle><addtitle>Clin Exp Rheumatol</addtitle><date>2020-07</date><risdate>2020</risdate><volume>38 Suppl 126</volume><issue>4</issue><spage>180</spage><epage>188</epage><pages>180-188</pages><issn>0392-856X</issn><abstract>To assess whether the use of digital image analysis (DIA) in primary Sjögren's syndrome (pSS) for the calculation of the total area of the salivary gland (SG), focus score (FS) and SG area occupied by the inflammatory infiltrate (area fraction, AF), was able to generate reproducible readings among different raters, reducing disagreement.
Haematoxylin and Eosin digital slides from pSS and non-specific chronic sialadenitis (NSCS) patients were analysed blindly by 4 independent raters among 3 centres. Using an open-source software (QuPath) raters were asked to provide the total area of the gland i) using a grid-based method and ii) a software-based area-calculation tool, iii) the number of inflammatory foci and iv) the total area of the inflammatory infiltrate. Collected data was used to calculate the inter-rater agreement.
For the calculation of the total SG area, DIA generated higher agreement among raters than grid-based calculation (inter-class correlation coefficient ICC=0.85 vs 0.98). Agreement for calculated total area of the inflammatory infiltrate (ICC=0.94) and for AF (ICC=0.94) was higher than infiltrates count number (ICC=0.54) and FS (ICC=0.56). AF achieved a 30% improvement over the FS at generating consensus among raters when used as a diagnostic cut-off.
A digital approach achieved a far superior inter-rater agreement when calculating the total area compared to a grid-based approach. The calculation of AF proved superior to FS in correctly classifying pSS vs NSCS biopsies. We suggest that digitally calculated AF should be used alongside FS for large multi-centre studies to improve data harmonisation.</abstract><cop>Italy</cop><pmid>33025892</pmid><tpages>9</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0392-856X |
ispartof | Clinical and experimental rheumatology, 2020-07, Vol.38 Suppl 126 (4), p.180-188 |
issn | 0392-856X |
language | eng |
recordid | cdi_proquest_miscellaneous_2449179072 |
source | Freely Accessible Journals |
subjects | Algorithms Humans Observer Variation Reproducibility of Results Salivary Glands - diagnostic imaging Sjogren's Syndrome - diagnosis |
title | The use of digital image analysis in the histological assessment of Sjögren's syndrome salivary glands improves inter-rater agreement and facilitates multicentre data harmonisation |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T14%3A36%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=The%20use%20of%20digital%20image%20analysis%20in%20the%20histological%20assessment%20of%20Sj%C3%B6gren's%20syndrome%20salivary%20glands%20improves%20inter-rater%20agreement%20and%20facilitates%20multicentre%20data%20harmonisation&rft.jtitle=Clinical%20and%20experimental%20rheumatology&rft.au=Lucchesi,%20Davide&rft.date=2020-07&rft.volume=38%20Suppl%20126&rft.issue=4&rft.spage=180&rft.epage=188&rft.pages=180-188&rft.issn=0392-856X&rft_id=info:doi/&rft_dat=%3Cproquest_pubme%3E2449179072%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-p141t-cfd4af712cc5e51834b0cf30662b05b8e1a7c62e391770321757117d3a1b2a263%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2449179072&rft_id=info:pmid/33025892&rfr_iscdi=true |