Loading…

Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version

To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores. This study had three s...

Full description

Saved in:
Bibliographic Details
Published in:Trends in psychiatry and psychotherapy 2019-07, Vol.41 (3), p.218-226
Main Authors: Pacífico, Maria Clara, de Paula, Cristiane Silvestre, Namur, Victor Santos, Lowenthal, Rosane, Bosa, Cleonice Alves, Teixeira, Maria Cristina Triguero Veloz
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3
cites cdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3
container_end_page 226
container_issue 3
container_start_page 218
container_title Trends in psychiatry and psychotherapy
container_volume 41
creator Pacífico, Maria Clara
de Paula, Cristiane Silvestre
Namur, Victor Santos
Lowenthal, Rosane
Bosa, Cleonice Alves
Teixeira, Maria Cristina Triguero Veloz
description To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores. This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument. The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas. We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.
doi_str_mv 10.1590/2237-6089-2018-0063
format article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_ec513ccddf514fe5b5c2bbcde000ce54</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><scielo_id>S2237_60892019000300218</scielo_id><doaj_id>oai_doaj_org_article_ec513ccddf514fe5b5c2bbcde000ce54</doaj_id><sourcerecordid>2308523169</sourcerecordid><originalsourceid>FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</originalsourceid><addsrcrecordid>eNpdUttq3DAUNKWlCWm-oFAEfUmhTnWz1u7bNuklENjAts9Clo43WmRrI8kL6Qf2uyqvk6VULxJHM6M5mlMUbwm-JFWDP1HKFqXAdVNSTOoSY8FeFKe5Op1J8_JwnhEnxXmMW5xXLcQC49fFCSOCc9Hg0-LPXQBnezuo8Ihgbw0MGpDvULoHtFfOGpse0S54DTE-15djsrFH11ZtBh-T1WjVRgh7lawf0FrfgxkdoIvl9Wr94TNKQQ3RHS4_Ih18jKUeXRqDckgZtUszTw0GRejVMAnCw2jz8_-6-RLUb-usGtCdD2ncjBCzRQgxk98UrzrlIpw_7WfFr29ff179KG9X32-ulrel5jVLZYsB04VQtBPA-QKaqq2AKE1Jg01XixY3AlpKOq5a00EFlC80CKW7zihcG3ZW3My6xqut3AXb53-TXll5KPiwkSpk_w4k6IowrY3pKsKzVltp2rbaQA5CQ8Wz1uWsFbUF5-XWj2HI5uV6ik5O0eVsmwxnGFNSZ8LFTMhxPOTuk-xt1OCcGsCPUVKG64rmbJsMff8f9KieAQRzxmuRUWxGHUIJ0B07IlhOYyaPTuQ0ZnIas8x696Q9tj2YI-d5qNhfiBPP3g</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2311043486</pqid></control><display><type>article</type><title>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</title><source>Publicly Available Content Database</source><source>SciELO</source><creator>Pacífico, Maria Clara ; de Paula, Cristiane Silvestre ; Namur, Victor Santos ; Lowenthal, Rosane ; Bosa, Cleonice Alves ; Teixeira, Maria Cristina Triguero Veloz</creator><creatorcontrib>Pacífico, Maria Clara ; de Paula, Cristiane Silvestre ; Namur, Victor Santos ; Lowenthal, Rosane ; Bosa, Cleonice Alves ; Teixeira, Maria Cristina Triguero Veloz</creatorcontrib><description>To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores. This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument. The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas. We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.</description><identifier>ISSN: 2237-6089</identifier><identifier>ISSN: 2238-0019</identifier><identifier>EISSN: 2238-0019</identifier><identifier>DOI: 10.1590/2237-6089-2018-0063</identifier><identifier>PMID: 31644690</identifier><language>eng</language><publisher>Brazil: Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy</publisher><subject>Autism ; Autism Diagnostic Observation Schedule ; Autism spectrum disorder ; Autistic Disorder - diagnosis ; Brazil ; Cross-Cultural Comparison ; cultural adaptation ; Humans ; Kappa coefficient ; Language ; Medical diagnosis ; Mental health ; Observer Variation ; Portugal ; PSYCHIATRY ; Psychometrics ; Reproducibility of Results ; Semantics ; Translation ; Translations</subject><ispartof>Trends in psychiatry and psychotherapy, 2019-07, Vol.41 (3), p.218-226</ispartof><rights>Copyright Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy 2019</rights><rights>This work is licensed under a Creative Commons Attribution 4.0 International License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</citedby><cites>FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</cites><orcidid>0000-0002-6096-8414</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2311043486?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,24149,25752,27923,27924,37011,37012,44589</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/31644690$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Pacífico, Maria Clara</creatorcontrib><creatorcontrib>de Paula, Cristiane Silvestre</creatorcontrib><creatorcontrib>Namur, Victor Santos</creatorcontrib><creatorcontrib>Lowenthal, Rosane</creatorcontrib><creatorcontrib>Bosa, Cleonice Alves</creatorcontrib><creatorcontrib>Teixeira, Maria Cristina Triguero Veloz</creatorcontrib><title>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</title><title>Trends in psychiatry and psychotherapy</title><addtitle>Trends Psychiatry Psychother</addtitle><description>To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores. This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument. The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas. We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.</description><subject>Autism</subject><subject>Autism Diagnostic Observation Schedule</subject><subject>Autism spectrum disorder</subject><subject>Autistic Disorder - diagnosis</subject><subject>Brazil</subject><subject>Cross-Cultural Comparison</subject><subject>cultural adaptation</subject><subject>Humans</subject><subject>Kappa coefficient</subject><subject>Language</subject><subject>Medical diagnosis</subject><subject>Mental health</subject><subject>Observer Variation</subject><subject>Portugal</subject><subject>PSYCHIATRY</subject><subject>Psychometrics</subject><subject>Reproducibility of Results</subject><subject>Semantics</subject><subject>Translation</subject><subject>Translations</subject><issn>2237-6089</issn><issn>2238-0019</issn><issn>2238-0019</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNpdUttq3DAUNKWlCWm-oFAEfUmhTnWz1u7bNuklENjAts9Clo43WmRrI8kL6Qf2uyqvk6VULxJHM6M5mlMUbwm-JFWDP1HKFqXAdVNSTOoSY8FeFKe5Op1J8_JwnhEnxXmMW5xXLcQC49fFCSOCc9Hg0-LPXQBnezuo8Ihgbw0MGpDvULoHtFfOGpse0S54DTE-15djsrFH11ZtBh-T1WjVRgh7lawf0FrfgxkdoIvl9Wr94TNKQQ3RHS4_Ih18jKUeXRqDckgZtUszTw0GRejVMAnCw2jz8_-6-RLUb-usGtCdD2ncjBCzRQgxk98UrzrlIpw_7WfFr29ff179KG9X32-ulrel5jVLZYsB04VQtBPA-QKaqq2AKE1Jg01XixY3AlpKOq5a00EFlC80CKW7zihcG3ZW3My6xqut3AXb53-TXll5KPiwkSpk_w4k6IowrY3pKsKzVltp2rbaQA5CQ8Wz1uWsFbUF5-XWj2HI5uV6ik5O0eVsmwxnGFNSZ8LFTMhxPOTuk-xt1OCcGsCPUVKG64rmbJsMff8f9KieAQRzxmuRUWxGHUIJ0B07IlhOYyaPTuQ0ZnIas8x696Q9tj2YI-d5qNhfiBPP3g</recordid><startdate>20190701</startdate><enddate>20190701</enddate><creator>Pacífico, Maria Clara</creator><creator>de Paula, Cristiane Silvestre</creator><creator>Namur, Victor Santos</creator><creator>Lowenthal, Rosane</creator><creator>Bosa, Cleonice Alves</creator><creator>Teixeira, Maria Cristina Triguero Veloz</creator><general>Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy</general><general>Associação de Psiquiatria do Rio Grande do Sul</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7TK</scope><scope>7TS</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>88G</scope><scope>8AO</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CLZPN</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>K9.</scope><scope>KB0</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>M2O</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>PADUT</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>7X8</scope><scope>GPN</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-6096-8414</orcidid></search><sort><creationdate>20190701</creationdate><title>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</title><author>Pacífico, Maria Clara ; de Paula, Cristiane Silvestre ; Namur, Victor Santos ; Lowenthal, Rosane ; Bosa, Cleonice Alves ; Teixeira, Maria Cristina Triguero Veloz</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Autism</topic><topic>Autism Diagnostic Observation Schedule</topic><topic>Autism spectrum disorder</topic><topic>Autistic Disorder - diagnosis</topic><topic>Brazil</topic><topic>Cross-Cultural Comparison</topic><topic>cultural adaptation</topic><topic>Humans</topic><topic>Kappa coefficient</topic><topic>Language</topic><topic>Medical diagnosis</topic><topic>Mental health</topic><topic>Observer Variation</topic><topic>Portugal</topic><topic>PSYCHIATRY</topic><topic>Psychometrics</topic><topic>Reproducibility of Results</topic><topic>Semantics</topic><topic>Translation</topic><topic>Translations</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pacífico, Maria Clara</creatorcontrib><creatorcontrib>de Paula, Cristiane Silvestre</creatorcontrib><creatorcontrib>Namur, Victor Santos</creatorcontrib><creatorcontrib>Lowenthal, Rosane</creatorcontrib><creatorcontrib>Bosa, Cleonice Alves</creatorcontrib><creatorcontrib>Teixeira, Maria Cristina Triguero Veloz</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Nursing and Allied Health Journals</collection><collection>Neurosciences Abstracts</collection><collection>Physical Education Index</collection><collection>ProQuest Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>ProQuest Pharma Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Latin America &amp; Iberia Database</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Psychology Database (ProQuest)</collection><collection>ProQuest research library</collection><collection>Research Library (Corporate)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Research Library China</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>SciELO</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Trends in psychiatry and psychotherapy</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pacífico, Maria Clara</au><au>de Paula, Cristiane Silvestre</au><au>Namur, Victor Santos</au><au>Lowenthal, Rosane</au><au>Bosa, Cleonice Alves</au><au>Teixeira, Maria Cristina Triguero Veloz</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</atitle><jtitle>Trends in psychiatry and psychotherapy</jtitle><addtitle>Trends Psychiatry Psychother</addtitle><date>2019-07-01</date><risdate>2019</risdate><volume>41</volume><issue>3</issue><spage>218</spage><epage>226</epage><pages>218-226</pages><issn>2237-6089</issn><issn>2238-0019</issn><eissn>2238-0019</eissn><abstract>To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores. This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument. The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas. We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.</abstract><cop>Brazil</cop><pub>Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy</pub><pmid>31644690</pmid><doi>10.1590/2237-6089-2018-0063</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-6096-8414</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2237-6089
ispartof Trends in psychiatry and psychotherapy, 2019-07, Vol.41 (3), p.218-226
issn 2237-6089
2238-0019
2238-0019
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_ec513ccddf514fe5b5c2bbcde000ce54
source Publicly Available Content Database; SciELO
subjects Autism
Autism Diagnostic Observation Schedule
Autism spectrum disorder
Autistic Disorder - diagnosis
Brazil
Cross-Cultural Comparison
cultural adaptation
Humans
Kappa coefficient
Language
Medical diagnosis
Mental health
Observer Variation
Portugal
PSYCHIATRY
Psychometrics
Reproducibility of Results
Semantics
Translation
Translations
title Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T16%3A12%3A15IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Preliminary%20evidence%20of%20the%20validity%20process%20of%20the%20Autism%20Diagnostic%20Observation%20Schedule%20(ADOS):%20translation,%20cross-cultural%20adaptation%20and%20semantic%20equivalence%20of%20the%20Brazilian%20Portuguese%20version&rft.jtitle=Trends%20in%20psychiatry%20and%20psychotherapy&rft.au=Pac%C3%ADfico,%20Maria%20Clara&rft.date=2019-07-01&rft.volume=41&rft.issue=3&rft.spage=218&rft.epage=226&rft.pages=218-226&rft.issn=2237-6089&rft.eissn=2238-0019&rft_id=info:doi/10.1590/2237-6089-2018-0063&rft_dat=%3Cproquest_doaj_%3E2308523169%3C/proquest_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2311043486&rft_id=info:pmid/31644690&rft_scielo_id=S2237_60892019000300218&rfr_iscdi=true