Loading…
Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version
To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores. This study had three s...
Saved in:
Published in: | Trends in psychiatry and psychotherapy 2019-07, Vol.41 (3), p.218-226 |
---|---|
Main Authors: | , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3 |
---|---|
cites | cdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3 |
container_end_page | 226 |
container_issue | 3 |
container_start_page | 218 |
container_title | Trends in psychiatry and psychotherapy |
container_volume | 41 |
creator | Pacífico, Maria Clara de Paula, Cristiane Silvestre Namur, Victor Santos Lowenthal, Rosane Bosa, Cleonice Alves Teixeira, Maria Cristina Triguero Veloz |
description | To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores.
This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument.
The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas.
We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country. |
doi_str_mv | 10.1590/2237-6089-2018-0063 |
format | article |
fullrecord | <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_ec513ccddf514fe5b5c2bbcde000ce54</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><scielo_id>S2237_60892019000300218</scielo_id><doaj_id>oai_doaj_org_article_ec513ccddf514fe5b5c2bbcde000ce54</doaj_id><sourcerecordid>2308523169</sourcerecordid><originalsourceid>FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</originalsourceid><addsrcrecordid>eNpdUttq3DAUNKWlCWm-oFAEfUmhTnWz1u7bNuklENjAts9Clo43WmRrI8kL6Qf2uyqvk6VULxJHM6M5mlMUbwm-JFWDP1HKFqXAdVNSTOoSY8FeFKe5Op1J8_JwnhEnxXmMW5xXLcQC49fFCSOCc9Hg0-LPXQBnezuo8Ihgbw0MGpDvULoHtFfOGpse0S54DTE-15djsrFH11ZtBh-T1WjVRgh7lawf0FrfgxkdoIvl9Wr94TNKQQ3RHS4_Ih18jKUeXRqDckgZtUszTw0GRejVMAnCw2jz8_-6-RLUb-usGtCdD2ncjBCzRQgxk98UrzrlIpw_7WfFr29ff179KG9X32-ulrel5jVLZYsB04VQtBPA-QKaqq2AKE1Jg01XixY3AlpKOq5a00EFlC80CKW7zihcG3ZW3My6xqut3AXb53-TXll5KPiwkSpk_w4k6IowrY3pKsKzVltp2rbaQA5CQ8Wz1uWsFbUF5-XWj2HI5uV6ik5O0eVsmwxnGFNSZ8LFTMhxPOTuk-xt1OCcGsCPUVKG64rmbJsMff8f9KieAQRzxmuRUWxGHUIJ0B07IlhOYyaPTuQ0ZnIas8x696Q9tj2YI-d5qNhfiBPP3g</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2311043486</pqid></control><display><type>article</type><title>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</title><source>Publicly Available Content Database</source><source>SciELO</source><creator>Pacífico, Maria Clara ; de Paula, Cristiane Silvestre ; Namur, Victor Santos ; Lowenthal, Rosane ; Bosa, Cleonice Alves ; Teixeira, Maria Cristina Triguero Veloz</creator><creatorcontrib>Pacífico, Maria Clara ; de Paula, Cristiane Silvestre ; Namur, Victor Santos ; Lowenthal, Rosane ; Bosa, Cleonice Alves ; Teixeira, Maria Cristina Triguero Veloz</creatorcontrib><description>To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores.
This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument.
The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas.
We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.</description><identifier>ISSN: 2237-6089</identifier><identifier>ISSN: 2238-0019</identifier><identifier>EISSN: 2238-0019</identifier><identifier>DOI: 10.1590/2237-6089-2018-0063</identifier><identifier>PMID: 31644690</identifier><language>eng</language><publisher>Brazil: Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy</publisher><subject>Autism ; Autism Diagnostic Observation Schedule ; Autism spectrum disorder ; Autistic Disorder - diagnosis ; Brazil ; Cross-Cultural Comparison ; cultural adaptation ; Humans ; Kappa coefficient ; Language ; Medical diagnosis ; Mental health ; Observer Variation ; Portugal ; PSYCHIATRY ; Psychometrics ; Reproducibility of Results ; Semantics ; Translation ; Translations</subject><ispartof>Trends in psychiatry and psychotherapy, 2019-07, Vol.41 (3), p.218-226</ispartof><rights>Copyright Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy 2019</rights><rights>This work is licensed under a Creative Commons Attribution 4.0 International License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</citedby><cites>FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</cites><orcidid>0000-0002-6096-8414</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2311043486?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,24149,25752,27923,27924,37011,37012,44589</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/31644690$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Pacífico, Maria Clara</creatorcontrib><creatorcontrib>de Paula, Cristiane Silvestre</creatorcontrib><creatorcontrib>Namur, Victor Santos</creatorcontrib><creatorcontrib>Lowenthal, Rosane</creatorcontrib><creatorcontrib>Bosa, Cleonice Alves</creatorcontrib><creatorcontrib>Teixeira, Maria Cristina Triguero Veloz</creatorcontrib><title>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</title><title>Trends in psychiatry and psychotherapy</title><addtitle>Trends Psychiatry Psychother</addtitle><description>To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores.
This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument.
The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas.
We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.</description><subject>Autism</subject><subject>Autism Diagnostic Observation Schedule</subject><subject>Autism spectrum disorder</subject><subject>Autistic Disorder - diagnosis</subject><subject>Brazil</subject><subject>Cross-Cultural Comparison</subject><subject>cultural adaptation</subject><subject>Humans</subject><subject>Kappa coefficient</subject><subject>Language</subject><subject>Medical diagnosis</subject><subject>Mental health</subject><subject>Observer Variation</subject><subject>Portugal</subject><subject>PSYCHIATRY</subject><subject>Psychometrics</subject><subject>Reproducibility of Results</subject><subject>Semantics</subject><subject>Translation</subject><subject>Translations</subject><issn>2237-6089</issn><issn>2238-0019</issn><issn>2238-0019</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNpdUttq3DAUNKWlCWm-oFAEfUmhTnWz1u7bNuklENjAts9Clo43WmRrI8kL6Qf2uyqvk6VULxJHM6M5mlMUbwm-JFWDP1HKFqXAdVNSTOoSY8FeFKe5Op1J8_JwnhEnxXmMW5xXLcQC49fFCSOCc9Hg0-LPXQBnezuo8Ihgbw0MGpDvULoHtFfOGpse0S54DTE-15djsrFH11ZtBh-T1WjVRgh7lawf0FrfgxkdoIvl9Wr94TNKQQ3RHS4_Ih18jKUeXRqDckgZtUszTw0GRejVMAnCw2jz8_-6-RLUb-usGtCdD2ncjBCzRQgxk98UrzrlIpw_7WfFr29ff179KG9X32-ulrel5jVLZYsB04VQtBPA-QKaqq2AKE1Jg01XixY3AlpKOq5a00EFlC80CKW7zihcG3ZW3My6xqut3AXb53-TXll5KPiwkSpk_w4k6IowrY3pKsKzVltp2rbaQA5CQ8Wz1uWsFbUF5-XWj2HI5uV6ik5O0eVsmwxnGFNSZ8LFTMhxPOTuk-xt1OCcGsCPUVKG64rmbJsMff8f9KieAQRzxmuRUWxGHUIJ0B07IlhOYyaPTuQ0ZnIas8x696Q9tj2YI-d5qNhfiBPP3g</recordid><startdate>20190701</startdate><enddate>20190701</enddate><creator>Pacífico, Maria Clara</creator><creator>de Paula, Cristiane Silvestre</creator><creator>Namur, Victor Santos</creator><creator>Lowenthal, Rosane</creator><creator>Bosa, Cleonice Alves</creator><creator>Teixeira, Maria Cristina Triguero Veloz</creator><general>Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy</general><general>Associação de Psiquiatria do Rio Grande do Sul</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7TK</scope><scope>7TS</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>88G</scope><scope>8AO</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CLZPN</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>K9.</scope><scope>KB0</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>M2O</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>PADUT</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>7X8</scope><scope>GPN</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-6096-8414</orcidid></search><sort><creationdate>20190701</creationdate><title>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</title><author>Pacífico, Maria Clara ; de Paula, Cristiane Silvestre ; Namur, Victor Santos ; Lowenthal, Rosane ; Bosa, Cleonice Alves ; Teixeira, Maria Cristina Triguero Veloz</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Autism</topic><topic>Autism Diagnostic Observation Schedule</topic><topic>Autism spectrum disorder</topic><topic>Autistic Disorder - diagnosis</topic><topic>Brazil</topic><topic>Cross-Cultural Comparison</topic><topic>cultural adaptation</topic><topic>Humans</topic><topic>Kappa coefficient</topic><topic>Language</topic><topic>Medical diagnosis</topic><topic>Mental health</topic><topic>Observer Variation</topic><topic>Portugal</topic><topic>PSYCHIATRY</topic><topic>Psychometrics</topic><topic>Reproducibility of Results</topic><topic>Semantics</topic><topic>Translation</topic><topic>Translations</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pacífico, Maria Clara</creatorcontrib><creatorcontrib>de Paula, Cristiane Silvestre</creatorcontrib><creatorcontrib>Namur, Victor Santos</creatorcontrib><creatorcontrib>Lowenthal, Rosane</creatorcontrib><creatorcontrib>Bosa, Cleonice Alves</creatorcontrib><creatorcontrib>Teixeira, Maria Cristina Triguero Veloz</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Nursing and Allied Health Journals</collection><collection>Neurosciences Abstracts</collection><collection>Physical Education Index</collection><collection>ProQuest Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>ProQuest Pharma Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Latin America & Iberia Database</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Psychology Database (ProQuest)</collection><collection>ProQuest research library</collection><collection>Research Library (Corporate)</collection><collection>Nursing & Allied Health Premium</collection><collection>Research Library China</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>SciELO</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Trends in psychiatry and psychotherapy</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pacífico, Maria Clara</au><au>de Paula, Cristiane Silvestre</au><au>Namur, Victor Santos</au><au>Lowenthal, Rosane</au><au>Bosa, Cleonice Alves</au><au>Teixeira, Maria Cristina Triguero Veloz</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version</atitle><jtitle>Trends in psychiatry and psychotherapy</jtitle><addtitle>Trends Psychiatry Psychother</addtitle><date>2019-07-01</date><risdate>2019</risdate><volume>41</volume><issue>3</issue><spage>218</spage><epage>226</epage><pages>218-226</pages><issn>2237-6089</issn><issn>2238-0019</issn><eissn>2238-0019</eissn><abstract>To translate and back-translate the Autism Diagnostic Observation Schedule (ADOS) into Brazilian Portuguese, to assess its cross-cultural semantic equivalence, and to verify indicators of quality of the final version by analyzing the inter-rater reliability of the ADOS scores.
This study had three stages: 1) translation and back-translation; 2) semantic equivalence analysis; and 3) pre-test to verify the agreement between mental health specialists and an ADOS senior examiner regarding the scoring procedure. Authorization to translate and carry out the cultural adaptation of the instrument was first obtained from the Western Psychological Services, publishers of the instrument.
The main preliminary results pointed to good equivalence between the original English version and the final version and the Brazilian version following the cultural adaptation process. Some semantic differences were found between the original version and the back-translation into English, but they did not interfere with the first translation into Portuguese or into the final version. One of the limitations of the study was the small sample size; for that reason, the inter-rater reliability of the ADOS scores between the specialists and the senior examiner using the kappa coefficient was adequate for 7 out of 10 areas.
We conclude that the creation of an official Brazilian version of ADOS will help to strengthen clinical and scientific research into ASD, and deter the use of other unauthorized versions of ADOS in the country.</abstract><cop>Brazil</cop><pub>Associação de Psiquiatria do Rio Grande do Sul - Trends in Psychiatry and Psychotherapy</pub><pmid>31644690</pmid><doi>10.1590/2237-6089-2018-0063</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-6096-8414</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2237-6089 |
ispartof | Trends in psychiatry and psychotherapy, 2019-07, Vol.41 (3), p.218-226 |
issn | 2237-6089 2238-0019 2238-0019 |
language | eng |
recordid | cdi_doaj_primary_oai_doaj_org_article_ec513ccddf514fe5b5c2bbcde000ce54 |
source | Publicly Available Content Database; SciELO |
subjects | Autism Autism Diagnostic Observation Schedule Autism spectrum disorder Autistic Disorder - diagnosis Brazil Cross-Cultural Comparison cultural adaptation Humans Kappa coefficient Language Medical diagnosis Mental health Observer Variation Portugal PSYCHIATRY Psychometrics Reproducibility of Results Semantics Translation Translations |
title | Preliminary evidence of the validity process of the Autism Diagnostic Observation Schedule (ADOS): translation, cross-cultural adaptation and semantic equivalence of the Brazilian Portuguese version |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T16%3A12%3A15IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Preliminary%20evidence%20of%20the%20validity%20process%20of%20the%20Autism%20Diagnostic%20Observation%20Schedule%20(ADOS):%20translation,%20cross-cultural%20adaptation%20and%20semantic%20equivalence%20of%20the%20Brazilian%20Portuguese%20version&rft.jtitle=Trends%20in%20psychiatry%20and%20psychotherapy&rft.au=Pac%C3%ADfico,%20Maria%20Clara&rft.date=2019-07-01&rft.volume=41&rft.issue=3&rft.spage=218&rft.epage=226&rft.pages=218-226&rft.issn=2237-6089&rft.eissn=2238-0019&rft_id=info:doi/10.1590/2237-6089-2018-0063&rft_dat=%3Cproquest_doaj_%3E2308523169%3C/proquest_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c483t-b0e0276a2f6e447e95b5e1ac2190df86b096eb21f4abdfe5e247ce6acffda08d3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2311043486&rft_id=info:pmid/31644690&rft_scielo_id=S2237_60892019000300218&rfr_iscdi=true |