Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives

We outline essential considerations for any study of partial randomisation of research funding, and consider scenarios in which randomised controlled trials (RCTs) would be feasible and appropriate. We highlight the interdependence of target outcomes, sample availability and statistical power for de...

Full description

Saved in:
Bibliographic Details
Published in:Wellcome open research 2023, Vol.8, p.309
Main Authors: Stafford, Tom, Rombach, Ines, Hind, Dan, Mateen, Bilal, Woods, Helen Buckley, Dimario, Munya, Wilsdon, James
Format: Article
Language:English
Subjects:
eng
experiments
lottery
metaresearch
metascience
Review
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c3471-35b33404eb1d12726f38eec4f9a4f767c5b49407a6efc3824b43c1994b583c6f3
container_end_page
container_issue
container_start_page 309
container_title Wellcome open research
container_volume 8
creator Stafford, Tom
Rombach, Ines
Hind, Dan
Mateen, Bilal
Woods, Helen Buckley
Dimario, Munya
Wilsdon, James
description We outline essential considerations for any study of partial randomisation of research funding, and consider scenarios in which randomised controlled trials (RCTs) would be feasible and appropriate. We highlight the interdependence of target outcomes, sample availability and statistical power for determining the cost and feasibility of a trial. For many choices of target outcome, RCTs may be less practical and more expensive than they at first appear (in large part due to issues pertaining to sample size and statistical power). As such, we briefly discuss alternatives to RCTs. It is worth noting that many of the considerations relevant to experiments on partial randomisation may also apply to other potential experiments on funding processes (as described in The Experimental Research Funder's Handbook. RoRI, June 2022).
doi_str_mv 10.12688/wellcomeopenres.19565.1
format article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_c510a75e15804fd39ff72d1f53049db1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><doaj_id>oai_doaj_org_article_c510a75e15804fd39ff72d1f53049db1</doaj_id><sourcerecordid>2860617863</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3471-35b33404eb1d12726f38eec4f9a4f767c5b49407a6efc3824b43c1994b583c6f3</originalsourceid><addsrcrecordid>eNpdkUtrWzEQhS-hJQlp_kLRshu7ekt3FYrpIxAoFJdkJyTdka1wLbnSddr8-8p2GpKuJDTnfDOj03WI4DmhUuuPv2Ecfd5A3kIqUOekF1LMyUl3TlmvZwLTuzcv7mfdZa33GGOiJdUan3ZnTEnJVC_PO3e7hgIowZ8JhVzQ1pYp2hEVm4a8idVOMSeUA2qNwBa_RmGXhphWV2i5BhTA1ujiGKfHvejHYllRcyI7TlBSMz9Afde9DXascPl0XnQ_v3xeLr7Nbr5_vV58upl5xhWZMeEY45iDIwOhisrANIDnobc8KKm8cLznWFkJwTNNuePMk77nTmjmm_qiuz5yh2zvzbbEjS2PJttoDg-5rMx-OT-C8YJgqwQQoTEPA-tDUHQgQTDM-8GRxro6srY7t4HBQ5qKHV9BX1dSXJtVfjAEc8UZ043w4YlQ8q8d1Mm03_QtOZsg76qhWmJJlJasSfVR6kuutUB47kOwOURu_ovcHCI3-znfv5zz2fgvYPYXU3iuUQ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2860617863</pqid></control><display><type>article</type><title>Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives</title><source>PubMed Central</source><creator>Stafford, Tom ; Rombach, Ines ; Hind, Dan ; Mateen, Bilal ; Woods, Helen Buckley ; Dimario, Munya ; Wilsdon, James</creator><creatorcontrib>Stafford, Tom ; Rombach, Ines ; Hind, Dan ; Mateen, Bilal ; Woods, Helen Buckley ; Dimario, Munya ; Wilsdon, James</creatorcontrib><description>We outline essential considerations for any study of partial randomisation of research funding, and consider scenarios in which randomised controlled trials (RCTs) would be feasible and appropriate. We highlight the interdependence of target outcomes, sample availability and statistical power for determining the cost and feasibility of a trial. For many choices of target outcome, RCTs may be less practical and more expensive than they at first appear (in large part due to issues pertaining to sample size and statistical power). As such, we briefly discuss alternatives to RCTs. It is worth noting that many of the considerations relevant to experiments on partial randomisation may also apply to other potential experiments on funding processes (as described in The Experimental Research Funder's Handbook. RoRI, June 2022).</description><identifier>ISSN: 2398-502X</identifier><identifier>EISSN: 2398-502X</identifier><identifier>DOI: 10.12688/wellcomeopenres.19565.1</identifier><identifier>PMID: 37663796</identifier><language>eng</language><publisher>England: F1000 Research Limited</publisher><subject>eng ; experiments ; lottery ; metaresearch ; metascience ; Review</subject><ispartof>Wellcome open research, 2023, Vol.8, p.309</ispartof><rights>Copyright: © 2023 Stafford T et al.</rights><rights>Copyright: © 2023 Stafford T et al. 2023</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c3471-35b33404eb1d12726f38eec4f9a4f767c5b49407a6efc3824b43c1994b583c6f3</cites><orcidid>0000-0002-8089-9479 ; 0000-0003-4423-6472 ; 0000-0002-5395-5949</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474338/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474338/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,4024,27923,27924,27925,53791,53793</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37663796$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Stafford, Tom</creatorcontrib><creatorcontrib>Rombach, Ines</creatorcontrib><creatorcontrib>Hind, Dan</creatorcontrib><creatorcontrib>Mateen, Bilal</creatorcontrib><creatorcontrib>Woods, Helen Buckley</creatorcontrib><creatorcontrib>Dimario, Munya</creatorcontrib><creatorcontrib>Wilsdon, James</creatorcontrib><title>Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives</title><title>Wellcome open research</title><addtitle>Wellcome Open Res</addtitle><description>We outline essential considerations for any study of partial randomisation of research funding, and consider scenarios in which randomised controlled trials (RCTs) would be feasible and appropriate. We highlight the interdependence of target outcomes, sample availability and statistical power for determining the cost and feasibility of a trial. For many choices of target outcome, RCTs may be less practical and more expensive than they at first appear (in large part due to issues pertaining to sample size and statistical power). As such, we briefly discuss alternatives to RCTs. It is worth noting that many of the considerations relevant to experiments on partial randomisation may also apply to other potential experiments on funding processes (as described in The Experimental Research Funder's Handbook. RoRI, June 2022).</description><subject>eng</subject><subject>experiments</subject><subject>lottery</subject><subject>metaresearch</subject><subject>metascience</subject><subject>Review</subject><issn>2398-502X</issn><issn>2398-502X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>DOA</sourceid><recordid>eNpdkUtrWzEQhS-hJQlp_kLRshu7ekt3FYrpIxAoFJdkJyTdka1wLbnSddr8-8p2GpKuJDTnfDOj03WI4DmhUuuPv2Ecfd5A3kIqUOekF1LMyUl3TlmvZwLTuzcv7mfdZa33GGOiJdUan3ZnTEnJVC_PO3e7hgIowZ8JhVzQ1pYp2hEVm4a8idVOMSeUA2qNwBa_RmGXhphWV2i5BhTA1ujiGKfHvejHYllRcyI7TlBSMz9Afde9DXascPl0XnQ_v3xeLr7Nbr5_vV58upl5xhWZMeEY45iDIwOhisrANIDnobc8KKm8cLznWFkJwTNNuePMk77nTmjmm_qiuz5yh2zvzbbEjS2PJttoDg-5rMx-OT-C8YJgqwQQoTEPA-tDUHQgQTDM-8GRxro6srY7t4HBQ5qKHV9BX1dSXJtVfjAEc8UZ043w4YlQ8q8d1Mm03_QtOZsg76qhWmJJlJasSfVR6kuutUB47kOwOURu_ovcHCI3-znfv5zz2fgvYPYXU3iuUQ</recordid><startdate>2023</startdate><enddate>2023</enddate><creator>Stafford, Tom</creator><creator>Rombach, Ines</creator><creator>Hind, Dan</creator><creator>Mateen, Bilal</creator><creator>Woods, Helen Buckley</creator><creator>Dimario, Munya</creator><creator>Wilsdon, James</creator><general>F1000 Research Limited</general><general>Wellcome</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-8089-9479</orcidid><orcidid>https://orcid.org/0000-0003-4423-6472</orcidid><orcidid>https://orcid.org/0000-0002-5395-5949</orcidid></search><sort><creationdate>2023</creationdate><title>Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives</title><author>Stafford, Tom ; Rombach, Ines ; Hind, Dan ; Mateen, Bilal ; Woods, Helen Buckley ; Dimario, Munya ; Wilsdon, James</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3471-35b33404eb1d12726f38eec4f9a4f767c5b49407a6efc3824b43c1994b583c6f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>eng</topic><topic>experiments</topic><topic>lottery</topic><topic>metaresearch</topic><topic>metascience</topic><topic>Review</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Stafford, Tom</creatorcontrib><creatorcontrib>Rombach, Ines</creatorcontrib><creatorcontrib>Hind, Dan</creatorcontrib><creatorcontrib>Mateen, Bilal</creatorcontrib><creatorcontrib>Woods, Helen Buckley</creatorcontrib><creatorcontrib>Dimario, Munya</creatorcontrib><creatorcontrib>Wilsdon, James</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Wellcome open research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Stafford, Tom</au><au>Rombach, Ines</au><au>Hind, Dan</au><au>Mateen, Bilal</au><au>Woods, Helen Buckley</au><au>Dimario, Munya</au><au>Wilsdon, James</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives</atitle><jtitle>Wellcome open research</jtitle><addtitle>Wellcome Open Res</addtitle><date>2023</date><risdate>2023</risdate><volume>8</volume><spage>309</spage><pages>309-</pages><issn>2398-502X</issn><eissn>2398-502X</eissn><abstract>We outline essential considerations for any study of partial randomisation of research funding, and consider scenarios in which randomised controlled trials (RCTs) would be feasible and appropriate. We highlight the interdependence of target outcomes, sample availability and statistical power for determining the cost and feasibility of a trial. For many choices of target outcome, RCTs may be less practical and more expensive than they at first appear (in large part due to issues pertaining to sample size and statistical power). As such, we briefly discuss alternatives to RCTs. It is worth noting that many of the considerations relevant to experiments on partial randomisation may also apply to other potential experiments on funding processes (as described in The Experimental Research Funder's Handbook. RoRI, June 2022).</abstract><cop>England</cop><pub>F1000 Research Limited</pub><pmid>37663796</pmid><doi>10.12688/wellcomeopenres.19565.1</doi><orcidid>https://orcid.org/0000-0002-8089-9479</orcidid><orcidid>https://orcid.org/0000-0003-4423-6472</orcidid><orcidid>https://orcid.org/0000-0002-5395-5949</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2398-502X
ispartof Wellcome open research, 2023, Vol.8, p.309
issn 2398-502X
2398-502X
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_c510a75e15804fd39ff72d1f53049db1
source PubMed Central
subjects eng
experiments
lottery
metaresearch
metascience
Review
title Where next for partial randomisation of research funding? The feasibility of RCTs and alternatives
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T04%3A46%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Where%20next%20for%20partial%20randomisation%20of%20research%20funding?%20The%20feasibility%20of%20RCTs%20and%20alternatives&rft.jtitle=Wellcome%20open%20research&rft.au=Stafford,%20Tom&rft.date=2023&rft.volume=8&rft.spage=309&rft.pages=309-&rft.issn=2398-502X&rft.eissn=2398-502X&rft_id=info:doi/10.12688/wellcomeopenres.19565.1&rft_dat=%3Cproquest_doaj_%3E2860617863%3C/proquest_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c3471-35b33404eb1d12726f38eec4f9a4f767c5b49407a6efc3824b43c1994b583c6f3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2860617863&rft_id=info:pmid/37663796&rfr_iscdi=true