Loading…

Validation in fusion research: Towards guidelines and best practices

Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verifi...

Full description

Saved in:
Bibliographic Details
Published in:Physics of plasmas 2008-06, Vol.15 (6), p.062503-062503-12
Main Authors: Terry, P. W., Greenwald, M., Leboeuf, J.-N., McKee, G. R., Mikkelsen, D. R., Nevins, W. M., Newman, D. E., Stotler, D. P.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43
cites cdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43
container_end_page 062503-12
container_issue 6
container_start_page 062503
container_title Physics of plasmas
container_volume 15
creator Terry, P. W.
Greenwald, M.
Leboeuf, J.-N.
McKee, G. R.
Mikkelsen, D. R.
Nevins, W. M.
Newman, D. E.
Stotler, D. P.
description Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.
doi_str_mv 10.1063/1.2928909
format article
fullrecord <record><control><sourceid>scitation_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1063_1_2928909</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>pop</sourcerecordid><originalsourceid>FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</originalsourceid><addsrcrecordid>eNp9kE1LAzEQQIMoWKsH_8GCJ4WtmU12k3gQpH5CwUsVbyGfNlJ3S7Kt-O_tuoUepJ5mDm8ew0PoFPAIcEUuYVSIggss9tAAMBc5qxjd73aG86qib4foKKUPjDGtSj5At69qHqxqQ1Nnoc78MnVbdMmpaGZX2bT5UtGm7H0ZrJuH2qVM1TbTLrXZIirTBuPSMTrwap7cyWYO0cv93XT8mE-eH57GN5PcUGBtzj1jvtTcaueBCqu5sARTqDRVriJek9KUlDPtGRABoiiU1UqYArQ3YCgZorPe26Q2yGRC68zMNHXtTCsLgAJTwtbUeU-Z2KQUnZeLGD5V_JaAZRdJgtxEWrPXPdvJfivshrelZKhlX2otuNglWDVxeywX1v8H_33tB_dyi2s</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Validation in fusion research: Towards guidelines and best practices</title><source>American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list)</source><source>AIP Journals (American Institute of Physics)</source><creator>Terry, P. W. ; Greenwald, M. ; Leboeuf, J.-N. ; McKee, G. R. ; Mikkelsen, D. R. ; Nevins, W. M. ; Newman, D. E. ; Stotler, D. P.</creator><creatorcontrib>Terry, P. W. ; Greenwald, M. ; Leboeuf, J.-N. ; McKee, G. R. ; Mikkelsen, D. R. ; Nevins, W. M. ; Newman, D. E. ; Stotler, D. P. ; Task Group on Verification and Validation ; U.S. Burning Plasma Organization ; U.S. Transport Task Force</creatorcontrib><description>Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.</description><identifier>ISSN: 1070-664X</identifier><identifier>EISSN: 1089-7674</identifier><identifier>DOI: 10.1063/1.2928909</identifier><identifier>CODEN: PHPAEN</identifier><language>eng</language><publisher>United States: American Institute of Physics</publisher><subject>70 PLASMA PHYSICS AND FUSION TECHNOLOGY ; ALGORITHMS ; COMPARATIVE EVALUATIONS ; ERRORS ; LEAD ; MAGNETIC CONFINEMENT ; MATHEMATICAL MODELS ; PLASMA ; RECOMMENDATIONS ; SENSITIVITY ; SENSITIVITY ANALYSIS ; VALIDATION</subject><ispartof>Physics of plasmas, 2008-06, Vol.15 (6), p.062503-062503-12</ispartof><rights>American Institute of Physics</rights><rights>2008 American Institute of Physics</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</citedby><cites>FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://pubs.aip.org/pop/article-lookup/doi/10.1063/1.2928909$$EHTML$$P50$$Gscitation$$H</linktohtml><link.rule.ids>230,314,780,782,784,795,885,27924,27925,76383</link.rule.ids><backlink>$$Uhttps://www.osti.gov/biblio/21120437$$D View this record in Osti.gov$$Hfree_for_read</backlink></links><search><creatorcontrib>Terry, P. W.</creatorcontrib><creatorcontrib>Greenwald, M.</creatorcontrib><creatorcontrib>Leboeuf, J.-N.</creatorcontrib><creatorcontrib>McKee, G. R.</creatorcontrib><creatorcontrib>Mikkelsen, D. R.</creatorcontrib><creatorcontrib>Nevins, W. M.</creatorcontrib><creatorcontrib>Newman, D. E.</creatorcontrib><creatorcontrib>Stotler, D. P.</creatorcontrib><creatorcontrib>Task Group on Verification and Validation</creatorcontrib><creatorcontrib>U.S. Burning Plasma Organization</creatorcontrib><creatorcontrib>U.S. Transport Task Force</creatorcontrib><title>Validation in fusion research: Towards guidelines and best practices</title><title>Physics of plasmas</title><description>Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.</description><subject>70 PLASMA PHYSICS AND FUSION TECHNOLOGY</subject><subject>ALGORITHMS</subject><subject>COMPARATIVE EVALUATIONS</subject><subject>ERRORS</subject><subject>LEAD</subject><subject>MAGNETIC CONFINEMENT</subject><subject>MATHEMATICAL MODELS</subject><subject>PLASMA</subject><subject>RECOMMENDATIONS</subject><subject>SENSITIVITY</subject><subject>SENSITIVITY ANALYSIS</subject><subject>VALIDATION</subject><issn>1070-664X</issn><issn>1089-7674</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2008</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQQIMoWKsH_8GCJ4WtmU12k3gQpH5CwUsVbyGfNlJ3S7Kt-O_tuoUepJ5mDm8ew0PoFPAIcEUuYVSIggss9tAAMBc5qxjd73aG86qib4foKKUPjDGtSj5At69qHqxqQ1Nnoc78MnVbdMmpaGZX2bT5UtGm7H0ZrJuH2qVM1TbTLrXZIirTBuPSMTrwap7cyWYO0cv93XT8mE-eH57GN5PcUGBtzj1jvtTcaueBCqu5sARTqDRVriJek9KUlDPtGRABoiiU1UqYArQ3YCgZorPe26Q2yGRC68zMNHXtTCsLgAJTwtbUeU-Z2KQUnZeLGD5V_JaAZRdJgtxEWrPXPdvJfivshrelZKhlX2otuNglWDVxeywX1v8H_33tB_dyi2s</recordid><startdate>20080601</startdate><enddate>20080601</enddate><creator>Terry, P. W.</creator><creator>Greenwald, M.</creator><creator>Leboeuf, J.-N.</creator><creator>McKee, G. R.</creator><creator>Mikkelsen, D. R.</creator><creator>Nevins, W. M.</creator><creator>Newman, D. E.</creator><creator>Stotler, D. P.</creator><general>American Institute of Physics</general><scope>AAYXX</scope><scope>CITATION</scope><scope>OTOTI</scope></search><sort><creationdate>20080601</creationdate><title>Validation in fusion research: Towards guidelines and best practices</title><author>Terry, P. W. ; Greenwald, M. ; Leboeuf, J.-N. ; McKee, G. R. ; Mikkelsen, D. R. ; Nevins, W. M. ; Newman, D. E. ; Stotler, D. P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2008</creationdate><topic>70 PLASMA PHYSICS AND FUSION TECHNOLOGY</topic><topic>ALGORITHMS</topic><topic>COMPARATIVE EVALUATIONS</topic><topic>ERRORS</topic><topic>LEAD</topic><topic>MAGNETIC CONFINEMENT</topic><topic>MATHEMATICAL MODELS</topic><topic>PLASMA</topic><topic>RECOMMENDATIONS</topic><topic>SENSITIVITY</topic><topic>SENSITIVITY ANALYSIS</topic><topic>VALIDATION</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Terry, P. W.</creatorcontrib><creatorcontrib>Greenwald, M.</creatorcontrib><creatorcontrib>Leboeuf, J.-N.</creatorcontrib><creatorcontrib>McKee, G. R.</creatorcontrib><creatorcontrib>Mikkelsen, D. R.</creatorcontrib><creatorcontrib>Nevins, W. M.</creatorcontrib><creatorcontrib>Newman, D. E.</creatorcontrib><creatorcontrib>Stotler, D. P.</creatorcontrib><creatorcontrib>Task Group on Verification and Validation</creatorcontrib><creatorcontrib>U.S. Burning Plasma Organization</creatorcontrib><creatorcontrib>U.S. Transport Task Force</creatorcontrib><collection>CrossRef</collection><collection>OSTI.GOV</collection><jtitle>Physics of plasmas</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Terry, P. W.</au><au>Greenwald, M.</au><au>Leboeuf, J.-N.</au><au>McKee, G. R.</au><au>Mikkelsen, D. R.</au><au>Nevins, W. M.</au><au>Newman, D. E.</au><au>Stotler, D. P.</au><aucorp>Task Group on Verification and Validation</aucorp><aucorp>U.S. Burning Plasma Organization</aucorp><aucorp>U.S. Transport Task Force</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Validation in fusion research: Towards guidelines and best practices</atitle><jtitle>Physics of plasmas</jtitle><date>2008-06-01</date><risdate>2008</risdate><volume>15</volume><issue>6</issue><spage>062503</spage><epage>062503-12</epage><pages>062503-062503-12</pages><issn>1070-664X</issn><eissn>1089-7674</eissn><coden>PHPAEN</coden><abstract>Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.</abstract><cop>United States</cop><pub>American Institute of Physics</pub><doi>10.1063/1.2928909</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1070-664X
ispartof Physics of plasmas, 2008-06, Vol.15 (6), p.062503-062503-12
issn 1070-664X
1089-7674
language eng
recordid cdi_crossref_primary_10_1063_1_2928909
source American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list); AIP Journals (American Institute of Physics)
subjects 70 PLASMA PHYSICS AND FUSION TECHNOLOGY
ALGORITHMS
COMPARATIVE EVALUATIONS
ERRORS
LEAD
MAGNETIC CONFINEMENT
MATHEMATICAL MODELS
PLASMA
RECOMMENDATIONS
SENSITIVITY
SENSITIVITY ANALYSIS
VALIDATION
title Validation in fusion research: Towards guidelines and best practices
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T22%3A50%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-scitation_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Validation%20in%20fusion%20research:%20Towards%20guidelines%20and%20best%20practices&rft.jtitle=Physics%20of%20plasmas&rft.au=Terry,%20P.%20W.&rft.aucorp=Task%20Group%20on%20Verification%20and%20Validation&rft.date=2008-06-01&rft.volume=15&rft.issue=6&rft.spage=062503&rft.epage=062503-12&rft.pages=062503-062503-12&rft.issn=1070-664X&rft.eissn=1089-7674&rft.coden=PHPAEN&rft_id=info:doi/10.1063/1.2928909&rft_dat=%3Cscitation_cross%3Epop%3C/scitation_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true