Loading…
Validation in fusion research: Towards guidelines and best practices
Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verifi...
Saved in:
Published in: | Physics of plasmas 2008-06, Vol.15 (6), p.062503-062503-12 |
---|---|
Main Authors: | , , , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43 |
---|---|
cites | cdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43 |
container_end_page | 062503-12 |
container_issue | 6 |
container_start_page | 062503 |
container_title | Physics of plasmas |
container_volume | 15 |
creator | Terry, P. W. Greenwald, M. Leboeuf, J.-N. McKee, G. R. Mikkelsen, D. R. Nevins, W. M. Newman, D. E. Stotler, D. P. |
description | Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged. |
doi_str_mv | 10.1063/1.2928909 |
format | article |
fullrecord | <record><control><sourceid>scitation_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1063_1_2928909</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>pop</sourcerecordid><originalsourceid>FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</originalsourceid><addsrcrecordid>eNp9kE1LAzEQQIMoWKsH_8GCJ4WtmU12k3gQpH5CwUsVbyGfNlJ3S7Kt-O_tuoUepJ5mDm8ew0PoFPAIcEUuYVSIggss9tAAMBc5qxjd73aG86qib4foKKUPjDGtSj5At69qHqxqQ1Nnoc78MnVbdMmpaGZX2bT5UtGm7H0ZrJuH2qVM1TbTLrXZIirTBuPSMTrwap7cyWYO0cv93XT8mE-eH57GN5PcUGBtzj1jvtTcaueBCqu5sARTqDRVriJek9KUlDPtGRABoiiU1UqYArQ3YCgZorPe26Q2yGRC68zMNHXtTCsLgAJTwtbUeU-Z2KQUnZeLGD5V_JaAZRdJgtxEWrPXPdvJfivshrelZKhlX2otuNglWDVxeywX1v8H_33tB_dyi2s</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Validation in fusion research: Towards guidelines and best practices</title><source>American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list)</source><source>AIP Journals (American Institute of Physics)</source><creator>Terry, P. W. ; Greenwald, M. ; Leboeuf, J.-N. ; McKee, G. R. ; Mikkelsen, D. R. ; Nevins, W. M. ; Newman, D. E. ; Stotler, D. P.</creator><creatorcontrib>Terry, P. W. ; Greenwald, M. ; Leboeuf, J.-N. ; McKee, G. R. ; Mikkelsen, D. R. ; Nevins, W. M. ; Newman, D. E. ; Stotler, D. P. ; Task Group on Verification and Validation ; U.S. Burning Plasma Organization ; U.S. Transport Task Force</creatorcontrib><description>Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.</description><identifier>ISSN: 1070-664X</identifier><identifier>EISSN: 1089-7674</identifier><identifier>DOI: 10.1063/1.2928909</identifier><identifier>CODEN: PHPAEN</identifier><language>eng</language><publisher>United States: American Institute of Physics</publisher><subject>70 PLASMA PHYSICS AND FUSION TECHNOLOGY ; ALGORITHMS ; COMPARATIVE EVALUATIONS ; ERRORS ; LEAD ; MAGNETIC CONFINEMENT ; MATHEMATICAL MODELS ; PLASMA ; RECOMMENDATIONS ; SENSITIVITY ; SENSITIVITY ANALYSIS ; VALIDATION</subject><ispartof>Physics of plasmas, 2008-06, Vol.15 (6), p.062503-062503-12</ispartof><rights>American Institute of Physics</rights><rights>2008 American Institute of Physics</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</citedby><cites>FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://pubs.aip.org/pop/article-lookup/doi/10.1063/1.2928909$$EHTML$$P50$$Gscitation$$H</linktohtml><link.rule.ids>230,314,780,782,784,795,885,27924,27925,76383</link.rule.ids><backlink>$$Uhttps://www.osti.gov/biblio/21120437$$D View this record in Osti.gov$$Hfree_for_read</backlink></links><search><creatorcontrib>Terry, P. W.</creatorcontrib><creatorcontrib>Greenwald, M.</creatorcontrib><creatorcontrib>Leboeuf, J.-N.</creatorcontrib><creatorcontrib>McKee, G. R.</creatorcontrib><creatorcontrib>Mikkelsen, D. R.</creatorcontrib><creatorcontrib>Nevins, W. M.</creatorcontrib><creatorcontrib>Newman, D. E.</creatorcontrib><creatorcontrib>Stotler, D. P.</creatorcontrib><creatorcontrib>Task Group on Verification and Validation</creatorcontrib><creatorcontrib>U.S. Burning Plasma Organization</creatorcontrib><creatorcontrib>U.S. Transport Task Force</creatorcontrib><title>Validation in fusion research: Towards guidelines and best practices</title><title>Physics of plasmas</title><description>Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.</description><subject>70 PLASMA PHYSICS AND FUSION TECHNOLOGY</subject><subject>ALGORITHMS</subject><subject>COMPARATIVE EVALUATIONS</subject><subject>ERRORS</subject><subject>LEAD</subject><subject>MAGNETIC CONFINEMENT</subject><subject>MATHEMATICAL MODELS</subject><subject>PLASMA</subject><subject>RECOMMENDATIONS</subject><subject>SENSITIVITY</subject><subject>SENSITIVITY ANALYSIS</subject><subject>VALIDATION</subject><issn>1070-664X</issn><issn>1089-7674</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2008</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQQIMoWKsH_8GCJ4WtmU12k3gQpH5CwUsVbyGfNlJ3S7Kt-O_tuoUepJ5mDm8ew0PoFPAIcEUuYVSIggss9tAAMBc5qxjd73aG86qib4foKKUPjDGtSj5At69qHqxqQ1Nnoc78MnVbdMmpaGZX2bT5UtGm7H0ZrJuH2qVM1TbTLrXZIirTBuPSMTrwap7cyWYO0cv93XT8mE-eH57GN5PcUGBtzj1jvtTcaueBCqu5sARTqDRVriJek9KUlDPtGRABoiiU1UqYArQ3YCgZorPe26Q2yGRC68zMNHXtTCsLgAJTwtbUeU-Z2KQUnZeLGD5V_JaAZRdJgtxEWrPXPdvJfivshrelZKhlX2otuNglWDVxeywX1v8H_33tB_dyi2s</recordid><startdate>20080601</startdate><enddate>20080601</enddate><creator>Terry, P. W.</creator><creator>Greenwald, M.</creator><creator>Leboeuf, J.-N.</creator><creator>McKee, G. R.</creator><creator>Mikkelsen, D. R.</creator><creator>Nevins, W. M.</creator><creator>Newman, D. E.</creator><creator>Stotler, D. P.</creator><general>American Institute of Physics</general><scope>AAYXX</scope><scope>CITATION</scope><scope>OTOTI</scope></search><sort><creationdate>20080601</creationdate><title>Validation in fusion research: Towards guidelines and best practices</title><author>Terry, P. W. ; Greenwald, M. ; Leboeuf, J.-N. ; McKee, G. R. ; Mikkelsen, D. R. ; Nevins, W. M. ; Newman, D. E. ; Stotler, D. P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2008</creationdate><topic>70 PLASMA PHYSICS AND FUSION TECHNOLOGY</topic><topic>ALGORITHMS</topic><topic>COMPARATIVE EVALUATIONS</topic><topic>ERRORS</topic><topic>LEAD</topic><topic>MAGNETIC CONFINEMENT</topic><topic>MATHEMATICAL MODELS</topic><topic>PLASMA</topic><topic>RECOMMENDATIONS</topic><topic>SENSITIVITY</topic><topic>SENSITIVITY ANALYSIS</topic><topic>VALIDATION</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Terry, P. W.</creatorcontrib><creatorcontrib>Greenwald, M.</creatorcontrib><creatorcontrib>Leboeuf, J.-N.</creatorcontrib><creatorcontrib>McKee, G. R.</creatorcontrib><creatorcontrib>Mikkelsen, D. R.</creatorcontrib><creatorcontrib>Nevins, W. M.</creatorcontrib><creatorcontrib>Newman, D. E.</creatorcontrib><creatorcontrib>Stotler, D. P.</creatorcontrib><creatorcontrib>Task Group on Verification and Validation</creatorcontrib><creatorcontrib>U.S. Burning Plasma Organization</creatorcontrib><creatorcontrib>U.S. Transport Task Force</creatorcontrib><collection>CrossRef</collection><collection>OSTI.GOV</collection><jtitle>Physics of plasmas</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Terry, P. W.</au><au>Greenwald, M.</au><au>Leboeuf, J.-N.</au><au>McKee, G. R.</au><au>Mikkelsen, D. R.</au><au>Nevins, W. M.</au><au>Newman, D. E.</au><au>Stotler, D. P.</au><aucorp>Task Group on Verification and Validation</aucorp><aucorp>U.S. Burning Plasma Organization</aucorp><aucorp>U.S. Transport Task Force</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Validation in fusion research: Towards guidelines and best practices</atitle><jtitle>Physics of plasmas</jtitle><date>2008-06-01</date><risdate>2008</risdate><volume>15</volume><issue>6</issue><spage>062503</spage><epage>062503-12</epage><pages>062503-062503-12</pages><issn>1070-664X</issn><eissn>1089-7674</eissn><coden>PHPAEN</coden><abstract>Because experiment/model comparisons in magnetic confinement fusion have not yet satisfied the requirements for validation as understood broadly, approaches to validating mathematical models and numerical algorithms are recommended as good practices. Previously identified procedures, such as, verification, qualification, and analysis of errors from uncertainties and deficiencies, remain important. However, particular challenges intrinsic to fusion plasmas and physical measurement therein lead to identification of new or less familiar concepts that are also critical in validation. These include the primacy hierarchy, which tracks the integration of measurable quantities, and sensitivity analysis, which assesses how model output is apportioned to different sources of variation. The use of validation metrics for individual measurements is extended to multiple measurements, with provisions for the primacy hierarchy and sensitivity. This composite validation metric is essential for quantitatively evaluating comparisons with experiments. To mount successful and credible validation in magnetic fusion, a new culture of validation is envisaged.</abstract><cop>United States</cop><pub>American Institute of Physics</pub><doi>10.1063/1.2928909</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1070-664X |
ispartof | Physics of plasmas, 2008-06, Vol.15 (6), p.062503-062503-12 |
issn | 1070-664X 1089-7674 |
language | eng |
recordid | cdi_crossref_primary_10_1063_1_2928909 |
source | American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list); AIP Journals (American Institute of Physics) |
subjects | 70 PLASMA PHYSICS AND FUSION TECHNOLOGY ALGORITHMS COMPARATIVE EVALUATIONS ERRORS LEAD MAGNETIC CONFINEMENT MATHEMATICAL MODELS PLASMA RECOMMENDATIONS SENSITIVITY SENSITIVITY ANALYSIS VALIDATION |
title | Validation in fusion research: Towards guidelines and best practices |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T22%3A50%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-scitation_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Validation%20in%20fusion%20research:%20Towards%20guidelines%20and%20best%20practices&rft.jtitle=Physics%20of%20plasmas&rft.au=Terry,%20P.%20W.&rft.aucorp=Task%20Group%20on%20Verification%20and%20Validation&rft.date=2008-06-01&rft.volume=15&rft.issue=6&rft.spage=062503&rft.epage=062503-12&rft.pages=062503-062503-12&rft.issn=1070-664X&rft.eissn=1089-7674&rft.coden=PHPAEN&rft_id=info:doi/10.1063/1.2928909&rft_dat=%3Cscitation_cross%3Epop%3C/scitation_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c417t-8f77f5b8dbef149db89d30416b4ae63fb35c5487bf71391922adba9c21bfc1c43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |