Groundwater modelling reports fail to comply with guideline recommendations for model reproducibility

• Published in: Journal of environmental management 2024-03, Vol.355, p.120292-120292, Article 120292
• Main Authors: Kamali Maskooni, Ehsan, Werner, Adrian D., Solórzano-Rivas, S. Cristina
• Format: Article
• Language: English
• Subjects: Computer model; Hydrogeology; Industry best practice; Water management; Water policy
• ISSN: 0301-4797; 1095-8630
• DOI: 10.1016/j.jenvman.2024.120292

Computer models are routinely used to underpin critical decision-making for projects that impact groundwater systems. Modelling results are communicated through technical reports, which advise regulators and other stakeholders of groundwater impacts, thereby informing approvals, project restrictions and monitoring requirements. Several guidelines and texts are available to instruct groundwater model development and reporting. In seven of the eight guidelines/texts reviewed, it is recommended that modelling reports (or a model archive) contain sufficient information for an external party to rebuild the model. This study examined that expectation (assumed to be “best practice”) by reviewing 25 groundwater modelling reports from eight countries and assessing whether the information contained therein was sufficient (or an archive was provided) to rebuild the model on which the report was based. The reports were characterised based on 18 model components (e.g., aquifer properties, boundary conditions, etc.), and the availability of sufficient information in the report to rebuild each one. The “rebuildability” of model components was classified as: (a) reproducible (from the report), (b) reproducible but assumptions needed, and (c) not reproducible. The Analytical Hierarchical Process was employed to rank the reports based on the reproducibility of the models they describe. Only one of the 25 reports provided adequate information to rebuild the model, while one other report was accompanied by a model archive, resulting in two cases of model reproducibility, contrary to guideline recommendations. This outcome reflects problems with reproducibility in the wider scientific community. We conclude that modelling reports need to provide more detailed information to be compliant with best practice or model archives ought to be made available. Addressing this issue will ensure that stakeholders have access to the information needed to properly assess whether future groundwater impacts have been reliably evaluated. •Several guidelines recommend that reports allow groundwater models to be rebuilt.•One of the 25 reports reviewed had sufficient detail for model reconstruction.•A model archive obviated the reliance on one report for model reproducibility.•Model reports should be more comprehensive, or model archives should be provided.