Loading…

Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators

Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these proces...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-07
Main Authors: Wesselkamp, Marieke, Chantry, Matthew, Pinnington, Ewan, Choulga, Margarita, Boussetta, Souhail, Kalweit, Maria, Boedecker, Joschka, Dormann, Carsten F, Pappenberger, Florian, Balsamo, Gianpaolo
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Wesselkamp, Marieke
Chantry, Matthew
Pinnington, Ewan
Choulga, Margarita
Boussetta, Souhail
Kalweit, Maria
Boedecker, Joschka
Dormann, Carsten F
Pappenberger, Florian
Balsamo, Gianpaolo
description Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_3084093179</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3084093179</sourcerecordid><originalsourceid>FETCH-proquest_journals_30840931793</originalsourceid><addsrcrecordid>eNqNjUFOAkEQRTsmJhLlDpW4ZZJmGgTcoXF0AW5gT8ruGjI4dGFVN8QDeU8H9QCu3uL___6F6ZXODYvpqCyvTF91Z60t7ybleOx65msejhg9KTQRFhgDrLLU6AmWHKgt3lApQMVCHjU1cXsPc_C8P6Bgao4EmnL4BK5hsVovB_AsGBqKCR6Yf_oDOEsrolCznFACvFIWbDukE8v7748CKhyEt_G88p0VEwHtc4uJRW_MZY2tUv-P1-a2elo_vhTd5COTps2Os8Qu2jg7HdmZG05m7n-tb9wYXZE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3084093179</pqid></control><display><type>article</type><title>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</title><source>Publicly Available Content Database</source><creator>Wesselkamp, Marieke ; Chantry, Matthew ; Pinnington, Ewan ; Choulga, Margarita ; Boussetta, Souhail ; Kalweit, Maria ; Boedecker, Joschka ; Dormann, Carsten F ; Pappenberger, Florian ; Balsamo, Gianpaolo</creator><creatorcontrib>Wesselkamp, Marieke ; Chantry, Matthew ; Pinnington, Ewan ; Choulga, Margarita ; Boussetta, Souhail ; Kalweit, Maria ; Boedecker, Joschka ; Dormann, Carsten F ; Pappenberger, Florian ; Balsamo, Gianpaolo</creatorcontrib><description>Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Accuracy ; Artificial neural networks ; Carbon ; Comparative studies ; Emulators ; Encoders-Decoders ; Fluxes ; Heterogeneity ; Initial conditions ; Neural networks ; Numerical models ; Parameterization ; Positive feedback ; Weather forecasting</subject><ispartof>arXiv.org, 2024-07</ispartof><rights>2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/3084093179?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>776,780,25732,36991,44569</link.rule.ids></links><search><creatorcontrib>Wesselkamp, Marieke</creatorcontrib><creatorcontrib>Chantry, Matthew</creatorcontrib><creatorcontrib>Pinnington, Ewan</creatorcontrib><creatorcontrib>Choulga, Margarita</creatorcontrib><creatorcontrib>Boussetta, Souhail</creatorcontrib><creatorcontrib>Kalweit, Maria</creatorcontrib><creatorcontrib>Boedecker, Joschka</creatorcontrib><creatorcontrib>Dormann, Carsten F</creatorcontrib><creatorcontrib>Pappenberger, Florian</creatorcontrib><creatorcontrib>Balsamo, Gianpaolo</creatorcontrib><title>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</title><title>arXiv.org</title><description>Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.</description><subject>Accuracy</subject><subject>Artificial neural networks</subject><subject>Carbon</subject><subject>Comparative studies</subject><subject>Emulators</subject><subject>Encoders-Decoders</subject><subject>Fluxes</subject><subject>Heterogeneity</subject><subject>Initial conditions</subject><subject>Neural networks</subject><subject>Numerical models</subject><subject>Parameterization</subject><subject>Positive feedback</subject><subject>Weather forecasting</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNjUFOAkEQRTsmJhLlDpW4ZZJmGgTcoXF0AW5gT8ruGjI4dGFVN8QDeU8H9QCu3uL___6F6ZXODYvpqCyvTF91Z60t7ybleOx65msejhg9KTQRFhgDrLLU6AmWHKgt3lApQMVCHjU1cXsPc_C8P6Bgao4EmnL4BK5hsVovB_AsGBqKCR6Yf_oDOEsrolCznFACvFIWbDukE8v7748CKhyEt_G88p0VEwHtc4uJRW_MZY2tUv-P1-a2elo_vhTd5COTps2Os8Qu2jg7HdmZG05m7n-tb9wYXZE</recordid><startdate>20240723</startdate><enddate>20240723</enddate><creator>Wesselkamp, Marieke</creator><creator>Chantry, Matthew</creator><creator>Pinnington, Ewan</creator><creator>Choulga, Margarita</creator><creator>Boussetta, Souhail</creator><creator>Kalweit, Maria</creator><creator>Boedecker, Joschka</creator><creator>Dormann, Carsten F</creator><creator>Pappenberger, Florian</creator><creator>Balsamo, Gianpaolo</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20240723</creationdate><title>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</title><author>Wesselkamp, Marieke ; Chantry, Matthew ; Pinnington, Ewan ; Choulga, Margarita ; Boussetta, Souhail ; Kalweit, Maria ; Boedecker, Joschka ; Dormann, Carsten F ; Pappenberger, Florian ; Balsamo, Gianpaolo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_30840931793</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Artificial neural networks</topic><topic>Carbon</topic><topic>Comparative studies</topic><topic>Emulators</topic><topic>Encoders-Decoders</topic><topic>Fluxes</topic><topic>Heterogeneity</topic><topic>Initial conditions</topic><topic>Neural networks</topic><topic>Numerical models</topic><topic>Parameterization</topic><topic>Positive feedback</topic><topic>Weather forecasting</topic><toplevel>online_resources</toplevel><creatorcontrib>Wesselkamp, Marieke</creatorcontrib><creatorcontrib>Chantry, Matthew</creatorcontrib><creatorcontrib>Pinnington, Ewan</creatorcontrib><creatorcontrib>Choulga, Margarita</creatorcontrib><creatorcontrib>Boussetta, Souhail</creatorcontrib><creatorcontrib>Kalweit, Maria</creatorcontrib><creatorcontrib>Boedecker, Joschka</creatorcontrib><creatorcontrib>Dormann, Carsten F</creatorcontrib><creatorcontrib>Pappenberger, Florian</creatorcontrib><creatorcontrib>Balsamo, Gianpaolo</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Databases</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wesselkamp, Marieke</au><au>Chantry, Matthew</au><au>Pinnington, Ewan</au><au>Choulga, Margarita</au><au>Boussetta, Souhail</au><au>Kalweit, Maria</au><au>Boedecker, Joschka</au><au>Dormann, Carsten F</au><au>Pappenberger, Florian</au><au>Balsamo, Gianpaolo</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</atitle><jtitle>arXiv.org</jtitle><date>2024-07-23</date><risdate>2024</risdate><eissn>2331-8422</eissn><abstract>Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2024-07
issn 2331-8422
language eng
recordid cdi_proquest_journals_3084093179
source Publicly Available Content Database
subjects Accuracy
Artificial neural networks
Carbon
Comparative studies
Emulators
Encoders-Decoders
Fluxes
Heterogeneity
Initial conditions
Neural networks
Numerical models
Parameterization
Positive feedback
Weather forecasting
title Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T17%3A55%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Advances%20in%20Land%20Surface%20Model-based%20Forecasting:%20A%20comparative%20study%20of%20LSTM,%20Gradient%20Boosting,%20and%20Feedforward%20Neural%20Network%20Models%20as%20prognostic%20state%20emulators&rft.jtitle=arXiv.org&rft.au=Wesselkamp,%20Marieke&rft.date=2024-07-23&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E3084093179%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_30840931793%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=3084093179&rft_id=info:pmid/&rfr_iscdi=true