Loading…
Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators
Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these proces...
Saved in:
Published in: | arXiv.org 2024-07 |
---|---|
Main Authors: | , , , , , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Wesselkamp, Marieke Chantry, Matthew Pinnington, Ewan Choulga, Margarita Boussetta, Souhail Kalweit, Maria Boedecker, Joschka Dormann, Carsten F Pappenberger, Florian Balsamo, Gianpaolo |
description | Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces. |
format | article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_3084093179</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3084093179</sourcerecordid><originalsourceid>FETCH-proquest_journals_30840931793</originalsourceid><addsrcrecordid>eNqNjUFOAkEQRTsmJhLlDpW4ZZJmGgTcoXF0AW5gT8ruGjI4dGFVN8QDeU8H9QCu3uL___6F6ZXODYvpqCyvTF91Z60t7ybleOx65msejhg9KTQRFhgDrLLU6AmWHKgt3lApQMVCHjU1cXsPc_C8P6Bgao4EmnL4BK5hsVovB_AsGBqKCR6Yf_oDOEsrolCznFACvFIWbDukE8v7748CKhyEt_G88p0VEwHtc4uJRW_MZY2tUv-P1-a2elo_vhTd5COTps2Os8Qu2jg7HdmZG05m7n-tb9wYXZE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3084093179</pqid></control><display><type>article</type><title>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</title><source>Publicly Available Content Database</source><creator>Wesselkamp, Marieke ; Chantry, Matthew ; Pinnington, Ewan ; Choulga, Margarita ; Boussetta, Souhail ; Kalweit, Maria ; Boedecker, Joschka ; Dormann, Carsten F ; Pappenberger, Florian ; Balsamo, Gianpaolo</creator><creatorcontrib>Wesselkamp, Marieke ; Chantry, Matthew ; Pinnington, Ewan ; Choulga, Margarita ; Boussetta, Souhail ; Kalweit, Maria ; Boedecker, Joschka ; Dormann, Carsten F ; Pappenberger, Florian ; Balsamo, Gianpaolo</creatorcontrib><description>Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Accuracy ; Artificial neural networks ; Carbon ; Comparative studies ; Emulators ; Encoders-Decoders ; Fluxes ; Heterogeneity ; Initial conditions ; Neural networks ; Numerical models ; Parameterization ; Positive feedback ; Weather forecasting</subject><ispartof>arXiv.org, 2024-07</ispartof><rights>2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/3084093179?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>776,780,25732,36991,44569</link.rule.ids></links><search><creatorcontrib>Wesselkamp, Marieke</creatorcontrib><creatorcontrib>Chantry, Matthew</creatorcontrib><creatorcontrib>Pinnington, Ewan</creatorcontrib><creatorcontrib>Choulga, Margarita</creatorcontrib><creatorcontrib>Boussetta, Souhail</creatorcontrib><creatorcontrib>Kalweit, Maria</creatorcontrib><creatorcontrib>Boedecker, Joschka</creatorcontrib><creatorcontrib>Dormann, Carsten F</creatorcontrib><creatorcontrib>Pappenberger, Florian</creatorcontrib><creatorcontrib>Balsamo, Gianpaolo</creatorcontrib><title>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</title><title>arXiv.org</title><description>Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.</description><subject>Accuracy</subject><subject>Artificial neural networks</subject><subject>Carbon</subject><subject>Comparative studies</subject><subject>Emulators</subject><subject>Encoders-Decoders</subject><subject>Fluxes</subject><subject>Heterogeneity</subject><subject>Initial conditions</subject><subject>Neural networks</subject><subject>Numerical models</subject><subject>Parameterization</subject><subject>Positive feedback</subject><subject>Weather forecasting</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNjUFOAkEQRTsmJhLlDpW4ZZJmGgTcoXF0AW5gT8ruGjI4dGFVN8QDeU8H9QCu3uL___6F6ZXODYvpqCyvTF91Z60t7ybleOx65msejhg9KTQRFhgDrLLU6AmWHKgt3lApQMVCHjU1cXsPc_C8P6Bgao4EmnL4BK5hsVovB_AsGBqKCR6Yf_oDOEsrolCznFACvFIWbDukE8v7748CKhyEt_G88p0VEwHtc4uJRW_MZY2tUv-P1-a2elo_vhTd5COTps2Os8Qu2jg7HdmZG05m7n-tb9wYXZE</recordid><startdate>20240723</startdate><enddate>20240723</enddate><creator>Wesselkamp, Marieke</creator><creator>Chantry, Matthew</creator><creator>Pinnington, Ewan</creator><creator>Choulga, Margarita</creator><creator>Boussetta, Souhail</creator><creator>Kalweit, Maria</creator><creator>Boedecker, Joschka</creator><creator>Dormann, Carsten F</creator><creator>Pappenberger, Florian</creator><creator>Balsamo, Gianpaolo</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20240723</creationdate><title>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</title><author>Wesselkamp, Marieke ; Chantry, Matthew ; Pinnington, Ewan ; Choulga, Margarita ; Boussetta, Souhail ; Kalweit, Maria ; Boedecker, Joschka ; Dormann, Carsten F ; Pappenberger, Florian ; Balsamo, Gianpaolo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_30840931793</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Artificial neural networks</topic><topic>Carbon</topic><topic>Comparative studies</topic><topic>Emulators</topic><topic>Encoders-Decoders</topic><topic>Fluxes</topic><topic>Heterogeneity</topic><topic>Initial conditions</topic><topic>Neural networks</topic><topic>Numerical models</topic><topic>Parameterization</topic><topic>Positive feedback</topic><topic>Weather forecasting</topic><toplevel>online_resources</toplevel><creatorcontrib>Wesselkamp, Marieke</creatorcontrib><creatorcontrib>Chantry, Matthew</creatorcontrib><creatorcontrib>Pinnington, Ewan</creatorcontrib><creatorcontrib>Choulga, Margarita</creatorcontrib><creatorcontrib>Boussetta, Souhail</creatorcontrib><creatorcontrib>Kalweit, Maria</creatorcontrib><creatorcontrib>Boedecker, Joschka</creatorcontrib><creatorcontrib>Dormann, Carsten F</creatorcontrib><creatorcontrib>Pappenberger, Florian</creatorcontrib><creatorcontrib>Balsamo, Gianpaolo</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Databases</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wesselkamp, Marieke</au><au>Chantry, Matthew</au><au>Pinnington, Ewan</au><au>Choulga, Margarita</au><au>Boussetta, Souhail</au><au>Kalweit, Maria</au><au>Boedecker, Joschka</au><au>Dormann, Carsten F</au><au>Pappenberger, Florian</au><au>Balsamo, Gianpaolo</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators</atitle><jtitle>arXiv.org</jtitle><date>2024-07-23</date><risdate>2024</risdate><eissn>2331-8422</eissn><abstract>Most useful weather prediction for the public is near the surface. The processes that are most relevant for near-surface weather prediction are also those that are most interactive and exhibit positive feedback or have key role in energy partitioning. Land surface models (LSMs) consider these processes together with surface heterogeneity and forecast water, carbon and energy fluxes, and coupled with an atmospheric model provide boundary and initial conditions. This numerical parametrization of atmospheric boundaries being computationally expensive, statistical surrogate models are increasingly used to accelerated progress in experimental research. We evaluated the efficiency of three surrogate models in speeding up experimental research by simulating land surface processes, which are integral to forecasting water, carbon, and energy fluxes in coupled atmospheric models. Specifically, we compared the performance of a Long-Short Term Memory (LSTM) encoder-decoder network, extreme gradient boosting, and a feed-forward neural network within a physics-informed multi-objective framework. This framework emulates key states of the ECMWF's Integrated Forecasting System (IFS) land surface scheme, ECLand, across continental and global scales. Our findings indicate that while all models on average demonstrate high accuracy over the forecast period, the LSTM network excels in continental long-range predictions when carefully tuned, the XGB scores consistently high across tasks and the MLP provides an excellent implementation-time-accuracy trade-off. The runtime reduction achieved by the emulators in comparison to the full numerical models are significant, offering a faster, yet reliable alternative for conducting numerical experiments on land surfaces.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2024-07 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_3084093179 |
source | Publicly Available Content Database |
subjects | Accuracy Artificial neural networks Carbon Comparative studies Emulators Encoders-Decoders Fluxes Heterogeneity Initial conditions Neural networks Numerical models Parameterization Positive feedback Weather forecasting |
title | Advances in Land Surface Model-based Forecasting: A comparative study of LSTM, Gradient Boosting, and Feedforward Neural Network Models as prognostic state emulators |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T17%3A55%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Advances%20in%20Land%20Surface%20Model-based%20Forecasting:%20A%20comparative%20study%20of%20LSTM,%20Gradient%20Boosting,%20and%20Feedforward%20Neural%20Network%20Models%20as%20prognostic%20state%20emulators&rft.jtitle=arXiv.org&rft.au=Wesselkamp,%20Marieke&rft.date=2024-07-23&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E3084093179%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_30840931793%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=3084093179&rft_id=info:pmid/&rfr_iscdi=true |