Loading…

Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction

Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the...

Full description

Saved in:
Bibliographic Details
Published in:Applied energy 2023-04, Vol.336, p.120815, Article 120815
Main Authors: Liu, Chenyu, Zhang, Xuemin, Mei, Shengwei, Zhou, Qingyu, Fan, Hang
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43
cites cdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43
container_end_page
container_issue
container_start_page 120815
container_title Applied energy
container_volume 336
creator Liu, Chenyu
Zhang, Xuemin
Mei, Shengwei
Zhou, Qingyu
Fan, Hang
description Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost. •NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.
doi_str_mv 10.1016/j.apenergy.2023.120815
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_apenergy_2023_120815</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0306261923001794</els_id><sourcerecordid>S0306261923001794</sourcerecordid><originalsourceid>FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</originalsourceid><addsrcrecordid>eNqFkMtOwzAQRb0AiVL4BeQfSLCdOE13oIqXVIkFsLacybi4tHawDVH_HkeFNat5XN2rmUPIFWclZ7y53pZ6QIdhcygFE1XJBWu5PCEzVrGmEA1fnpHzGLeMMZG1Gfl8wWAxFqONSHVK6JL1jjpMow8f1PhAR-t6OvgRwzQi6Jis21DwLto-u3OfcD_4oHd0pzfUG-q-9lmAvBhRp_fsHAL2FqbsC3Jq9C7i5W-dk7f7u9fVY7F-fnha3a4LELVIhTQdN0ZiK8wC0XQSe0DguOCS8WrRVqI2S2CVNJhlw1tcQt2BqWUHvNF1NSfNMReCjzGgUUOwex0OijM1wVJb9QdLTbDUEVY23hyNmK_7thhUBIsO8gP5-6R6b_-L-AHyq31y</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</title><source>ScienceDirect Journals</source><creator>Liu, Chenyu ; Zhang, Xuemin ; Mei, Shengwei ; Zhou, Qingyu ; Fan, Hang</creator><creatorcontrib>Liu, Chenyu ; Zhang, Xuemin ; Mei, Shengwei ; Zhou, Qingyu ; Fan, Hang</creatorcontrib><description>Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost. •NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.</description><identifier>ISSN: 0306-2619</identifier><identifier>DOI: 10.1016/j.apenergy.2023.120815</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Block-sparse ; Numerical weather prediction ; Series-wise attention ; Temporal lag ; Ultra-short-term forecasting ; Weak inertia</subject><ispartof>Applied energy, 2023-04, Vol.336, p.120815, Article 120815</ispartof><rights>2023 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</citedby><cites>FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</cites><orcidid>0000-0002-8308-9332 ; 0000-0002-7611-1490</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Liu, Chenyu</creatorcontrib><creatorcontrib>Zhang, Xuemin</creatorcontrib><creatorcontrib>Mei, Shengwei</creatorcontrib><creatorcontrib>Zhou, Qingyu</creatorcontrib><creatorcontrib>Fan, Hang</creatorcontrib><title>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</title><title>Applied energy</title><description>Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost. •NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.</description><subject>Block-sparse</subject><subject>Numerical weather prediction</subject><subject>Series-wise attention</subject><subject>Temporal lag</subject><subject>Ultra-short-term forecasting</subject><subject>Weak inertia</subject><issn>0306-2619</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNqFkMtOwzAQRb0AiVL4BeQfSLCdOE13oIqXVIkFsLacybi4tHawDVH_HkeFNat5XN2rmUPIFWclZ7y53pZ6QIdhcygFE1XJBWu5PCEzVrGmEA1fnpHzGLeMMZG1Gfl8wWAxFqONSHVK6JL1jjpMow8f1PhAR-t6OvgRwzQi6Jis21DwLto-u3OfcD_4oHd0pzfUG-q-9lmAvBhRp_fsHAL2FqbsC3Jq9C7i5W-dk7f7u9fVY7F-fnha3a4LELVIhTQdN0ZiK8wC0XQSe0DguOCS8WrRVqI2S2CVNJhlw1tcQt2BqWUHvNF1NSfNMReCjzGgUUOwex0OijM1wVJb9QdLTbDUEVY23hyNmK_7thhUBIsO8gP5-6R6b_-L-AHyq31y</recordid><startdate>20230415</startdate><enddate>20230415</enddate><creator>Liu, Chenyu</creator><creator>Zhang, Xuemin</creator><creator>Mei, Shengwei</creator><creator>Zhou, Qingyu</creator><creator>Fan, Hang</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-8308-9332</orcidid><orcidid>https://orcid.org/0000-0002-7611-1490</orcidid></search><sort><creationdate>20230415</creationdate><title>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</title><author>Liu, Chenyu ; Zhang, Xuemin ; Mei, Shengwei ; Zhou, Qingyu ; Fan, Hang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Block-sparse</topic><topic>Numerical weather prediction</topic><topic>Series-wise attention</topic><topic>Temporal lag</topic><topic>Ultra-short-term forecasting</topic><topic>Weak inertia</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Liu, Chenyu</creatorcontrib><creatorcontrib>Zhang, Xuemin</creatorcontrib><creatorcontrib>Mei, Shengwei</creatorcontrib><creatorcontrib>Zhou, Qingyu</creatorcontrib><creatorcontrib>Fan, Hang</creatorcontrib><collection>CrossRef</collection><jtitle>Applied energy</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Liu, Chenyu</au><au>Zhang, Xuemin</au><au>Mei, Shengwei</au><au>Zhou, Qingyu</au><au>Fan, Hang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</atitle><jtitle>Applied energy</jtitle><date>2023-04-15</date><risdate>2023</risdate><volume>336</volume><spage>120815</spage><pages>120815-</pages><artnum>120815</artnum><issn>0306-2619</issn><abstract>Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost. •NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.apenergy.2023.120815</doi><orcidid>https://orcid.org/0000-0002-8308-9332</orcidid><orcidid>https://orcid.org/0000-0002-7611-1490</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0306-2619
ispartof Applied energy, 2023-04, Vol.336, p.120815, Article 120815
issn 0306-2619
language eng
recordid cdi_crossref_primary_10_1016_j_apenergy_2023_120815
source ScienceDirect Journals
subjects Block-sparse
Numerical weather prediction
Series-wise attention
Temporal lag
Ultra-short-term forecasting
Weak inertia
title Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T23%3A17%3A55IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Series-wise%20attention%20network%20for%20wind%20power%20forecasting%20considering%20temporal%20lag%20of%20numerical%20weather%20prediction&rft.jtitle=Applied%20energy&rft.au=Liu,%20Chenyu&rft.date=2023-04-15&rft.volume=336&rft.spage=120815&rft.pages=120815-&rft.artnum=120815&rft.issn=0306-2619&rft_id=info:doi/10.1016/j.apenergy.2023.120815&rft_dat=%3Celsevier_cross%3ES0306261923001794%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true