Loading…
Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction
Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the...
Saved in:
Published in: | Applied energy 2023-04, Vol.336, p.120815, Article 120815 |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43 |
---|---|
cites | cdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43 |
container_end_page | |
container_issue | |
container_start_page | 120815 |
container_title | Applied energy |
container_volume | 336 |
creator | Liu, Chenyu Zhang, Xuemin Mei, Shengwei Zhou, Qingyu Fan, Hang |
description | Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost.
•NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy. |
doi_str_mv | 10.1016/j.apenergy.2023.120815 |
format | article |
fullrecord | <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_apenergy_2023_120815</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0306261923001794</els_id><sourcerecordid>S0306261923001794</sourcerecordid><originalsourceid>FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</originalsourceid><addsrcrecordid>eNqFkMtOwzAQRb0AiVL4BeQfSLCdOE13oIqXVIkFsLacybi4tHawDVH_HkeFNat5XN2rmUPIFWclZ7y53pZ6QIdhcygFE1XJBWu5PCEzVrGmEA1fnpHzGLeMMZG1Gfl8wWAxFqONSHVK6JL1jjpMow8f1PhAR-t6OvgRwzQi6Jis21DwLto-u3OfcD_4oHd0pzfUG-q-9lmAvBhRp_fsHAL2FqbsC3Jq9C7i5W-dk7f7u9fVY7F-fnha3a4LELVIhTQdN0ZiK8wC0XQSe0DguOCS8WrRVqI2S2CVNJhlw1tcQt2BqWUHvNF1NSfNMReCjzGgUUOwex0OijM1wVJb9QdLTbDUEVY23hyNmK_7thhUBIsO8gP5-6R6b_-L-AHyq31y</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</title><source>ScienceDirect Journals</source><creator>Liu, Chenyu ; Zhang, Xuemin ; Mei, Shengwei ; Zhou, Qingyu ; Fan, Hang</creator><creatorcontrib>Liu, Chenyu ; Zhang, Xuemin ; Mei, Shengwei ; Zhou, Qingyu ; Fan, Hang</creatorcontrib><description>Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost.
•NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.</description><identifier>ISSN: 0306-2619</identifier><identifier>DOI: 10.1016/j.apenergy.2023.120815</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Block-sparse ; Numerical weather prediction ; Series-wise attention ; Temporal lag ; Ultra-short-term forecasting ; Weak inertia</subject><ispartof>Applied energy, 2023-04, Vol.336, p.120815, Article 120815</ispartof><rights>2023 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</citedby><cites>FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</cites><orcidid>0000-0002-8308-9332 ; 0000-0002-7611-1490</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Liu, Chenyu</creatorcontrib><creatorcontrib>Zhang, Xuemin</creatorcontrib><creatorcontrib>Mei, Shengwei</creatorcontrib><creatorcontrib>Zhou, Qingyu</creatorcontrib><creatorcontrib>Fan, Hang</creatorcontrib><title>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</title><title>Applied energy</title><description>Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost.
•NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.</description><subject>Block-sparse</subject><subject>Numerical weather prediction</subject><subject>Series-wise attention</subject><subject>Temporal lag</subject><subject>Ultra-short-term forecasting</subject><subject>Weak inertia</subject><issn>0306-2619</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNqFkMtOwzAQRb0AiVL4BeQfSLCdOE13oIqXVIkFsLacybi4tHawDVH_HkeFNat5XN2rmUPIFWclZ7y53pZ6QIdhcygFE1XJBWu5PCEzVrGmEA1fnpHzGLeMMZG1Gfl8wWAxFqONSHVK6JL1jjpMow8f1PhAR-t6OvgRwzQi6Jis21DwLto-u3OfcD_4oHd0pzfUG-q-9lmAvBhRp_fsHAL2FqbsC3Jq9C7i5W-dk7f7u9fVY7F-fnha3a4LELVIhTQdN0ZiK8wC0XQSe0DguOCS8WrRVqI2S2CVNJhlw1tcQt2BqWUHvNF1NSfNMReCjzGgUUOwex0OijM1wVJb9QdLTbDUEVY23hyNmK_7thhUBIsO8gP5-6R6b_-L-AHyq31y</recordid><startdate>20230415</startdate><enddate>20230415</enddate><creator>Liu, Chenyu</creator><creator>Zhang, Xuemin</creator><creator>Mei, Shengwei</creator><creator>Zhou, Qingyu</creator><creator>Fan, Hang</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-8308-9332</orcidid><orcidid>https://orcid.org/0000-0002-7611-1490</orcidid></search><sort><creationdate>20230415</creationdate><title>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</title><author>Liu, Chenyu ; Zhang, Xuemin ; Mei, Shengwei ; Zhou, Qingyu ; Fan, Hang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Block-sparse</topic><topic>Numerical weather prediction</topic><topic>Series-wise attention</topic><topic>Temporal lag</topic><topic>Ultra-short-term forecasting</topic><topic>Weak inertia</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Liu, Chenyu</creatorcontrib><creatorcontrib>Zhang, Xuemin</creatorcontrib><creatorcontrib>Mei, Shengwei</creatorcontrib><creatorcontrib>Zhou, Qingyu</creatorcontrib><creatorcontrib>Fan, Hang</creatorcontrib><collection>CrossRef</collection><jtitle>Applied energy</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Liu, Chenyu</au><au>Zhang, Xuemin</au><au>Mei, Shengwei</au><au>Zhou, Qingyu</au><au>Fan, Hang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction</atitle><jtitle>Applied energy</jtitle><date>2023-04-15</date><risdate>2023</risdate><volume>336</volume><spage>120815</spage><pages>120815-</pages><artnum>120815</artnum><issn>0306-2619</issn><abstract>Numerical Weather Prediction (NWP), which provides approximate weather information in the next few days, is an essential feature in wind power forecasting (WPF). However, the forecasted wind speed in NWP (NWPWS) shows temporal lag compared to the actual wind speed. And the time-varying nature of the temporal lag challenges the WPF methods on selecting the NWP temporal features within valid time windows. To this end, this paper first summarizes the characteristics of the temporal lag and finds the weak inertia property within a few hours. Consequently, a series-wise mechanism, temporal lag attention (TLA), is proposed to extract valid NWP information for the ultra-short-term WPF by considering the temporal lag’s interference. Three fundamental parts included in TLA, Block-Sparse Attention Range, Lag Recognition, and Feature Fusion, are conducted sequentially. Block-Sparse Attention Range firstly screens out the critical range from the wide distribution of the temporal lag to simplify the subsequent calculation; Lag Recognition real-timely compares the series-wise similarity between actual wind speed and NWPWS time series to determine the top-k most likely temporal lags with their probability; Feature Fusion finally generates the lag-fixed weighted NWPWS as the valid NWP information. TLA has good scalability and can be integrated into the matured WPF model as the feature processing module. Real-world cases verify the accuracy improvement by integrating TLA into a modified encoder–decoder model (MED). Compared to the common point-wise attention mechanism, TLA can mitigate the negative influence of NWPWS temporal lag on WPF more effectively. Meanwhile, the sparse attention range is also proven to benefit the higher WPF accuracy and lower training cost.
•NWP temporal lag challenges prediction methods in selecting valid feature periods.•Time-varying nature of NWP temporal lag is studied and found weak inertia property.•Temporal lag attention facilitates real-time NWP feature selection and processing.•Sparse attention range benefits higher forecasting accuracy with lower complexity.•The ideal condition of the proposed mechanism gives the potentially best accuracy.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.apenergy.2023.120815</doi><orcidid>https://orcid.org/0000-0002-8308-9332</orcidid><orcidid>https://orcid.org/0000-0002-7611-1490</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0306-2619 |
ispartof | Applied energy, 2023-04, Vol.336, p.120815, Article 120815 |
issn | 0306-2619 |
language | eng |
recordid | cdi_crossref_primary_10_1016_j_apenergy_2023_120815 |
source | ScienceDirect Journals |
subjects | Block-sparse Numerical weather prediction Series-wise attention Temporal lag Ultra-short-term forecasting Weak inertia |
title | Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T23%3A17%3A55IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Series-wise%20attention%20network%20for%20wind%20power%20forecasting%20considering%20temporal%20lag%20of%20numerical%20weather%20prediction&rft.jtitle=Applied%20energy&rft.au=Liu,%20Chenyu&rft.date=2023-04-15&rft.volume=336&rft.spage=120815&rft.pages=120815-&rft.artnum=120815&rft.issn=0306-2619&rft_id=info:doi/10.1016/j.apenergy.2023.120815&rft_dat=%3Celsevier_cross%3ES0306261923001794%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c242t-5fb1ff5e82f7eefb5edcec1e71501378324f9c035feeeff18e9c4bcf45bc16a43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |