Loading…
Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance
Most existing data-driven power system short-term voltage stability assessment (STVSA) approaches presume class-balanced input data. However, in practical applications, the occurrence of short-term voltage instability following a disturbance is minimal, leading to a significant class imbalance probl...
Saved in:
Published in: | Renewable & sustainable energy reviews 2024-01, Vol.189, p.113913, Article 113913 |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13 |
---|---|
cites | cdi_FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13 |
container_end_page | |
container_issue | |
container_start_page | 113913 |
container_title | Renewable & sustainable energy reviews |
container_volume | 189 |
creator | Li, Yang Cao, Jiting Xu, Yan Zhu, Lipeng Dong, Zhao Yang |
description | Most existing data-driven power system short-term voltage stability assessment (STVSA) approaches presume class-balanced input data. However, in practical applications, the occurrence of short-term voltage instability following a disturbance is minimal, leading to a significant class imbalance problem and a consequent decline in classifier performance. This work proposes a Transformer-based STVSA method to address this challenge. By utilizing the basic Transformer architecture, a stability assessment Transformer (StaaT) is developed as a classification model to reflect the correlation between the operational states of the system and the resulting stability outcomes. To combat the negative impact of imbalanced datasets, this work employs a conditional Wasserstein generative adversarial network with gradient penalty (CWGAN-GP) for synthetic data generation, aiding in the creation of a balanced, representative training set for the classifier. Semi-supervised clustering learning is implemented to enhance clustering quality, addressing the lack of a unified quantitative criterion for short-term voltage stability. Numerical tests on the IEEE 39-bus test system extensively demonstrate that the proposed method exhibits robust performance under class imbalances up to 100:1 and noisy environments, and maintains consistent effectiveness even with an increased penetration of renewable energy. Comparative results reveal that the CWGAN-GP generates more balanced datasets than traditional oversampling methods and that the StaaT outperforms other deep learning algorithms. This study presents a compelling solution for real-world STVSA applications that often face class imbalance and data noise challenges.
[Display omitted]
•The class imbalance issue is addressed using balanced samples generated by CWGAN-GP.•StaaT with multi-head self-attention mechanisms learns important features.•SFCM labels samples undeterminable directly by domain knowledge.•StaaT exceeds other methods, showing robustness amid class imbalances and noises. |
doi_str_mv | 10.1016/j.rser.2023.113913 |
format | article |
fullrecord | <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_rser_2023_113913</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1364032123007712</els_id><sourcerecordid>S1364032123007712</sourcerecordid><originalsourceid>FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13</originalsourceid><addsrcrecordid>eNp9kMtKQzEQhoMoWKsv4CovcI6TpD0XcCP1CgU3dR2SnDltyrmUTGzpwnc3pa5dzfAP3_DzMXYvIBcgiodtHghDLkGqXAhVC3XBJqIq6wyKGi7TropZBkqKa3ZDtAUQ86pUE_bzjLjjHZow-GHNrSFs-DjwVTADtWPoMXAT3MZHdPE7IE8Z342HFNORIvacNmOIWcTQ8_3YRbNGTtFY3_l45IYIiXocIj_4uOGuSwn3vTWdGRzesqvWdIR3f3PKvl5fVov3bPn59rF4WmZOAcRMGeGkmlUWbYFQz8rS1E7IRkJhS-mErXBmpGpU0xbKAcwlVI0FbOetEJURasrk-a8LI1HAVu-C7004agH6JFBv9UmgPgnUZ4EJejxDmJrtfbqS85haNz4kGboZ_X_4L-C8fSc</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance</title><source>Elsevier</source><creator>Li, Yang ; Cao, Jiting ; Xu, Yan ; Zhu, Lipeng ; Dong, Zhao Yang</creator><creatorcontrib>Li, Yang ; Cao, Jiting ; Xu, Yan ; Zhu, Lipeng ; Dong, Zhao Yang</creatorcontrib><description>Most existing data-driven power system short-term voltage stability assessment (STVSA) approaches presume class-balanced input data. However, in practical applications, the occurrence of short-term voltage instability following a disturbance is minimal, leading to a significant class imbalance problem and a consequent decline in classifier performance. This work proposes a Transformer-based STVSA method to address this challenge. By utilizing the basic Transformer architecture, a stability assessment Transformer (StaaT) is developed as a classification model to reflect the correlation between the operational states of the system and the resulting stability outcomes. To combat the negative impact of imbalanced datasets, this work employs a conditional Wasserstein generative adversarial network with gradient penalty (CWGAN-GP) for synthetic data generation, aiding in the creation of a balanced, representative training set for the classifier. Semi-supervised clustering learning is implemented to enhance clustering quality, addressing the lack of a unified quantitative criterion for short-term voltage stability. Numerical tests on the IEEE 39-bus test system extensively demonstrate that the proposed method exhibits robust performance under class imbalances up to 100:1 and noisy environments, and maintains consistent effectiveness even with an increased penetration of renewable energy. Comparative results reveal that the CWGAN-GP generates more balanced datasets than traditional oversampling methods and that the StaaT outperforms other deep learning algorithms. This study presents a compelling solution for real-world STVSA applications that often face class imbalance and data noise challenges.
[Display omitted]
•The class imbalance issue is addressed using balanced samples generated by CWGAN-GP.•StaaT with multi-head self-attention mechanisms learns important features.•SFCM labels samples undeterminable directly by domain knowledge.•StaaT exceeds other methods, showing robustness amid class imbalances and noises.</description><identifier>ISSN: 1364-0321</identifier><identifier>EISSN: 1879-0690</identifier><identifier>DOI: 10.1016/j.rser.2023.113913</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Class imbalance ; Conditional wasserstein generative adversarial network with gradient penalty (CWGAN-GP) ; Power system ; Renewable energy penetration ; Short-term voltage stability assessment ; Transformer architecture</subject><ispartof>Renewable & sustainable energy reviews, 2024-01, Vol.189, p.113913, Article 113913</ispartof><rights>2023 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13</citedby><cites>FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13</cites><orcidid>0000-0002-2151-1745 ; 0000-0002-6515-4567 ; 0000-0001-6051-9064</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Li, Yang</creatorcontrib><creatorcontrib>Cao, Jiting</creatorcontrib><creatorcontrib>Xu, Yan</creatorcontrib><creatorcontrib>Zhu, Lipeng</creatorcontrib><creatorcontrib>Dong, Zhao Yang</creatorcontrib><title>Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance</title><title>Renewable & sustainable energy reviews</title><description>Most existing data-driven power system short-term voltage stability assessment (STVSA) approaches presume class-balanced input data. However, in practical applications, the occurrence of short-term voltage instability following a disturbance is minimal, leading to a significant class imbalance problem and a consequent decline in classifier performance. This work proposes a Transformer-based STVSA method to address this challenge. By utilizing the basic Transformer architecture, a stability assessment Transformer (StaaT) is developed as a classification model to reflect the correlation between the operational states of the system and the resulting stability outcomes. To combat the negative impact of imbalanced datasets, this work employs a conditional Wasserstein generative adversarial network with gradient penalty (CWGAN-GP) for synthetic data generation, aiding in the creation of a balanced, representative training set for the classifier. Semi-supervised clustering learning is implemented to enhance clustering quality, addressing the lack of a unified quantitative criterion for short-term voltage stability. Numerical tests on the IEEE 39-bus test system extensively demonstrate that the proposed method exhibits robust performance under class imbalances up to 100:1 and noisy environments, and maintains consistent effectiveness even with an increased penetration of renewable energy. Comparative results reveal that the CWGAN-GP generates more balanced datasets than traditional oversampling methods and that the StaaT outperforms other deep learning algorithms. This study presents a compelling solution for real-world STVSA applications that often face class imbalance and data noise challenges.
[Display omitted]
•The class imbalance issue is addressed using balanced samples generated by CWGAN-GP.•StaaT with multi-head self-attention mechanisms learns important features.•SFCM labels samples undeterminable directly by domain knowledge.•StaaT exceeds other methods, showing robustness amid class imbalances and noises.</description><subject>Class imbalance</subject><subject>Conditional wasserstein generative adversarial network with gradient penalty (CWGAN-GP)</subject><subject>Power system</subject><subject>Renewable energy penetration</subject><subject>Short-term voltage stability assessment</subject><subject>Transformer architecture</subject><issn>1364-0321</issn><issn>1879-0690</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kMtKQzEQhoMoWKsv4CovcI6TpD0XcCP1CgU3dR2SnDltyrmUTGzpwnc3pa5dzfAP3_DzMXYvIBcgiodtHghDLkGqXAhVC3XBJqIq6wyKGi7TropZBkqKa3ZDtAUQ86pUE_bzjLjjHZow-GHNrSFs-DjwVTADtWPoMXAT3MZHdPE7IE8Z342HFNORIvacNmOIWcTQ8_3YRbNGTtFY3_l45IYIiXocIj_4uOGuSwn3vTWdGRzesqvWdIR3f3PKvl5fVov3bPn59rF4WmZOAcRMGeGkmlUWbYFQz8rS1E7IRkJhS-mErXBmpGpU0xbKAcwlVI0FbOetEJURasrk-a8LI1HAVu-C7004agH6JFBv9UmgPgnUZ4EJejxDmJrtfbqS85haNz4kGboZ_X_4L-C8fSc</recordid><startdate>202401</startdate><enddate>202401</enddate><creator>Li, Yang</creator><creator>Cao, Jiting</creator><creator>Xu, Yan</creator><creator>Zhu, Lipeng</creator><creator>Dong, Zhao Yang</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-2151-1745</orcidid><orcidid>https://orcid.org/0000-0002-6515-4567</orcidid><orcidid>https://orcid.org/0000-0001-6051-9064</orcidid></search><sort><creationdate>202401</creationdate><title>Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance</title><author>Li, Yang ; Cao, Jiting ; Xu, Yan ; Zhu, Lipeng ; Dong, Zhao Yang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Class imbalance</topic><topic>Conditional wasserstein generative adversarial network with gradient penalty (CWGAN-GP)</topic><topic>Power system</topic><topic>Renewable energy penetration</topic><topic>Short-term voltage stability assessment</topic><topic>Transformer architecture</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Yang</creatorcontrib><creatorcontrib>Cao, Jiting</creatorcontrib><creatorcontrib>Xu, Yan</creatorcontrib><creatorcontrib>Zhu, Lipeng</creatorcontrib><creatorcontrib>Dong, Zhao Yang</creatorcontrib><collection>CrossRef</collection><jtitle>Renewable & sustainable energy reviews</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Li, Yang</au><au>Cao, Jiting</au><au>Xu, Yan</au><au>Zhu, Lipeng</au><au>Dong, Zhao Yang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance</atitle><jtitle>Renewable & sustainable energy reviews</jtitle><date>2024-01</date><risdate>2024</risdate><volume>189</volume><spage>113913</spage><pages>113913-</pages><artnum>113913</artnum><issn>1364-0321</issn><eissn>1879-0690</eissn><abstract>Most existing data-driven power system short-term voltage stability assessment (STVSA) approaches presume class-balanced input data. However, in practical applications, the occurrence of short-term voltage instability following a disturbance is minimal, leading to a significant class imbalance problem and a consequent decline in classifier performance. This work proposes a Transformer-based STVSA method to address this challenge. By utilizing the basic Transformer architecture, a stability assessment Transformer (StaaT) is developed as a classification model to reflect the correlation between the operational states of the system and the resulting stability outcomes. To combat the negative impact of imbalanced datasets, this work employs a conditional Wasserstein generative adversarial network with gradient penalty (CWGAN-GP) for synthetic data generation, aiding in the creation of a balanced, representative training set for the classifier. Semi-supervised clustering learning is implemented to enhance clustering quality, addressing the lack of a unified quantitative criterion for short-term voltage stability. Numerical tests on the IEEE 39-bus test system extensively demonstrate that the proposed method exhibits robust performance under class imbalances up to 100:1 and noisy environments, and maintains consistent effectiveness even with an increased penetration of renewable energy. Comparative results reveal that the CWGAN-GP generates more balanced datasets than traditional oversampling methods and that the StaaT outperforms other deep learning algorithms. This study presents a compelling solution for real-world STVSA applications that often face class imbalance and data noise challenges.
[Display omitted]
•The class imbalance issue is addressed using balanced samples generated by CWGAN-GP.•StaaT with multi-head self-attention mechanisms learns important features.•SFCM labels samples undeterminable directly by domain knowledge.•StaaT exceeds other methods, showing robustness amid class imbalances and noises.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.rser.2023.113913</doi><orcidid>https://orcid.org/0000-0002-2151-1745</orcidid><orcidid>https://orcid.org/0000-0002-6515-4567</orcidid><orcidid>https://orcid.org/0000-0001-6051-9064</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1364-0321 |
ispartof | Renewable & sustainable energy reviews, 2024-01, Vol.189, p.113913, Article 113913 |
issn | 1364-0321 1879-0690 |
language | eng |
recordid | cdi_crossref_primary_10_1016_j_rser_2023_113913 |
source | Elsevier |
subjects | Class imbalance Conditional wasserstein generative adversarial network with gradient penalty (CWGAN-GP) Power system Renewable energy penetration Short-term voltage stability assessment Transformer architecture |
title | Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T23%3A32%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deep%20learning%20based%20on%20Transformer%20architecture%20for%20power%20system%20short-term%20voltage%20stability%20assessment%20with%20class%20imbalance&rft.jtitle=Renewable%20&%20sustainable%20energy%20reviews&rft.au=Li,%20Yang&rft.date=2024-01&rft.volume=189&rft.spage=113913&rft.pages=113913-&rft.artnum=113913&rft.issn=1364-0321&rft.eissn=1879-0690&rft_id=info:doi/10.1016/j.rser.2023.113913&rft_dat=%3Celsevier_cross%3ES1364032123007712%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c300t-3a1c2348beb6e09477a9c12d206b72c1b8e4a23d3df63c005208db0ef5f118a13%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |