Model-Free Economic Dispatch for Virtual Power Plants: An Adversarial Safe Reinforcement Learning Approach

To address the model inaccuracy and uncertainty of virtual power plants (VPPs), a model-free economic dispatch approach for multiple VPPs is studied in this article, which does not rely on an accurate environmental model. An adversarial safe reinforcement learning approach is proposed, which promote...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on power systems 2024-03, Vol.39 (2), p.1-15
Main Authors: Yi, Zhongkai, Xu, Ying, Wu, Chenyu
Format: Article
Language:English
Subjects:
adversarial learning
Algorithms
Computer simulation
Deviation
Economic dispatch
Economic models
Load flow
Mathematical models
Parameter uncertainty
Power dispatch
Power systems
Reinforcement learning
Robustness (mathematics)
safe reinforcement learning
Safety
Security
Training
Uncertainty
virtual power plant
Virtual power plants
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To address the model inaccuracy and uncertainty of virtual power plants (VPPs), a model-free economic dispatch approach for multiple VPPs is studied in this article, which does not rely on an accurate environmental model. An adversarial safe reinforcement learning approach is proposed, which promotes the safety of the actions and makes the model robust to deviations between the training and testing environments. Moreover, a two-stage reinforcement learning framework is formulated based on the proposed algorithm. The dispatch policy is pretrained in the simulator and then fine-tuned in the real-world environment. The numerical simulations illustrate that the proposed approach is adaptive to the deviation between the training and testing environments, and it provides higher robustness to the noise of the network parameters and uncertainty of the VPPs' power outputs. The scalability and superiority of the proposed approach are verified by comparing it with existing methods.
ISSN:0885-8950
1558-0679
DOI:10.1109/TPWRS.2023.3289334