Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations

• Published in: IEEE transactions on power systems 2020-01, Vol.35 (1), p.814-817
• Main Authors: Duan, Jiajun, Shi, Di, Diao, Ruisheng, Li, Haifeng, Wang, Zhiwei, Zhang, Bei, Bian, Desong, Yi, Zhehan
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial intelligence; Automatic voltage control; autonomous voltage control; Computer simulation; DDPG; deep reinforcement learning; DQN; Electric potential; Generators; Grid Mind; Machine learning; Measuring instruments; PMU; Power grids; Supervisory control and data acquisition; Training; Voltage
• ISSN: 0885-8950; 1558-0679
• DOI: 10.1109/TPWRS.2019.2941134

In this letter, a novel autonomous control framework "Grid Mind" is proposed for the secure operation of power grids based on cutting-edge artificial intelligence (AI) technologies. The proposed platform provides a data-driven, model-free and closed-loop control agent trained using deep reinforcement learning (DRL) algorithms by interacting with massive simulations and/or real environment of a power grid. The proposed agent learns from scratch to master the power grid voltage control problem purely from data. It can make autonomous voltage control (AVC) strategies to support grid operators in making effective and timely control actions, according to the current system conditions detected by real-time measurements from supervisory control and data acquisition (SCADA) or phasor measurement units (PMUs). Two state-of-the-art DRL algorithms, namely deep Q-network (DQN) and deep deterministic policy gradient (DDPG), are proposed to formulate the AVC problem with performance compared. Case studies on a realistic 200-bus test system demonstrate the effectiveness and promising performance of the proposed framework.