Research on Electric Hydrogen Hybrid Storage Operation Strategy for Wind Power Fluctuation Suppression

• Published in: Energies (Basel) 2024-10, Vol.17 (20), p.5019
• Main Authors: Li, Dongsen, Qian, Kang, Gao, Ciwei, Xu, Yiyue, Xing, Qiang, Wang, Zhangfan
• Format: Article
• Language: English
• Subjects: Algorithms; Alternative energy sources; Control algorithms; Deep learning; deep reinforcement learning; electric hydrogen hybrid storage; Electric power production; Electricity; Electricity distribution; Energy storage; Entropy; Hydrogen; Markov decision process; Methods; modified proximal policy optimization; Optimization; Reinforcement learning (Machine learning); Renewable resources; Systems stability; Wavelet transforms; Wind farms; Wind power; wind power fluctuations
• ISSN: 1996-1073; 1996-1073
• DOI: 10.3390/en17205019

Due to real-time fluctuations in wind farm output, large-scale renewable energy (RE) generation poses significant challenges to power system stability. To address this issue, this paper proposes a deep reinforcement learning (DRL)-based electric hydrogen hybrid storage (EHHS) strategy to mitigate wind power fluctuations (WPFs). First, a wavelet packet power decomposition algorithm based on variable frequency entropy improvement is proposed. This algorithm characterizes the energy characteristics of the original wind power in different frequency bands. Second, to minimize WPF and the comprehensive operating cost of EHHS, an optimization model for suppressing wind power in the integrated power and hydrogen system (IPHS) is constructed. Next, considering the real-time and stochastic characteristics of wind power, the wind power smoothing model is transformed into a Markov decision process. A modified proximal policy optimization (MPPO) based on wind power deviation is proposed for training and solving. Based on the DRL agent’s real-time perception of wind power energy characteristics and the IPHS operation status, a WPF smoothing strategy is formulated. Finally, a numerical analysis based on a specific wind farm is conducted. The simulation results based on MATLAB R2021b show that the proposed strategy effectively suppresses WPF and demonstrates excellent convergence stability. The comprehensive performance of the MPPO is improved by 21.25% compared with the proximal policy optimization (PPO) and 42.52% compared with MPPO.