Optimizing Battery Storage Systems in Energy Microgrids: A Reinforcement Learning Approach Comparing Multiple Reward Functions

• Main Authors: Ghione, Giorgia, Randazzo, Vincenzo, Badami, Marco, Pasero, Eros
• Format: Conference Proceeding
• Language: English
• Subjects: Batteries; Battery energy storage systems; Deep Reinforce-ment Learning; Energy Microgrids; Microgrids; Optimal control; Optimization; Power generation; Proximal Policy Optimization; Reinforcement learning; Renewable energy sources; Technological innovation; Training; Uncertainty
• ISSN: 2687-6817
• DOI: 10.1109/RTSI61910.2024.10761708

Battery Storage Systems (BSS) are increasingly utilized to enhance renewable energy consumption and operational stability in energy microgrids. However, the uncertainty characterizing renewable energy generation poses significant challenges in the optimal control of BSS. Multiple Reinforcement Learning (RL) approaches have been presented to solve this optimization problem. However, a comparison of different targets for the training of the RL systems is rarely performed. This work compares different reward functions that enable efficient BSS usage in the power plant of a transport hub while expressing the problem as a partially observable Markov Decision Process (POMDP). A Proximal Policy Optimization (PPO) algorithm is trained using reward functions derived from financial targets and BSS efficiency objectives. Results indicate that reward functions aligning BSS usage with market trends lead to superior performance compared to traditional earnings-based objectives. Furthermore, limitations regarding training episode numbers and reward normalization are identified, suggesting avenues for future research. This study contributes to advancing RL-based approaches for optimal BSS management in energy microgrid environments.