Optimization Strategies for Atari Game Environments: Integrating Snake Optimization Algorithm and Energy Valley Optimization in Reinforcement Learning Models

• Published in: AI (Basel) 2024-09, Vol.5 (3), p.1172-1191
• Main Authors: Sarkhi, Sadeq Mohammed Kadhm, Koyuncu, Hakan
• Format: Article
• Language: English
• Subjects: agent; Algorithms; Artificial intelligence; Automation; Datasets; Decision making; Deep learning; ESO; EVO; Games; Heuristic methods; Human performance; Machine learning; metaheuristic; Neural networks; Optimization; Optimization techniques; Real time; Recommender systems; reinforcement learning; Robotics; SOA; State-of-the-art reviews
• ISSN: 2673-2688; 2673-2688
• DOI: 10.3390/ai5030057

One of the biggest problems in gaming AI is related to how we can optimize and adapt a deep reinforcement learning (DRL) model, especially when it is running inside complex, dynamic environments like “PacMan”. The existing research has concentrated more or less on basic DRL approaches though the utilization of advanced optimization methods. This paper tries to fill these gaps by proposing an innovative methodology that combines DRL with high-level metaheuristic optimization methods. The work presented in this paper specifically refactors DRL models on the “PacMan” domain with Energy Serpent Optimizer (ESO) for hyperparameter search. These novel adaptations give a major performance boost to the AI agent, as these are where its adaptability, response time, and efficiency gains start actually showing in the more complex game space. This work innovatively incorporates the metaheuristic optimization algorithm into another field—DRL—for Atari gaming AI. This integration is essential for the improvement of DRL models in general and allows for more efficient and real-time game play. This work delivers a comprehensive empirical study for these algorithms that not only verifies their capabilities in practice but also sets a state of the art through the prism of AI-driven game development. More than simply improving gaming AI, the developments could eventually apply to more sophisticated gaming environments, ongoing improvement of algorithms during execution, real-time adaptation regarding learning, and likely even robotics/autonomous systems. This study further illustrates the necessity for even-handed and conscientious application of AI in gaming—specifically regarding questions of fairness and addiction.