Ex-RL: Experience-based reinforcement learning

Reinforcement learning (RL) has achieved significant success across various tasks. However, generalizing RL for similar tasks remains a challenge. This study leverages expertise from related tasks to introduce a novel algorithm, Ex-RL, for executing transfer learning in tabular RL. The methodology c...

Full description

Saved in:
Bibliographic Details
Published in:Information sciences 2025-01, Vol.689, Article 121479
Main Authors: Ghandi, Ali, Shouraki, Saeed Bagheri, Gholampour, Iman, Kamranian, Azam, Riazati, Mahyar
Format: Article
Language:English
Subjects:
Experience-based learning
Meta-learning
Reinforcement learning
Transfer-learning
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Reinforcement learning (RL) has achieved significant success across various tasks. However, generalizing RL for similar tasks remains a challenge. This study leverages expertise from related tasks to introduce a novel algorithm, Ex-RL, for executing transfer learning in tabular RL. The methodology concentrates on abstracting previous experiences into descriptive data and utilizing such data for similar tasks. The research focuses on classic RL solutions for balancing and anti-balancing, which improve the sample efficiency of the learning process. Studies indicate that weak learners, such as Q-learning, require fewer learning episodes, resulting in a 50% improvement and a higher success rate in the learning process. An online virtual lab was developed to facilitate the execution of the experiments. The code is available at Github.
ISSN:0020-0255
DOI:10.1016/j.ins.2024.121479