Opportunities and Challenges from Using Animal Videos in Reinforcement Learning for Navigation

We investigate the use of animal videos (observations) to improve Reinforcement Learning (RL) efficiency and performance in navigation tasks with sparse rewards. Motivated by theoretical considerations, we make use of weighted policy optimization for off-policy RL and describe the main challenges wh...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2022-11
Main Authors: Giammarino, Vittorio, Queeney, James, Carstensen, Lucas C, Hasselmo, Michael E, Paschalidis, Ioannis Ch
Format: Article
Language:English
Subjects:
Animals
Learning
Optimization
Video
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We investigate the use of animal videos (observations) to improve Reinforcement Learning (RL) efficiency and performance in navigation tasks with sparse rewards. Motivated by theoretical considerations, we make use of weighted policy optimization for off-policy RL and describe the main challenges when learning from animal videos. We propose solutions and test our ideas on a series of 2D navigation tasks. We show how our methods can leverage animal videos to improve performance over RL algorithms that do not leverage such observations.
ISSN:2331-8422