A Review on Interactive Reinforcement Learning From Human Social Feedback

Reinforcement learning agent learns how to perform a task by interacting with the environment. The use of reinforcement learning in real-life applications has been limited because of the sample efficiency problem. Interactive reinforcement learning has been developed to speed up the agent's lea...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2020, Vol.8, p.120757-120765
Main Authors: Lin, Jinying, Ma, Zhen, Gomez, Randy, Nakamura, Keisuke, He, Bo, Li, Guangliang
Format: Article
Language:English
Subjects:
Feedback
Feeds
Human agent/robot interaction
interactive reinforcement learning
interactive shaping
Learning
Numerical models
Reinforcement learning
Robots
social interaction
Task analysis
Training
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Reinforcement learning agent learns how to perform a task by interacting with the environment. The use of reinforcement learning in real-life applications has been limited because of the sample efficiency problem. Interactive reinforcement learning has been developed to speed up the agent's learning and facilitate to learn from ordinary people by allowing them to provide social feedback, e.g, evaluative feedback, advice or instruction. Inspired by real-life biological learning scenarios, there could be many ways to provide feedback for agent learning, such as via hardware delivered, natural interaction like facial expressions, speech or gestures. The agent can even learn from feedback via unimodal or multimodal sensory input. This paper reviews methods for interactive reinforcement learning agent to learn from human social feedback and the ways of delivering feedback. Finally, we discuss some open problems and possible future research directions.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2020.3006254