From Recurrent Choice to Skill Learning: A Reinforcement-Learning Model

The authors propose a reinforcement-learning mechanism as a model for recurrent choice and extend it to account for skill learning. The model was inspired by recent research in neurophysiological studies of the basal ganglia and provides an integrated explanation of recurrent choice behavior and ski...

Full description

Saved in:
Bibliographic Details
Published in:Journal of experimental psychology. General 2006-05, Vol.135 (2), p.184-206
Main Authors: Fu, Wai-Tat, Anderson, John R
Format: Article
Language:English
Subjects:
Animals
Basal Ganglia - physiology
Behavior
Behavioral Science Research
Biological and medical sciences
Brain
Choice Behavior
Cognition - physiology
Cognitive Measurement
Fundamental and applied biological sciences. Psychology
Goodness of Fit
Human
Humans
Item Analysis
Learning
Learning. Memory
Maze Learning
Models, Psychological
Multivariate Analysis
Neuropsychology
Probability
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics
Rats
Reinforcement
Reinforcement (Psychology)
Reinforcement Schedule
Serial Learning
Skill Development
Skill Learning
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The authors propose a reinforcement-learning mechanism as a model for recurrent choice and extend it to account for skill learning. The model was inspired by recent research in neurophysiological studies of the basal ganglia and provides an integrated explanation of recurrent choice behavior and skill learning. The behavior includes effects of differential probabilities, magnitudes, variabilities, and delay of reinforcement. The model can also produce the violation of independence, preference reversals, and the goal gradient of reinforcement in maze learning. An experiment was conducted to study learning of action sequences in a multistep task. The fit of the model to the data demonstrated its ability to account for complex skill learning. The advantages of incorporating the mechanism into a larger cognitive architecture are discussed.
ISSN:0096-3445
1939-2222
DOI:10.1037/0096-3445.135.2.184