Effects of methylphenidate on reinforcement learning depend on working memory capacity

• Published in: Psychopharmacology 2021-12, Vol.238 (12), p.3569-3584
• Main Authors: Rostami Kandroodi, Mojtaba, Cook, Jennifer L., Swart, Jennifer C., Froböse, Monja I., Geurts, Dirk E. M., Vahabie, Abdol-Hossein, Nili Ahmadabadi, Majid, Cools, Roshan, den Ouden, Hanneke E. M.
• Format: Article
• Language: English
• Subjects: Analysis; Biomedical and Life Sciences; Biomedicine; Blindness; Catecholamines; Choice learning; Computational neuroscience; Dosage and administration; Humans; Impulsive behavior; Machine learning; Memory, Short-Term; Methods; Methylphenidate; Methylphenidate - pharmacology; Methylphenidate hydrochloride; Neurosciences; Original Investigation; Pharmacology/Toxicology; Physiological aspects; Psychiatry; Psychological aspects; Punishment; Reinforcement; Reinforcement, Psychology; Reversal Learning; Reward; Short term memory
• ISSN: 0033-3158; 1432-2072
• DOI: 10.1007/s00213-021-05974-w

Rationale Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. Objectives and methods Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate’s effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample ( n  = 102) of healthy volunteers. Results Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. Conclusions This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function.