The Structure and Acquisition of Sensorimotor Maps

• Published in: Journal of cognitive neuroscience 2018-03, Vol.30 (3), p.290-306
• Main Authors: van Vugt, Floris T., Ostry, David J.
• Format: Article
• Language: English
• Subjects: Arm; Auditory Perception; Computer applications; Computer Simulation; Control; Humans; Learning; Models, Psychological; Motor skill learning; Motor Skills; Movement; Sensorimotor system; Sound
• ISSN: 0898-929X; 1530-8898
• DOI: 10.1162/jocn_a_01204

One of the puzzles of learning to talk or play a musical instrument is how we learn which movement produces a particular sound: an audiomotor map. Existing research has used mappings that are already well learned such as controlling a cursor using a computer mouse. By contrast, the acquisition of novel sensorimotor maps was studied by having participants learn arm movements to auditory targets. These sounds did not come from different directions but, like speech, were only distinguished by their frequencies. It is shown that learning involves forming not one but two maps: a point map connecting sensory targets with motor commands and an error map linking sensory errors to motor corrections. Learning a point map is possible even when targets never repeat. Thus, although participants make errors, there is no opportunity to correct them because the target is different on every trial, and therefore learning cannot be driven by error correction. Furthermore, when the opportunity for error correction is provided, it is seen that acquiring error correction is itself a learning process that changes over time and results in an error map. In principle, the error map could be derived from the point map, but instead, these two maps are independently acquired and jointly enable sensorimotor control and learning. A computational model shows that this dual encoding is optimal and simulations based on this architecture predict that learning the two maps results in performance improvements comparable with those observed empirically.