Neural similarity between overlapping events at learning differentially affects reinstatement across the cortex

• Published in: NeuroImage (Orlando, Fla.) Fla.), 2023-08, Vol.277, p.120220-120220, Article 120220
• Main Authors: Hebscher, Melissa, Bainbridge, Wilma A., Voss, Joel L.
• Format: Article
• Language: English
• Subjects: Brain; Brain Mapping; Functional magnetic resonance imaging; Humans; Information processing; Learning; Magnetic Resonance Imaging; Memory, Episodic; Mental Recall; Mental task performance; Neural networks; Occipital lobe; Recall; Reinstatement; Sensory integration; Somatosensory cortex; Temporal lobe
• ISSN: 1053-8119; 1095-9572
• DOI: 10.1016/j.neuroimage.2023.120220

•Visual similarity between videos predicts neural similarity across posterior cortex.•Events encoded with high neural dissimilarity are reinstated more in visual cortex.•Events encoded with high similarity show greater parietal/temporal reinstatement.•Integration at encoding predicts better memory recall in high-level sensory regions. Episodic memory often involves high overlap between the actors, locations, and objects of everyday events. Under some circumstances, it may be beneficial to distinguish, or differentiate, neural representations of similar events to avoid interference at recall. Alternatively, forming overlapping representations of similar events, or integration, may aid recall by linking shared information between memories. It is currently unclear how the brain supports these seemingly conflicting functions of differentiation and integration. We used multivoxel pattern similarity analysis (MVPA) of fMRI data and neural-network analysis of visual similarity to examine how highly overlapping naturalistic events are encoded in patterns of cortical activity, and how the degree of differentiation versus integration at encoding affects later retrieval. Participants performed an episodic memory task in which they learned and recalled naturalistic video stimuli with high feature overlap. Visually similar videos were encoded in overlapping patterns of neural activity in temporal, parietal, and occipital regions, suggesting integration. We further found that encoding processes differentially predicted later reinstatement across the cortex. In visual processing regions in occipital cortex, greater differentiation at encoding predicted later reinstatement. Higher-level sensory processing regions in temporal and parietal lobes showed the opposite pattern, whereby highly integrated stimuli showed greater reinstatement. Moreover, integration in high-level sensory processing regions during encoding predicted greater accuracy and vividness at recall. These findings provide novel evidence that encoding-related differentiation and integration processes across the cortex have divergent effects on later recall of highly similar naturalistic events.