Extrastriate Visual Areas Integrate Form Features over Space and Time to Construct Representations of Stationary and Rigidly Rotating Objects

• Published in: Journal of cognitive neuroscience 2015-11, Vol.27 (11), p.2158-2173
• Main Authors: McCarthy, J. Daniel, Kohler, Peter J., Tse, Peter U., Caplovitz, Gideon Paul
• Format: Article
• Language: English
• Subjects: Analysis of Variance; Brain; Brain Mapping; Correlation analysis; Female; Humans; Image Processing, Computer-Assisted; Information processing; Linear Models; Magnetic Resonance Imaging; Male; Neurons; Neuropsychology; NMR; Nuclear magnetic resonance; Photic Stimulation; Sensory perception; Space Perception - physiology; Time Perception - physiology; Visual Cortex - blood supply; Visual Cortex - physiology; Visual Fields - physiology
• ISSN: 0898-929X; 1530-8898
• DOI: 10.1162/jocn_a_00850

When an object moves behind a bush, for example, its visible fragments are revealed at different times and locations across the visual field. Nonetheless, a whole moving object is perceived. Unlike traditional modal and amodal completion mechanisms known to support spatial form integration when all parts of a stimulus are simultaneously visible, relatively little is known about the neural substrates of the spatiotemporal form integration (STFI) processes involved in generating coherent object representations from a succession visible fragments. We used fMRI to identify brain regions involved in two mechanisms supporting the representation of stationary and rigidly rotating objects whose form features are shown in succession: STFI and position updating. STFI allows past and present form cues to be integrated over space and time into a coherent object even when the object is not visible in any given frame. STFI can occur whether or not the object is moving. Position updating allows us to perceive a moving object, whether rigidly rotating or translating, even when its form features are revealed at different times and locations in space. Our results suggest that STFI is mediated by visual regions beyond V1 and V2. Moreover, although widespread cortical activation has been observed for other motion percepts derived solely from form-based analyses [Tse, P. U. Neural correlates of transformational apparent motion. 766–773, 2006; Krekelberg, B., Vatakis, A., & Kourtzi, Z. Implied motion from form in the human visual cortex. 4373–4386, 2005], increased responses for the position updating that lead to rigidly rotating object representations were only observed in visual areas KO and possibly hMT+, indicating that this is a distinct and highly specialized type of processing.