MRGazer: decoding eye gaze points from functional magnetic resonance imaging in individual space

. Eye-tracking research has proven valuable in understanding numerous cognitive functions. Recently, Frey provided an exciting deep learning method for learning eye movements from functional magnetic resonance imaging (fMRI) data. It employed the multi-step co-registration of fMRI into the group tem...

Full description

Saved in:
Bibliographic Details
Published in:Journal of neural engineering 2024-08, Vol.21 (4), p.46048
Main Authors: Wu, Xiuwen, Hu, Rongjie, Liang, Jie, Wang, Yanming, Qiu, Bensheng, Wang, Xiaoxiao
Format: Article
Language:English
Subjects:
Adult
Brain - diagnostic imaging
Brain - physiology
deep convolutional neural networks
Deep Learning
digital morphology operation
Eye Movements - physiology
eye tracking
Eye-Tracking Technology
Female
Fixation, Ocular - physiology
fMRI analysis
Humans
Magnetic Resonance Imaging - methods
Male
object detection
Young Adult
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:. Eye-tracking research has proven valuable in understanding numerous cognitive functions. Recently, Frey provided an exciting deep learning method for learning eye movements from functional magnetic resonance imaging (fMRI) data. It employed the multi-step co-registration of fMRI into the group template to obtain eyeball signal, and thus required additional templates and was time consuming. To resolve this issue, in this paper, we propose a framework named MRGazer for predicting eye gaze points from fMRI in individual space. . The MRGazer consists of an eyeball extraction module and a residual network-based eye gaze prediction module. Compared to the previous method, the proposed framework skips the fMRI co-registration step, simplifies the processing protocol, and achieves end-to-end eye gaze regression. . The proposed method achieved superior performance in eye fixation regression (Euclidean error, EE = 2.04°) than the co-registration-based method (EE = 2.89°), and delivered objective results within a shorter time (∼0.02 s volume ) than prior method (∼0.3 s volume ). . The MRGazer is an efficient, simple, and accurate deep learning framework for predicting eye movement from fMRI data, and can be employed during fMRI scans in psychological and cognitive research. The code is available athttps://github.com/ustc-bmec/MRGazer.
ISSN:1741-2560
1741-2552
1741-2552
DOI:10.1088/1741-2552/ad6185