Reliability and Validity of Noncognitive Ecological Momentary Assessment Survey Response Times as an Indicator of Cognitive Processing Speed in People's Natural Environment: Intensive Longitudinal Study

• Published in: JMIR mHealth and uHealth 2023-05, Vol.11, p.e45203-e45203
• Main Authors: Hernandez, Raymond, Hoogendoorn, Claire, Gonzalez, Jeffrey S, Jin, Haomiao, Pyatak, Elizabeth A, Spruijt-Metz, Donna, Junghaenel, Doerte U, Lee, Pey-Jiuan, Schneider, Stefan
• Format: Article
• Language: English
• Subjects: Adult; Breast cancer; Chronic fatigue syndrome; Chronic illnesses; Cognition & reasoning; Cognitive ability; Diabetes; Ecological Momentary Assessment; Fatigue; Glucose; Humans; Investigations; Longitudinal Studies; Mental depression; Original Paper; Processing Speed; Reaction Time; Reproducibility of Results; Smartphones; Surveys and Questionnaires; Validity
• ISSN: 2291-5222; 2291-5222
• DOI: 10.2196/45203

Various populations with chronic conditions are at risk for decreased cognitive performance, making assessment of their cognition important. Formal mobile cognitive assessments measure cognitive performance with greater ecological validity than traditional laboratory-based testing but add to participant task demands. Given that responding to a survey is considered a cognitively demanding task itself, information that is passively collected as a by-product of ecological momentary assessment (EMA) may be a means through which people's cognitive performance in their natural environment can be estimated when formal ambulatory cognitive assessment is not feasible. We specifically examined whether the item response times (RTs) to EMA questions (eg, mood) can serve as approximations of cognitive processing speed. This study aims to investigate whether the RTs from noncognitive EMA surveys can serve as approximate indicators of between-person (BP) differences and momentary within-person (WP) variability in cognitive processing speed. Data from a 2-week EMA study investigating the relationships among glucose, emotion, and functioning in adults with type 1 diabetes were analyzed. Validated mobile cognitive tests assessing processing speed (Symbol Search task) and sustained attention (Go-No Go task) were administered together with noncognitive EMA surveys 5 to 6 times per day via smartphones. Multilevel modeling was used to examine the reliability of EMA RTs, their convergent validity with the Symbol Search task, and their divergent validity with the Go-No Go task. Other tests of the validity of EMA RTs included the examination of their associations with age, depression, fatigue, and the time of day. Overall, in BP analyses, evidence was found supporting the reliability and convergent validity of EMA question RTs from even a single repeatedly administered EMA item as a measure of average processing speed. BP correlations between the Symbol Search task and EMA RTs ranged from 0.43 to 0.58 (P