Moving Psychological Assessment Out of the Controlled Laboratory Setting: Practical Challenges

• Published in: Psychological assessment 2019-03, Vol.31 (3), p.292-303
• Main Authors: Holmlund, Terje B, Foltz, Peter W, Cohen, Alex S, Johansen, Håvard D, Sigurdsen, Randi, Fugelli, Pål, Bergsager, Dagfinn, Cheng, Jian, Bernstein, Jared, Rosenfeld, Elizabeth, Elvevåg, Brita
• Format: Article
• Language: English
• Subjects: Behavioral Assessment; Behavioral Research - methods; Behavioral Research - standards; Clinical psychology: 262; Cognition; Cognition & reasoning; Cross Cultural Differences; Data Collection; Engineering; Health risk assessment; Human; Humans; Informed Consent; Klinisk psykologi: 262; Language; Legal Processes; Mental Health; Mobile Health; Motor ability; Motor Skills; Privileged Communication; Psychological Assessment; Psychological tests; Psychology: 260; Psychometrics - methods; Psychometrics - standards; Psykologi: 260; Samfunnsvitenskap: 200; Social science: 200; Tactual Perception; Technology; Telemedicine - methods; Telemedicine - standards; VDP
• ISSN: 1040-3590; 1939-134X; 1939-134X
• DOI: 10.1037/pas0000647

Behavioral assessment using smart devices affords novel methods, notably remote self-administration by the individuals themselves. However, this new approach requires navigating complex legal and technical terrain. Given the limited empirical data that currently exists, we provide and discuss anecdotes of the methodological, technical, legal, and cultural issues associated with an implementation in both U.S. and European settings of a mobile software application for regular psychological monitoring purposes. The tasks required participants to listen, watch, speak, and touch to interact with the smart device, thus assessing cognition, motor skill, and language. Four major findings merit mention: First, moving assessment out of the hands of a trained investigator necessitates excellent usability engineering, such that the tool is easily usable by the participant and the resulting data relevant to the investigator. Second, remote assessment requires that the data are transferred safely back to the investigator, and that risk of compromising participant confidentiality is minimized. Third, frequent data collection over long periods of time is associated with a possibility that participants may choose to withdraw consent for participation thus requiring data retraction. Fourth, data collection and analysis across international borders creates new challenges and new opportunities because of important cultural and language issues that may inform the underlying behavioral constructs of interest. In conclusion, the new technological frameworks provide unprecedented opportunities for remote self-administered behavioral assessments but will be most productive in multidisciplinary teams to ensure the highest level of user satisfaction and data quality, and to guarantee the highest level of data protection. Public Significance Statement Technologically it is now possible to collect a variety of behavioral measurements frequently and remotely via smart devices operated by the individuals themselves. This article describes the implementation in the U.S. and Europe of mobile psychological assessment software for regular monitoring purposes. Although new technology affords an unprecedented opportunity for psychological assessment, these new approaches are accompanied by important methodological, technical, legal, and cultural issues that must be addressed so as to guarantee the highest possible quality, value, and security of each participant's data.