Speech, Facial and Fine Motor Features for Conversation-Based Remote Assessment and Monitoring of Parkinson's Disease

We present a cloud-based multimodal dialogue platform for the remote assessment and monitoring of speech, facial and fine motor function in Parkinson's Disease (PD) at scale, along with a preliminary investigation of the efficacy of the various metrics automatically extracted by the platform. 2...

Full description

Saved in:
Bibliographic Details
Main Authors: Kothare, Hardik, Roesler, Oliver, Burke, William, Neumann, Michael, Liscombe, Jackson, Exner, Andrew, Snyder, Sandy, Cornish, Andrew, Habberstad, Doug, Pautler, David, Suendermann-Oeft, David, Huber, Jessica, Ramanarayanan, Vikram
Format: Conference Proceeding
Language:English
Subjects:
Batteries
Biology
Fingers
Kinematics
Parkinson's disease
Reliability
Sensitivity
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a cloud-based multimodal dialogue platform for the remote assessment and monitoring of speech, facial and fine motor function in Parkinson's Disease (PD) at scale, along with a preliminary investigation of the efficacy of the various metrics automatically extracted by the platform. 22 healthy controls and 38 people with Parkinson's Disease (pPD) were instructed to complete four interactive sessions, spaced a week apart, on the platform. Each session involved a battery of tasks designed to elicit speech, facial movements and finger movements. We find that speech, facial kinematic and finger movement dexterity metrics show statistically significant differences between controls and pPD. We further investigate the sensitivity, specificity, reliability and generalisability of these metrics. Our results offer encouraging evidence for the utility of automatically-extracted audiovisual analytics in remote mon-itoring of PD and other movement disorders.
ISSN:2694-0604
DOI:10.1109/EMBC48229.2022.9871375