Evaluating Medical Devices Remotely: Current Methods and Potential Innovations

• Published in: Human factors 2020-11, Vol.62 (7), p.1041-1060
• Main Authors: McLaughlin, Anne Collins, DeLucia, Patricia R., Drews, Frank A., Vaughn-Cooke, Monifa, Kumar, Anil, Nesbitt, Robert R., Cluff, Kevin
• Format: Article
• Language: English
• Subjects: Cognitive ability; Data Collection; Equipment Design; How The HF/E Knowledge Base Can Contribute to Addressing The Coronavirus Crisis; Human factors; Humans; Laboratories; Medical equipment; Medical research; Medical technology; Psychology; Research Design; Technology; Three dimensional printing; Usability; Virtual prototyping
• ISSN: 0018-7208; 1547-8181; 1547-8181
• DOI: 10.1177/0018720820953644

Objective We present examples of laboratory and remote studies, with a focus on studies appropriate for medical device design and evaluation. From this review and description of extant options for remote testing, we provide methods and tools to achieve research goals remotely. Background The FDA mandates human factors evaluation of medical devices. Studies show similarities and differences in results collected in laboratories compared to data collected remotely in non-laboratory settings. Remote studies show promise, though many of these are behavioral studies related to cognitive or experimental psychology. Remote usability studies are rare but increasing, as technologies allow for synchronous and asynchronous data collection. Method We reviewed methods of remote evaluation of medical devices, from testing labels and instruction to usability testing and simulated use. Each method was coded for the attributes (e.g., supported media) that need consideration in usability studies. Results We present examples of how published usability studies of medical devices could be moved to remote data collection. We also present novel systems for creating such tests, such as the use of 3D printed or virtual prototypes. Finally, we advise on targeted participant recruitment. Conclusion Remote testing will bring opportunities and challenges to the field of medical device testing. Current methods are adequate for most purposes, excepting the validation of Class III devices. Application The tools we provide enable the remote evaluation of medical devices. Evaluations have specific research goals, and our framework of attributes helps to select or combine tools for valid testing of medical devices.