DEVAN: A tool for detailed video analysis of user test data

• Published in: Behaviour & information technology 2002-11, Vol.21 (6), p.403-423
• Main Authors: Vermeeren, Arnold P. O. S., den Bouwmeester, Karin, Aasman, Jans, de Ridder, Huib
• Format: Article
• Language: English
• Subjects: Exact sciences and technology; Information and communication sciences; Information science. Documentation; Library and information science. General aspects; Sciences and techniques of general use; Usability testing; Use and user studies. Information needs; Video
• ISSN: 0144-929X; 1362-3001
• DOI: 10.1080/0144929021000051714

A tool was developed for structured and detailed analysis of video data from user tests of interactive systems. It makes use of a table format for representing an interaction at multiple levels of abstraction. Interactions are segmented based on threshold times for pauses between actions. Usability problems are found using a list of observable indications for the occurrence of problems. The tool was evaluated by having two analysts apply it to three data sets from user tests on two different products. The segmentation technique proved to yield meaningful segments that helped in understanding the interaction. The interaction table was explicit enough to discuss in detail what had caused the differences in the analysts' lists of usability problems. The results suggested that the majority of differences were caused by unavoidable differences in interpretations of subjects' behaviour and that only minor improvements should be expected by refining the tool.