Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems

Despite the increased focus on usability and on the processes and methods used to increase usability, a substantial amount of software is unusable and poorly designed. Much of this is attributable to the lack of cost-effective usability evaluation tools that provide an interaction-based framework fo...

Full description

Saved in:
Bibliographic Details
Published in:Human factors 2003-09, Vol.45 (3), p.455-482
Main Authors: Andre, Terence S., Hartson, H. Rex, Williges, Robert C.
Format: Article
Language:English
Subjects:
Adult
Applied psychology
Biological and medical sciences
Computer Simulation
Computer software industry
Decision Making, Computer-Assisted
Ergonomics
Female
Fundamental and applied biological sciences. Psychology
Humans
Male
Man-Machine Systems
Methods
Miscellaneous
Models, Psychological
Problem solving
Product development
Product Line Management
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Reproducibility of Results
Research Design
Space life sciences
Task Performance and Analysis
User-Computer Interface
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Despite the increased focus on usability and on the processes and methods used to increase usability, a substantial amount of software is unusable and poorly designed. Much of this is attributable to the lack of cost-effective usability evaluation tools that provide an interaction-based framework for identifying problems. We developed the user action framework and a corresponding evaluation tool, the usability problem inspector (UPI), to help organize usability concepts and issues into a knowledge base. We conducted a comprehensive comparison study to determine if our theory-based framework and tool could be effectively used to find important usability problems in an interface design, relative to two other established inspection methods (heuristic evaluation and cognitive walkthrough). Results showed that the UPI scored higher than heuristic evaluation in terms of thoroughness, validity, and effectiveness and was consistent with cognitive walkthrough for these same measures. We also discuss other potential advantages of the UPI over heuristic evaluation and cognitive walkthrough when applied in practice. Potential applications of this work include a cost-effective alternative or supplement to lab-based formative usability evaluation during any stage of development.
ISSN:0018-7208
1547-8181
DOI:10.1518/hfes.45.3.455.27255