User-centered evaluation of adaptive and adaptable systems: a literature review

This literature review focuses on user-centered evaluation (UCE) studies of adaptive and adaptable systems. Usability, perceived usefulness and appropriateness of adaptation are the three most commonly assessed variables. Questionnaires appeared to be the most popular method, followed by interviews...

Full description

Saved in:
Bibliographic Details
Published in:Knowledge engineering review 2008-09, Vol.23 (3), p.261-281
Main Authors: VAN VELSEN, LEX, VAN DER GEEST, THEA, KLAASSEN, ROB, STEEHOUDER, MICHAËL
Format: Article
Language:English
Subjects:
Adaptation
Design
Interactive computer systems
Literature reviews
Methods
Questionnaires
Users
Validity
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This literature review focuses on user-centered evaluation (UCE) studies of adaptive and adaptable systems. Usability, perceived usefulness and appropriateness of adaptation are the three most commonly assessed variables. Questionnaires appeared to be the most popular method, followed by interviews and data log analysis. The quality of most questionnaires was questionable, and the reporting of interviews and think-aloud protocols was found to be shallow. Furthermore, data logs need triangulation in order to be useful. The reports encountered lack empirical value. The article models the iterative design process for adaptive and adaptable systems, linked to the goals of UCE: supporting decisions, detecting problems and verifying quality. This model summarizes the variables to be assessed at each stage of the process and the relevant methods to assess them.
ISSN:0269-8889
1469-8005
DOI:10.1017/S0269888908001379