A single generic multi-source feedback tool for revalidation of all UK career-grade doctors: Does one size fit all?

Background: The UK Department of Health is considering a single, generic multi-source feedback (MSF) questionnaire to inform revalidation. Method: Evaluation of an implementation pilot, reporting: response rates, assessor mix, question redundancy and participants' perceptions. Reliability was e...

Full description

Saved in:
Bibliographic Details
Published in:Medical teacher 2011-02, Vol.33 (2), p.e75-e83
Main Authors: Mackillop, Lucy H., Crossley, Jim, Vivekananda-Schmidt, Pirashanthie, Wade, Winnie, Armitage, Mary
Format: Article
Language:English
Subjects:
Assessors
Clinical Competence
Doctors
Employee Performance Appraisal - methods
Feedback
Humans
Licensure - legislation & jurisprudence
Medicine
Peer Group
Physicians
Recertification
Reliability
Response rate
United Kingdom
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Background: The UK Department of Health is considering a single, generic multi-source feedback (MSF) questionnaire to inform revalidation. Method: Evaluation of an implementation pilot, reporting: response rates, assessor mix, question redundancy and participants' perceptions. Reliability was estimated using Generalisability theory. Results: A total of 12,540 responses were received on 977 doctors. The mean time taken to complete an MSF exercise was 68.2 days. The mean number of responses received per doctor was 12.0 (range 1-17) with no significant difference between specialties. Individual question response rates and participants' comments about questions indicate that some questions are less appropriate for some specialities. There was a significant difference in the mean score between specialities. Despite guidance, there were significant differences in the mix of assessors across specialties. More favourable scores were given by progressively more junior doctors. Nurses gave the most reliable scores. Conclusions: It is feasible to electronically administer a generic questionnaire to a large population of doctors. Generic content is appropriate for most but not all specialties. The differences in mean scores and the reliability of the MSF between specialties may be in part due to the specialty differences in assessor mix. Therefore the number and assessor mix should be standardised at specialty level and scores should not be compared across specialties.
ISSN:0142-159X
1466-187X
DOI:10.3109/0142159X.2010.535870