Conflict between Guideline Methodologic Quality and Recommendation Validity: A Potential Problem for Practitioners

• Published in: Clinical chemistry (Baltimore, Md.) Md.), 2006-01, Vol.52 (1), p.65-72
• Main Authors: Watine, Joseph, Friedberg, Bruno, Nagy, Eva, Onody, Rita, Oosterhuis, Wytze, Bunting, Peter S, Charet, Jean-Christophe, Horvath, Andrea Rita
• Format: Article
• Language: English
• Subjects: Analytical, structural and metabolic biochemistry; Antigens; Biochemistry; Biological and medical sciences; Biomarkers; Cancer therapies; Carcinoma, Non-Small-Cell Lung - diagnosis; Chemotherapy; Clinical Chemistry Tests - methods; Clinical Chemistry Tests - standards; Evidence-Based Medicine; Fundamental and applied biological sciences. Psychology; Hemoglobin; Humans; International cooperation; Investigative techniques, diagnostic techniques (general aspects); Laboratories; Laboratory tests; Leukocytes; Lung cancer; Lung Neoplasms - diagnosis; Medical prognosis; Medical sciences; Patients; Practice Guidelines as Topic - standards; Quality Control; Reproducibility of Results; Surveillance; Systematic review; Validity
• ISSN: 0009-9147; 1530-8561
• DOI: 10.1373/clinchem.2005.056952

It is not clear if good methodologic quality in current practice guidelines necessarily leads to more valid recommendations, i.e., those that are supported with consistent research evidence or, when evidence is conflicting or lacking, with sufficient consensus among the guideline development team. To help clarify this issue, we assessed whether there is a link between methodologic quality and recommendation validity in practice guidelines for the use of laboratory tests in the management of patients with non-small cell lung cancer (NSCLC). We conducted a systematic review of data on laboratory tests in NSCLC published in English or in French within the last 10 years and retrieved 11 practice guidelines for the use of these tests. The guidelines were critically appraised and scored for methodologic quality and recommendation validity based on the Appraisal of Guidelines Research and Evaluation (AGREE) criteria and on the systematic review. Overall, these 11 guidelines had considerable shortcomings in methodologic quality and, to a lesser extent, in recommendation validity. Practice guidelines with the best methodologic quality were not necessarily the most valid in their recommendations, and conversely. Poor methodologic quality and lack of recommendation validity in laboratory medicine call for methodologic standards of guideline development and for international collaboration of guideline development agencies. We advise readers of guidelines to critically evaluate the methods used as well as the content of the recommendations before adopting them for use in practice.