Original article
Incorporating variations in the quality of individual randomized trials into meta-analysis

https://doi.org/10.1016/0895-4356(92)90085-2Get rights and content

Abstract

Meta-analysis is a method of synthesizing evidence from multiple sources. It has been increasingly applied to combine results from randomized trials of therapeutic strategies. Unfortunately there is often variation in the quality of the trials that are included in meta-analyses, limiting the value of combining the results in an overview. This variation in quality can lead to both bias and reduction in precision of the estimate of the therapy's effectiveness.

There are a number of methods for quantifying the quality of trials including the detailed Chalmers system and simple scales. The nature of the relationship between these quality scores and the true estimate of effectiveness is unknown at this time.

We discuss four methods of incorporating quality into meta-analysis: threshold score as inclusion/exclusion criterion, use of quality score as a weight in statistical pooling, visual plot of effect size against quality score and sequential combination of trial results based on quality score. The last method permits an examination of the relation between quality and both bias and precision on the pooled estimates.

We conclude that while it is possible to incorporate the effect of variation of quality of individual trials into overviews, this issue requires more study.

References (32)

  • C.D. Naylor

    Meta-analysis of controlled clinical trials

    J Rheum

    (1989)
  • S.B. Thacker

    Meta-analysis. A quantitative approach to research integration

    JAMA

    (1988)
  • T.C. Chalmers et al.

    Meta-analysis of clinical trials as a scientific discipline. 1. Control of bias and comparison with large cooperative trials

    Stat Med

    (1987)
  • T.C. Chalmers et al.

    Meta-analysis of clinical trials as a scientific discipline. II. Replicate variability and comparison of studies that agree and disagree

    Stat Med

    (1987)
  • S.B. Gerbarg et al.

    Resolving conflicting clinical trials. Guidelines for meta-analysis

    J Clin Epidemiol

    (1988)
  • S. Greenland

    Quantitative methods in the review of epidemoogy literature

    Epidemiol Rev

    (1987)
  • Cited by (558)

    View all citing articles on Scopus
    View full text