Abstract
Subgroup analysis is the process of comparing a treatment effect for two or more variants of an intervention—to ask, for example, if an intervention’s impact is affected by the setting (school versus community), by the delivery agent (outside facilitator versus regular classroom teacher), by the quality of delivery, or if the long-term effect differs from the short-term effect. While large-scale studies often employ subgroup analyses, these analyses cannot generally be performed for small-scale studies, since these typically include a homogeneous population and only one variant of the intervention. This limitation can be bypassed by using meta-analysis. Meta-analysis allows the researcher to compare the treatment effect in different subgroups, even if these subgroups appear in separate studies. We discuss several statistical issues related to this procedure, including the selection of a statistical model and statistical power for the comparison. To illustrate these points, we use the example of a meta-analysis of obesity prevention.
Similar content being viewed by others
References
Bonett, D. G. (2008). Meta-analytic interval estimation for bivariate correlations. Psychological Methods, 13, 173–189.
Bonett, D. G. (2009). Meta-analytic interval estimation for standardized and unstandardized mean differences. Psychological Methods, 14, 225–238.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1, 97–111.
Cooper, H. M., Hedges, L. V., & Valentine, J. (2009). The handbook of research synthesis and meta-analysis. New York: Russell Sage Foundation.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic.
Hedges, L. V., & Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychological Methods, 6, 203–217.
Hedges, L. V., & Pigott, T. D. (2004). The power of statistical tests for moderators in meta-analysis. Psychological Methods, 9, 426–445.
Lindgarde, F. (2000). The effect of orlistat on body weight and coronary heart disease risk profile in obese patients: The Swedish Multimorbidity Study. Journal of Internal Medicine, 248, 245–254.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage Publications.
Padwal, R., Li, S. K., & Lau, D. C. W. (2003a). Long-term pharmacotherapy for overweight and obesity: A systematic review and meta-analysis of randomized controlled trials. International Journal of Obesity, 27, 1437–1446.
Padwal, R. S., Rucker, D., Li, S. K., Curioni, C., Lau, D. C. W. (2003) Long-term pharmacotherapy for obesity and overweight. Cochrane Database of Systematic Reviews Issue 4. Art. No.: CD004094. doi:10.1002/14651858.CD004094.pub2.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
Acknowledgments
The ideas expressed in this paper reflect the many discussions that took place among ourselves, Larry Hedges, and Hannah Rothstein while we were working on the text “Introduction to Meta-Analysis” and on the computer program “Comprehensive Meta-Analysis.” We are grateful for Larry’s and Hannah’s many insights, their generosity, and their friendship. Dr. Borenstein was funded in part by the following grants from the National Institute on Drug Abuse: “Forest Plots for Meta-Analysis” (DA019280) under the direction of Dr. Thomas Hilton, “Power Analysis for Meta-Analysis” (DA022799), and “Power Analysis for Cluster Randomized Trials” (DA025366) under the direction of Dr. Augusto (Augie) Diana. Prof. Higgins was funded in part by Grant U105285807 from the UK Medical Research Council.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
ESM 1
(DOCX 125 kb)
Rights and permissions
About this article
Cite this article
Borenstein, M., Higgins, J.P.T. Meta-Analysis and Subgroups. Prev Sci 14, 134–143 (2013). https://doi.org/10.1007/s11121-013-0377-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-013-0377-7