Home LiteratureArticle Details
PMID: 25345738 Published · ppublish English Journal Article Research Support, N.I.H., Extramural

Small sample performance of bias-corrected sandwich estimators for cluster-randomized trials with binary outcomes.

Statistics in medicine ·Vol. 34 ·No. 2 ·2015-01-30 ·Pages 281-96

Li P, Redden DT

Abstract

The sandwich estimator in generalized estimating equations (GEE) approach underestimates the true variance in small samples and consequently results in inflated type I error rates in hypothesis testing. This fact limits the application of the GEE in cluster-randomized trials (CRTs) with few clusters. Under various CRT scenarios with correlated binary outcomes, we evaluate the small sample properties of the GEE Wald tests using bias-corrected sandwich estimators. Our results suggest that the GEE Wald z-test should be avoided in the analyses of CRTs with few clusters even when bias-corrected sandwich estimators are used. With t-distribution approximation, the Kauermann and Carroll (KC)-correction can keep the test size to nominal levels even when the number of clusters is as low as 10 and is robust to the moderate variation of the cluster sizes. However, in cases with large variations in cluster sizes, the Fay and Graubard (FG)-correction should be used instead. Furthermore, we derive a formula to calculate the power and minimum total number of clusters one needs using the t-test and KC-correction for the CRTs with binary outcomes. The power levels as predicted by the proposed formula agree well with the empirical powers from the simulations. The proposed methods are illustrated using real CRT data. We conclude that with appropriate control of type I error rates under small sample sizes, we recommend the use of GEE approach in CRTs with binary outcomes because of fewer assumptions and robustness to the misspecification of the covariance structure.

Keywords
correlated data generalized estimating equations (GEE) power sample size type I error rates
MeSH Terms
Bias Breast Neoplasms/diagnosis Computer Simulation Early Detection of Cancer/statistics & numerical data Female General Practice/methods,statistics & numerical data Health Services Research/methods,statistics & numerical data Humans London Monte Carlo Method Outcome Assessment, Health Care/methods,statistics & numerical data Patient Acceptance of Health Care/statistics & numerical data Randomized Controlled Trials as Topic/methods,statistics & numerical data Sample Size
Authors & Affiliations
2 authors, click to expand affiliations / ORCID
Li Peng
Department of Biostatistics, School of Public Health, University of Alabama at Birmingham, Birmingham, AL 35294, U.S.A.
Redden David T
References (26)
26 references, click to expand
  1. Sample size considerations for GEE analyses of three-level cluster randomized trials.
    Biometrics. 2010 Dec;66(4):1230-7 PMID: 20070297
  2. Statistical power and sample size requirements for three level hierarchical cluster randomized trials.
    Biometrics. 2008 Dec;64(4):1256-62 PMID: 18266889
  3. Design and analysis of group-randomized trials: a review of recent methodological developments.
    Am J Public Health. 2004 Mar;94(3):423-32 PMID: 14998806
  4. Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method.
    Int J Epidemiol. 2006 Oct;35(5):1292-300 PMID: 16943232
  5. Sample size for a two-group comparison of repeated binary measurements using GEE.
    Stat Med. 2005 Sep 15;24(17):2583-96 PMID: 16118812
  6. Relative efficiency of unequal versus equal cluster sizes in cluster randomized and multicentre trials.
    Stat Med. 2007 Jun 15;26(13):2589-603 PMID: 17094074
  7. Small-sample adjustments for Wald-type tests using sandwich estimators.
    Biometrics. 2001 Dec;57(4):1198-206 PMID: 11764261
  8. To GEE or not to GEE: comparing population average and mixed models for estimating the associations between neighborhood risk factors and health.
    Epidemiology. 2010 Jul;21(4):467-74 PMID: 20220526
  9. Sample size and power calculations with correlated binary data.
    Control Clin Trials. 2001 Jun;22(3):211-27 PMID: 11384786
  10. Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care.
    Clin Trials. 2004 Feb;1(1):80-90 PMID: 16281464
  11. Selected statistical issues in group randomized trials.
    Annu Rev Public Health. 2001;22:167-87 PMID: 11274517
  12. Sample size requirements for stratified cluster randomization designs.
    Stat Med. 1992 Apr;11(6):743-50 PMID: 1594813
  13. Modified robust variance estimator for generalized estimating equations with improved small-sample performance.
    Stat Med. 2011 May 20;30(11):1278-91 PMID: 21538453
  14. A comparison of statistical methods for clustered data analysis with Gaussian error.
    Stat Med. 1996 Aug 30;15(16):1793-806 PMID: 8870161
  15. Jackknife estimators of variance for parameter estimates from estimating equations with applications to clustered survival data.
    Biometrics. 1994 Sep;50(3):842-6 PMID: 7981404
  16. Sample size for repeated measures studies with binary responses.
    Stat Med. 1994 Jun 30;13(12):1233-9 PMID: 7973204
  17. Developments in cluster randomized trials and Statistics in Medicine.
    Stat Med. 2007 Jan 15;26(1):2-19 PMID: 17136746
  18. A comparison of two bias-corrected covariance estimators for generalized estimating equations.
    Biometrics. 2007 Sep;63(3):935-41 PMID: 17825023
  19. Analysis of a cluster randomized trial with binary outcome data using a multi-level model.
    Stat Med. 2000 Oct 15;19(19):2675-88 PMID: 10986541
  20. Cluster randomized trials in general (family) practice research.
    Stat Methods Med Res. 2000 Apr;9(2):81-94 PMID: 10946428
  21. Estimation and sample size considerations for clustered binary responses.
    Stat Med. 1994 Jun 30;13(12):1241-52 PMID: 7973205
  22. Inadequate reporting of research ethics review and informed consent in cluster randomised trials: review of random sample of published trials.
    BMJ. 2011 May 11;342:d2496 PMID: 21562003
  23. A covariance estimator for GEE with improved small-sample properties.
    Biometrics. 2001 Mar;57(1):126-34 PMID: 11252587
  24. Bayesian methods of analysis for cluster randomized trials with binary outcome data.
    Stat Med. 2001 Feb 15;20(3):453-72 PMID: 11180313
  25. Small-sample adjustments in using the sandwich variance estimator in generalized estimating equations.
    Stat Med. 2002 May 30;21(10):1429-41 PMID: 12185894
  26. Sample size calculations for studies with correlated observations.
    Biometrics. 1997 Sep;53(3):937-47 PMID: 9290224
Article Info
Journal
Statistics in medicine
Abbr.
Stat Med
ISSN
1097-0258
Published
2015-01-30
Epub
2014-00-24
Pages
281-96
Language
English
Region
England
NLM ID
8215016
PMCID
PMC4268228
Subset
IM
Grants
NIAMS NIH HHS · P60 AR048095 · United States
NCATS NIH HHS · UL1TR000165 · United States
NHLBI NIH HHS · T32HL079888 · United States
NIAMS NIH HHS · P60AR048095 · United States
NCATS NIH HHS · UL1 TR000165 · United States
NHLBI NIH HHS · T32 HL079888 · United States
NIAMS NIH HHS · P60AR064172 · United States
NCATS NIH HHS · UL1 TR001417 · United States
NIAMS NIH HHS · P60 AR064172 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]