Abstract
The sandwich estimator in generalized estimating equations (GEE) approach underestimates the true variance in small samples and consequently results in inflated type I error rates in hypothesis testing. This fact limits the application of the GEE in cluster-randomized trials (CRTs) with few clusters. Under various CRT scenarios with correlated binary outcomes, we evaluate the small sample properties of the GEE Wald tests using bias-corrected sandwich estimators. Our results suggest that the GEE Wald z-test should be avoided in the analyses of CRTs with few clusters even when bias-corrected sandwich estimators are used. With t-distribution approximation, the Kauermann and Carroll (KC)-correction can keep the test size to nominal levels even when the number of clusters is as low as 10 and is robust to the moderate variation of the cluster sizes. However, in cases with large variations in cluster sizes, the Fay and Graubard (FG)-correction should be used instead. Furthermore, we derive a formula to calculate the power and minimum total number of clusters one needs using the t-test and KC-correction for the CRTs with binary outcomes. The power levels as predicted by the proposed formula agree well with the empirical powers from the simulations. The proposed methods are illustrated using real CRT data. We conclude that with appropriate control of type I error rates under small sample sizes, we recommend the use of GEE approach in CRTs with binary outcomes because of fewer assumptions and robustness to the misspecification of the covariance structure.
Keywords
correlated data
generalized estimating equations (GEE)
power
sample size
type I error rates
MeSH Terms
Bias
Breast Neoplasms/diagnosis
Computer Simulation
Early Detection of Cancer/statistics & numerical data
Female
General Practice/methods,statistics & numerical data
Health Services Research/methods,statistics & numerical data
Humans
London
Monte Carlo Method
Outcome Assessment, Health Care/methods,statistics & numerical data
Patient Acceptance of Health Care/statistics & numerical data
Randomized Controlled Trials as Topic/methods,statistics & numerical data
Sample Size
Authors & Affiliations
2 authors, click to expand affiliations / ORCID
Li Peng
Department of Biostatistics, School of Public Health, University of Alabama at Birmingham, Birmingham, AL 35294, U.S.A.
Redden David T
References (26)
26 references, click to expand
-
Sample size considerations for GEE analyses of three-level cluster randomized trials.
Biometrics. 2010 Dec;66(4):1230-7
PMID: 20070297
-
Statistical power and sample size requirements for three level hierarchical cluster randomized trials.
Biometrics. 2008 Dec;64(4):1256-62
PMID: 18266889
-
Design and analysis of group-randomized trials: a review of recent methodological developments.
Am J Public Health. 2004 Mar;94(3):423-32
PMID: 14998806
-
Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method.
Int J Epidemiol. 2006 Oct;35(5):1292-300
PMID: 16943232
-
Sample size for a two-group comparison of repeated binary measurements using GEE.
Stat Med. 2005 Sep 15;24(17):2583-96
PMID: 16118812
-
Relative efficiency of unequal versus equal cluster sizes in cluster randomized and multicentre trials.
Stat Med. 2007 Jun 15;26(13):2589-603
PMID: 17094074
-
Small-sample adjustments for Wald-type tests using sandwich estimators.
Biometrics. 2001 Dec;57(4):1198-206
PMID: 11764261
-
To GEE or not to GEE: comparing population average and mixed models for estimating the associations between neighborhood risk factors and health.
Epidemiology. 2010 Jul;21(4):467-74
PMID: 20220526
-
Sample size and power calculations with correlated binary data.
Control Clin Trials. 2001 Jun;22(3):211-27
PMID: 11384786
-
Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care.
Clin Trials. 2004 Feb;1(1):80-90
PMID: 16281464
-
Selected statistical issues in group randomized trials.
Annu Rev Public Health. 2001;22:167-87
PMID: 11274517
-
Sample size requirements for stratified cluster randomization designs.
Stat Med. 1992 Apr;11(6):743-50
PMID: 1594813
-
Modified robust variance estimator for generalized estimating equations with improved small-sample performance.
Stat Med. 2011 May 20;30(11):1278-91
PMID: 21538453
-
A comparison of statistical methods for clustered data analysis with Gaussian error.
Stat Med. 1996 Aug 30;15(16):1793-806
PMID: 8870161
-
Jackknife estimators of variance for parameter estimates from estimating equations with applications to clustered survival data.
Biometrics. 1994 Sep;50(3):842-6
PMID: 7981404
-
Sample size for repeated measures studies with binary responses.
Stat Med. 1994 Jun 30;13(12):1233-9
PMID: 7973204
-
Developments in cluster randomized trials and Statistics in Medicine.
Stat Med. 2007 Jan 15;26(1):2-19
PMID: 17136746
-
A comparison of two bias-corrected covariance estimators for generalized estimating equations.
Biometrics. 2007 Sep;63(3):935-41
PMID: 17825023
-
Analysis of a cluster randomized trial with binary outcome data using a multi-level model.
Stat Med. 2000 Oct 15;19(19):2675-88
PMID: 10986541
-
Cluster randomized trials in general (family) practice research.
Stat Methods Med Res. 2000 Apr;9(2):81-94
PMID: 10946428
-
Estimation and sample size considerations for clustered binary responses.
Stat Med. 1994 Jun 30;13(12):1241-52
PMID: 7973205
-
Inadequate reporting of research ethics review and informed consent in cluster randomised trials: review of random sample of published trials.
BMJ. 2011 May 11;342:d2496
PMID: 21562003
-
A covariance estimator for GEE with improved small-sample properties.
Biometrics. 2001 Mar;57(1):126-34
PMID: 11252587
-
Bayesian methods of analysis for cluster randomized trials with binary outcome data.
Stat Med. 2001 Feb 15;20(3):453-72
PMID: 11180313
-
Small-sample adjustments in using the sandwich variance estimator in generalized estimating equations.
Stat Med. 2002 May 30;21(10):1429-41
PMID: 12185894
-
Sample size calculations for studies with correlated observations.
Biometrics. 1997 Sep;53(3):937-47
PMID: 9290224