Home LiteratureArticle Details
PMID: 15987725 Published · ppublish English Journal Article Research Support, N.I.H., Extramural Research Support, U.S. Gov't, P.H.S. Validation Study

Adjusting effect estimates for unmeasured confounding with validation data using propensity score calibration.

American journal of epidemiology ·Vol. 162 ·No. 3 ·2005-08-01 ·Pages 279-89

Stürmer T, Schneeweiss S, Avorn J, Glynn RJ

Abstract

Often, data on important confounders are not available in cohort studies. Sensitivity analyses based on the relation of single, but not multiple, unmeasured confounders with an exposure of interest in a separate validation study have been proposed. In this paper, the authors controlled for measured confounding in the main cohort using propensity scores (PS's) and addressed unmeasured confounding by estimating two additional PS's in a validation study. The "error-prone" PS exclusively used information available in the main cohort. The "gold standard" PS additionally included data on covariates available only in the validation study. Based on these two PS's in the validation study, regression calibration was applied to adjust regression coefficients. This propensity score calibration (PSC) adjusts for unmeasured confounding in cohort studies with validation data under certain, usually untestable, assumptions. The authors used PSC to assess the relation between nonsteroidal antiinflammatory drugs (NSAIDs) and 1-year mortality in a large cohort of elderly persons. "Traditional" adjustment resulted in a hazard ratio for NSAID users of 0.80 (95% confidence interval (CI): 0.77, 0.83) as compared with an unadjusted hazard ratio of 0.68 (95% CI: 0.66, 0.71). Application of PSC resulted in a more plausible hazard ratio of 1.06 (95% CI: 1.00, 1.12). Until the validity and limitations of PSC have been assessed in different settings, the method should be seen as a sensitivity analysis.

MeSH Terms
Aged Anti-Inflammatory Agents, Non-Steroidal/therapeutic use Bias Calibration Cohort Studies Confounding Factors, Epidemiologic Epidemiologic Methods Female Humans Male Mortality/trends New Jersey/epidemiology Regression Analysis
Chemicals
Anti-Inflammatory Agents, Non-Steroidal
Authors & Affiliations
4 authors, click to expand affiliations / ORCID
Stürmer Til
Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA. [email protected]
Schneeweiss Sebastian
Avorn Jerry
Glynn Robert J
References (45)
45 references, click to expand
  1. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group.
    Stat Med. 1998 Oct 15;17(19):2265-81 PMID: 9802183
  2. Assessing the sensitivity of regression results to unmeasured confounders in observational studies.
    Biometrics. 1998 Sep;54(3):948-63 PMID: 9750244
  3. Nonsteroidal anti-inflammatory drug-associated azotemia in the very old.
    JAMA. 1990 Jul 25;264(4):471-5 PMID: 2366280
  4. Nonnarcotic analgesic use and the risk of hypertension in US women.
    Hypertension. 2002 Nov;40(5):604-8; discussion 601-3 PMID: 12411450
  5. Epidemiologic assessment of the safety of conventional nonsteroidal anti-inflammatory drugs.
    Am J Med. 2001 Feb 19;110 Suppl 3A:20S-7S PMID: 11173046
  6. Matching MCBS (Medicare Current Beneficiary Survey) and Medicare data: the best of both worlds.
    Health Care Financ Rev. 1997 Spring;18(3):211-29 PMID: 10170350
  7. Initiation of antihypertensive treatment during nonsteroidal anti-inflammatory drug therapy.
    JAMA. 1994 Sep 14;272(10):781-6 PMID: 8078142
  8. Regression calibration in studies with correlated variables measured with error.
    Am J Epidemiol. 2001 Nov 1;154(9):836-44 PMID: 11682366
  9. Medicare beneficiaries rate their medical care: new data from the MCBS (Medicare Current Beneficiary Survey).
    Health Care Financ Rev. 1995 Summer;16(4):175-87 PMID: 10172473
  10. Estimating the parameters in the Cox model when covariate variables are measured with error.
    Biometrics. 1998 Dec;54(4):1407-19 PMID: 9883541
  11. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors.
    Stat Med. 1996 Feb 28;15(4):361-87 PMID: 8668867
  12. A profile of the Medicare Current Beneficiary Survey.
    Health Care Financ Rev. 1994 Summer;15(4):153-63 PMID: 10138483
  13. The association between hospital type and mortality and length of stay: a study of 16.9 million hospitalized Medicare beneficiaries.
    Med Care. 2000 Feb;38(2):231-45 PMID: 10659696
  14. Flexible maximum likelihood methods for assessing joint effects in case-control studies with complex sampling.
    Biometrics. 1994 Jun;50(2):350-7 PMID: 8068835
  15. The hidden cost of nonselective nonsteroidal antiinflammatory drugs in older patients.
    J Rheumatol. 2003 Apr;30(4):792-8 PMID: 12672201
  16. Invited commentary: propensity scores.
    Am J Epidemiol. 1999 Aug 15;150(4):327-33 PMID: 10453808
  17. The performance of methods for correcting measurement error in case-control studies.
    Epidemiology. 2002 Sep;13(5):507-16 PMID: 12192219
  18. Randomization, statistics, and causal inference.
    Epidemiology. 1990 Nov;1(6):421-9 PMID: 2090279
  19. Digoxin therapy and mortality after myocardial infarction. Experience in the MILIS Study.
    N Engl J Med. 1986 Jan 30;314(5):265-71 PMID: 3510391
  20. Efficient regression calibration for logistic regression in main study/internal validation study designs with an imperfect reference instrument.
    Stat Med. 2001 Jan 15;20(1):139-160 PMID: 11135353
  21. Measurement error correction for logistic regression models with an "alloyed gold standard".
    Am J Epidemiol. 1997 Jan 15;145(2):184-96 PMID: 9006315
  22. Principles for modeling propensity scores in medical research: a systematic literature review.
    Pharmacoepidemiol Drug Saf. 2004 Dec;13(12):841-53 PMID: 15386709
  23. Paradoxical relations of drug treatment with mortality in older persons.
    Epidemiology. 2001 Nov;12(6):682-9 PMID: 11679797
  24. Controlling confounding when studying large pharmacoepidemiologic databases: a case study of the two-stage sampling design.
    Epidemiology. 1998 May;9(3):309-15 PMID: 9583424
  25. Adjusting for unmeasured confounders in pharmacoepidemiologic claims data using external information: the example of COX2 inhibitors and myocardial infarction.
    Epidemiology. 2005 Jan;16(1):17-24 PMID: 15613941
  26. Validation studies: bias, efficiency, and exposure assessment.
    Epidemiology. 2002 Sep;13(5):503-6 PMID: 12192218
  27. The renal effects of nonsteroidal anti-inflammatory drugs in older people: findings from the Established Populations for Epidemiologic Studies of the Elderly.
    J Am Geriatr Soc. 1999 May;47(5):507-11 PMID: 10323640
  28. Study design for epidemiologic studies with measurement error.
    Stat Methods Med Res. 1995 Dec;4(4):339-58 PMID: 8745130
  29. Sensitivity analysis for matched case-control studies.
    Biometrics. 1991 Mar;47(1):87-100 PMID: 2049516
  30. A Bayesian approach to logistic regression models having measurement error following a mixture distribution.
    Stat Med. 1993 Jun 30;12(12):1141-53 PMID: 8210818
  31. Determinants of impaired renal function with use of nonsteroidal anti-inflammatory drugs: the importance of half-life and other medications.
    Am J Med. 2001 Nov;111(7):521-7 PMID: 11705427
  32. Regression calibration method for correcting measurement-error bias in nutritional epidemiology.
    Am J Clin Nutr. 1997 Apr;65(4 Suppl):1179S-1186S PMID: 9094918
  33. Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches.
    Annu Rev Public Health. 2000;21:121-45 PMID: 10884949
  34. Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error.
    Stat Med. 1989 Sep;8(9):1051-69; discussion 1071-3 PMID: 2799131
  35. Multiple imputation in health-care databases: an overview and some applications.
    Stat Med. 1991 Apr;10(4):585-98 PMID: 2057657
  36. Relative risk of upper gastrointestinal complications among users of acetaminophen and nonsteroidal anti-inflammatory drugs.
    Epidemiology. 2001 Sep;12(5):570-6 PMID: 11505178
  37. Statistical uncertainty due to misclassification: implications for validation substudies.
    J Clin Epidemiol. 1988;41(12):1167-74 PMID: 3062138
  38. Agreement between the pharmacy medication history and patient interview for cardiovascular drugs: the Rotterdam elderly study.
    Br J Clin Pharmacol. 1998 Jun;45(6):591-5 PMID: 9663815
  39. Matching using estimated propensity scores: relating theory to practice.
    Biometrics. 1996 Mar;52(1):249-64 PMID: 8934595
  40. Cost-efficient study designs for binary response data with Gaussian covariate measurement error.
    Biometrics. 1991 Sep;47(3):851-69 PMID: 1789885
  41. An overview of issues related to the correction of non-differential exposure measurement error in epidemiologic studies.
    Stat Med. 1989 Sep;8(9):1031-40; discussion 1071-3 PMID: 2678348
  42. Effects of the use of unreliable surrogate variables on the validity of epidemiologic research studies.
    Am J Epidemiol. 1984 Oct;120(4):643-8 PMID: 6475932
  43. Smoking and lung cancer: recent evidence and a discussion of some questions.
    J Natl Cancer Inst. 1959 Jan;22(1):173-203 PMID: 13621204
  44. Correction of logistic regression relative risk estimates and confidence intervals for measurement error: the case of multiple covariates measured with error.
    Am J Epidemiol. 1990 Oct;132(4):734-45 PMID: 2403114
  45. A metaanalysis of severe upper gastrointestinal complications of nonsteroidal antiinflammatory drugs.
    J Rheumatol. 2002 Apr;29(4):804-12 PMID: 11950025
Article Info
Journal
American journal of epidemiology
Abbr.
Am J Epidemiol
ISSN
0002-9262
Published
2005-08-01
Epub
2005-00-29
Pages
279-89
Language
English
Region
United States
NLM ID
7910653
PMCID
PMC1444885
Subset
IM
Grants
NIA NIH HHS · R01 AG023178 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]