Home LiteratureArticle Details
PMID: 17584919 Published · epublish English Journal Article Research Support, Non-U.S. Gov't Review Systematic Review

What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature.

BMC health services research ·Vol. 7 ·2007-06-20 ·Pages 91

Pitches DW, Mohammed MA, Lilford RJ

Abstract

Despite increasing interest and publication of risk-adjusted hospital mortality rates, the relationship with underlying quality of care remains unclear. We undertook a systematic review to ascertain the extent to which variations in risk-adjusted mortality rates were associated with differences in quality of care. We identified studies in which risk-adjusted mortality and quality of care had been reported in more than one hospital. We adopted an iterative search strategy using three databases--Medline, HealthSTAR and CINAHL from 1966, 1975 and 1982 respectively. We identified potentially relevant studies on the basis of the title or abstract. We obtained these papers and included those which met our inclusion criteria. From an initial yield of 6,456 papers, 36 studies met the inclusion criteria. Several of these studies considered more than one process-versus-risk-adjusted mortality relationship. In total we found 51 such relationships in a widen range of clinical conditions using a variety of methods. A positive correlation between better quality of care and risk-adjusted mortality was found in under half the relationships (26/51 51%) but the remainder showed no correlation (16/51 31%) or a paradoxical correlation (9/51 18%). The general notion that hospitals with higher risk-adjusted mortality have poorer quality of care is neither consistent nor reliable.

MeSH Terms
Evidence-Based Medicine Health Services Research Hospital Mortality Humans Quality of Health Care Reproducibility of Results Risk Adjustment
Authors & Affiliations
3 authors, click to expand affiliations / ORCID
Pitches David W
Department of Public Health and Epidemiology, University of Birmingham, Birmingham, UK. [email protected] <[email protected]>
Mohammed Mohammed A
Lilford Richard J
References (64)
64 references, click to expand
  1. The California Hospital Outcomes Project: using administrative data to compare hospital performance.
    Jt Comm J Qual Improv. 1995 Dec;21(12):668-82 PMID: 8688923
  2. JCAHO accreditation and quality of care for acute myocardial infarction.
    Health Aff (Millwood). 2003 Mar-Apr;22(2):243-54 PMID: 12674428
  3. The importance of technology for achieving superior outcomes from intensive care. Brazil APACHE III Study Group.
    Intensive Care Med. 1996 Jul;22(7):664-9 PMID: 8844231
  4. Mortality rates as an indicator of hospital quality.
    Hosp Health Serv Adm. 1997 Spring;42(1):3-15 PMID: 10164896
  5. Predictions of hospital mortality rates: a comparison of data sources.
    Ann Intern Med. 1997 Mar 1;126(5):347-54 PMID: 9054278
  6. Variations in medical care for HIV-related Pneumocystis carinii pneumonia: a comparison of process and outcome at two hospitals.
    Chest. 1997 Aug;112(2):398-405 PMID: 9266875
  7. The risks of risk adjustment.
    JAMA. 1997 Nov 19;278(19):1600-7 PMID: 9370507
  8. Variation in mortality among seven hemodialysis centers as a quality indicator.
    Clin Perform Qual Health Care. 1998 Apr-Jun;6(2):73-8 PMID: 10180125
  9. Research evidence on the validity of risk-adjusted mortality rate as a measure of hospital quality of care.
    Med Care Res Rev. 1998 Dec;55(4):371-404 PMID: 9844348
  10. Do "America's Best Hospitals" perform better for acute myocardial infarction?
    N Engl J Med. 1999 Jan 28;340(4):286-92 PMID: 9920954
  11. Accuracy of risk-adjusted mortality rate as a measure of hospital quality of care.
    Med Care. 1999 Jan;37(1):83-92 PMID: 10413396
  12. Performance of the '100 top hospitals': what does the report card report?
    Health Aff (Millwood). 1999 Jul-Aug;18(4):53-68 PMID: 10425843
  13. Comparing processes of stroke care in high- and low-mortality hospitals in the West Midlands, UK.
    Int J Qual Health Care. 2005 Feb;17(1):31-6 PMID: 15668308
  14. Association between hospital process performance and outcomes among patients with acute coronary syndromes.
    JAMA. 2006 Apr 26;295(16):1912-20 PMID: 16639050
  15. Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality.
    JAMA. 2006 Jul 5;296(1):72-8 PMID: 16820549
  16. America's best hospitals.
    US News World Rep. 2006 Jul 17;141(2):64-5, 112, 114 passim PMID: 17886775
  17. Using severity-adjusted stroke mortality rates to judge hospitals.
    Int J Qual Health Care. 1995 Jun;7(2):81-94 PMID: 7655814
  18. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses.
    Lancet. 1999 Nov 27;354(9193):1896-900 PMID: 10584742
  19. Relationship of hospital teaching status with quality of care and mortality for Medicare patients with acute MI.
    JAMA. 2000 Sep 13;284(10):1256-62 PMID: 10979112
  20. Use of comorbidity scores for control of confounding in studies using administrative databases.
    Int J Epidemiol. 2000 Oct;29(5):891-8 PMID: 11034974
  21. Differences in management and outcomes of acute myocardial infarction among four general hospitals in Japan.
    Int J Cardiol. 2001 May;78(3):277-84 PMID: 11376831
  22. Towards a national system for monitoring the quality of hospital-based stroke services.
    Stroke. 2001 Jun;32(6):1415-21 PMID: 11387507
  23. Validating risk-adjusted surgical outcomes: chart review of process of care.
    Int J Qual Health Care. 2001 Jun;13(3):187-96 PMID: 11476143
  24. Differences in treatment and outcome of patients with acute myocardial infarction admitted to hospitals with compared to without departments of cardiology; results from the pooled data of the Maximal Individual Therapy in Acute Myocardial Infarction (MITRA 1+2) Registries and the Myocardial Infarction Registry (MIR).
    Eur Heart J. 2001 Oct;22(19):1794-801 PMID: 11549301
  25. Variation in intensive care unit outcomes: a search for the evidence on organizational factors.
    Curr Opin Crit Care. 2001 Aug;7(4):284-96 PMID: 11571428
  26. Association between prevalent care process measures and facility-specific mortality rates.
    Kidney Int. 2001 Nov;60(5):1917-29 PMID: 11703611
  27. Very-low-birth-weight infant outcomes in 11 South American NICUs.
    J Perinatol. 2002 Jan;22(1):2-7 PMID: 11840234
  28. Evaluation of a consumer-oriented internet health care report card: the risk of quality ratings based on mortality data.
    JAMA. 2002 Mar 13;287(10):1277-87 PMID: 11886319
  29. Hospital volume and surgical mortality in the United States.
    N Engl J Med. 2002 Apr 11;346(15):1128-37 PMID: 11948273
  30. Volume and outcome--it is time to move ahead.
    N Engl J Med. 2002 Apr 11;346(15):1161-4 PMID: 11948278
  31. Management of severe head injury: institutional variations in care and effect on outcome.
    Crit Care Med. 2002 Aug;30(8):1870-6 PMID: 12163808
  32. Is volume related to outcome in health care? A systematic review and methodologic critique of the literature.
    Ann Intern Med. 2002 Sep 17;137(6):511-20 PMID: 12230353
  33. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction.
    JAMA. 2002 Oct 23-30;288(16):1987-93 PMID: 12387650
  34. The quality of care is related to death rates: hospital inpatient management of infants with acute gastroenteritis in Jamaica.
    Am J Public Health. 1988 Feb;78(2):149-52 PMID: 3337327
  35. Hospital characteristics and mortality rates.
    N Engl J Med. 1989 Dec 21;321(25):1720-5 PMID: 2594031
  36. Explaining variations in hospital death rates. Randomness, severity of illness, quality of care.
    JAMA. 1990 Jul 25;264(4):484-90 PMID: 2195173
  37. Improved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities.
    Crit Care Med. 1991 Feb;19(2):150-9 PMID: 1796932
  38. Hospital characteristics and quality of care.
    JAMA. 1992 Oct 7;268(13):1709-14 PMID: 1527880
  39. Coronary artery bypass grafting surgery in Oklahoma: processes and outcomes of care.
    J Okla State Med Assoc. 2003 Feb;96(2):63-9 PMID: 12674906
  40. Hospital mortality league tables.
    BMJ. 2003 Apr 12;326(7393):777-8 PMID: 12689953
  41. Hindsight not equal to foresight: the effect of outcome knowledge on judgment under uncertainty. 1975.
    Qual Saf Health Care. 2003 Aug;12(4):304-11; discussion 311-2 PMID: 12897366
  42. Management of acute nonvariceal upper gastrointestinal hemorrhage: comparison of an American and a Canadian medical centre.
    Can J Gastroenterol. 2003 Aug;17(8):489-95 PMID: 12945010
  43. The measurement of active errors: methodological issues.
    Qual Saf Health Care. 2003 Dec;12 Suppl 2:ii8-12 PMID: 14645889
  44. US hospital care for patients with HIV infection and pneumonia: the role of public, private, and Veterans Affairs hospitals in the early highly active antiretroviral therapy era.
    Chest. 2004 Feb;125(2):548-56 PMID: 14769737
  45. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma.
    Lancet. 2004 Apr 3;363(9415):1147-54 PMID: 15064036
  46. Quality of care for acute myocardial infarction in rural and urban US hospitals.
    J Rural Health. 2004 Spring;20(2):99-108 PMID: 15085622
  47. More interventions do not necessarily improve outcome in critically ill patients.
    Intensive Care Med. 2004 Aug;30(8):1586-93 PMID: 14991099
  48. Surgical mortality as an indicator of hospital quality: the problem with small sample size.
    JAMA. 2004 Aug 18;292(7):847-51 PMID: 15315999
  49. Collaborative quality improvement to promote evidence based surfactant for preterm infants: a cluster randomised trial.
    BMJ. 2004 Oct 30;329(7473):1004 PMID: 15514344
  50. Measuring the effectiveness of perinatal medical care.
    Med Care. 1979 Feb;17(2):95-110 PMID: 569745
  51. Hospital inpatient mortality. Is it a predictor of quality?
    N Engl J Med. 1987 Dec 24;317(26):1674-80 PMID: 3683509
  52. The relationship between adjusted hospital mortality and the results of peer review.
    Health Serv Res. 1993 Feb;27(6):765-77 PMID: 8428812
  53. Validating risk-adjusted mortality as an indicator for quality of care.
    Inquiry. 1993 Spring;30(1):6-22 PMID: 8454316
  54. The ratio of observed-to-expected mortality as a quality of care indicator in non-surgical VA patients.
    Med Care. 1994 Apr;32(4):390-400 PMID: 8139303
  55. Treatment of patients with acute myocardial infarction at a Veterans Affairs (VA) hospital and a non-VA hospital.
    J Gen Intern Med. 1994 Aug;9(8):455-8 PMID: 7965241
  56. Using mortality rates as a screening tool: the experience of the Department of Veterans Affairs.
    Jt Comm J Qual Improv. 1994 Sep;20(9):511-22 PMID: 7804410
  57. Differences in mortality after fracture of hip: the east Anglian audit.
    BMJ. 1995 Apr 8;310(6984):904-8 PMID: 7719180
  58. Process and outcome of care for acute myocardial infarction among Medicare beneficiaries in Connecticut: a quality improvement demonstration project.
    Ann Intern Med. 1995 Jun 15;122(12):928-36 PMID: 7755229
  59. Physician staffing patterns and clinical outcomes in critically ill patients: a systematic review.
    JAMA. 2002 Nov 6;288(17):2151-62 PMID: 12413375
  60. Comparison of mortality between private for-profit and private not-for-profit hemodialysis centers: a systematic review and meta-analysis.
    JAMA. 2002 Nov 20;288(19):2449-57 PMID: 12435258
  61. Quality improvement for patients with hip fracture: experience from a multi-site audit.
    Qual Saf Health Care. 2002 Sep;11(3):239-45 PMID: 12486988
  62. Relationship between process and outcome in stroke care.
    Stroke. 2003 Mar;34(3):713-7 PMID: 12624296
  63. Quality assurance with regard to outcome and use of medical resources for patients hospitalized with acute chest pain: a comparison between a city university hospital and a county hospital.
    Eur J Emerg Med. 2003 Mar;10(1):6-12 PMID: 12637853
  64. Identifying poor-quality hospitals. Can hospital mortality rates detect quality problems for medical diagnoses?
    Med Care. 1996 Aug;34(8):737-53 PMID: 8709656
Article Info
Journal
BMC health services research
Abbr.
BMC Health Serv Res
ISSN
1472-6963
Published
2007-06-20
Epub
2007-00-20
Pages
91
Language
English
Region
England
NLM ID
101088677
PMCID
PMC1924858
Subset
IM
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]