Abstract
To develop a transparent and reproducible measure for hospitals that can indicate when deaths in hospital or within 30 days of discharge are high relative to other hospitals, given the characteristics of the patients in that hospital, and to investigate those factors that have the greatest effect in changing the rank of a hospital, whether interactions exist between those factors, and the stability of the measure over time. Retrospective cross sectional study of admissions to English hospitals. Hospital episode statistics for England from 1 April 2005 to 30 September 2010, with linked mortality data from the Office for National Statistics. 36.5 million completed hospital admissions in 146 general and 72 specialist trusts. Deaths within hospital or within 30 days of discharge from hospital. The predictors that were used in the final model comprised admission diagnosis, age, sex, type of admission, and comorbidity. The percentage of people admitted who died in hospital or within 30 days of discharge was 4.2% for males and 4.5% for females. Emergency admissions comprised 75% of all admissions and 5.5% died, in contrast to 0.8% who died after an elective admission. The percentage who died with a Charlson comorbidity score of 0 was 2% in contrast with 15% who died with a score greater than 5. Given these variables, the relative standardised mortality rates of the hospitals were not noticeably changed by adjusting for the area level deprivation and number of previous emergency visits to hospital. There was little evidence that including interaction terms changed the relative values by any great amount. Using these predictors the summary hospital mortality index (SHMI) was derived. For 2007/8 the model had a C statistic of 0.911 and accounted for 81% of the variability of between hospital mortality. A random effects funnel plot was used to identify outlying hospitals. The outliers from the SHMI over the period 2005-10 have previously been identified using other mortality indicators. The SHMI is a relatively simple tool that can be used in conjunction with other information to identify hospitals that may need further investigation.
MeSH Terms
Adolescent
Adult
Aged
Aged, 80 and over
Child
Child, Preschool
Comorbidity
Cross-Sectional Studies
Emergency Service, Hospital/statistics & numerical data
England/epidemiology
Female
Hospital Mortality/trends
Hospitalization/statistics & numerical data
Hospitals/standards
Humans
Infant
Male
Middle Aged
Models, Statistical
Outcome Assessment, Health Care/statistics & numerical data
Quality Indicators, Health Care/standards
Reproducibility of Results
Retrospective Studies
Sex Distribution
Young Adult
Authors & Affiliations
5 authors, click to expand affiliations / ORCID
Jacques Richard M
Fotheringham James
Maheswaran Ravi
Nicholl Jon
References (17)
17 references, click to expand
-
Improved comorbidity adjustment for predicting mortality in Medicare populations.
Health Serv Res. 2003 Aug;38(4):1103-20
PMID: 12968819
-
Patient coding and the ratings game.
BMJ. 2010 Apr 23;340:c2153
PMID: 20418546
-
Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals.
BMJ. 2009 Mar 18;338:b780
PMID: 19297447
-
Why do we continue to use standardized mortality ratios for small area comparisons?
J Public Health Med. 2001 Mar;23(1):40-6
PMID: 11315692
-
A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.
J Chronic Dis. 1987;40(5):373-83
PMID: 3558716
-
Explaining differences in English hospital death rates using routinely collected data.
BMJ. 1999 Jun 5;318(7197):1515-20
PMID: 10356004
-
Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away.
BMJ. 2010 Apr 20;340:c2016
PMID: 20406861
-
Case-mix adjustment in non-randomised observational evaluations: the constant risk fallacy.
J Epidemiol Community Health. 2007 Nov;61(11):1010-3
PMID: 17933961
-
Creative use of existing clinical and health outcomes data to assess NHS performance in England: Part 1--performance indicators closely linked to clinical care.
BMJ. 2005 Jun 18;330(7505):1426-31
PMID: 15961815
-
Handling over-dispersion of performance indicators.
Qual Saf Health Care. 2005 Oct;14(5):347-51
PMID: 16195568
-
Standardisation of rates using logistic regression: a comparison with the direct method.
BMC Health Serv Res. 2008 Dec 29;8:275
PMID: 19113996
-
Strengths and weaknesses of hospital standardised mortality ratios.
BMJ. 2010 Jan 21;342:c7116
PMID: 21257655
-
Funnel plots for comparing institutional performance.
Stat Med. 2005 Apr 30;24(8):1185-202
PMID: 15568194
-
Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries.
Am J Epidemiol. 2011 Mar 15;173(6):676-82
PMID: 21330339
-
Enhancement of claims data to improve risk adjustment of hospital mortality.
JAMA. 2007 Jan 3;297(1):71-6
PMID: 17200477
-
What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature.
BMC Health Serv Res. 2007 Jun 20;7:91
PMID: 17584919
-
A combined comorbidity score predicted mortality in elderly patients better than existing scores.
J Clin Epidemiol. 2011 Jul;64(7):749-59
PMID: 21208778