Abstract
To expand an emerging classification for problems with health information technology (HIT) using reports submitted to the US Food and Drug Administration Manufacturer and User Facility Device Experience (MAUDE) database. HIT events submitted to MAUDE were retrieved using a standardized search strategy. Using an emerging classification with 32 categories of HIT problems, a subset of relevant events were iteratively analyzed to identify new categories. Two coders then independently classified the remaining events into one or more categories. Free-text descriptions were analyzed to identify the consequences of events. Descriptive statistics by number of reported problems per category and by consequence; inter-rater reliability analysis using the κ statistic for the major categories and consequences. A search of 899 768 reports from January 2008 to July 2010 yielded 1100 reports about HIT. After removing duplicate and unrelated reports, 678 reports describing 436 events remained. The authors identified four new categories to describe problems with software functionality, system configuration, interface with devices, and network configuration; the authors' classification with 32 categories of HIT problems was expanded by the addition of these four categories. Examination of the 436 events revealed 712 problems, 96% were machine-related, and 4% were problems at the human-computer interface. Almost half (46%) of the events related to hazardous circumstances. Of the 46 events (11%) associated with patient harm, four deaths were linked to HIT problems (0.9% of 436 events). Only 0.1% of the MAUDE reports searched were related to HIT. Nevertheless, Food and Drug Administration reports did prove to be a useful new source of information about the nature of software problems and their safety implications with potential to inform strategies for safe design and implementation.
MeSH Terms
Databases, Factual
Medical Informatics/classification
Research Report
Safety
Software
United States
United States Food and Drug Administration
Authors & Affiliations
4 authors, click to expand affiliations / ORCID
Magrabi Farah
Centre for Health Informatics, Australian Institute for Health Innovation, University of New South Wales, Sydney, Australia.
[email protected]
Ong Mei-Sing
Runciman William
Coiera Enrico
References (18)
18 references, click to expand
-
Crisis management during anaesthesia: the development of an anaesthetic crisis management manual.
Qual Saf Health Care. 2005 Jun;14(3):e1
PMID: 15933282
-
Challenges in ethics, safety, best practices, and oversight regarding HIT vendors, their customers, and patients: a report of an AMIA special task force.
J Am Med Inform Assoc. 2011 Jan-Feb;18(1):77-81
PMID: 21075789
-
EHR safety: the way forward to safe and effective systems.
J Am Med Inform Assoc. 2008 May-Jun;15(3):272-7
PMID: 18308981
-
The safety and quality of decision support systems.
Yearb Med Inform. 2006;:20-5
PMID: 17051290
-
Patient safety problems associated with heathcare information technology: an analysis of adverse events reported to the US Food and Drug Administration.
AMIA Annu Symp Proc. 2011;2011:853-7
PMID: 22195143
-
Anticipating and addressing the unintended consequences of health IT and policy: a report from the AMIA 2009 Health Policy Meeting.
J Am Med Inform Assoc. 2011 Jan-Feb;18(1):82-90
PMID: 21169620
-
Health information technology: fallacies and sober realities.
J Am Med Inform Assoc. 2010 Nov-Dec;17(6):617-23
PMID: 20962121
-
Symposium--The Australian Incident Monitoring Study.
Anaesth Intensive Care. 1993 Oct;21(5):501-5
PMID: 8273869
-
Safe electronic health record use requires a comprehensive monitoring and evaluation framework.
JAMA. 2010 Feb 3;303(5):450-1
PMID: 20124542
-
Deaths and cardiovascular injuries due to device-assisted implantable cardioverter-defibrillator and pacemaker lead extraction.
Europace. 2010 Mar;12(3):395-401
PMID: 19946113
-
An integrated framework for safety, quality and risk management: an information and incident management system based on a universal patient safety classification.
Qual Saf Health Care. 2006 Dec;15 Suppl 1:i82-90
PMID: 17142615
-
Setting priorities for patient safety.
Qual Saf Health Care. 2002 Sep;11(3):224-9
PMID: 12486985
-
Some unintended consequences of information technology in health care: the nature of patient care information system-related errors.
J Am Med Inform Assoc. 2004 Mar-Apr;11(2):104-12
PMID: 14633936
-
Towards an International Classification for Patient Safety: key concepts and terms.
Int J Qual Health Care. 2009 Feb;21(1):18-26
PMID: 19147597
-
Review of Reported Clinical Information System Adverse Events in US Food and Drug Administration Databases.
Appl Clin Inform. 2011;2(1):63-74
PMID: 21938265
-
The measurement of observer agreement for categorical data.
Biometrics. 1977 Mar;33(1):159-74
PMID: 843571
-
An analysis of computer-related patient safety incidents to inform the development of a classification.
J Am Med Inform Assoc. 2010 Nov-Dec;17(6):663-70
PMID: 20962128
-
The effect of electronic prescribing on medication errors and adverse drug events: a systematic review.
J Am Med Inform Assoc. 2008 Sep-Oct;15(5):585-600
PMID: 18579832