The occurrence, types, consequences and preventability of in-hospital adverse events – a scoping review

1Adverse events (AEs) seriously affect patient safety and quality of care in hospitals. The epidemiology of harm due to medical care remains a pressing issue on a global scale. In the US, a recent report reviewing earlier studies ranked iatrogenic causes, especially medical errors, as the third leading cause of death. Specifically, up to 1.1% of hospital admissions led to deaths due to medical errors. Extrapolating this percentage to the annual patient numbers for all registered US hospitals, this would account for more than 400,000 deaths in 2013 alone. While such a high volume of patient harm associated with hospital care is shocking, the projected annual cost of measurable medical errors is mind-boggling: in the US alone, based on data from that year, AEs have been dubbed “the 17.1 billion dollar problem”.

2The two most frequent classes of AE, postoperative infections and pressure ulcers, accounted for the largest annual costs (6.5 billion USD). Following these, central venous catheter infections and infections following infusions, injections and similar procedures resulted in a combined total of more than one billion USD in extra healthcare costs.

3The authors conclude that the most frequent errors result from rather common medical services for which cost-cutting efforts compromise patient safety. That is, the majority of medical errors leading to in-hospital AEs are not caused by poorly performing physicians, nurses, or other clinicians. More commonly, they arise from care delivery problems that result from conditions at the levels of the individual patient or staff member, the task or the health care team. They may even be rooted in the overall work environment. If safeguards along this causal pathway fail, AEs can result. Thus, current, accurate information on AEs is crucial both for individual learning and for improving and developing more reliable health care systems.

4Despite the existence of various national AE registries, such as the US Food and Drug Administration’s system for voluntary reporting of serious drug- or medical device-related AEs, or the Dutch Healthcare Inspectorate for mandatory reporting of sentinel events, comprehensive, prospective national-level data on in-hospital AEs are severely limited. Thus, the available evidence is based mainly on retrospective chart review studies aimed at detecting AE occurrences. The two most frequently used review methods are the ‘Harvard method’ and the Institute of Healthcare Improvement’s Global Trigger Tool. Both involve two-stage medical record reviews and were designed to provide data on the frequency and types of AEs. Stage 1, an evaluation of the presence of certain screening criteria–triggers–is followed by a more in-depth manual review of the medical record to detect an AE (Stage 2). Table 1 provides a brief overview of the characteristics and differences between the two methods.

5The Global Trigger Tool (GTT) has the demonstrated advantage of identifying AEs more accurately than other readily available methods, including voluntary reporting of critical incidents or the Patient Safety Indicators put forth by the Agency for Healthcare Research and Quality. Consequently, it has become an increasingly popular method for post hoc safety measurement and monitoring. In a recent systematic review on 48 general inpatient studies using the GTT, rates of AEs varied between 7 and 40%. Of those identified, the most common event types were complications related to infections, surgical procedures and medication. An earlier systematic review indicated similar findings in eight studies, including a total of more than 70,000 hospital inpatient records, using the Harvard method or comparable approaches. Their analyses revealed that nearly every 10th patient was affected by an adverse event, of which 43% were deemed preventable, and 7.4% were lethal. This time, the majority of AEs were related to surgical procedures (39.6%) and medications (15.1%), while medical procedure- (7.8%), diagnostic- (7.5%) and therapeutic-related (7%) events were less frequent, they remained noteworthy.

6Despite increasing interest among clinical practitioners and researchers to further investigate and develop the GTT, e.g., studies of the accuracy of automated methods for identifying AEs from electronic health record data, retrospective chart review methods such as the Harvard method remain widely used to identify AEs. In particular, these have been used in large-scale studies to estimate national-level AE prevalence. As a consequence, since de Vries’s 2008 systematic review on the topic, numerous retrospective chart review studies have applied Harvard-style methodologies.

7The purpose of this study was to update recent in-hospital adverse event figures according to three objectives: (1) to describe the proportions of patients affected by in-hospital AEs; (2) to report the types and consequences of observed AEs; and (3) to estimate the preventability of in-hospital AEs.

8We conducted a scoping review based on the framework outlined by Arksey and O’Malley. A scoping review’s purpose is to summarize “a range of evidence in order to convey the breadth and depth of a field”. It differs from a systematic literature review in that it requires broader research aims (as opposed to a narrowly focused question) and more refined post hoc (rather than a priori) selection criteria for papers during the review process, but suspends critical appraisal of bias risk or other quality indicators until after the selection process is complete.

9A first literature search of the Medline (PubMed) and CINAHL databases was conducted in May 2017 using the terms “Incidence” [tiab] AND “adverse events” [tiab] AND “patient safety.” The records retrieved were screened independently by CB and SD for hospital adverse event studies conducted between 1991 and 2017. A manual search of the returned articles’ bibliographies was also performed to identify additional relevant studies. In February 2018, in line with our scoping review methodology, a second comprehensive database search was conducted to confirm and complement the results of the first PubMed literature search using an elaborate search string using Hausner et al.’s approach: ((adverse [tiab] AND events [tiab] AND patient*[tiab]) OR incidents [tiab]) AND preventable [tiab])). Following Hausner et al.’s model, we developed our search string based on a primary set of relevant records (a development set) identified in the first search. The relevant records’ titles and abstracts contained keywords (e.g., MeSH terms) and free text terms that served as the building blocks of the final search string. Variations of the search string were then tested against a second set of relevant records (validation set). In our case, as no MeSH term for “adverse events” existed and no promising alternative keywords could be identified, a free text only search string was compiled. All records retrieved were screened independently by RS and DA (see Fig. 1).

10In order to reliably compare the data, we defined an AE according to the Harvard Medical Practice Study definition: “an unintended injury or complication that results in disability at the time of discharge, death or prolonged hospital stay caused by health care management rather than by the patient’s underlying disease process”. All primary studies that (1) used this or a similar definition of an AE, (2) applied a retrospective medical record review according to the Harvard method or a similar method, (3) used a two-stage record review with primary criteria-driven screening by trained reviewers (mostly nurses) and a secondary review of their findings by a physician, (4) were conducted in acute care hospital settings (e.g., medical, surgical, ICU), and (5) included hospitalized adult patients (≥18 years), were eligible for inclusion. Studies restricted to specific clinical areas (e.g., pediatrics, emergency department), studies from non-acute care settings (e.g., rehabilitation, long-term care, primary care), as well as those that evaluated only specific types of AE (e.g., adverse drug events), were excluded. Systematic reviews or studies applying prospective methods (e.g., critical incident reporting systems) were also excluded. Likewise, given that differences in review methodologies result in disparities in AE detection, and that a systematic literature review on the application of the GTT had recently been published, studies applying the GTT method were excluded. Final inclusion of studies was achieved by consensus between the authors (RS and DA).

11From the selected studies, we extracted information on the prevalence (i.e., the proportion of affected patients), types, frequencies, and related consequences of AEs, those AEs’ preventability, and relevant study details (i.e., methods, number of hospitals, setting and sample size) (see Table). Critical appraisal of the included studies and meta-analysis of AE rates across studies were not undertaken due to methodological heterogeneity (e.g., differences in setting, retrospective chart review methods, number of screening criteria, number of reviewers, detection and inclusion of AEs before index admission). Medians and ranges of occurrence, types, consequences and preventability of AEs were calculated using Microsoft Office Excel 2016.

12We included 25 studies conducted between 1991 and 2017 in 27 countries in Europe, Asia, Africa, North and South America, and Australia/New Zealand (see Table 2). All included studies used two-stage retrospective medical record reviews to detect in-hospital AEs based on the ‘Harvard method’ or modified versions of it, such as those developed in Canada and the United Kingdom. Of the 25 studies used, 19 were multi- and 6 single-centre studies. In the multicentre studies, the number of hospitals ranged from two to 58, with sample sizes ranging from 354 to 30,121 patients/records. The single-centre studies’ samples ranged from 500 to 1501 patients/records (see Table 2).

13Across all studies, the frequencies of patients with AEs spanned between 2.9% and 21.9%. The overall median was 10%, with multicentre studies showing a median of 9.3% (range: 2.9% – 21.9%). Single centre studies reported a median of 11.2% with an overall range of 3.3% to 13.5% patients affected by AEs.

14The most common and most consistently reported types of AE in the included studies were operative/surgical-related events, often resulting from procedural complications and injuries such as post-op bleeding or return to surgery. These accounted for a median of 40% of those detected (range: 27% – 74.9%). The second most frequent type was medication- or drug/fluid-related events such as medication errors, which accounted for a median of 19.3% of those detected (Range: 4% – 73%). In third position, healthcare-associated infections and allergic reactions were responsible for a median of 17.7% of all detected events (Range: 0.2% – 25.3%).

15AEs’ consequences were mostly temporary and minimal (recuperation < 1 month) (Median: 53.5%; Range: 16.1% – 73.4%) or caused no patient harm. However, 21.2% of those affected suffered from moderate impairment (recuperation 1–12 months) (Range: 4.1% – 56.5%). A median of 7.3% of AEs resulted in permanent disability (< 50% and > 50% disability) (Range: 3.9% – 17%). Death occurred in a median of 7.3% of patients affected by at least one AE (Range: 0.6% – 30%). Across all included studies, a median of 51.2% of events were considered preventable (Range: 34.3% – 83%). In the reviewed studies, an AE was classified as preventable based on the chart reviewer’s professional judgement of the given incident and consent. In most of the selected studies, preventability of AEs was determined based on a 6-point scale range from “virtually no evidence of preventability” (1 point) to “virtually certain evidence of preventability” (6 points), with a cut-off score of 4.

16We conducted a scoping review and provided an updated international overview of studies on the prevalence, characteristics/types, consequences and preventability of reported hospital AEs. Included studies that applied a retrospective chart review methodology based on the ‘Harvard Medical Practice Study’ approach or similar methods published after 2008 confirmed the findings of de Vries et al.’s systematic review on the worldwide magnitude of in-hospital AEs: one out of ten hospitalized patients is affected by at least one AE, with one out of 14 such events resulting in fatality and half of all cases considered preventable. These findings on AEs’ occurrence are comparable to those reported in studies either applying the Global Trigger Tool methodology or relying on patients’ reports of having experienced medical errors. Applying these figures to the Swiss context in 2015 would mean that roughly 140,500 in-patients in Swiss hospitals experienced AEs, resulting in about 9′400 fatalities.

17Although we included studies that used similar definitions for AEs and retrospective record review methodologies similar to the Harvard Medical Practice Study, the occurrence of in-hospital AEs varied considerably across studies. A number of methodological differences including setting/sample (e.g., medical and/or surgical patients), inclusion of events before or after index admission, the number and types of screening criteria, thresholds for defining causation and preventability or the number, professional background, and the chart reviewers’ level of experience, may partly account for the variability observed in in-hospital AEs across countries. It must be acknowledged that retrospective record review methodology is at risk of bias, including hindsight and performance bias, which would lead respectively to over- or underestimation. However, reducing methodological heterogeneity is crucial to achieving accurate comparisons between countries and meta-analyses of AE rates across studies. The development of a reporting guideline on retrospective chart review studies, e.g., based on the “Strengthening the Reporting of Observational Studies in Epidemiology” (STROBE) statement, could contribute to standardization of the performance and reporting of AE studies.

18Moreover, contextual factors within healthcare systems, such as variation in the quality and methods of medical and patient record documentation across countries and hospitals, might be a key source of variation in AE detection. In combination with the GTT, electronic health records (EHR) are currently gaining the interest of researchers and clinical practitioners alike, as they offer tremendous opportunities to develop automated AE identification methods. While such an approach appears to be time-saving and less resource intensive compared to manual retrospective record review, it demands consistent documentation and representation of key EHR data elements. However, using machine learning and natural language processing in electronic health records, the possibilities to detect and monitor AEs are expanding rapidly. The most advanced systems are already providing real-time feedback to healthcare professionals, thereby offering hospitals advanced quality improvement and learning opportunities. While the results obtained via EHR analyses are surprisingly similar to those available via manual review, computerized searches are virtually instantaneous and cost very little after the initial infrastructure is in place.

19Despite variations between in-hospital AE incidence and measurement, our findings confirm both AEs’ harmful impacts on patients and the persistent need for effective preventive measures. As noted above, the three main types of AEs reported in the included studies were related to surgery, medication/drugs and healthcare-associated infections. In recent years, the study of quality improvement interventions has led to major progress in patient safety, with evidence on effective strategies readily available. For example, hospitals can adopt individual or bundled interventions. Adapted from aviation industry methodology, these are aimed at reducing the three major types of AEs, and include the use of checklists in the operating room, care bundles for the insertion of central venous catheters, hand hygiene adherence, and medication reconciliation practices. Acute care hospitals need to utilize comprehensive and balanced frameworks such as those available to measure, monitor and improve care safety, as well as to foster a culture of safety, especially concerning the three main AE types. Accurate monitoring of in-hospital AEs, including via retrospective record reviews, is essential for the implementation and evaluation of evidence-based strategies to reduce their occurrence and patient harm.

20This scoping review should be read in view of certain limitations. First, we conducted our literature search in the two major electronic databases, Medline (Pubmed) and CINAHL, but did not search for “gray” literature. Therefore, additional relevant studies might have been missed. Second, in line with the scoping review methodology, we did not assess the included studies’ risk of bias. Although we observed methodological heterogeneity in the included studies we did not include/exclude studies based on a quality assessment, as would be necessary in a systematic review. Therefore, caution is advised when drawing conclusions based on these studies’ combined data.

21This scoping review included 25 studies conducted in 27 countries. All had applied the ‘Harvard Method’ of detecting AEs. The median overall occurrence was 10%. Of this number, half were regarded as preventable and 7.3% led to fatal outcomes. However, the occurrence of in-hospital AEs varied considerably across studies, indicating methodological variation and cultural/contextual differences in conducting this type of retrospective chart review. Further research, such as on automated methods of identifying AEs in electronic health records, is needed to overcome methodological issues and bias related to this type of retrospective medical record review and to provide accurate data on their occurrence. As the three most common and most consistently reported types of in-hospital AEs were related to surgery, medication and nosocomial infections, further efforts to measure and monitor these three areas will make hospital care safer and more reliable.