Article Text

Download PDFPDF

Barriers and facilitators to adopting high value practices and de-adopting low value practices in Canadian intensive care units: a multimethod study
  1. Khara Sauro1,
  2. Sean M Bagshaw2,
  3. Daniel Niven1,
  4. Andrea Soo1,
  5. Rebecca Brundin-Mather1,
  6. Jeanna Parsons Leigh1,
  7. Deborah J Cook3,
  8. Henry Thomas Stelfox1
  1. 1 Department of Critical Care Medicine, University of Calgary, Calgary, Alberta, Canada
  2. 2 Department of Critical Care Medicine, University of Alberta, Edmonton, Alberta, Canada
  3. 3 Department of Medicine, McMaster University, Hamilton, Canada
  1. Correspondence to Dr Henry Thomas Stelfox; tstelfox{at}ucalgary.ca

Abstract

Objective To compare and contrast illustrative examples of the adoption of high value practices and the de-adoption of low value practices.

Design (1) Retrospective, population-based audit of low molecular weight heparin (LMWH) for venous thromboembolism (VTE) prophylaxis (high value practice) and albumin for fluid resuscitation (low value practice) and (2) cross-sectional survey of healthcare providers.

Setting Data were collected from nine adult medical-surgical intensive care units (ICUs) in two large Canadian cities. Patients are managed in these ICUs by a group of multiprofessional and multidisciplinary healthcare providers.

Participants Participants included 6946 ICU admissions and 309 healthcare providers from the same ICUs.

Main outcome measures (1) The use of LMWH for VTE prophylaxis (per cent ICU days) and albumin for fluid resuscitation (per cent of patients); and (2) provider knowledge of evidence underpinning these practices, and barriers and facilitators to adopt and de-adopt these practices.

Results LMWH was administered on 38.7% of ICU days, and 20.0% of patients received albumin.

Most participants had knowledge of evidence underpinning VTE prophylaxis and fluid resuscitation (59.1% and 84.2%, respectively). Providers perceived these practices to be followed. The most commonly reported barrier to adoption was insufficient knowledge/understanding (32.8%), and to de-adoption was clinical leader preferences (33.2%). On-site education was the most commonly identified facilitator for adoption and de-adoption (67.8% and 68.6%, respectively).

Conclusions Despite knowledge of and self-reported adherence to best practices, the audit demonstrated opportunity to improve. Provider-reported barriers and facilitators to adoption and de-adoption are broadly similar.

  • quality improvement
  • healthcare system
  • under-use and over-use
  • appropriateness
  • intensive care

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • A strength of this study is the use of mixed methods to comprehensively compare adoption of high value practices and de-adoption of low value practices in the intensive care unit.

  • Another strength is the use of population-based data to capture current clinical practices.

  • The survey used to assess barriers and facilitators of the two illustrative practices was derived from a validated survey instrument.

  • The survey used was simple and designed to garner a representative perspective from all provider professions and therefore captured key concepts, but not granular data.

Introduction  

Optimising the quality of care1 is of particular importance in the intensive care unit (ICU) due to the acuity of patient illness and substantial resources required to care for these patients. However, practice change (adopting high value practices or de-adopting low value practices) can lag behind the publication of evidence hindering delivery of evidence-based practices and may be different when adopting or de-adopting practices.2 3 To minimise the latency for change, it is important to find ways to improve the implementation of evidence-based practices.

A growing body of evidence has evaluated barriers and facilitators for adopting high value practices (effective at improving outcomes).4–7 Substantially less is known about the barriers and facilitators for de-adopting low value practices (ineffective at improving outcomes or harmful), and how they compare to those for adopting high value practices.8 9 De-adoption, also known by several other terms such as disinvestment and de-implementation,8 is the discontinuation of a practice that has been previously adopted.10 Some have suggested that the adoption of high value practices and de-adoption of low value practices involves similar processes and common facilitators and barriers11 12; however, others suggest that the two are clearly distinct.9 13 There has been limited comparative evaluation of adoption and de-adoption and this is an important knowledge gap given the growing number of initiatives aimed at de-adopting low value practices.13–16

The objective of this study was to describe illustrative example practices of the adoption of a high value practice (use of low molecular weight heparin (LMWH) instead of unfractionated heparin (UFH) for venous thromboembolism prophylaxis (VTE) and the de-adoption of a low value practice (albumin for fluid resuscitation) in the ICU. The results of this study prompted a subsequent implementation study to improve these two practices. The audit data identified important opportunities to improve clinical care, and the perceived barriers and facilitators identified in the survey were used to inform the development of interventions.

Methods

Study design

This multimethod observational study included: (1) a retrospective cohort study of patients admitted to ICUs to describe current VTE prophylaxis and fluid resuscitation practices, and (2) a cross-sectional survey of ICU healthcare providers to examine: knowledge of evidence underpinning these two practices, and perceived barriers and facilitators to adopt LMWH for VTE prophylaxis and de-adopt albumin for fluid resuscitation.

Setting

All data were collected from nine adult medical-surgical ICUs in the two largest cities in a Canadian province (population of 4.1 million). A single health services provider is responsible for the provision of all hospital-based care in the province and uses a single formulary across all ICUs (clinical practices may differ between cities and sites). ICU patients are managed by a multidisciplinary and multiprofessional group of healthcare providers, including (but not limited to): physicians, medical trainees (clinical fellows and residents), nurse practitioners (NPs with prescribing privileges), pharmacists and nurses (managers, educators, bedside).

Audit of current practices

Participants

We included patients admitted to nine adult medical-surgical ICUs between 1 January, 2014 and 31 December, 2014. For analyses, patients were grouped into two cohorts. (1) The adoption cohort consisted of patients without a contraindication for pharmacological VTE prophylaxis where according to international and local guidelines LMWH should be prescribed.17–21 Contraindications to pharmacological prophylaxis included a diagnosis potentially associated with a high risk of bleeding (online supplementary content 1), daily assessed platelet count <50×109/L, International Normalized Ratio (INR) ≥2, Partial Thromboplastin Time (PTT) ≥55 s or receipt of therapeutic anticoagulation.

Supplementary file 1

(2)The de-adoption cohort consisted of patients without an indication for use of albumin for fluid resuscitation and where according to the current evidence, albumin should not be used for fluid resuscitation.22–25 Potential indications for albumin included documented liver disease (cirrhosis or hepatic failure), or receipt of plasma exchange.26–29 The two study cohorts were drawn from the same patient population and patients satisfying both sets of clinical indications were included in both cohorts.

Data source

All nine ICUs employ a shared integrated, prospective, clinical information system that captures and delivers multimodal patient data (demographic, clinical, outcome) in real time to the bedside (eCritical MetaVision, iMDsoft, MetaVision), and is also a repository and clinical analytics system that stores these data (eCritical TRACER) to support quality improvement and clinical research. eCritical TRACER was used to extract all data.

Variables

Patient and ICU demographic variables included age, sex, comorbidities, admission type, disease severity (Acute Physiologic Assessment and Chronic Health Evaluation (APACHE) II score), ICU and hospital length of stay, ICU and hospital mortality. Data abstracted included: (1) type of VTE prophylaxis (mechanical included antiembolic stockings and sequential compression devices, and pharmacological included UFH and LMWH), (2) ICU day that VTE prophylaxis was administered, (3) if the patient received albumin, (4) quantity (units) of albumin and (5) ICU day that albumin was administered. An ICU day was defined as any portion of a day between 07:00 and 06:59, recognising that follow-up time on admission day and discharge day may be less than 24 hours.

Data analysis

Descriptive statistics (means with SD, medians with IQR, frequencies with proportions) were used to describe the two cohorts. The proportion of admissions and ICU days with LMWH, UFH and mechanical VTE prophylaxis by ICU and ICU day; and with any albumin administration by ICU and patient were calculated to describe current clinical practices. The unit of analysis for our outcome for the adoption cohort (LMWH use) was patient days because VTE prophylaxis is a routine clinical practice that should be performed on a daily basis. Conversely, the unit of analysis for our outcome for the de-adoption cohort (albumin use) was per patient because fluid resuscitation is a sporadic event that is not part of routine daily patient care.

To examine potential associations between patient demographic and sites, and the use of the high value practice (LMWH) a multivariable generalised estimating equations (GEEs) logistic regression model with exchangeable correlation structure given daily measurements (clustering by patient) was used. To examine potential associations between demographic and site-level factors, and the use of the low value practice (albumin) a multivariable logistic regression model given a single measurement per patient was used.

Barriers and facilitators to adopting low molecular weight heparin for venous thromboembolism prophylaxis and de-adopting albumin for fluid resuscitation

Survey development

The survey was modelled after previous work on adoption of LMWH for VTE prophylaxis,30 and refined to include questions regarding fluid resuscitation. Because research around barriers and facilitators of de-adopting low value practices is in its infancy31 the evidence of barriers and facilitators for adopting high value practices was employed.

The survey was divided into four sections: participant demographic information, knowledge of the current evidence underpinning the best practices and perceptions of barriers and facilitators to the use of the two illustrative examples of best practices (online supplementary content 2).

Supplementary file 2

The survey was pilot tested in two phases: phase (1) seven providers completed the survey and identified unnecessary, missing or poorly worded items. The survey was modified and pilot tested with 12 additional ICU providers (one attending physician, two residents, one clinical fellow, one NP, one nurse manager/charge nurse, one nurse educator, two bedside nurses and three pharmacists). Phase (2) providers completed the survey twice (7–10 days apart) and an additional brief questionnaire to rate the clinical sensibility of the survey. Test-retest reliability of the survey demonstrated a mean intraclass correlation coefficient (ICC) of 0.66 (SD 0.47) for continuous responses and a mean proportion of agreement of 0.86 (SD 0.10) for categorical responses. The low ICC for continuous responses is due to low variability in responses for questions relating to knowledge of best practices. The participants agreed that the survey had face validity (100%), content validity (92%), clarity (92%), utility (100%), discriminability (75%) and minimal redundancy (100%).

Participants

Healthcare providers (as described in setting) that cared for patients in the nine ICUs were invited by email to participate in the study. Invitations to participate were sent to healthcare providers by the principal investigators or by a local clinical leader and included a link to the electronic survey (Fluid Survey) or were provided a paper copy if requested. Weekly reminders were sent for 3 weeks. Providers that responded to the survey were offered entry into a draw for one of three $20 coffee gift cards.

Data analysis

We used descriptive statistics to describe demographic features of participants, knowledge of best practices, perceived barriers to adopting high value practices and de-adopting low value practices, perceived facilitators to encourage adopting high value practices and de-adopting low value practices. Barriers and facilitators to the use of best practices were described overall, and by professional group. Professions were categorised into three groups for analysis: (1) physicians/NPs (those who prescribe), (2) nurses (those who administer) and (3) pharmacists (those who advise prescribers). χ2 tests were used to test for statistical significance between groups.

Patient and public involvement

Patient and family representatives were members of a committee that identified and prioritised research questions for improving the care of critically ill patients.32 LMWH for VTE prophylaxis and de-adopting albumin for fluid resuscitation were two of the research questions identified by this committee. Patients were not involved in the design, the recruitment and conduct of this study. The results of this study have been disseminated to patient and family advisors through oral presentations.

Results

Audit of current practices

There were 6946 ICU admissions during the study period, from 6299 unique patients. Patient characteristics are presented in online supplementary content 3.

Supplementary file 3

The adoption cohort consisted of 4931 admissions (71.0% of all admissions) without a contraindication to pharmacological VTE prophylaxis, and the de-adoption cohort consisted of 6467 admissions (93.1%) without a potential indication for albumin (online supplementary content 4).

Supplementary file 4

During the ICU stay LMWH was given on 38.7% of ICU days, UFH on 45.3% of ICU days and mechanical prophylaxis (exclusive of pharmacological prophylaxis) on 7.7% of ICU days. The type of VTE prophylaxis administered varied throughout patients’ ICU stay; administration of mechanical devices and UFH decreased over the course of the ICU stay while administration of LMWH increased (online supplementary content 5).

Supplementary file 5

A total of 6804 units of albumin were administered to 20.0% of the 6467 admissions without documented liver disease or receipt of plasma exchange. Among those receiving at least 1 unit of albumin, the median number of units per patient was 3 (IQR=1.0–6.0). Albumin was administered on 6.5% of ICU days.

When controlling for demographic and site-level factors, the odds of receiving LMWH for VTE prophylaxis and not receiving albumin for fluid resuscitation were significantly lower for those patients with higher severity of illness (APACHE II score). The odds of receiving LMWH for VTE prophylaxis were significantly higher for patients with non-surgical admissions compared with those with elective surgical admissions (OR=1.34 [95% CI 1.08 to1.66]; table 1). There were significant differences in the odds of using LMWH for VTE prophylaxis, and not using albumin for fluid resuscitation across ICUs (online supplementary content 6), and when controlling for patient-level factors some of these differences persisted especially with regard to the use of LMWH for VTE prophylaxis (table 1).

Supplementary file 6

Table 1

Association between patient demographic and sites, and the use of low molecular weight heparin (LMWH) for venous thromboembolism (VTE) prophylaxis and not using albumin for fluid resuscitation

Barriers and facilitators to adopting low molecular weight heparin for venous thromboembolism prophylaxis and de-adopting albumin for fluid resuscitation

Participants

83.8% (259 of 309) of participants responded; physicians/NPs (48.3%), nurses (42.5%) and pharmacists (9.3%). Participants worked in healthcare for a median of 13 years (IQR=7.1–20.0) and in critical care for a median of 8 years (IQR=3.0–15.0; online supplementary content 7).

Supplementary file 7

Knowledge of evidence

Most participants reported that LMWH was most effective at preventing deep vein thrombosis and pulmonary embolism; and that crystalloids were most effective for fluid resuscitation (table 2). Perceptions regarding the effectiveness of VTE prophylaxis varied by professional group, as did perceptions regarding the risks of harm (table 2). Perceptions regarding effectiveness of albumin for fluid resuscitation and risks of harm associated with each form of fluid resuscitation did not vary by professional group but perceptions regarding the risk of fluid overload did (table 2).

Table 2

Knowledge of best practices for VTE prophylaxis and fluid resuscitation

It was perceived that both best practices were being followed in the ICUs where the participants practiced (table 2).

Barriers to adopting low molecular weight heparin for venous thromboembolism prophylaxis and de-adopting albumin for fluid resuscitation

Barriers to adoption and de-adoption were reported by 65.2% and 64.9% of respondents, respectively. The most commonly reported perceived barriers to adopting LMWH for VTE prophylaxis were insufficient knowledge or understanding, ICU culture and no clinical guidelines (figure 1). The most commonly reported barriers to de-adopting albumin for fluid resuscitation were a strong clinical preference of the local clinical leaders in the ICUs, ICU culture and insufficient knowledge or understanding (figure 1). Reported barriers differed between professional groups for both adoption (figure 2A) and de-adoption (figure 2B).

Figure 1

Barriers to the adoption of high value practices (low molecular weight heparin for venous thromboembolism prophylaxis) and de-adoption of low value practices (albumin for fluid resuscitation). Abbreviations: ICU, intensive care unit.

Figure 2

(A) Barriers to the adoption of high value practices (low molecular weight heparin for venous thromboembolism prophylaxis) by professional group. (B) Barriers to the de-adoption of low value practices (albumin for fluid resuscitation) by professional group. ICU, intensive care unit; NP, nurse practitioner.

Facilitators to adopting low molecular weight heparin for venous thromboembolism prophylaxis and de-adopting albumin for fluid resuscitation

On site education and preset orders were perceived to be the most commonly reported facilitator of both adoption and de-adoption (figure 3). Verbal reminders from pharmacists to physicians were commonly reported as a perceived facilitator for adopting LWMH for VTE prophylaxis. A local leader championing the practice was commonly reported as a perceived facilitator for de-adopting albumin for fluid resuscitation (figure 3). There was no variability by professional group.

Figure 3

Facilitators to the adoption of high value practices (low molecular weight heparin for venous thromboembolism prophylaxis) and de-adoption of low value practices (albumin for fluid resuscitation). MD, medical doctor; QI, quality improvement.

Discussion

The present study identified opportunities to improve the use of best practices for VTE prophylaxis (adopting the high value practice of LMWH) and fluid resuscitation (de-adopting the low value practice of albumin). Our audit data demonstrated that current practice does not reflect providers’ understanding of the evidence for these practices. The use of the best practice for these two illustrative examples were less likely for patients with greater severity of illness and varied across institutions. The perceived barriers and facilitators to adoption and de-adoption were broadly similar.

Are de-adoption and adoption just the flip-side of the same coin? There is substantial literature describing the adoption of high value practices, but much less is known about de-adoption of low value practices.8 Science can inform clinical practice through discovery resulting in adoption of a new practice, replacement resulting in a practice update and reversal resulting in de-adoption of an existing practice. It is only recently that the last concept, de-adopting low value practices, has been debated in journals and by professional societies.13 14 16 The practical implication is that there is limited evidence to inform whether the barriers and facilitators for adoption and de-adoption are similar or sufficiently distinct to warrant different approaches.9 11–13 Our study adds to the limited evidence base by suggesting that culture or organisational factors, provider characteristics and patient characteristics are perceived to be important barriers and facilitators that may play broadly similar roles in adoption and de-adoption.11 12

Knowledge translation (KT) interventions are strategies to improve the synthesis, dissemination, exchange and application of evidence to improve health.5 KT interventions tailored to the specific barriers and facilitators of an innovation and the local context are more likely to effect change.5 6 Our study provides insight into the perceived barriers and facilitators of adopting high value practices (LMWH for VTE prophylaxis) and de-adopting low value practices (albumin for fluid resuscitation) within ICUs, which should be taken into consideration when designing KT interventions. Interestingly, despite knowledge of the evidence underlying the illustrative example practices, providers perceived insufficient knowledge or understanding to be a barrier and perceived education to be a facilitator to both adopting high value practices and de-adopting low value practices. These barriers and facilitators are consistent with a systematic review that suggests the most effective KT interventions in the ICU employ a combination of education and protocols.33 While consistent with previous KT studies, this finding is paradoxical. It is possible that while knowledgeable, providers’ confidence in applying their knowledge clinically was low and they believed education to be the intervention needed to improve their confidence in applying their knowledge. Furthermore, confidence in applying new evidence in clinical practice may be particularly challenging in the care of severely ill patients. This hypothesis is supported by two of our findings: (1) the use of LMWH for VTE prophylaxis and not using albumin for fluid resuscitation was inversely associated with severity of patient illness and (2) the use of LMWH and not using albumin increased as the patient became more stable (over ICU stay). Potential hypotheses to explain these observations include that clinicians may employ conservative decision making (use more familiar practices) or unintendedly neglect to use best practices when caring for sicker patients, but this need further exploration. The implications are that KT interventions should consider clinician heuristics that are likely to be influenced by the nature and severity of patient illness.

Our study suggests that factors other than knowledge may contribute to the successful adoption of high value practices and de-adoption of low value practices, which includes culture, providers and the innovation. These factors have previously been identified within the context of the ICU.2 34–39 ICU culture and local clinical leader preferences were among the most commonly endorsed barriers to adopting high value practices and de-adopting low value practices in our study. This is highlighted by the variation in the use of LMWH between ICUs, even when patient level factors were taken into consideration. Interestingly, this finding was less pronounced for de-adoption, which has been previously reported.9 Culture, also referred to as organisational context, is a frequently cited barrier to evidence-based medicine and can have a profound effect on clinical practice.7 40 However, few studies have systematically evaluated the effect of culture on adopting high value practices and de-adopting low value practices, and implementation studies infrequently account for the effect of culture on their practice change interventions.41 Similarly, the professional role of the provider is not often contextualised but may be important (eg, should pharmacists and nurses be targeted in KT interventions designed to change the prescribing patterns of physicians and if so how?).42 This may be especially relevant as healthcare delivery becomes increasingly multi-professional and team-based as illustrated in our setting (ICU).

The characteristics of innovations themselves may influence change in clinical practice. Evidence suggests that if the innovation being adopted is congruent with clinical practice beliefs it can facilitate adoption.7 Furthermore, the quality, quantity and stability of available evidence to support the adoption or de-adoption of an innovation is likely important.43 Although most providers in our study were aware of the evidence to support the adoption of LMWH for VTE prophylaxis and de-adoption of albumin for fluid resuscitation, they may not have perceived the evidence to be sufficient to warrant practice change. A growing awareness of challenges with reproducing scientific evidence and clinician experience with practice reversals2 may result in more conservative provider behaviour and slower practice change in response to new evidence. The suboptimal prescribing practices observed in our study likely represent a combination of all these factors.

One limitation of this study is that the survey used was imperfect. The results of the self-reported survey reflect perceived modifiers of practice among providers rather than factors shown to influence practice patterns as identified in observational studies.44 The survey was purposefully designed to be simple and accessible to garner a representative perspective from all provider professions and therefore captured key concepts, but not granular data. Nevertheless, the survey has been successfully used for a similar purpose by others30; was reliable and reported to have good clinical sensibility. Alternative methodologies such as qualitative analyses of semistructured interviews may have allowed for more in depth exploration of barriers and facilitators to adopting LMWH and de-adopting albumin. Finally, while this study was a provincial and multisite it was constrained to ICUs, which should be taken into consideration when interpreting our findings beyond this setting.

In conclusion, our study provides several insights into similarities and differences between adoption of high value practices and de-adoption of low value practices. Both adoption and de-adoption of the illustrative example practices did not reflect healthcare providers’ knowledge of the evidence. The use of best practices for both illustrative examples practices were less likely for patients with greater severity of illness and varied across institutions. We found that perceived barriers and facilitators are more similar than different between adoption and de-adoption, which suggests existing behaviour change frameworks for adopting high value practices may also be applicable for de-adopting low value practices.

Acknowledgments

KS would like to acknowledge salary support from the O’Brien Institute for Public Health & Ward of the 21st Century within the Cumming School of Medicine at the University of Calgary, and the Canadian Institutes of Health Research. SB is supported by a Canada Research Chair in Critical Care Nephrology. DJC holds a Canada Research Chair in Knowledge Translation in the ICU. HTS is supported by a Population Health Investigator Award from Alberta Innovates and an Embedded Clinician Researcher Award from the Canadian Institutes of Health Research.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.

Footnotes

  • Contributors KS contributed to the design and conceptualisation of the study; analysis and interpretation of the data, drafting and revising the manuscript and gave approval of the final version of the manuscript. SMB, DN, JPL, DJC and HTS contributed to the design and conceptualisation of the study, interpretation of the data, providing feedback on the manuscript and gave approval of the final version of the manuscript. AS contributed to the analysis and interpretation of the data, providing feedback on the manuscript and gave approval of the final version of the manuscript. RB-M contributed to the interpretation of the data, providing feedback on the manuscript and gave approval of the final version of the manuscript.

  • Funding This work was supported by a Partnership for Research and Innovation in Health Systems grant awarded by Alberta Innovates (Grant #201309 [HTS and SMB]).

  • Competing interests None declared.

  • Ethics approval This study was approved by the University of Calgary Conjoint Health Research Ethics Board (REB14-0992 and REB15-2147) and the University of Alberta Research Ethics Board (Pro00056709 and Pro00060650).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement Data will be available if accepted.

  • Patient consent for publication Not required.