Computerized Provider Order Entry—What are health professionals concerned about? A qualitative study in an Australian hospital

https://doi.org/10.1016/j.ijmedinf.2008.09.007Get rights and content

Abstract

Purpose

To identify the main concerns of a broad range of hospital staff about the implementation of a new Computerized Provider Order Entry (CPOE) system for medication management.

Methods

The study was conducted in a large Australian teaching hospital using semi-structured interviews (n = 20) and focus groups (six focus groups involving a total of 30 participants) from a broad section of health professionals including doctors, nurses, managers, pharmacists and senior health executives. Systematic concurrent analysis of the data was undertaken by a team of researchers.

Results

We identified 20 recurrent themes related to nine areas of shared concern including work practices, software/hardware, relationships/communication, education and training, inexperienced staff and de-skilling. A higher level of analysis identified four interrelated constructs that highlight what people are concerned about: (1) Will it help? (2) Will it work? (3) Will we cope? (4) Will it impair existing interaction?

Limitations

The research provides a snapshot overview of perceptions from a range of hospital personnel in the lead up to CPOE implementation. Generalizability is limited by the size of the sample and the contextual circumstances of the hospital being studied.

Discussion

This work contributes valuable evidence about an often-neglected dimension in the evaluation of computer systems in hospitals, namely the pre-implementation concerns of staff. These pre-conceptions can have a significant effect on how technology is implemented and utilised. Acknowledging and addressing people's concerns can contribute to the establishment of durable channels of negotiation and communication. Further research informed by the findings of this study will help advance this process.

Introduction

Computerized Provider Order Entry (CPOE) systems are widely recognized as a critical component of the future electronic health record for accessing and sharing information across health care settings, and making delivery of patient care safer [1]. Defined by their ability to provide doctors, or other authorised clinicians with the facility to enter orders (e.g. laboratory, medication, imaging, etc.) directly into computers, CPOE systems open up possibilities for improving the efficiency, effectiveness and quality of health care systems [2]. Despite the considerable potential of CPOE systems, their adoption in the US and internationally has been slow [3]. Research has pointed to the possibility of these systems to have unexpected and detrimental effects on workload, hospital culture and relationships, with implications for the delivery of patient care [4], [5], [6], [7], [8], [9], [10]. The successful implementation of a CPOE system requires a range of inputs from a wide variety of professionals including clinical groups, health care managers and service planners. What are their views in the lead-in to CPOE implementation?

A key theoretical consideration centres on the underlying processes associated with new information and communication technology (ICT) systems and how their stability over time depends on the way that users approach and deal with these processes. According to McLaughlin, the value of technology has to be built by users over time as they make sense of and embed it into their local settings [11]. Orlikowski et al. describe this as a transformational development involving ongoing and explicit adaptation of information technology (IT) systems in their changing contexts [12], [13]. Such technology-use mediation incorporates the pre-conceptions, concerns and worries about the value of the new system. The identification of pre-existing barriers and obstacles, and the investigation of the diverse concerns and perceptions of different groups, are crucial steps in implementing change [14], [15]. A valuable example of physicians’ perceptions prior to implementation of a drug prescribing support system is provided by Bastholm Rahmner et al. who reported an inconsistency between physicians’ views that access to patient history would be a major potential benefit, and the inability of the new system to provide this information [16].

The dominant approach to the evaluation of ICT systems such as CPOE has viewed implementation as a largely rational process based upon clearly defined criteria [17]. This approach aspires to provide step-by-step guidance in order to maximise hospital preparedness for employing these systems. But even the more strongly researched and influential of CPOE readiness assessment tools such as that produced by Stablein et al. [18] underscore the complex and difficult tasks involved with CPOE implementation. There are few processes and departments or disciplines which remain untouched by the many changes caused by CPOE. Implementation of these systems crosses cultural and professional boundaries and barriers. Alternative approaches to evaluation have been developed using behavioural models with a greater emphasis on the impact of human factors, emotions and even self-interest [4], [19], [20].

Studies using a wide range of qualitative and theoretical methods to investigate the impact of CPOE have become more numerous. They have added an important dimension to improving our understanding of the complexities and challenges of implementation. In large part these studies have sought to deal with the “why” and “how” questions relevant to understanding the difficulties involved with CPOE systems [21]. Many of them have contributed to challenging pre-existing assumptions about implementation [22], [23] or revealed important unanticipated consequences of the system [24].

The aim of this study was to identify the main concerns of a broad section of hospital personnel (doctors, nurses, managers, pharmacists and senior executives) prior to the implementation of an electronic medication management system. This commercial system comprises prescribing and direct drug administration functionalities with an electronic medication chart. The study represents a before study which investigates an often-neglected dimension to ICT evaluation, namely the pre-implementation inclinations and concerns of a range of different hospital staff about new ICT systems. There are few studies which have considered the perspectives of users prior to implementation, particularly those in situ users who will be instrumental in adopting and using CPOE, and who can therefore make or break the implementation. Their pre-conceptions can have a significant mediating effect on the implementation process. Understanding the nature and cause of the concerns can greatly help to inform strategies to overcome difficulties and potential hurdles including those from unintended consequences. Further, there is limited information about the differences in the concerns of clinicians and managers regarding ICT implementation to determine whether different strategies may be required for these groups. In the end this understanding can contribute to a better appreciation of the dynamics of computer use in work practices [25]. These data also provide a valuable reference point which can be used to monitor and follow up the impact of the system and to assess whether (and how) the challenges of implementation were met [26].

Section snippets

Design and data collection

The work was carried out in the period between January 2005 and February 2006. This provided a source of formative data [27] with which to identify issues and challenges confronting hospital staff as they arose during the planning stage of the implementation, without the influence of hindsight which can have a confounding effect. The study was conducted in a large Australian teaching hospital preparing to implement an electronic medication management system. Initial planning for the new system

Research findings

Our analysis identified 20 recurrent themes (described below), grouped under subheadings of areas of concern designed to capture frequent and related characteristics. Quotations have been chosen because they are representative and provide an effective illustration of the concern. These are presented verbatim to convey the point according to the perspective of the speaker, and as a way of presenting the richness of the data.

Discussion

While each of the four overarching constructs were expressed with varying degrees of emphasis, they nevertheless remained common to respondents irrespective of profession, gender or managerial status. It is interesting that clinical and management participants voiced analogous concerns with a similar level of frequency. This contrasts with the result of a study by Ash et al. of perceptions of physician order entry among a number of diverse US settings that had installed CPOE [34]. That study

Limitations

This study encompasses a snapshot overview of the concerns of a range of clinical and managerial professions in one Australian hospital in the lead up to the implementation of a major extension of CPOE capacity into medication management. The perceptions of our respondents should be viewed in context, particularly as levels of trepidation and anticipation are expected to accompany a major system change in a complex hospital environment. Although the results achieved saturation and provided rich

Conclusion

CPOE systems are expensive and the risks of ineffective implementation are high with the potential to lead to unintended consequences and harm [7], [51], [52]. The importance of identifying and understanding the emotions, concerns and worries of hospital staff confronted by new CPOE systems has been underscored previously by Sittig et al., who noted that the implementation of the new system provoked examples of emotions – positive, negative and neutral – with negative the most prevalent. The

Acknowledgements

This study is part of an Australian Research Council Linkage Grant (LP0347042) funded project to evaluate the effect of information and communication technologies on organizational processes and outcomes using a multidisciplinary, multi-method approach. The project partners included the Health Informatics Research & Evaluation Unit at The University of Sydney, the Centre for Clinical Governance Research in Health from the University of New South Wales and the New South Wales Health Department.

References (58)

  • J.S. Ash et al.

    Some unintended consequences of information technology in health care: the nature of patient care information system-related errors

    J. Am. Med. Inform. Assoc.

    (2004)
  • J. Aarts et al.

    Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center

    J. Am. Med. Inform. Assoc.

    (2004)
  • A. Georgiou et al.

    When requests become orders—a formative investigation into the impact of a computerized physician order entry system on a pathology laboratory service

    Int. J. Med. Inf.

    (2007)
  • M.C. Beuscart-Zephir et al.

    Impact of CPOE on doctor–nurse cooperation for the medication ordering and administration process

    Int. J. Med. Inf.

    (2005)
  • J.L. Callen et al.

    Contextual implementation model: a framework for assisting clinical information system implementations

    J. Am. Med. Inform. Assoc.

    (2008)
  • J.I. Westbrook et al.

    Multimethod evaluation of information and communication technologies in health in the context of wicked problems and sociotechnical theory

    J. Am. Med. Inform. Assoc.

    (2007)
  • E. Ammenwerth et al.

    Visions and strategies to improve evaluation of health information systems. Reflections and lessons based on the HIS-EVAL workshop in Innsbruck

    Int. J. Med. Inf.

    (2004)
  • D. Sittig et al.

    Computer-based physician order entry: the state of the art

    J. Am. Med. Inform. Assoc.

    (1994)
  • T.A. Massaro

    Introducing physician order entry at a major academic medical center: I. Impact on organizational culture and behavior

    Acad. Med.

    (1993)
  • G. Geiger et al.

    Methodology for evaluating physician order entry (POE) implementations

    J. Eval. Clin. Pract.

    (2003)
  • Y.Y. Han et al.

    Unexpected increased mortality after implementation of a commercially sold Computerized Physician Order Entry System

    Pediatrics

    (2005)
  • R. Koppel et al.

    Role of Computerized Physician Order Entry Systems in facilitating medication errors

    JAMA

    (2005)
  • J. McLaughlin et al.

    Valuing Technology; Organisations Culture and Change

    (1999)
  • W. Orlikowski et al.

    Shaping electronic communication: the metastructuring of technology in the context of use

    Organ. Sci.

    (1995)
  • R.E. Rice et al.

    New media and organizational structuring

  • P. Bastholm Rahmner et al.

    Physicians’ perceptions of possibilities and obstacles prior to implementing a computerised drug prescribing support system

    Int. J. Health Qual. Assur.

    (2004)
  • G. Walsham

    Interpreting Information Systems in Organizations

    (1993)
  • R. Heeks et al.

    Understanding success and failure in information age reform

  • A.P. Stoop et al.

    Integrating quantitative and qualitative methods in patient care information system evaluation: guidance for the organizational decision maker

    Methods Inf. Med.

    (2003)
  • Cited by (39)

    • Investigation of physicians' awareness and use of mHealth apps: A mixed method study

      2017, Health Policy and Technology
      Citation Excerpt :

      The interviews revealed a certain level of compatibility issued among mHealth apps and hospital information systems. However, since there is no active implementation of mHealth or use of mHealth apps within an organized official capacity, there may not be a perception about compatibility in behavioral intention, simply due to lack of practice [79,80]. Similarly, mobile self-efficacy (MS) was observed to exist; however, the conceptualization of mHealth use in practice might be ambiguous due to limited apps for each specialty.

    • Assessment of efficiency and safety of the comprehensive Chemotherapy Assistance Program for ordering oncology medications

      2013, International Journal of Medical Informatics
      Citation Excerpt :

      It is difficult to streamline a prescribing system simultaneously for all users [4]. Although achieving collaboration amongst all health care providers in the practice setting can be a lengthy process, that involves discussions between numerous stakeholders, the process is necessary to promote the efficiency and safety of the CPOE system [31,37–40]. Furthermore, for continuous development of the CPOE system, strategies for identifying and managing the unintended consequences need to be prepared in advance [41].

    View all citing articles on Scopus
    View full text