Computerized Provider Order Entry—What are health professionals concerned about? A qualitative study in an Australian hospital
Introduction
Computerized Provider Order Entry (CPOE) systems are widely recognized as a critical component of the future electronic health record for accessing and sharing information across health care settings, and making delivery of patient care safer [1]. Defined by their ability to provide doctors, or other authorised clinicians with the facility to enter orders (e.g. laboratory, medication, imaging, etc.) directly into computers, CPOE systems open up possibilities for improving the efficiency, effectiveness and quality of health care systems [2]. Despite the considerable potential of CPOE systems, their adoption in the US and internationally has been slow [3]. Research has pointed to the possibility of these systems to have unexpected and detrimental effects on workload, hospital culture and relationships, with implications for the delivery of patient care [4], [5], [6], [7], [8], [9], [10]. The successful implementation of a CPOE system requires a range of inputs from a wide variety of professionals including clinical groups, health care managers and service planners. What are their views in the lead-in to CPOE implementation?
A key theoretical consideration centres on the underlying processes associated with new information and communication technology (ICT) systems and how their stability over time depends on the way that users approach and deal with these processes. According to McLaughlin, the value of technology has to be built by users over time as they make sense of and embed it into their local settings [11]. Orlikowski et al. describe this as a transformational development involving ongoing and explicit adaptation of information technology (IT) systems in their changing contexts [12], [13]. Such technology-use mediation incorporates the pre-conceptions, concerns and worries about the value of the new system. The identification of pre-existing barriers and obstacles, and the investigation of the diverse concerns and perceptions of different groups, are crucial steps in implementing change [14], [15]. A valuable example of physicians’ perceptions prior to implementation of a drug prescribing support system is provided by Bastholm Rahmner et al. who reported an inconsistency between physicians’ views that access to patient history would be a major potential benefit, and the inability of the new system to provide this information [16].
The dominant approach to the evaluation of ICT systems such as CPOE has viewed implementation as a largely rational process based upon clearly defined criteria [17]. This approach aspires to provide step-by-step guidance in order to maximise hospital preparedness for employing these systems. But even the more strongly researched and influential of CPOE readiness assessment tools such as that produced by Stablein et al. [18] underscore the complex and difficult tasks involved with CPOE implementation. There are few processes and departments or disciplines which remain untouched by the many changes caused by CPOE. Implementation of these systems crosses cultural and professional boundaries and barriers. Alternative approaches to evaluation have been developed using behavioural models with a greater emphasis on the impact of human factors, emotions and even self-interest [4], [19], [20].
Studies using a wide range of qualitative and theoretical methods to investigate the impact of CPOE have become more numerous. They have added an important dimension to improving our understanding of the complexities and challenges of implementation. In large part these studies have sought to deal with the “why” and “how” questions relevant to understanding the difficulties involved with CPOE systems [21]. Many of them have contributed to challenging pre-existing assumptions about implementation [22], [23] or revealed important unanticipated consequences of the system [24].
The aim of this study was to identify the main concerns of a broad section of hospital personnel (doctors, nurses, managers, pharmacists and senior executives) prior to the implementation of an electronic medication management system. This commercial system comprises prescribing and direct drug administration functionalities with an electronic medication chart. The study represents a before study which investigates an often-neglected dimension to ICT evaluation, namely the pre-implementation inclinations and concerns of a range of different hospital staff about new ICT systems. There are few studies which have considered the perspectives of users prior to implementation, particularly those in situ users who will be instrumental in adopting and using CPOE, and who can therefore make or break the implementation. Their pre-conceptions can have a significant mediating effect on the implementation process. Understanding the nature and cause of the concerns can greatly help to inform strategies to overcome difficulties and potential hurdles including those from unintended consequences. Further, there is limited information about the differences in the concerns of clinicians and managers regarding ICT implementation to determine whether different strategies may be required for these groups. In the end this understanding can contribute to a better appreciation of the dynamics of computer use in work practices [25]. These data also provide a valuable reference point which can be used to monitor and follow up the impact of the system and to assess whether (and how) the challenges of implementation were met [26].
Section snippets
Design and data collection
The work was carried out in the period between January 2005 and February 2006. This provided a source of formative data [27] with which to identify issues and challenges confronting hospital staff as they arose during the planning stage of the implementation, without the influence of hindsight which can have a confounding effect. The study was conducted in a large Australian teaching hospital preparing to implement an electronic medication management system. Initial planning for the new system
Research findings
Our analysis identified 20 recurrent themes (described below), grouped under subheadings of areas of concern designed to capture frequent and related characteristics. Quotations have been chosen because they are representative and provide an effective illustration of the concern. These are presented verbatim to convey the point according to the perspective of the speaker, and as a way of presenting the richness of the data.
Discussion
While each of the four overarching constructs were expressed with varying degrees of emphasis, they nevertheless remained common to respondents irrespective of profession, gender or managerial status. It is interesting that clinical and management participants voiced analogous concerns with a similar level of frequency. This contrasts with the result of a study by Ash et al. of perceptions of physician order entry among a number of diverse US settings that had installed CPOE [34]. That study
Limitations
This study encompasses a snapshot overview of the concerns of a range of clinical and managerial professions in one Australian hospital in the lead up to the implementation of a major extension of CPOE capacity into medication management. The perceptions of our respondents should be viewed in context, particularly as levels of trepidation and anticipation are expected to accompany a major system change in a complex hospital environment. Although the results achieved saturation and provided rich
Conclusion
CPOE systems are expensive and the risks of ineffective implementation are high with the potential to lead to unintended consequences and harm [7], [51], [52]. The importance of identifying and understanding the emotions, concerns and worries of hospital staff confronted by new CPOE systems has been underscored previously by Sittig et al., who noted that the implementation of the new system provoked examples of emotions – positive, negative and neutral – with negative the most prevalent. The
Acknowledgements
This study is part of an Australian Research Council Linkage Grant (LP0347042) funded project to evaluate the effect of information and communication technologies on organizational processes and outcomes using a multidisciplinary, multi-method approach. The project partners included the Health Informatics Research & Evaluation Unit at The University of Sydney, the Centre for Clinical Governance Research in Health from the University of New South Wales and the New South Wales Health Department.
References (58)
- et al.
Factors and forces affecting EHR system adoption: report of a 2004 ACMI discussion
J. Am. Med. Inform. Assoc.
(2005) - et al.
Computerized physician order entry in U.S. hospitals: results of a 2002 Survey
J. Am. Med. Inform. Assoc.
(2004) - et al.
Extending the understanding of computerized physician order entry: Implications for professional collaboration, workflow and quality of care
Int. J. Med. Inf.
(2007) - et al.
Types of unintended consequences related to computerized provider order entry
J. Am. Med. Inform. Assoc.
(2006) - et al.
Assessing the anticipated consequences of Computer-based Provider Order Entry at three community hospitals using an open-ended, semi-structured survey instrument
Int. J. Med. Inf.
(2008) - et al.
From best evidence to best practice: effective implementation of change in patients’ care
Lancet
(2003) - et al.
The story behind the story: physician skepticism about relying on clinical information technologies to reduce medical errors
Int. J. Med. Inf.
(2007) - et al.
Understanding hospital readiness for computerized physician order entry
Jt. Comm. J. Qual. Saf.
(2003) - et al.
Emotional aspects of computer-based provider order entry: a qualitative study
J. Am. Med. Inform. Assoc.
(2005) - et al.
Impacts of computerized physician documentation in a teaching hospital: perceptions of faculty and resident physicians
J. Am. Med. Inform. Assoc.
(2004)
Some unintended consequences of information technology in health care: the nature of patient care information system-related errors
J. Am. Med. Inform. Assoc.
Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center
J. Am. Med. Inform. Assoc.
When requests become orders—a formative investigation into the impact of a computerized physician order entry system on a pathology laboratory service
Int. J. Med. Inf.
Impact of CPOE on doctor–nurse cooperation for the medication ordering and administration process
Int. J. Med. Inf.
Contextual implementation model: a framework for assisting clinical information system implementations
J. Am. Med. Inform. Assoc.
Multimethod evaluation of information and communication technologies in health in the context of wicked problems and sociotechnical theory
J. Am. Med. Inform. Assoc.
Visions and strategies to improve evaluation of health information systems. Reflections and lessons based on the HIS-EVAL workshop in Innsbruck
Int. J. Med. Inf.
Computer-based physician order entry: the state of the art
J. Am. Med. Inform. Assoc.
Introducing physician order entry at a major academic medical center: I. Impact on organizational culture and behavior
Acad. Med.
Methodology for evaluating physician order entry (POE) implementations
J. Eval. Clin. Pract.
Unexpected increased mortality after implementation of a commercially sold Computerized Physician Order Entry System
Pediatrics
Role of Computerized Physician Order Entry Systems in facilitating medication errors
JAMA
Valuing Technology; Organisations Culture and Change
Shaping electronic communication: the metastructuring of technology in the context of use
Organ. Sci.
New media and organizational structuring
Physicians’ perceptions of possibilities and obstacles prior to implementing a computerised drug prescribing support system
Int. J. Health Qual. Assur.
Interpreting Information Systems in Organizations
Understanding success and failure in information age reform
Integrating quantitative and qualitative methods in patient care information system evaluation: guidance for the organizational decision maker
Methods Inf. Med.
Cited by (39)
Investigation of physicians' awareness and use of mHealth apps: A mixed method study
2017, Health Policy and TechnologyCitation Excerpt :The interviews revealed a certain level of compatibility issued among mHealth apps and hospital information systems. However, since there is no active implementation of mHealth or use of mHealth apps within an organized official capacity, there may not be a perception about compatibility in behavioral intention, simply due to lack of practice [79,80]. Similarly, mobile self-efficacy (MS) was observed to exist; however, the conceptualization of mHealth use in practice might be ambiguous due to limited apps for each specialty.
Assessment of efficiency and safety of the comprehensive Chemotherapy Assistance Program for ordering oncology medications
2013, International Journal of Medical InformaticsCitation Excerpt :It is difficult to streamline a prescribing system simultaneously for all users [4]. Although achieving collaboration amongst all health care providers in the practice setting can be a lengthy process, that involves discussions between numerous stakeholders, the process is necessary to promote the efficiency and safety of the CPOE system [31,37–40]. Furthermore, for continuous development of the CPOE system, strategies for identifying and managing the unintended consequences need to be prepared in advance [41].
Maintaining a medical institution in a context of materiality change: Lessons from a Canadian university hospital
2023, Health (United Kingdom)Digital interventions for antimicrobial prescribing and monitoring: a qualitative meta-synthesis of factors influencing user acceptance
2022, Journal of the American Medical Informatics AssociationThe leadership behaviors needed to implement clinical genomics at scale: a qualitative study
2020, Genetics in Medicine