Article Text

Download PDFPDF

Use of simulation for education in hospital pharmaceutical technologies: a systematic review
  1. Alexandra Garnier1,2,
  2. Romain Vanherp1,
  3. Pascal Bonnabry1,2,
  4. Lucie Bouchoud1
  1. 1Department of Pharmacy, Geneva University Hospitals, Geneva, Switzerland
  2. 2Institute of Pharmaceutical Sciences of Western Switzerland, School of Pharmaceutical Sciences, University of Geneva, Geneva, Switzerland
  1. Correspondence to Mrs Alexandra Garnier, Pharmacy, Geneva University Hospitals, 1211 Geneve, Switzerland; alexandra.garnier{at}hcuge.ch

Abstract

Objectives Because of the inherent risks facing pharmacy technicians, and consequently also patients, initial and continuing education on hospital pharmaceutical technologies is essential. Simulation is a pedagogical tool now widely used in healthcare education. This study’s objectives are to provide an overview of simulation’s current place in the field of hospital pharmaceutical technology education, to classify these uses, and to discuss how simulation technologies could be better used in the future.

Data sources Two pharmacists independently searched PubMed, Embase, and Web of Science on 21 July 2020 and included studies in English or French that used simulation as an educational tool in the field of hospital pharmaceutical technologies, whether in academic teaching or professional practice.

Data summary Our search criteria resulted in 6248 articles, of which 24 were assessed for eligibility and 13 included in the qualitative synthesis. Simulation in hospital pharmaceutical technology education is used in three different ways: first, as a playful pedagogical tool, with error-based simulations (cleanrooms and preparation sheets with errors), or game-based simulations (escape games, role-plays, and board games); second, as an electronic tool with virtual reality (virtual cleanrooms and serious games), or augmented reality (3D glasses); finally, to evaluate chemical contamination (fluorescein and quinine tests) and microbiological contamination (media-fill tests) during compounding to periodically requalify pharmacy technicians.

Conclusion Further studies, including non-technical skills evaluations, are needed to confirm the usefulness of this innovative technique in training as efficiently as possible actual and future pharmacy professionals.

  • pharmaceutical preparations
  • pharmacy service
  • hospital
  • education
  • pharmacy
  • education
  • pharmacy
  • continuing
  • pharmacy administration

Data availability statement

Data are available upon reasonable request. Not applicable.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, an indication of whether changes were made, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Pharmaceutical technologies include methods, techniques, and instrumentation in the compounding of drugs and other preparations used in the diagnosis and treatment of patients. These drugs can be sterile or non-sterile. In the case of sterile drugs, the work environment is a cleanroom with a laminar flow hood or isolator, and aseptic techniques are required to maintain sterility throughout the process.

Healthcare simulation is a technique that creates a situation or environment to allow persons to experience a representation of a real healthcare event for the purpose of practise, learning, evaluation, testing, or to gain understanding of systems or human actions.1 In other words, simulation makes an experimental situation as close to reality as possible.

The efficacy of simulation methods depends on the trainer’s perspective of the three axes of simulation fidelity2: environmental fidelity, concerning the extent to which the simulator duplicates sensory information from the environment (a simulated cleanroom that looks like a real one); equipment fidelity, concerning the degree to which the simulator duplicates the appearance and feel of the real system (isolator or laminar flow hood identical to the one used daily); and psychological fidelity, concerning the degree to which the trainee perceives the simulation to be a believable surrogate for the real task.3

The French National Authority for Health lists three categories for simulation techniques in healthcare4: human simulation (standardised patients, role-playing), synthetic simulation (procedural simulators, patient simulators), and electronic simulation (3D environments, serious games, virtual reality, augmented reality). This classification is representative in medicine, and particularly in surgery or anaesthesia where simulation is regularly used, but is less appropriate for pharmaceutical courses and especially for hospital pharmaceutical technologies (HPT) where simulation is still in its infancy.

Several studies have shown the positive impact of using simulation in the training of pharmacy students and pharmacists to improve technical skills5–7 (medicines reconciliation, medical emergencies, order verification) and non-technical skills8–10 (communication, attitude, empathy). The above competencies mainly concern clinical pharmacists and their relationships with patients. It is hard to find simulation-based training dedicated to pharmacists working in pharmaceutical technologies, especially in hospital.

However, using simulation could enhance numerous pharmaceutical technology skills such as developing technical and functional expertise (training in routine or exceptional technical manipulations and implementing individual or team procedures such as hygiene or preparation of an isolator), building problem-solving and decision-making skills (in risk management—reproduction of adverse events, ability to cope with exceptional situations—of medication errors, broken vials, or extravasation and training in diagnostic and therapeutic clinical reasoning such as the analysis of prescriptions or preparation sheets), and promoting interpersonal, communication, and team-based skills (behaviour management of professional situations, teamwork, and communication using stress management or effective team communication).11 12 Considering these potentials, we decided to review the literature about the different uses of simulation in HPT. We believe that this literature review could help pharmacists in the conception and promotion of educational actions involving the use of simulation for HPT.

The present study’s objectives were: (1) to provide an overview of simulation’s current place in the field of HPT education; (2) to create a classification specific to HPT inspired by the HAS classification; and (3) to discuss how simulation in HPT could be better used in the future.

Material and methods

Data sources

This systematic review was performed according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines.13 The research strategy consisted of searching for relevant article titles and abstracts in the PubMed, Embase, and Web of Science databases. Keywords were chosen by consensus between the authors, with regards to our objectives. The words ‘pharmaceutical technology’ or ‘pharmaceutical technologies’ are rarely used in scientific articles which usually focus on a specific area of that field. That is the reason why the words ‘cytotoxic OR chemotherapy OR aseptic OR parenteral nutrition’ were selected for the pharmaceutical technologies axis. The word ‘education’ would have been too discriminating, therefore, it was not included among our keywords and only ‘AND simulation’ was used for the pedagogical method axis. An additional manual search was also conducted in the bibliographic reference lists of selected articles and in the journals and archives of specific congresses on pharmaceutical technologies.

Inclusion and exclusion criteria

Inclusion criteria were: design or use of simulation tools for education in pharmaceutical technologies, in initial education (university) or continuing education (hospital), published articles in English or French, and availability of the whole article. Exclusion criteria were: mathematical, computer, molecular, robotic, or cost simulation models.

Analysis

Two pharmacists (AG and RV), working independently, searched the literature on 21 July 2020 using the chosen keywords, and selected articles based on their titles. These articles were sorted using their abstracts, and duplicate entries were eliminated. An analysis file spreadsheet (Excel) was created to collect the relevant data from each article. After a reconciliation of the results (comparing Excel spreadsheets), any discrepant opinions about article selection were discussed with a third author (PB) in order to reach a consensus. A final synthetic table was created from the detailed analysis file: author; title; year of publication; journal; country; study objectives; type of education—initial or continuing; field—chemotherapy or aseptic techniques; number and types of participants—pharmacists or pharmacy technicians; study length; evaluations of study limitations, impact, and Kirkpatrick evaluation levels (Reaction, Learning, Behaviour, Results) which are commonly used for evaluating training.14

Results

The search strategy is presented in figure 1 and summaries of the included studies can be found in tables 1 and 2.

Figure 1

Flow diagram of the review article selection strategy of the literature.

Table 1

Summary of the articles about the use of simulations in hospital pharmaceutical technologies initial education

Table 2

Summary of the articles about the use of simulations in hospital pharmaceutical technologies continuing education

Most of the simulation studies were carried out in France (54%; n=7), with the others occurring in Switzerland (15%; n=2) and the USA (31%; n=4). Continuing education for professionals was represented (77%; n=10) more than initial education for students (23%; n=3). The training topics were competencies in the preparation of chemotherapies (31%; n=4) or parenteral nutrition (8%; n=1) and aseptic techniques for handling chemotherapies or other products (61%; n=8). Simulation-based training (SBT) sessions were proposed in different settings, including real-life cleanrooms in daily use (42%; n=5), simulated cleanrooms (42%; n=5), and virtual cleanrooms (16.7%; n=2). Participation was mandatory (8.3%; n=1), voluntary (16.7%; n=2), or not mentioned (75%; n=9).

When participants were pharmacists and pharmacy technicians (62%; n=8), the number of participants ranged from nine to 20 people. Sometimes participants were gathered from several hospitals (15%; n=2), thus increasing the number of participants from 45 to 72 people. When students were involved (23%; n=3), this number ranged from 109 to 150.

Discussion

To our knowledge, this is the first systematic literature review investigating the use of SBT in HPT. It highlights the limited number of published articles on this subject, since only 13 articles were reviewed, both in academic teaching and professional practice. Our research revealed that the use of SBT in HPT could be separated into three categories summarised in figure 2: the use of simulation as a playful tool, simulation using electronic tools, and simulation as a contamination verification tool.

Figure 2

Ways of using simulation for education in hospital pharmaceutical technologies.

Simulation as a playful tool

The error-based simulation

The chamber of errors, also called the cleanroom of errors,15 16 the isolator of errors,17 18 or the controlled atmosphere area of errors,19 20 is an SBT approach where participants are asked to observe and report any of the several mistakes intentionally presented in a training room21 22 or on chemotherapy preparation sheets.23 24 The global objective of these studies is to assess pharmacy technicians’ knowledge of appropriate chemotherapy preparation practices. Some of these mistakes, which could lead to consequences for the patient (administering an expired medication or an overdose of vincristine, dispensing the wrong form of a drug), are major errors which participants are expected to spot.21

Integrating learning through errors into simulation approaches probably improves several competencies because trainees actively explore their environment and are explicitly encouraged to make and learn from mistakes, while competencies requiring improvement are pointed out. Error-based simulation is not only a game but also a cognitive model of safety improvement.

The game-based simulation

Using games—structured tasks forcing participants to interact according to a set of rules—captures the essence of real-life situations. Very few published, innovative, game-based simulations exist in the field of pharmaceutical technologies. One good example is the escape room for learning good manufacturing practices.25 In addition to testing learners’ theoretical and practical knowledge, the game aims to provide an instrument with which to study the processes involved in the actors’ interactions. However, the success of these studies differs according to the participants’ degree of involvement (better when they are deeply involved), the type of role being played (better when they play their own roles), and the response specificity (better when they feel free to behave as they want).26 In the HPT field, this role-playing method has been used to help students understand the role of an oncology pharmacist.27 Despite the discrepancy between role-playing and reality, students were able to apply (or identify gaps in) their knowledge and reinforce their critical thinking skills. Finally, several board-game-based simulations have been created to allow pharmacy technicians to check all the knowledge needed for the preparation of chemotherapies, such as a Trivial Pursuit-type game, a 37-card game, or a snakes-and-ladders board game.28–30 All of them have been well received thanks to their engaging visual, interactive, playful, and collaborative aspects.

Simulation using electronic tools

Virtual reality

In 2011 the first virtual cleanroom was created to cultivate students’ confidence in preparing intravenous medications appropriately while emphasising safe medication practices.31 At that time, it was challenging to find a suitable facility to host the sessions, access knowledgeable individuals capable of validating the virtual environment, and work within the limits of technology. Then a cleanroom simulator called LabQuest was developed to show that professionals trained using this system performed better than those trained using the traditional methods of video, quizzes, and PowerPoint presentations.32 This study is particularly interesting because it compared two homogeneous populations undergoing two different types of training.

As a mix between virtual reality and error-based simulation, the Association for the Digital and the Information for Pharmacy (ADIPH) created a serious game including 60 errors in its SimUPAC 360° virtual cleanroom.33

Augmented reality

Augmented reality’s use in the field of educating employees about pharmacy technologies is still in its infancy, but results are encouraging. For the preparation of injectable drugs, 3D glasses can be used to reduce the number of medication errors related to a lack of information, by giving the step-by-step instructions to the pharmacy technician in an ergonomic and practical way.34 Test feedbacks are positive, but efficiency results are unavailable for the moment.

Simulation as a contamination verification tool

Chemical contamination

The fluorescein test is a chemical contamination simulation process with two big advantages: it is safe, and contamination is easily visible under ultraviolet (UV) light. This method enables an assessment of the actions leading to contamination, as well as the frequency, location, and volumes of those contaminations. All these parameters are essential to knowing and controlling the exposure faced by pharmacy technicians, and this method, developed 25 years ago,35 36 is still used for validating them.37–39 Other studies replace fluorescein with quinine. Quinine solution is non-toxic and fluorescent under UV light, but it is also colourless, preventing pharmacy technicians from seeing contamination directly and modifying their actions during production. One of the studies reviewed showed no correlation between contamination rates and pharmacy technicians’ experience, but provided specific, individualised training when contamination quantities were over 10 µL.40 Others used the same method to insist on collective awareness of contamination risks and to work on improving manipulation gestures.41

These educational approaches are interesting because pharmacy technicians can visualise and account for chemical contamination in real-time. It seems more appropriate to use quinine in such evaluations because its solution resembles the drugs handled regularly in hospital pharmacies, being mostly colourless. These tests thus appear essential for validating new pharmacy technicians and requalifying them periodically in order to detect any problems during manipulation.

Microbiological contamination

The media-fill test (MFT), sometimes known as ‘process simulation’, validates the pharmacy technician’s ability to maintain sterility throughout the manufacturing process. Microbiological growth medium is used in place of the drug solution to test whether aseptic procedures are adequate to prevent contamination during real-life drug production. As there is a significant microbiological risk during the preparation of parenteral nutrients or chemotherapies, the MFT is a very good means of evaluating pharmacy technicians. The result necessary for the validation of an MFT is zero microbiological growth. It was found that cases of microbiological growth were always linked to Enterococccus faecalis and directly correlated to poor aseptic technique,42 and that contamination during aseptic compounding was linked to human errors rather than environmental contamination.43 The MFT is used to validate how pharmacy technicians manipulate their equipment and is thus considered a pedagogical tool. If a pharmacy technician’s manipulations lead to microbiological growth, then they must be retrained in that particular manipulation gesture.

Perspectives for improvement

Evaluation and educational content

Strengthening and improving the use of simulation in educating pharmacy technicians about HPT requires permanent evaluation and adjustment of the methods used. Only five of the 12 articles considered reported collecting information on trainee satisfaction (Kirkpatrick’s level 1). This ranged from a group discussion during a meeting21 to an individual survey composed of three questions using Likert scale responses.31 Such heterogeneity and subjectivity could be reduced by evaluating the relevance of the training content and the trainee’s involvement as the training progresses, as suggested in the New World Kirkpatrick Model.44 Although level 2 evaluation was more common, with seven out of 12 articles reporting a pre/post-assessment of knowledge, we believe that it is still not enough to justify scientifically the use of simulation over other training methods. Level 3 evaluation measures the impact of training on daily practice and is considered the most difficult part of training to evaluate. Indeed, none of the studies included in this review reported it.

Finally, level 4 aims to evaluate the impact of the training on patients, which none of our reviewed studies managed, or on the institution. LabQuest claims a training cost saving of at least €1500 per new employee45 but, in this review, only two studies mentioned its costs in terms of material, time, and human resources.31 46 If a positive return on investment represents the holy grail of SBT, the lack of studies including this aspect does not work in this educational approach’s favour. Some authors have proposed a framework for calculating the return on investment in the field of healthcare, and this might be adaptable to the field of HPT.47 However, it is more likely that the future evaluation of SBT is based on the return on expectations, a collaborative process where the sponsor’s expectations are identified and transformed into criteria of success, which are themselves transformed into assessment criteria.

Monitoring non-technical skills

A competency is the sum of knowledge, skill, and attitude. A study assessing 11 non-technical skills in a group of 15 pharmacy technicians showed a low score in leadership, commitment and work quality, which are all related to teamworking attitude.48 However, the importance of teamwork, communication, and collegiality—as non-technical skills—was neither assessed nor discussed in any of the studies reviewed. There is a need, in the future, to develop this field.

Conclusion

This study reviews all the simulation-based training used for education in hospital pharmaceutical technologies, both in academic teaching and professional practice. The classification proposed in this paper—playful tool, electronic tool, and verification tool—provides a state of the art but will certainly evolve in parallel with the evolution of evaluation methods and the recognition of non-technical skills as a fully-fledged subject of learning. Further studies are needed to confirm the usefulness of this innovative technique in training as efficiently as possible actual and future pharmacy professionals.

Data availability statement

Data are available upon reasonable request. Not applicable.

Ethics statements

Patient consent for publication

Ethics approval

This study does not involve human participants.

References

Footnotes

  • EAHP Statement 6: Education and Research.

  • Twitter @bonnabry

  • Contributors AG: research idea development, data acquisition, data analysis, results interpretation, drafting/revision of the paper. RV: data acquisition, data analysis, results interpretation. PB: research idea development, drafting/revision of the paper. LB: research idea development, drafting/revision of the paper.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.