Article Text

Download PDFPDF

Electronic monitoring of potential adverse drug events related to lopinavir/ritonavir and hydroxychloroquine during the first wave of COVID-19
  1. Christian Skalafouris1,2,
  2. Caroline Samer3,
  3. Jerome Stirnemann4,
  4. Olivier Grosgurin4,
  5. François Eggimann5,
  6. Damien Grauser5,
  7. Jean-Luc Reny4,
  8. Pascal Bonnabry1,2,
  9. Bertrand Guignard1
  1. 1Pharmacy, Geneva University Hospitals, Geneva, Switzerland
  2. 2Institute of Pharmaceutical Sciences of Western Switzerland (ISPSO), School of pharmaceutical sciences, University of Geneva, Geneva, Switzerland
  3. 3Clinical Pharmacology and Toxicology Division, Geneva University Hospitals, Geneva, Switzerland
  4. 4General Internal Medicine Division, Geneva University Hospitals, Geneve, Switzerland
  5. 5Information Systems Department, Geneva University Hospitals, Geneva, Switzerland
  1. Correspondence to Christian Skalafouris, Pharmacy, Geneva University Hospitals, 1205 Geneva, Switzerland; christian.skalafouris{at}


During Switzerland’s first wave of COVID-19, clinical pharmacy activities during medical rounds in Geneva University Hospitals were replaced by targeted remote interventions. We describe using the electronic PharmaCheck system to screen high-risk situations of adverse drug events (ADEs), particularly targeting prescriptions of lopinavir/ritonavir (LPVr) and hydroxychloroquine (HCQ) in the presence of contraindications or prescriptions outside institutional guidelines. Of 416 patients receiving LPVr and/or HCQ, 182 alerts were triggered for 164 (39.4%) patients. The main associated risk factors of ADEs were drug–drug interactions, QTc interval prolongation, electrolyte disorder and inadequate LPVr dosage. Therapeutic optimisation recommended by a pharmacist or proposals for additional monitoring were accepted in 80% (n=36) of cases. Combined with pharmacist contextualisation to the clinical context, PharmaCheck made it possible to successfully adapt clinical pharmacist activities by switching from a global to a targeted analysis mode in an emergency context.

  • COVID-19
  • pharmacy service
  • hospital
  • automation
  • drug-related side effects and adverse reactions
  • medical informatics

Data availability statement

All data relevant to the study are included in the article or uploaded as supplementary information.

This article is made freely available for use in accordance with BMJ’s website terms and conditions for the duration of the covid-19 pandemic or until otherwise determined by BMJ. You may use, download and print the article for any lawful, non-commercial purpose (including text and data mining) provided that all copyright notices and trade marks are retained.

Statistics from


The SARS-CoV-2 pandemic hit Switzerland in March 2020, and many hospitals had to reorganise rapidly to cope with the influx of COVID-19 patients.1 The 2000-bed Geneva University Hospitals (HUG) were designated as the unique point of care for COVID-19 patients requiring hospitalisation in the canton of Geneva; non-COVID-19 patients were admitted to private clinics.2 Over 11 weeks, more than 1200 COVID-19 patients were admitted, occupying the equivalent of up to 20 acute care wards in the Department of General Medicine (four times normal admissions). Intensive care unit capacity was increased from 30 to 80. The main treatments prescribed were restricted to a few therapeutic classes for managing symptoms and complications (eg, antipyretics, anticoagulants, antibiotics) or supportive care (resuscitation measures with oxygen therapy).

During the pandemic’s initial phase, certain drugs were identified as potential treatments specifically for SARS-CoV-2. Expectations were high. Although there were very limited preliminary data regarding their potential efficacy, these drugs were known for their potential adverse effects or propensity for drug–drug interactions (DDIs). An in-house multidisciplinary expert group regularly redefined institutional guidelines in the light of new data. The compounds considered in HUG’s institutional guidelines were: lopinavir/ritonavir (LPVr) 400 mg/100 mg twice daily for 5 days (for patients >75 years old, dose reduced to 400 mg/100 mg before noon, 200 mg/50 mg at bedtime) and hydroxychloroquine (HCQ) 800 mg as a single dose (weak grade 2C recommendations). Off-label dosages were justified using pharmacokinetic data and expert opinions and were motivated by the fear of drug shortages.3 4

Patients on the HUG’s internal medicine wards are screened daily by a pharmacist using the in-house PharmaCheck electronic screening tool to detect 20 high-risk situations that could lead to adverse drug events (ADEs). PharmaCheck screens electronic health records by aggregating information from the hospital’s data lake in near real-time (eg, drug prescriptions, laboratory values, vital signs, medical problems). The pharmacist analyses the detected situations and alerts the prescriber if a risk of ADE is clinically relevant, recommending a treatment adjustment. PharmaCheck was deployed in the hospital information system in February 2020. Since then a pilot study began to assess PharmaCheck’s impact on clinical pharmacist efficiency.

As soon as our hospital became a COVID-19 centre (March 2020), the massive increase in patients made traditional medication reviews during medical rounds no longer efficient. They were replaced exclusively by centralised pharmaceutical screening using PharmaCheck, and the tool was extended to monitor prescriptions of LPVr and HCQ.

Except for the pharmacist who had developed and tested the PharmaCheck software before its deployment, experience in its use was short. During this first wave, PharmaCheck was also used for the detection of 20 high-risk situations as it was intended in addition to the version dedicated to patients treated with LPVr and/or HCQ.

The present study assessed how many high-risk situations PharmaCheck detected regarding LPVr and HCQ prescriptions during the first wave of COVID-19, the proportion of these situations for which clinical pharmacists recommended treatment adjustments or additional monitoring, and whether prescribers accepted these recommendations.



Two types of alerts are provided by the institutional clinical decision support system associated with computerised provider order entry (CPOE): active alerts (ie, providing a warning with a disruptive pop-up) are triggered on the exclusive basis of drug data (maximum dosage exceeded, double drug alert) without any possible contextualisation (automated correlation with biological or vital signs); passive alerts (ie, providing warning to the prescriber when consulting the integrated alerting system) are used to identify drug interactions in accordance with a single third-party database (Thériaque, CHNIM).5

Study design

PharmaCheck was evaluated during a 7 week prospective observational study (24 March to 12 May 2020). All patients admitted to internal medicine wards with current LPVr prescriptions and/or a history of HCQ prescription (even if discontinued due to the drug’s long half-life) were included.

Alerts and triggers

Different triggers were set up to isolate high-risk situations: co-prescription of at least one drug that can interact with LPVr and/or HCQ as per the ‘do not co-administer’ category in the University of Liverpool’s list of DDIs6; QT interval corrected using the Bazett formula (QTc) ≥500 ms or QTc increase of ≥50 ms after initiation of LPVr and/or HCQ; hypokalaemia (<3.6 mmol/L) or hypomagnesaemia (<0.59 mmol/L); and lopinavir dose not adapted to age (dose reduction required for patients >75 years old). When a current LPVr prescription or a history of HCQ prescription was detected in the presence of one or more triggers, the clinical pharmacist was sent an alert.

Alert processing

Two decisional algorithms were built to standardise alert analysis (figure 1). PharmaCheck ran twice daily to identify patients with high-risk situations related to LPVr and/or HCQ prescriptions. As per the decisional algorithm, the most relevant alerts led to telephoned recommendations to prescribers for therapeutic adjustments or additional monitoring. For alerts associated with QTc increase, attributability to LPVr and/or HCQ was retrospectively assessed by the regional pharmacovigilance centre in order to report possible, probable or certain adverse drug reactions to the Uppsala Monitoring Centre (UMC).

Figure 1

ADE, adverse drug event; a.m., every morning; b.i.d., two times a day; DDI, drug-drug interactions; ECG, electrocardiogram; h.s., at bedtime.

Four pharmacists took turns using the tool and were following up situations requiring closer monitoring. An electronic tracking file shared among the pharmacists made it possible to document their attitude when the alert was analysed and to transmit information in a targeted way to the rest of the pharmaceutical team.

We measured the distribution of alerts and triggers, each trigger’s positive predictive value (PPV) (ratio of triggers associated with an intervention divided by total interventions), the proportion of alerts resulting in a recommendation for treatment adjustment or additional monitoring, and whether prescribers accepted the recommendations.


Descriptive statistics were calculated and the different variables measured were represented by means±SD. Comparative analyses of the proportions were performed using χ2 tests with Monte Carlo correction (10 000 draws) (R software version 3.3.0). A p value <0.05 was considered statistically significant.


Alerts and triggers

Over 7 weeks, 1208 patients were admitted and 416 (34.4%) received at least one of the two experimental treatments (LPVr +HCQ, n=77; LPVr alone, n=109; HCQ alone, n=230). PharmaCheck triggered 182 alerts for 164 patients taking these treatments (39.4%): 77 alerts for LPVr and 105 alerts for HCQ. Mean alert generation delays were 1.2±1.0 days after LPVr treatment initiation and 7.3±9.4 days after HCQ treatment initiation. Mean daily new alert generation was 5.4±6.4 (2.3±4.2 LPVr alerts and 3.1±3.2 HCQ alerts). In total, 218 triggers were linked to these alerts: 149 alerts (81.9%) with one trigger, 30 (16.5%) with two triggers, and three (1.6%) with three triggers; 136 alerts were triggered by at least one DDI (204 different DDIs involved 50 different compounds, with 1.3±1.1 DDIs for LPVr alerts and 1.0±1.0 DDIs for HCQ alerts); 107 alerts triggered by a DDI (79.0%) were linked to a risk of arrhythmia and 29 (21.0%) to another risk. Patients’ characteristics, triggers’ PPVs, and the therapeutic classes involved in DDIs are shown in table 1.

Table 1

Descriptions of patients and triggers

Alert processing

Overall, 20.9% (n=38) of the alerts (LPVr 23.4% (n=18); HCQ 19.0% (n=20); p=0.48) resulted in 45 recommendations for therapeutic optimisation or additional monitoring, 80% (n=36) of which were accepted by physicians (LPVr 84.2% (n=16); HCQ 77% (n=20); p=0.71). The acceptance of one intervention (2.2%) could not be evaluated. Recommendation refusals were linked to physicians estimating a favourable risk–benefit ratio (n=7) or to an unknown reason (n=1). For 42 patients with a QTc prolongation potentially attributable to LPVr and/or HCQ, 16 situations (38%) were assessed as probable and were reported to the UMC.


Our in-house PharmaCheck electronic screening tool enabled us to automatically check electronic health records to identify potentially high-risk situations linked to LPVr and/or HCQ prescriptions. By contextualising these alerts, the clinical pharmacist recommended the most relevant ones for treatment adjustments, which were mainly accepted by the prescribers.

More alerts were associated with HCQ than with LPVr because although patients only received a single dose of HCQ, its long half-life (7–50 days) exposed them to delayed ADEs.4 As CPOE no longer displayed discontinued HCQ prescriptions, physicians had more difficulty identifying potentially risky situations, including DDIs. In contrast, LPVr’s short half-life (5–6 hours) creates exposure to immediate ADEs; therefore, only patients with an active prescription were targeted, as their risk factors for ADEs were probably more easily identifiable on the CPOE during the 5 day treatment period.

The presence of at least one DDI was the most frequent trigger, with most DDIs involving the risk of arrhythmia (79.0%). However, clinical pharmacists only recognised a few of these situations as at risk of ADEs and PPVs were low; some DDIs were only theoretical or associated with very low evidence with no effects on an electrocardiogram (ECG) in the literature (eg, HCQ and calcium channel blockers, β-blockers, diuretics).7 Some DDIs were relevant but inconsequential, involving low-dose oral therapies for which the risk of ADEs was lower than at high doses (eg, haloperidol, quetiapine, risperidone).8

Pharmacists intervened in about a quarter of the alerts involving a QTc interval increase. In our electronic patient records, ECGs are computerised and associated parametric measurements, such as QTc interval, are provided automatically by the manufacturer’s algorithms.9 Despite recent improvements to these algorithms, interpretation errors remain possible and reduce the specificity of these techniques, meaning that traditional interpretation remains necessary (ie, visual inspection of the traces).10–12 Nevertheless, QTc value was a trigger of choice as it was easily accessible and queryable, even though physicians, in most cases, assessed prolonged intervals as normal and not requiring intervention. Hypomagnesaemia and hypokalaemia are two well-known risk factors for QT interval prolongation, and are frequently involved in heart rhythm disorders.13 Most cases of hypokalaemia in our study were already in correction and required no intervention other than daily monitoring. However, hypomagnesaemia alerts led to more pharmaceutical recommendations for supplementation, as this electrolyte disorder can be under-interpreted or under-detected.14 Finally, dose adjustments were recommended for over- or under-dosed LPVr prescriptions regarding patient age, as called for in our institutional guidelines.

Pharmacists estimated 20.6% of alerts to be specific enough to merit intervention. To the best of our knowledge, no published studies have evaluated a rule-based system targeting experimental LPVr and/or HCQ treatments against SARS-CoV-2. However, the PPVs of such alerts have previously been described as varying between 7.6% and 11% using similar tools targeting more common high-risk situations.15–17 The slightly greater specificity of our study’s alerts can be explained by the potentially higher incidence of factors contributing to drug-related problems, especially in a healthcare emergency context: prescription of uncommon treatments, heavy workloads, rapid reorganisation of care units, influxes of patients, stress and fatigue.18 Isolating the most relevant alerts according to patients’ clinical contexts and transmitting recommendations to physicians in a telephone call enabled an 80% acceptance rate to be achieved—close to rates observed when pharmacists go on medical rounds with face-to-face interventions (80–87%). Acceptance rates would probably have been lower if interventions had merely been written in patient files (53–56%).17 19–21

Active alert systems are associated with an alert fatigue phenomenon (due to lack of specificity).22 Regarding DDIs, passive alert systems are likely to be less well taken into account and dependent on the content of the third-party database.23 We assumed that contextualised alerts would be more considered by prescribers, particularly if they are pre-filtered by pharmacists. PharmaCheck’s major interest was to target, on the one hand, medical orders correlated with discriminating biological and vital signs and, on the other hand, drug interactions specifically involving LPVr and HCQ (the list of which was regularly updated according to Liverpool publications).

Our study had certain limitations. Without a control group, it is unknown whether fewer ADEs occurred as a result of our interventions. Our system’s sensitivity was not established and only alerts associated with at least one trigger were detected and analysed. Again, a control group using a standard practice medication review would have made this possible, and testing PharmaCheck outside a healthcare crisis would measure its sensitivity. Concerning alert specificity, a thorough, often lengthy analysis of electronic health records was carried out despite low PPVs of certain triggers (undetermined daily durations estimated from 1 to 3 hours). Our system’s performance could be improved by weighting each alert using a risk score to sort out patients’ electronic records to be analysed as a priority. A weighting system has already been proposed that would only display alerts for prescriptions with the highest risk of prolonging the QTc interval.24


PharmaCheck helped to quickly adapt our clinical pharmacy activities during the first wave of COVID-19 hospitalisations, moving from a thorough drug therapy analysis mode (limited patient numbers during medical rounds in selected care units) to a targeted analysis mode (high patient numbers analysed remotely for numerous wards). High-risk situations were selected from among the triggers characterising the main risks associated with LPVr and HCQ and for which analysis by the clinical pharmacist led to recommendations for therapeutic optimisation in the most relevant situations, which increased acceptance by prescribers. PharmaCheck can be adapted rapidly, and a new set of rules has been developed for the second wave of COVID-19, triggering potential ADEs related to remdesivir, dexamethasone and anticoagulants.

Data availability statement

All data relevant to the study are included in the article or uploaded as supplementary information.



  • EAHP Statement 4: Clinical Pharmacy Services. EAHP Statement 5: Patient Safety and Quality Assurance.

  • Twitter @ckalafouris, @bonnabry

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; internally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.