Article Text

Download PDFPDF
5PSQ-034 Homogeneity of opinion expert on CLEO scale when applied to 50 modelled pharmaceutical interventions
  1. C Viaud1,
  2. A Potier1,
  3. J Bouet1,
  4. M Ade1,
  5. A Dony2,
  6. E Divoux2,
  7. AS Willemin1,
  8. M Sergent2,
  9. C Titah3,
  10. N De Abreu2,
  11. W Hamdad2,
  12. B Demore1,
  13. E Dufay2
  1. 1CHU Nancy, Pharmacy, Vandoeuvre Les Nancy, France
  2. 2CH Luneville, Pharmacy, Lunéville, France
  3. 3CHU Nancy, Geriatric, Vandoeuvre Les Nancy, France


Background and importance The CLEO Scale is a three-dimensional tool to assess the clinical, economic and organisational impact of pharmacists’ interventions (PI) which would resolve drug-related problems in prescriptions.

AVICENNE is an advanced real-time pharmaceutical decision support system based on the patient’s data, pharmaceutical algorithms and Pharmaclass (Keenturtle) which enhances the PI relevance.

Aim and objectives This study aimed to analyse the reliability of the CLEO scale.

Material and methods From the 171 modelled clinical situations in Pharmaclass, the 50 most frequent were chosen. For each situation a PI was retrospectively and randomly selected between November 2019 and November 2020 in the AVICENNE database. It contained 1263 PI transmitted after of Pharmaclass alerts’ analysis in two 1700 beds health facilities.

A multiprofessional panel of 11 clinicians have rated independently the PIs using the CLEO scale. CLEO evaluates the clinical, economical and organisational impact of PI. The panel re-rated the PIs after a 1-month washout period.

Intra-class correlation coefficients in absolute agreement on single unit (ICCA,1) are calculated using the ‘Psych’ package on Rstudio to measure inter- and intra-rater reliabilities of the panel.

Results The PIs were rated as having a minor, medium, major or vital clinical impact in, respectively, 10%, 70%, 16% and 4% of situations.

Direct drug management costs were reduced by the PI in 24%, unchanged in 62% and increased in 14% of the situations. The care process did not change in 78% of the situations, 20% of PIs improved it and 2% of PIs altered it. On average less than 3 min are needed per evaluation.

Inter-rater reliability (ICCA,1) was poor for clinical (ICCA,1 = 0.297) and organiaational (ICCA,1 = 0.338) dimensions and moderate for economic dimensions (ICCA,1 = 0.665). Intra-rater reliability was moderate for clinical (ICCA,1 = 0.611) and organisational (ICCA,1 = 0.726) dimensions and excellent for economic dimensions (ICCA,1 = 0.914).

Conclusion and relevance Almost all of AVICENNE PIs prevent a temporary or permanent damage or the need of care to reduce their gravity. The CLEO tool offers a limited validity when used by untrained clinicians. Symbolic artificial intelligence reinforces the therapeutic safety of patients and the relevance of care.

Conflict of interest No conflict of interest

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.