Table 3

Agreement ratings per item per round. Created by the authors

ItemsRound 1Round 2Round 3P*
N (% agreement)N (% agreement)N (% agreement)
Item 1: medication chronic and acute/on demand21 (92%)
UsefulnessAdded 2nd round22 (96%)Included 2nd round
Relevance21 (91%)
Care provider20 (87%)
Hospital pharmacist22 (96%)
Item 2: lifestyle23 (83%)21 (90%)0.066
Usefulness24 (86%)21 (91%)Included 2nd round
Relevance24 (86%)21 (91%)
Care provider22 (79%)20 (87%)
Hospital pharmacist23 (82%)21 (91%)
Item 3: sources21 (76%)21 (89%)0.068
Usefulness22 (79%)22 (96%)Included 2nd round
Relevance22 (79%)21 (91%)
Repetitive20 (71%)17 (74%)13 (65%)
Hospital pharmacist21 (75%)22 (96%)Included 2nd round
Item 4: sources table26 (94%)23 (99%)0.109
Usefulness26 (93%)22 (96%)Included 2nd round
Relevance27 (96%)23 (100%)
Hospital pharmacist26 (93%)23 (100%)
Item 5: medication27 (96%)23 (99%)0.180
Usefulness28 (100%)Included 1st roundIncluded 2nd round
Relevance27 (96%)22 (96%)
Care provider25 (89%)23 (100%)
Hospital pharmacist27 (96%)23 (100%)
Item 6: dosage27 (96%)23 (100%)0.102
Usefulness28 (100%)Included 1st roundIncluded 2nd round
Relevance27 (96%)23 (100%)
Care provider26 (93%)23 (100%)
Hospital pharmacist26 (93%)23 (100%)
Item 7: remarks27 (95%)23 (99%)0.102
Usefulness28 (100%)Included 1st roundIncluded 2nd round
Relevance27 (96%)23 (100%)
Care provider24 (86%)22 (96%)
Hospital pharmacist27 (96%)23 (100%)
Item 8: self-medication22 (78%)20 (86%)0.068
Usefulness22 (79%)20 (87%)Included 2nd round
Relevance23 (82%)21 (91%)
Care provider19 (68%)22 (96%)
Hospital pharmacist23 (82%)22 (96%)
Item 9: medication management26 (92%)23 (98%)0.660
Usefulness27 (96%)23 (100%)Included 2nd round
Relevance27 (96%)23 (100%)
Care provider23 (82%)21 (91%)
Hospital pharmacist26 (93%)23 (100%)
Item 10: assistance in medication management24 (84%)20 (88%)0.660
Usefulness26 (93%)22 (96%)Included 2nd round
Relevance26 (93%)22 (96%)
Care provider17 (61%)15 (65%)13 (65%)
Hospital pharmacist25 (89%)22 (96%)Included 2nd round
Item 11: patients’ personal treatment27 (95%)22 (97%)0.102
Usefulness28 (100%)Included 1st roundIncluded 2nd round
Relevance27 (96%)23 (100%)
Care provider24 (86%)21 (91%)
Hospital pharmacist27 (96%)23 (100%)
Item 12: medication in the form of26 (93%)21 (91%)0.157
Usefulness26 (93%)21 (91%)Included 2nd round
Relevance26 (93%)21 (91%)
Item 13: medication for27 (95%)21 (91%)0.317
Usefulness27 (96%)22 (96%)Included 2nd round
Relevance26 (93%)20 (87%)
Item 14: vaccination16 (80%)
UsefulnessAdded 3rd round17 (85%)
Relevance17 (85%)
Hospital pharmacist14 (70%)
Item 15: change in your medication27 (95%)23 (98%)0.180
Usefulness28 (100%)Included 1st roundIncluded 2nd round
Relevance28 (100%)
Care provider24 (86%)22 (96%)
Hospital pharmacist26 (93%)23 (100%)
Item 16: antibiotic26 (94%)22 (96%)0.109
Usefulness27 (96%)23 (100%)Included 2nd round
Relevance27 (96%)22 (96%)
Care provider25 (89%)21 (91%)
Hospital pharmacist26 (93%)22 (96%)
Item 17: swallowing difficulties26 (93%)23 (99%)0.066
Usefulness27 (96%)23 (100%)Included 2nd round
Relevance27 (96%)23 (100%)
Care provider24 (86%)22 (96%)
Hospital pharmacist26 (93%)23 (100%)
Item 18: terms of use23 (83%)20 (86%)0.102
Usefulness24 (86%)20 (87%)Included 2nd round
Relevance24 (86%)20 (87%)
Hospital pharmacist22 (79%)19 (83%)18 (90%)
Item 19: allergies27 (95%)23 (100%)0.063
Usefulness27 (96%)23 (100%)Included 2nd round
Relevance27 (96%)23 (100%)
Care provider26 (93%)23 (100%)
Hospital pharmacist26 (93%)23 (100%)
Item 20: side effects26 (93%)23 (98%)0.066
Usefulness27 (96%)23 (100%)Included 2nd round
Relevance27 (96%)23 (100%)
Care provider24 (86%)21 (91%)
Hospital pharmacist26 (93%)23 (100%)
Item 21: medication available in the hospital’s formulary26 (92%)
Usefulness26 (93%)ExcludedExcluded
Relevance26 (93%)
Care provider24 (86%)
Hospital pharmacist27 (96%)
Item 22: comments18 (65%)
Usefulness20 (71%)ExcludedExcluded
Relevance20 (71%)
Care provider13 (46%)
Hospital pharmacist20 (71%)
Item 23: Morisky Medication Adherence Scale21 (75%)17 (73%)15 (76%)0.066
Usefulness22 (79%)18 (78%)17 (85%)
Relevance21 (75%)16 (70%)14 (70%)
Care provider19 (68%)15 (65%)13 (65%)
Hospital pharmacist22 (79%)18 (78%)17 (85%)
Layout of the document23 (81%)21 (91%)
Legible27 (96%)23 (100%)Included 2nd round
Choice of colours21 (75%)22 (96%)
Easy-fill20 (71%)17 (74%)16 (80%)
Adequate23 (82%)22 (96%)Included 2nd round
  • Data in bold show the items that did not achieve consensus.

  • *The table presents the distribution of Wilcoxon signed-rank test of second round versus first round.