Interobserver agreement: internist (evaluator 1)/hospital pharmacy specialist (evaluator 2) (n=50)
| Criterion | α | β | γ | δ | ppos | pneg | ĸ | PO |
| A1 | 1 | 0 | 1 | 48 | 0.67 | 0.99 | 0.66 | 0.98 |
| A2 | 0 | 0 | 0 | 50 | NA | 1.00 | NA | 1.00 |
| A3 | 1 | 1 | 1 | 47 | 0.50 | 0.98 | 0.48 | 0.96 |
| A4 | 2 | 1 | 4 | 43 | 0.44 | 0.95 | 0.40 | 0.90 |
| B1 | 2 | 6 | 0 | 42 | 0.40 | 0.93 | 0.36 | 0.88 |
| B2 | 8 | 5 | 3 | 34 | 0.67 | 0.89 | 0.56 | 0.84 |
| B3 | 1 | 6 | 0 | 43 | 0.25 | 0.93 | 0.22 | 0.88 |
| B4 | 1 | 2 | 0 | 47 | 0.50 | 0.98 | 0.49 | 0.96 |
| C1 | 7 | 1 | 18 | 24 | 0.42 | 0.72 | 0.24 | 0.62 |
| C2 | 1 | 5 | 6 | 38 | 0.15 | 0.87 | 0.03 | 0.78 |
| C3 | 2 | 1 | 2 | 45 | 0.57 | 0.97 | 0.54 | 0.94 |
| C4 | 0 | 1 | 0 | 49 | 0.00 | 0.99 | 0.00* | 0.98 |
| D1 | 0 | 0 | 0 | 50 | NA | 1.00 | NA | 1.00 |
| D2 | 0 | 0 | 0 | 50 | NA | 1.00 | NA | 1.00 |
| D3 | 4 | 0 | 7 | 39 | 0.53 | 0.92 | 0.47 | 0.86 |
| D4 | 1 | 0 | 2 | 47 | 0.50 | 0.98 | 0.49 | 0.96 |
| E1 | 0 | 0 | 0 | 50 | NA | 1.00 | NA | 1.00 |
| E2 | 1 | 2 | 1 | 46 | 0.40 | 0.97 | 0.37 | 0.94 |
| F1 | 0 | 6 | 0 | 44 | 0.00 | 0.94 | 0.00* | 0.88 |
| F2 | 10 | 6 | 4 | 30 | 0.67 | 0.86 | 0.52 | 0.80 |
| F3 | 10 | 3 | 5 | 32 | 0.71 | 0.89 | 0.60 | 0.84 |
| F4 | 2 | 3 | 4 | 41 | 0.36 | 0.92 | 0.29 | 0.86 |
| F5 | 0 | 0 | 1 | 49 | 0.00 | 0.99 | 0.00* | 0.98 |
| F6 | 0 | 0 | 0 | 50 | NA | 1.00 | NA | 1.00 |
| F7 | 1 | 0 | 0 | 49 | 1.00 | 1.00 | 1 | 1.00 |
| F8 | 0 | 0 | 0 | 50 | NA | 1.00 | NA | 1.00 |
| G1 | 0 | 2 | 0 | 48 | 0.00 | 0.98 | 0.00* | 0.96 |
| Global | 55 | 53 | 59 | 1183 | 0.50 | 0.96 | 0.46 | 0.92 |
α: Both evaluators scored the criterion as being fulfilled.
β: Evaluator 1 scored the criterion as being fulfilled and evaluator 2 scored the criterion as not fulfilled.
γ: Evaluator 2 scored the criterion as being fulfilled and evaluator 1 scored the criterion as not fulfilled.
δ: Both evaluators agreed the criterion was not fulfilled.
*Inadequate variability between groups.
NA, not applicable; pneg, proportion of negative agreement; PO, global per cent agreement; ppos, proportion of positive agreement.