Performance of GP referral decision on ECG and CHART reports compared with by consensus ground truth
Metric | ECG report Performance | CHART report Performance | CHART compare to ECG Hypothesis test with 95% CI | ||||
Lower conf. % | Observed value % | Upper conf. % | Lower conf. % | Observed value % | Upper conf. % | ||
SE% | 42.00 | 48.52 | 55.08 | 57.67 | 64.14 | 70.24 | Significant increase |
SP% | 73.63 | 78.59 | 83.01 | 79.49 | 84.03 | 87.91 | Significant increase |
PPV% | 55.74 | 63.19 | 70.20 | 68.70 | 75.25 | 81.04 | Significant increase |
NPV% | 61.78 | 66.85 | 71.64 | 70.71 | 75.57 | 80.00 | Significant increase |
K% | 22.52 | 27.90 | 33.71 | 42.89 | 49.04 | 55.25 | Significant increase |
AUC% | 66.02 | 70.80 | 75.02 | 74.44 | 79.13 | 83.03 | Significant increase |
LR+ | 1.84 | 2.27 | 2.86 | 3.13 | 4.01 | 5.30 | Significant increase |
LR− | 0.70 | 0.65 | 0.62 | 0.45 | 0.43 | 0.41 | Significant decrease |
PR% | 29.17 | 33.09 | 37.20 | 32.69 | 36.73 | 40.91 | Less significant increase |
Better performance values are shown in bold.
Confusion matrices and performance equations available in online supplemental file 1.
AUC, area under the curve; CHART, Cardio-HART; GP, general practitioner; K, kappa statistics; LR+, positive Likelihood Ratio; LR−, Negative Likelihood Ratio; NPV, negative predictive value; PPV, positive predictive value; PR, positive rate; SE, sensitivity; SP, specificity.