Skip to main content

Table 2 Aggregated evaluation metrics across the 18 data sets

From: What's unusual in online disease outbreak news?

  C3 C2 W2 F-Statistic EWMA
Sensitivity 0.78 0.73 0.72 0.80 0.73
  (0.74-0.82) (0.68-0.78) (0.67-0.77) (0.77-0.83) (0.68-0.78)
Specificity 0.95 0.97 0.97 0.91 0.95
  (0.94-0.95) (0.96-0.97) (0.97-0.97) (0.90-0.91) (0.94-0.96)
PPV 0.49 0.55 0.56 0.45 0.47
  (0.44-0.53) (0.50-0.60) (0.51-0.61) (0.42-0.48) (0.43-0.52)
NPV 0.99 0.99 0.99 0.98 0.98
  (0.98-0.99) (0.98-0.99) (0.98-0.99) (0.98-0.98) (0.98-0.99)
Alarms/100 days(A) 7.65 5.98 5.57 13.77 7.85
F1 0.60 0.63 0.63 0.58 0.58
  1. (A) This compares to a mean of 4.36 alerts per 100 days for ProMED-mail on the 18 data sets. Figures in parentheses show 95% CI.