Skip to main content

Table 2 Aggregated evaluation metrics across the 18 data sets

From: What's unusual in online disease outbreak news?

 

C3

C2

W2

F-Statistic

EWMA

Sensitivity

0.78

0.73

0.72

0.80

0.73

 

(0.74-0.82)

(0.68-0.78)

(0.67-0.77)

(0.77-0.83)

(0.68-0.78)

Specificity

0.95

0.97

0.97

0.91

0.95

 

(0.94-0.95)

(0.96-0.97)

(0.97-0.97)

(0.90-0.91)

(0.94-0.96)

PPV

0.49

0.55

0.56

0.45

0.47

 

(0.44-0.53)

(0.50-0.60)

(0.51-0.61)

(0.42-0.48)

(0.43-0.52)

NPV

0.99

0.99

0.99

0.98

0.98

 

(0.98-0.99)

(0.98-0.99)

(0.98-0.99)

(0.98-0.98)

(0.98-0.99)

Alarms/100 days(A)

7.65

5.98

5.57

13.77

7.85

F1

0.60

0.63

0.63

0.58

0.58

  1. (A) This compares to a mean of 4.36 alerts per 100 days for ProMED-mail on the 18 data sets. Figures in parentheses show 95% CI.