Skip to main content

Table 2 Aggregated results for SE Asian events

From: Towards cross-lingual alerting for bursty epidemic events

English only news (SE Asia)

model

Se

Sp

PPV

NPV

AlarmsA

DaysB

F1

C3

0.62

0.94

0.53

0.9

9.7

4.0

0.57

 

(0.49,0.72)

(0.92,0.96)

(0.42,0.64)

(0.93,0.97)

   

C2

0.53

0.96

0.61

0.92

6.6

3.9

0.57

 

(0.41,0.66)

(0.95,0.98)

(0.47,0.73)

(0.93,0.97)

   

W2

0.50

0.97

0.62

0.92

6.5

3.8

0.55

 

(0.38,062)

(0.95,0.98)

(0.48,0.74)

(0.92,0.96)

   

F-stat

0.76

0.83

0.42

0.82

20.9

5.0

0.54

 

(0.67,0.84)

(0.80,0.86)

(0.35,0.50)

(0.94,0.97)

   

EWMA

0.55

0.95

0.6

0.91

7.8

3.9

0.57

 

(0.43,0.66)

(0.93,0.97)

(0.47,0.71)

(0.92,0.96)

   

All language news8 (SE Asia)

model

Se

Sp

PPV

NPV

AlarmsA

DaysB

F1

C3

0.71

0.91

0.50

0.89

13.4

4.9

0.59

 

(0.60,0.80)

(0.88,0.93)

(0.41,0.59)

(0.94,0.97)

   

C2

0.62

0.94

0.50

0.91

8.3

4.3

0.55

 

(0.48,0.74)

(0.92,0.96)

(0.38,0.62)

(0.94,0.98)

   

W2

0.61

0.94

0.53

0.91

17.1

4.6

0.57

 

(0.49,0.73)

(0.92,0.96)

(0.41,0.65)

(0.94,0.97)

   

F-stat

0.90

0.77

0.47

0.79

30.7

5.8

0.62

 

(0.84,0.94)

(0.73,0.80)

(0.40,0.53)

(0.95,0.98)

   

EWMA

0.53

0.94

0.48

0.89

8.1

3.9

0.50

 

(0.40,0.65)

(0.91,0.96)

(0.36,0.61)

(0.92,0.96)

   
  1. Aggregated evaluation metrics for data sets e1 to e6 stratified by source language. The mean number of ProMED-mail alerts per 100 days was 8.1. A Model alarms per 100 days; B Mean number of days that alerts were given before ProMED-mail reports. Figures in parentheses show 95% CI.