Skip to main content

Table 3 The table shows the F-measure performance of the PPs and the CPs against the SSC-I (cos-98 harmonisation, 2 vote agreement). The project partners are part of the comparison (P01 – P04). P11, P12, and P14 used the training data for their annotations. Only the best performing submission of each CP was included into the analysis. P09 only contributed a small number of annotations in the submitted corpus.

From: Assessment of NER solutions against the first and second CALBC Silver Standard Corpus

Cos-98

P12

P11

P03

P04

P01

P02

P10

P14

P08

P15

P09

P06

P07

P09

P13

P16

SPE

93%

93%

79%

83%

71%

69%

84%

69%

56%

42%

2%

     

DISO

87%

89%

71%

69%

82%

76%

78%

62%

51%

32%

3%

73%

    

CHEM

83%

84%

75%

82%

49%

68%

 

51%

20%

17%

3%

   

23%

 

PRGE

81%

73%

77%

66%

66%

59%

40%

52%

12%

18%

2%

 

50%

11%

 

28%

Avg.

86%

85%

76%

75%

67%

68%

68%

58%

35%

27%

2%