Skip to main content

Table 3 The table shows the F-measure performance of the PPs and the CPs against the SSC-I (cos-98 harmonisation, 2 vote agreement). The project partners are part of the comparison (P01 – P04). P11, P12, and P14 used the training data for their annotations. Only the best performing submission of each CP was included into the analysis. P09 only contributed a small number of annotations in the submitted corpus.

From: Assessment of NER solutions against the first and second CALBC Silver Standard Corpus

Cos-98 P12 P11 P03 P04 P01 P02 P10 P14 P08 P15 P09 P06 P07 P09 P13 P16
SPE 93% 93% 79% 83% 71% 69% 84% 69% 56% 42% 2%      
DISO 87% 89% 71% 69% 82% 76% 78% 62% 51% 32% 3% 73%     
CHEM 83% 84% 75% 82% 49% 68%   51% 20% 17% 3%     23%  
PRGE 81% 73% 77% 66% 66% 59% 40% 52% 12% 18% 2%   50% 11%   28%
Avg. 86% 85% 76% 75% 67% 68% 68% 58% 35% 27% 2%      
\