Skip to main content

Table 8 Development dataset annotator agreement

From: CUILESS2016: a clinical corpus applying compositional normalization of text mentions

Agreement type

Agreement count

Proportionate agreement

Exact

1011

52.4

Hierarchical

NA

78.2

Total mentions

1929

 
  1. There is no count for hierarchical agreement since each mention is assigned a value based on Eq. (1), whereas exact agreement assign every mention as a match (1.0) or not (0.0)