Skip to main content

Table 5 CUILESS2016 annotator agreement type examples

From: CUILESS2016: a clinical corpus applying compositional normalization of text mentions

Exact mention score Hierarchical mention score Text mention Annotator 1 Concept/s Annotator 2 Concept/s
1.0 1.0 Allergies Levofloxacin Drug allergy Drug allergy
    Levofloxacin Levofloxacin
0.0 0.52 Posturing (O/E) - posturing Posturing behaviour
0.0 0.64 Rightward shift Midline shift of brain Midline shift of brain
    To the right  
0.0 0.22 Redness Erythema Redness
  1. The computed hierarchical mention score was used instead of annotator judgment in determining an approximate level of agreement