Table 3 Inter-annotator agreement on the test data
| Â | Precision | Recall | F1 |
|---|---|---|---|
Entities | Â | Â | Â |
test1 | 96.41 | 98.77 | 97.57 |
test2 | 95.84 | 98.40 | 97.10 |
test3 | 94.94 | 97.46 | 96.18 |
Total | 95.73 | 98.22 | 96.96 |
Negation | Â | Â | Â |
test1 | 95.90 | 98.19 | 97.03 |
test2 | 95.07 | 97.70 | 96.36 |
test3 | 94.73 | 97.29 | 96.00 |
Total | 95.22 | 97.72 | 96.46 |
Relations | Â | Â | Â |
test1 | 92.99 | 98.03 | 95.44 |
test2 | 97.47 | 97.47 | 97.47 |
test3 | 96.39 | 91.67 | 93.97 |
Total | 95.77 | 95.91 | 95.84 |
Labels | Â | Â | Â |
test1 | 92.50 | 93.08 | 92.79 |
test2 | 90.95 | 94.27 | 92.58 |
test3 | 94.32 | 99.40 | 96.79 |
Total | 92.52 | 95.56 | 94.02 |