Table 8 Detailed evaluation of system labelling compared to Annotator 2 showing numbers of true positives (TP), false positives (FP) and false negatives (FP), as well as precision, recall and F1
Type | TP | FP | FN | Precision | Recall | F1 |
|---|---|---|---|---|---|---|
Ischaemic stroke, deep, recent | 4 | 1 | 0 | 80.00 | 100.00 | 88.89 |
Ischaemic stroke, deep, old | 81 | 5 | 4 | 94.19 | 95.29 | 94.74 |
Ischaemic stroke, cortical, recent | 14 | 1 | 2 | 93.33 | 87.50 | 90.32 |
Ischaemic stroke, cortical, old | 56 | 5 | 8 | 91.80 | 87.50 | 89.60 |
Ischaemic stroke, underspecified | 6 | 8 | 6 | 42.86 | 50.00 | 46.15 |
Haemorrhagic stroke, deep, recent | 3 | 0 | 0 | 100.00 | 100.00 | 100.00 |
Haemorrhagic stroke, deep, old | 4 | 1 | 0 | 80.00 | 100.00 | 88.89 |
Haemorrhagic stroke, lobar, recent | 4 | 1 | 0 | 80.00 | 100.00 | 88.89 |
Haemorrhagic stroke, lobar, old | 3 | 1 | 0 | 75.00 | 100.00 | 85.71 |
Haemorrhagic stroke, underspecified | 9 | 3 | 0 | 75.00 | 100.00 | 85.71 |
Stroke, underspecified | 13 | 1 | 2 | 92.86 | 86.67 | 89.66 |
Tumour, meningioma | 4 | 1 | 0 | 80.00 | 100.00 | 88.89 |
Tumour, metastasis | 0 | 3 | 0 | 0.00 | - | - |
Tumour, glioma | 0 | 0 | 0 | - | - | - |
Tumour, other | 4 | 2 | 1 | 66.67 | 80.00 | 72.73 |
Small vessel disease | 158 | 0 | 3 | 100.00 | 98.14 | 99.06 |
Atrophy | 120 | 3 | 8 | 97.56 | 93.75 | 95.62 |
Subdural haematoma | 5 | 0 | 1 | 100.00 | 83.33 | 90.91 |
Subarachnoid haemorrhage, aneurysmal | 0 | 0 | 0 | - | - | - |
Subarachnoid haemorrhage, other | 4 | 1 | 3 | 80.00 | 57.14 | 66.67 |
Microbleed, deep | 1 | 0 | 1 | 100.00 | 50.00 | 66.67 |
Microbleed, lobar | 1 | 0 | 0 | 100.00 | 100.00 | 100.00 |
Microbleed, underspecified | 0 | 2 | 0 | 0.00 | - | - |
Haemorrhagic transformation | 1 | 0 | 1 | 100.00 | 50.00 | 66.67 |
TOTAL | 495 | 39 | 40 | 92.70 | 92.52 | 92.61 |