Skip to main content

Table 1 Manual annotation results on the two EHR corpora (First referral and Early intervention)

From: Temporal information extraction from mental health records to identify duration of untreated psychosis

Corpus

Batch

Documents (# tokens)

All annotations (A1, A2)

Overlapping annotations

Same value

IAA (acc)

First referral

dev

10 (49 K)

932, 972

913

768

0.84

First referral

valid

23 (83 K)

1455, 1475

1429

1254

0.88

First referral

test

19 (74 K)

1119, 1159

1100

927

0.84

Early intervention

batchA

14 (18 K)

435, 391

353

300

0.85

Early intervention

batchB

35 (57 K)

867, 822

714

600

0.84

  1. Manual annotation results on the two EHR corpora (First referral and Early intervention) divided into development (dev), validation (valid) and test sets, and batches (batchA and batchB), respectively. IAA: Inter-annotator agreement; A1/A2: annotators 1 and 2
Back to article page

Journal of Biomedical Semantics

ISSN: 2041-1480