Temporal information extraction from mental health records to identify duration of untreated psychosis

Table 3 Automated time expression normalization results on the First referral corpus, divided per time expression type

Batch	Type	IAA (matches)	IAA (acc)	System2 (TPs)	System2 (acc)	System2 (acc*)
dev	Date	572	0.84	427	0.93	0.93
	Time	77	0.87	65	0.51	0.88
	Duration	137	0.82	102	0.74	0.74
	Frequency	58	0.95	52	0.92	0.92
	Age_related	69	0.81	40	0.93	0.93
valid	Date	845	0.91	705	0.85	0.85
	Time	128	0.79	100	0.27	0.64
	Duration	209	0.77	147	0.84	0.84
	Frequency	123	0.98	101	0.95	0.95
	Age_related	124	0.81	62	0.73	0.73
test	Date	554	0.92	482	0.82	0.82
	Time	156	0.78	116	0.09	0.78
	Duration	192	0.72	128	0.77	0.77
	Frequency	90	0.72	48	0.83	0.83
	Age_related	108	0.86	54	0.80	0.80

Automated time expression extraction results (normalized values) on the First referral corpus (dev, valid, test), divided per time expression type. Results are presented in terms of inter-annotator agreement (IAA), system raw accuracy (System2 acc) and system relaxed accuracy (System2 acc*), where expressions with type Time are evaluated only on the “Thh:mm” portion

ISSN: 2041-1480