Table 5 Inter-rater agreement for page type annotation for each corpus.
From: Reliability and type of consumer health documents on the World Wide Web: an annotation study
Accuracy/Kappa | Type | ||
|---|---|---|---|
Set\Raters | X-Y | X-Z | Y-Z |
IBS train | 0.57 / 0.42 | 0.83 / 0.78 | 0.47 / 0.28 |
IBS test | 0.73 / 0.64 | 0.65 / 0.55 | 0.73 / 0.64 |
MMED100 | 0.81 / 0.73 | 0.48 / 0.29 | 0.50 / 0.31 |