Table 2 Inter-rater agreement on page reliability for each corpus: 3-classes.
From: Reliability and type of consumer health documents on the World Wide Web: an annotation study
Accuracy/ Kappa | Reliability: 3 classes | ||
|---|---|---|---|
Set\Raters | X-Y | X-Z | Y-Z |
IBS train | 0.70 / 0.44 | 0.60 / 0.25 | 0.67 / 0.33 |
IBS test | 0.70 / 0.43 | 0.65 / 0.42 | 0.75 / 0.59 |
MMED100 | 0.77 / 0.49 | 0.66 / 0.30 | 0.62 / 0.22 |