Skip to main content

Table 3 Kappa values for the annotation of single entities. The hyphens indicate that no entities were annotated with the corresponding category

From: An annotated corpus of clinical trial publications supporting schema-based relational information extraction

Annotation categories

Glaucoma

T2DM

AggregationMethod

0.89

0.41

AllocationRatio

0.91

0.00

Author

0.97

0.98

BaseLineValue

0.98

0.86

BioAndMedicalUnit

0.89

0.81

ChangeValue

0.96

0.77

ConclusionComment

0.96

0.92

ConflictInterest

0.00

0.00

Country

0.93

0.87

CTAnalysisApproach

0.26

0.19

CTDesign

0.85

0.86

DeliveryMethod

0.82

0.52

DiffGroupValues

0.71

0.78

DisorderOrSyndrome

0.93

0.98

DoseDescription

–

0.41

DoseValue

0.96

0.62

Drug

0.83

0.91

Duration

0.72

0.82

EndPointDescription

0.79

0.77

Ethnicity

0.83

0.86

Frequency

0.92

0.92

Gender

–

0.61

Journal

0.97

0.94

MeasurementDevice

0.19

0.00

ObjectiveDescription

0.83

0.88

ObservedResult

0.25

0.06

PMID

0.98

1.00

Precondition

0.47

0.66

PublicationYear

0.95

0.98

RelativeChangeValue

0.97

0.77

RelativeTime

0.32

0.71

ResultMeasuredValue

0.93

0.82

SubGroupDescription

0.23

0.46

TimePoint

0.46

0.71

Title

0.95

0.98

Avg. Kappa

0.74

0.68