Skip to main content

Table 5 Quality of the NL generated questions for mapping validation and average κ Inter-Assessor Agreement

From: Towards natural language question generation for the validation of ontologies and mappings

  Grammaticality Fluency Meaning
  Min. Max. Avg. Min. Max. Avg. Min. Max. Avg.
Assessor 1 0.4 1 0.775 0.4 1 0.81 0.4 1 0.915
Assessor 2 0.4 1 0.745 0.4 1 0.77 0.4 1 0.86
Assessor 3 0.6 0.9 0.735 0.6 0.9 0.745 0.6 0.9 0.77
Average κ   0.28    0.48    0.45