Table 5 Quality of the NL generated questions for mapping validation and average κ Inter-Assessor Agreement
From: Towards natural language question generation for the validation of ontologies and mappings
Grammaticality | Fluency | Meaning | |||||||
|---|---|---|---|---|---|---|---|---|---|
Min. | Max. | Avg. | Min. | Max. | Avg. | Min. | Max. | Avg. | |
Assessor 1 | 0.4 | 1 | 0.775 | 0.4 | 1 | 0.81 | 0.4 | 1 | 0.915 |
Assessor 2 | 0.4 | 1 | 0.745 | 0.4 | 1 | 0.77 | 0.4 | 1 | 0.86 |
Assessor 3 | 0.6 | 0.9 | 0.735 | 0.6 | 0.9 | 0.745 | 0.6 | 0.9 | 0.77 |
Average κ | 0.28 | 0.48 | 0.45 | ||||||