Skip to main content

Table 10 Evaluation results of the modules after removing false-positive mappings with an incorrect top-level hierarchy. Shown is the mean precision/F1-score for both the UMLS and BioPortal. Ontology pairs indicate the mean of all matching systems, matching systems indicate the mean of all ontology pairs. Recall has not changed and is therefore not included

From: Performance assessment of ontology matching systems for FAIR data

Pair or matching system

Precision UMLS

Precision BioPortal

F1-score UMLS

F1-score BioPortal

ORDO - SNOMED CT

0.51 (+0.06)

0.16 (+0.02)

0.55 (+0.04)

0.28 (+0.03)

NCIt - ORDO

0.52 (+0.03)

0.50 (+0.03)

0.58 (+0.02)

0.65 (+0.02)

NCIt - SNOMED CT

0.59 (+0.08)

0.71 (+0.29)

0.62 (+0.02)

0.81 (+0.22)

AgreementMakerLight 2.0

0.54 (+0.05)

0.39 (+0.02)

0.59 (+0.02)

0.52 (+0.01)

FCA-Map

0.49 (+0.07)

0.37 (+0.06)

0.57 (+0.05)

0.52 (+0.06)

LogMap 2.0

0.55 (+0.02)

0.36 (+0.01)

0.64 (+0.02)

0.49 (+0.00)