Skip to content

Advertisement

Journal of Biomedical Semantics

  • Research
  • Open Access

Integrating phenotype ontologies with PhenomeNET

Journal of Biomedical Semantics20178:58

https://doi.org/10.1186/s13326-017-0167-4

©  The Author(s) 2017

Received: 17 March 2017

Accepted: 22 November 2017

Published: 19 December 2017

Abstract

Background

Integration and analysis of phenotype data from humans and model organisms is a key challenge in building our understanding of normal biology and pathophysiology. However, the range of phenotypes and anatomical details being captured in clinical and model organism databases presents complex problems when attempting to match classes across species and across phenotypes as diverse as behaviour and neoplasia. We have previously developed PhenomeNET, a system for disease gene prioritization that includes as one of its components an ontology designed to integrate phenotype ontologies. While not applicable to matching arbitrary ontologies, PhenomeNET can be used to identify related phenotypes in different species, including human, mouse, zebrafish, nematode worm, fruit fly, and yeast.

Results

Here, we apply the PhenomeNET to identify related classes from two phenotype and two disease ontologies using automated reasoning. We demonstrate that we can identify a large number of mappings, some of which require automated reasoning and cannot easily be identified through lexical approaches alone. Combining automated reasoning with lexical matching further improves results in aligning ontologies.

Conclusions

PhenomeNET can be used to align and integrate phenotype ontologies. The results can be utilized for biomedical analyses in which phenomena observed in model organisms are used to identify causative genes and mutations underlying human disease.

Keywords

PhenotypePhenomeNETDisease gene prioritizationOWLAutomated reasoning

Background

Understanding the functions of genes and gene products is vital for our understanding of normal biology and pathophysiology. In recent years the amount of genotype and phenotype data available for species as distinct as man and model organisms such as nematode worms has increased dramatically and continues to accelerate. Insights from non-human species have an important role to play in our understanding of human biology [1] and the challenge is to mobilise this data in a way in which it can be used to give meaningful insights into human physiology and disease. While much data is now being captured formally using ontologies, data integration and comparison across species presents a major informatics challenge [2]. This task requires that related phenotypes which span levels of granularity as well as domains of knowledge, for example behaviour or neoplasia, in organisms as anatomically distinct as zebrafish and man, can be matched and compared so as to allow findings in one species to be related to others.

In response to this challenge we developed PhenomeNET. PhenomeNET [3] was built in 2011 as a system for disease gene discovery and prioritization. PhenomeNET consists of an ontology integrating species-specific phenotype ontologies based on the PATO ontology [4] and relations between anatomical structures and physiological processes, a database of gene-to-phenotype associations, and a measure of similarity between sets of phenotypes. Within PhenomeNET, species-specific phenotype ontologies are combined so that phenotypes observed in different species can be compared directly. The main application of PhenomeNET is the prioritization of candidate genes for human diseases by comparing human disease phenotypes to existing gene-phenotype associations derived from model organisms. In particular, human phenotypes associated with a disease can be compared to phenotypes observed in mouse or other model organisms using the integrated PhenomeNET ontology, and similarity between phenotypes can then be used to indicate the genetic basis of a disease. PhenomeNET has been successfully used to find candidate genes for diseases [3, 5], identify novel pathways [6], and repurpose drugs using mouse model phenotypes [7, 8].

The PhenomeNET ontology was originally built by formally integrating species-specific phenotype ontologies, permitting the relationship between classes of different phenotype ontologies to be determined through deductive inference. For this purpose, PhenomeNET relies on the UBERON [9] ontology that identifies equivalences between anatomy ontologies of different species, the Gene Ontology (GO) [10] as a means to identify equivalent or related processes and functions, and the PATO ontology [11] to identify the qualities associated with anatomical entities or biological processes.

Here, we use the PhenomeNET ontology to identify alignments between phenotypes in different species. We present our results based on three versions of the PhenomeNET ontology: the first version consists of the plain ontology using only the axioms provided in the Human Phenotype Ontology (HPO) [12] and the Mammalian Phenotype Ontology (MP) [13]; in the second version, we extend our original ontology by adding additional lexical and structural mappings generated with the AgreementMakerLight [14] system and represent them as equivalent class axioms in our ontology; and in the third version, we further generate mappings between classes in the PhenomeNET ontology, the Disease Ontology (DO) [15] and the Orphanet Rare Disease Ontology (ORDO) [16].

We find that our axiomatic approach can identify a large number of relations between classes that are not currently identified by other systems that do not utilize similar formal methods. However, our evaluation also shows that a large number of mappings can still be identified through lexical and structural approaches, and that a purely axiomatic approach will miss many mappings that cannot currently be identified axiomatically due to incomplete and underspecified formalization of phenotype classes. We illustrate how a combination of formal, lexical and structural approaches generates the most complete and comprehensive mappings between (phenotype) ontologies, and these mappings improve the application of phenotype ontologies in data analysis and translational research.

Methods

Data sources and ontologies

In our experiments, we use the Human Phenotype Ontology (HPO) [12], Mammalian Phenotype Ontology (MP) [13], Human Disease Ontology (DO) [15], and Orphanet Rare Disease Ontology (ORDO) [17] provided as part of the Ontology Alignment Evaluation Initiative 2016 competition.

The HPO is an ontology of human phenotypes and consists of 11,787 classes that provide a standarized vocabulary for describing phenotypic abnormalities which have been commonly encountered in human monogenic diseases [18]. The MP is mainly used to characterize mouse phenotypes, but can also be applied to other organisms. It consists of 11,720 classes that have been organized into a directed acyclic graph (DAG) and can be used to describe abnormal phenotypes of physiological and anatomical systems, behavior, and survival [19].

DO provides a classification of human diseases according to multiple axes related to genetic disorders, infectious diseases, metabolic disorders. It consists 9247 classes that aim at unifying the representation of human diseases defined across a variety of developed biomedical vocabularies [20].

ORDO is derived from the Orphanet database of rare and orphan diseases and used to represent and categorize the diseases within Orphanet. It consists of 12,960 classes which provides a structured vocabulary to represent relationships between phenomes, diseases, genes and relevant features such genetic inheritance for analyzing rare diseases [17].

Lexical mappings

We use the AgreementMakerLight (AML) [21], released on 5 April 2016, to generate lexical mappings between ontologies. We used the automatic match mode of the AML with the default settings to generate the lexical mappings that were used to extend the PhenomeNet ontology. The default settings of AML include use of the UBERON ontology, DO, and Wordnet as background knowledge, a lexical matcher, a word-based matcher that evaluates occurrence of the same words in class labels and synomyms, and a string similarity measure (ISub).

In addition to mappings generated by the AML, we also incorporate mappings between the ontologies obtained from BioPortal [22]. For each mapping between classes from two ontologies, we add an equivalent class axiom to the PhenomeNET ontology.

Semantic similarity and evaluation data

For additional external evaluation of our generated mappings, we apply the PhenomeNET ontology to the prioritization of candidate genes of human disease [3]. We use the phenotypes associated with knockout mice available from the Mouse Genome Informatics (MGI) database [23] and the phenotypes associated with human diseases from the Human Phenotype Ontology database [12]. We apply Resnik’s semantic similarity measure [24] together with the Best Matching Average strategy [25] to combine class similarities.

We evaluate the results using a list of gene–disease associations provided by the Human Phenotype Ontology database [12] as well as a set of mouse models of human disease provided by the MGI database [23].

Source code and experiments

Source code for the PhenomeNET matching system, including parameter files, and the generated alignments, are available at http://github.com/bio-ontology-research-group/OAEI2016. Code to generate the PhenomeNET ontology is available at https://github.com/bio-ontology-research-group/phenomeblast/tree/master/fixphenotypes.

Results

Combining knowledge-based and lexical approaches for ontology integration

We developed and extended the PhenomeNET ontology to integrate several species-specific phenotype ontologies and identify mappings between phenotype classes. Here, we consider a mapping between two classes (in two ontologies) a formal relation between them, i.e., an axiomatic relation such as equivalence, sub- or super-class, or disjointness. An alignment between two ontologies is created by a set of mappings. Ontology matching is the process of finding mappings between classes in two ontologies. Ontology integration goes beyond identification of an ontology alignment in that two or more ontologies are merged into a single ontology that encompasses all classes in the original ontologies [14].

Phenotype classes in the HP and MP ontologies are formally defined using the Entity-Quality (EQ) pattern [4, 26]. Based on the EQ patterns, a phenotype is decomposed into an affected entity and a quality that specifies how the entity is affected. The Entity will usually be a class taken either from an anatomy ontology or a physiology ontology. For example, the phenotype class macroglossia (HP:0000158) describes an anatomical abnormality and is defined as equivalent to ‘has part’ some (‘increased size’ and (‘inheres in’ some tongue)and (‘has modifier’ some abnormal)), relying on the entity tongue (from the UBERON anatomy ontology [9]) and the quality increased size (from PATO) in its definition. The class abnormality of salivation (HP:0100755) is a physiological abnormality and is defined as equivalent to ‘has part’ some (quality and (‘inheres in’ some ‘saliva secretion’) and (‘has modifier’ some abnormal)), where saliva secretion is a class from the biological process branch of the Gene Ontology (GO) [10].

The general pattern for defining a phenotype class in both the HP and MP ontologies, given Entity E and Quality Q, is to declare them equivalent to ‘has part’ some (Q and ‘inheres in’ some E). In some cases, the Entity E is further constrained, e.g., by a location in which a certain process may happen. The “E” classes are generally taken either from the UBERON cross-species anatomy ontology [9] or from the GO. As the use of anatomy and physiology ontologies (UBERON and GO) is shared between MP and HP, it is possible to integrate both ontologies directly, based on the axiom patterns used to constrain their classes. However, the type of axiom pattern used in both ontologies results in a classification that is primarily based on the PATO ontology, as the Quality Q is the main feature that distinguishes different classes.

In the PhenomeNET ontology, we rewrite all axioms in HP and MP using a pattern-based approach that allows us to utilize axioms from anatomy and physiology ontologies and enrich the classification of phenotype classes [11, 27]. In general, we declare phenotype classes defined using an Entity E and Quality Q as equivalent to ‘has part’ some (E and has-quality some Q) and we further add grouping classes that are defined as equivalent to ‘has part’ some ((‘part of’ some E)and has-quality some Quality). For example, based on the axiom that defines macroglossia (HP:0000158) as equivalent to ‘has part’ some (‘increased size’ and (‘inheres in’ some tongue) and (‘has modifier’ some abnormal)), we generate two new axioms: macroglossia Equivalent To: ‘has part’ some (tongue and has-quality some ‘increased size’) as well as ‘tongue abnormality’ EquivalentTo: ‘has part’some ((‘part of’ some tongue) and has-quality some Quality). These two axioms, together with the transitivity and reflexivity of the part of’ relation, ensure that macroglossia becomes a subclass of tongue abnormality, and that all phenotypes affecting the tongue or a part of the tongue also become a subclass of tongue abnormality. The aim of rewriting the axioms is to base the classification of phenotype classes primarily on anatomical or physiological entities instead of the quality, and to utilize the axioms involving parthood in anatomy and physiology ontologies [11, 28]. Crucially, all axioms we generate fall in the OWL 2 EL profile [29, 30] and allow efficient automated reasoning using optimized OWL 2 EL reasoners such as ELK [31]. The first version of the PhenomeNET ontology (PhenomeNET-Plain) consists only of these axioms and no additional mappings.

In addition to this knowledge-based approach to linking the HP and MP ontologies, we also add lexical mappings, mappings derived from cross-references in the ontologies [5], mappings between HP and MP from BioPortal [22], and mappings generated by the AgreementMaker Light (AML) [14] in its default settings with a score greater than 0.7. Each mapping is added as a single equivalent classes axiom to the PhenomeNET ontology (PhenomeNET-Plain) to generate a version of the PhenomeNET ontology with lexical mappings (PhenomeNET-Map).

Neither HP nor MP contain mappings to the DO or ORDO ontologies, despite a significant overlap between the four ontologies. Moreover, since neither DO nor ORDO contain axioms that follow a similar pattern to the axioms in HP and MP, we have to rely exclusively on lexical mappings in order to integrate DO and ORDO. To achieve this, we use the AML [14] in its default settings to generate mappings between HP and DO, HP and ORDO, MP and DO, MP and ORDO, and DO and ORDO (see Table 1). We then add an equivalent class axiom for each mapping AML identifies with a score greater than 0.7. The resulting ontology (PhenomeNET-Full) contains HP, MP, ORDO, and DO, and can be used to generate further mappings between these ontologies. Figure 1 provides an overview of the different data sources we used to generate the mappings for the three PhenomeNET ontologies.
Figure 1
Fig. 1

An overview of the data sources and strategies used to generate the PhenomeNET ontologies. On one side, we use mappings between HP, MP, DO, and ORDO, generated using the AML ontology matching system; on the other side, we use the axioms used to define classes in HP and MP together with the background knowledge in other ontologies to generate mappings formally. Using the ELK reasoner, we generate a hierarchical ontology structure (i.e., a taxonomy) from which we derive equivalent class, sub-class, and super-class mappings. The PhenomeNET-Full ontology is based on a combination of all these mapping approaches, while PhenomeNET-Map uses only the AML-generated mappings between HP and MP. PhenomeNET-Plain does not use any of the AML-generated mappings but solely relies on the axioms and background knowledge

Table 1

Number of classes, axioms and mappings in the PhenomeNET and AML ontologies

System

Ontology

Number of classes

Number of axioms

Mappings added

PhenomeNet-Plain

HP-MP

219,423

1,399,411

0

PhenomeNet-Map

HP-MP+mappings

219,423

1,400,570

1,160(AML), 639(BioPortal)

PhenomeNet-Full

HP-MP+DO-ORDO

241,817

1,631,543

1,489(AML), 1,018(BioPortal)

    

HP-MP: 1,160 (AML),

    

639(BioPortal);

    

DO-MP: 423 (AML);

    

DO-HP: 1,074 (AML);

    

ORDO-MP: 151 (AML);

    

ORDO-HP: 531 (AML);

AML

HP-MP mappings

32,509

229,337

1,160(AML)

All versions of the PhenomeNET ontology contain the classes from the HP and MP ontologies as well as the subclass axioms between named classes asserted in these ontologies. Furthermore, the PhenomeNET ontology imports the ChEBI [32] and Mouse Pathology [33] ontologies using an OWL import statement. Additionally, PhenomeNET includes all classes from the UBERON, the GO, the BioSpatial Ontology [34], the Zebrafish Anatomy ontology [35], the PATO ontology [4], the Cell Ontology [36], and the Neuro-Behavior Ontology [37]. However, these ontologies are not directly imported but rather pre-processed so that all disjointness axioms from these ontologies are excluded while all other axioms contained within them are included in the PhenomeNET ontology. The aim of this pre-processing step is to avoid unsatisfiable classes due to different conceptualizations between anatomy and phenotype ontologies, or within anatomy ontologies (Zebrafish Anatomy and UBERON) [3].

Mappings between ontologies included in PhenomeNET are generated using the ELK reasoner [31]. We use ELK to classify the PhenomeNET ontology and identify pairs of equivalent classes C 1 and C 2 that belong to the ontologies to be aligned. These constitute equivalent class mappings. Furthermore, we also use ELK to identify pairs of classes C 1 and C 2 such that C 1 is a proper sub- or super-class of C 2 to generate sub- and super-class mappings. A reasoner such as ELK is also required to explore and visualize the PhenomeNET ontology structures, and the PhenomeNET-Map ontology can be explored and visualized in the AberOWL ontology repository [38].

Evaluation of mappings: HP and MP

We employ the PhenomeNET ontology primarily for integrating the HP and MP ontologies. Using the axioms in the ontology alone (PhenomeNET-Plain), we identify 745 equivalent classes between the HP and MP ontologies (see Table 2). Additionally, a large number of sub- and super-class mappings can be identified based on querying the ontology using the ELK reasoner [31] for sub- or super-classes in the two ontologies.
Table 2

Equivalent and sub-equivalent classes identified. Numbers in parentheses represent inferred (subclass) mappings

System

Ontology

HP-MP (≡)

HP-MP (\(\sqsubseteq \))

DO-ORDO (≡)

DO-ORDO (\(\sqsubseteq \))

PhenomeNET-Plain

HP-MP

745

2707 (96,278)

0

0

PhenomeNET-Map

HP-MP+mappings

1536

3999 (107,268)

0

0

PhenomeNET-Full

HP-MP+DO-ORDO

1582

4144 (112,366)

1527

4576 (16,838)

The number of pairs of equivalent classes identified increases to 1536 when adding explicit mappings derived from AML. Of these, 370 are generated by automated reasoning and are also included in AML, 791 are generated from the AML-derived equivalent classes axioms, and 375 could only be derived through the automated reasoning. For example, using the PhenomeNET ontology, we infer an equivalence class mapping between Copper accumulation in brain HP:0012676) and Increased brain copper level (MP:0011214) based on their shared definition ‘has part’ some (‘increased amount’ and (‘inheres in’ some (‘copper atom’ and (‘part of’ some brain))) and (‘has modifier’ some abnormal)). Such mappings are not easily identified by methods that do not consider the axioms constraining the ontology classes.

Additionally, we observe an increase in the number of equivalent class mappings when adding the ORDO and DO ontologies to the PhenomeNET ontology. The increase in mappings (from 1536 to 1582 classes) is a result of additional inferences obtained from adding the mappings from HP and MP to ORDO and DO, and combining them with the axioms in the PhenomeNET ontology. For example, we infer a new mapping between decreased IgG level (MP:0001805) and agammaglobulinemia (HP:0004432) based on the equivalence axioms between both classes and agammaglobulinemia (DOID:2583) generated by AML (based on the asserted synonym “hypogammaglobulinemia” shared between the classes in DO and MP). Table 2 summarizes our results.

Evaluation of mappings: ORDO and DO

PhenomeNET is primarily designed for ontologies that follow the Entity-Quality definition pattern based on the PATO ontology. Neither ORDO nor DO follow this pattern, and ORDO and DO are primarily included in the PhenomeNET ontology through equivalent class axioms based on lexical mappings generated by AML. Notably, the mappings we generate are increased by including HP and MP. For example, we identify a mapping between mandibulofacial dysostosis (ORPHANET:155899) and Treacher Collins syndrome (DOID:2908), based on common AML-generated mappings to mandibulofacial dysostosis (HP:0005321).

OAEI evaluation

PhenomeNET participated in the Ontology Alignment Evaluation Initiative (OAEI) 2016 challenge where several ontology alignment systems where evaluated according to the following criteria:

  • precision and recall with respect to a silver standard generated by voting (using either two or three votes) the outputs of the participating systems,

  • recall with respect to manually generated mappings,

  • and a manual assessment of the mappings that were unique to a particular system.

In the first dataset, a silver standard reference alignment was generated from the systems participating in the OAEI challenge, using a vote of two of the participating systems. PhenomeNET-Full reached an F-measure of 0.829 in the HP-MP task and 0.886 in the DO-ORDO task. The LogMap system [39] achieved the highest F-measure in this evaluation of 0.925 for the HP-MP task, and the FCA_Map system [40] achieved the an F-measure of 0.962 in the DO-ORDO task. Results are similar when evaluating with a silver standard reference alignment generated by three votes of systems participating in the challenge. In particular in the DO-ORDO evaluation, PhenomeNET-Full achieved the second-highest F-score of 0.935, while the LogMap system [39] achieved an F-measure of 0.937.

When evaluating against manually created mappings, PhenomeNET-Full achieved the highest recall of 0.897 in the HP-MP task but could not generate any of the manually created mappings between DO and ORDO. Furthermore, when evaluating mappings that were uniquely identified by individual systems, 89 mappings between HP and MP as well as 3 mappings between ORDO and DO were generated only by the PhenomeNET ontologies and no other participating system. These were manually assessed, and PhenomeNET obtained a precision of 1.0 both for the 89 unique mappings generated between HP and MP as well as for the 3 mappings generated between DO and ORDO. We provide full evaluation for the OAEI as Additional file 1; results are also available at http://oaei.ontologymatching.org/2016/results/phenotype/.

As PhenomeNET relies on generating a taxonomic structure in which classes from HP and MP are combined, PhenomeNET also generated a large number of subclass and superclass mappings. While these were not explicitly evaluated, PhenomeNET was the only system explicitly focusing on these kind of mappings, while other participating systems primarily focused on identifying mappings represented class equivalence.

Predicting gene–disease associations

To determine the impact of the different mapping approaches in biomedical data analysis, we also apply the three ontologies in the task for which PhenomeNET was originally designed, predicting gene–disease associations based on semantic similarity between mouse model phenotypes and human phenotypes [3, 5]. For this purpose, we use the PhenomeNET ontology as an integrated version of both HP and MP so that semantic similarity can be computed simultaneously over both ontologies. Semantic similarity establishes a measure of relatedness between classes, or sets of classes, within an ontology (or, in some cases, between classes from multiple ontologies) [25].

To evaluate the success of the three ontologies in disease gene prioritization, we obtain mouse model phenotypes associated with loss-of-function mutations in single genes from the MGI database [23] as well as human disease phenotypes associated with Mendelian diseases from the HPO database [12], and apply a semantic similarity measure [24, 41] to compare the phenotypic similarity between phenotypes associated with mouse mutants and human disease. We systematically compute phenotypic similarity between 9131 loss-of-function mouse mutants and 7066 diseases. We perform this experiment three times, once for each version of the PhenomeNET ontology (PhenomeNET-Plain, PhenomeNET-Map, and PhenomeNET-Full). Additionally, to determine the effect of PhenomeNET’s knowledge-based approach, we also generate an integrated ontology based only on an alignment between HP and MP generated by AML.

We test how well this approach recovers known gene–disease associations. We use two sets for this evaluation: human gene–disease associations observed in a clinical context and presented in the Online Mendelian Inheritance in Man (OMIM) database [42], and mutant mice identified by curators as models of a human disease represented in the MGI database [23]. The receiver operating characteristic (ROC) curves [43] for this evaluation are shown in Fig. 2. We find that the PhenomeNET-Map version, which focuses specifically on generating mappings between MP and HP, performs best among our ontologies in this evaluation (AUROC 0.794 for human gene–disease associations and 0.930 for mouse associations), followed by PhenomeNET-Full (AUROC 0.791 for human 0.929 for mouse gene–disease associations) and PhenomeNET-Plain (AUROC 0.790 and 0.920 for human and mouse, respectively). An ontology generated only by mappings from AML, however, performs better than any of the PhenomeNET ontologies despite producing a fewer number of mappings. Using an ontology based only on the AML-derived mappings we achieve a AUROC of 0.795 and 0.934 for the human and mouse evaluation sets, respectively. However, none of the differences between the ontologies is statistically significant (p>0.05 for all 12 comparisons, Wilcoxon rank sum test, Bonferroni correction).
Figure 2
Fig. 2

ROC curves for predicting gene–disease associations using the three different ontologies

Discussion

Related work

A large number of ontology matching and alignment systems have been developed [44]. Several of these approaches have been applied to the same ontologies we use here. Most ontology matching systems combine methods based on lexical matching of class labels and synonyms, structural matches based on graph representations of ontologies, and background knowledge coming from a variety of sources. We make use of the AML system [14] since AML is one of the leading ontology alignment systems. AML implements a modular ontology matching framework based on lexical and structural matching methods. AML can further make use of external resources such as DO, UBERON, MeSH and Wordnet, which provide background knowledge to improve the generation of mappings, and AML further provides methods for identifying and repairing incoherent matches between two ontologies. Similarly, LogMap [39] utilizes multiple sources of background knowledge, including related ontologies from BioPortal, and utilizes lexical matching together with background knowledge to generate alignments. LogMap further uses a reasoner to identify and repair inconsistent or incoherent mappings. Similar ontology mapping systems include XMap [45] and the cross-lingual ontology matching system LYAM++ [46]. A distinct approach is FCA-Map [40], based on Formal Concept Analysis (FCA) [47], which constructs formal contexts of classes from its properties and relations, generates lattice structures and matches these concept lattices at a lexical and structural level.

One of the key features of the PhenomeNET system is its ability to identify subclass mapping in additional to equivalent class mappings. While PhenomeNET uses a reasoner for this purpose and relies on axioms that have specifically been developed for phenotype ontologies [4], alternative approaches can also identify subclass mappings based on matching sub-structures in ontology hierarchies or based on supervised machine learning [48, 49].

Due to the importance of integrating species-specific phenotype ontologies for biomedical research [50], several methods have been developed that specifically focus on the integration of phenotype ontologies. For example, PhenoHM [51] uses the Unified Medical Language System (UMLS) MetaMap service [52] to map classes from MP to UMLS concepts describing disorders and phenotypes. The Uberpheno ontology [53] as well as the Monarch knowledge graph [54] use a combination of lexical mappings and ontology axioms to generate mappings between MP and HPO. The main difference to our work lies in the representation patterns that are used to represent phenotype classes and the way in which lexical mappings are generated.

An alternative approach to finding relations between biomedical ontologies is to identify mappings between classes from different ontologies not based on the semantics of a class itself but rather based on shared annotations of the classes. For example, orthologous gene annotations can be used to identify orthologous phenotypes and thereby establish orthology relations between phenotypes. This approach has been used previously to identify yeast models for mammalian vasculature formation [55], a striking discovery since yeast has no blood vessels. To the best of our knowledge, these approaches have not yet been combined with mappings based entirely on the semantics of ontology classes and may provide a complementary source for future work on creating ontology mappings.

Knowledge-based, structural, and lexical mappings

PhenomeNET is one of very few systems that are primarily based on automated reasoning to generate mappings and does not rely on identifying similarity between class labels, synonyms, or other associated meta-data. PhenomeNET is a system intended to match phenotypes and as such, it is not a framework that can be applied to match ontologies in general. The axiom-based approach in PhenomeNET can be applied to any ontologies that utilize PATO and the Entity-Quality definition patterns [4, 11]. In particular, PhenomeNET can not only be used to integrate MP and HPO, but also has been used to further integrate yeast, fly, worm, slime mold, and fish phenotypes [3, 56]. Furthermore, the combination of semantic matching (using automated reasoning) and lexical matching in PhenomeNET mitigates some of the limitations of using lexical approaches alone, and we demonstrate this by inferring severa; mappings between HP and MP that cannot be inferred by other ontology matching systems.

However, relying on manually-created axioms also has several limitations. In particular, the axioms are created by domain experts, and only about half the classes in MP and HP are constrained by an Entity-Quality based axiom. Furthermore, the quality of the axioms is difficult to assess, and there are distinct differences between HP and MP in how the classes are constrained. A possible solution to these challenges could be to generate phenotype ontologies fully automatically using anatomy and physiology ontologies as templates and applying the axiom patterns we use in the PhenomeNET [57] or that are used elsewhere [26].

Another limitation of PhenomeNET is the reliance on OWL 2 EL which limits the expressivity of axiom patterns. The choice is mainly due to the size of the PhenomeNET ontology and the complexity of reasoning. However, more complex axiom patterns would enable more comprehensive classification of phenotypes involving absences and abnormalities [27]; experiments with an updated ontology will likely require improvement in OWL reasoning technologies.

Relying on automated reasoning over integrated phenotype ontologies can result in incoherencies due to different conceptualizations in the integrated ontologies. We avoid the incoherencies by removing disjointness axioms when including ontologies in PhenomeNET; however, this approach does not remove but only hide the underlying problems. Generic ontology matching systems have faced similar issues for a long time, and several methods have been proposed to automatically repair incoherent ontology mappings [58–60]. However, aligning incompatible conceptualizations across multiple ontologies is not trivial and automated methods still have limitations [61] that may require human intervention. In the future, we plan to investigate whether these methods can be applied to automatically repair some of the incoherencies we identified.

Finally, one limitation of most mapping approaches is their failure to consider subtle differences in ontological categories that may be obvious to ontology developers and users but are not always reflected in the labels. This issue is particularly prevalent in the domains of phenotypes and diseases where the same label may be used to specify different ontological categories. A phenotype such as ‘agammaglobulinemia’ is an observational phenomenon related to levels of gamma-globulin in blood, while the disease ‘agammaglobulinemia’ is a more complex entity that may involve a particular etiology and several signs and symptoms (of which the phenotype ‘agammaglobulinemia’ may be one). Inspection of the written definition of ‘agammaglubulinemia’ (HP:0004432) in HPO indicates that the class refers to a deficiency or absence of immunoglobulins in serum. However, the DO defines a class with this label as an immunodeficiency syndrome that includes agammaglobulinemia as part of its phenotype, and ORDO similarly implies that this is a disease but only because of its position as a child of ‘Immunodeficiency predominantly affecting antibody production’ (as there is no textual or formal definition of the class in ORDO). In MedGen (UID:168), the UMLS code C0001768 references both to HP:0004432 and Orphanet (ORPHANET:183669), but classifies both under ‘Disease or Syndrome’.

There are similar issues with, for example, hypoglycaemia which occurs in DO as a child of glucose metabolism disease (DOID:9993), therefore as a disease, and in HPO (HP:0001943) as a phenotype defined as ‘A decreased concentration of glucose in the blood’. HPO cross-references the UMLS (C0020615) which uses this concept in the phenomenological sense yet again classifies it under ‘Disease or Syndrome’. The ambiguity of whether two classes are equivalent, even if they use the same label, is therefore deeply embedded in the ontologies, their structure and general domain, and there is no clear way to disambiguate these types of classes without manual expert inspection or, indirectly, by their different uses for annotation and analysis of data [62]. The semantic ambiguity reflected in these examples is partly a consequence of clinical usage of language where different entities (such as a disease and phenotype) are referred to by the same name. Resolving these issues is a problem that can likely only be addressed through expert curation across a very wide range of ontologies. The impact of these issues is likely not severe for human ontology users, but it remains a problem for any semantic approach to knowledge capture, analysis, and integration, and not least in the area of ontology matching.

Conclusions

We have developed an ontology matching system for disease and phenotype ontologies. We generated three different version of the PhenomeNet ontology, each with different information and ontologies included. PhenomeNET is primarily based on deductive inference and automated reasoning, and while it can utilize lexically-derived mappings in the ontology generation process, it does not on its own include any lexical matching algorithms. Our results demonstrate that a combination of lexical and semantic approaches may improve upon mappings between ontologies generated using only one of these methods.

Abbreviations

OWL: 

Web ontology language

Declarations

Funding

Funding for GVG was provided by the National Science Foundation (Grant Number: IOS-1340112), the BBSRC national capability in plant phenotyping (Grant Number: BB/J004464/1) and the FP7 European Plant Phenotyping Network (Grant Agreement No. 284443). RH and MARG were supported by funding from the King Abdullah University of Science and Technology (Grant Number: FCC/1/1976-08-01).

Availability of data and materials

All data and materials are available from http://github.com/bio-ontology-research-group/OAEI2016 and https://github.com/bio-ontology-research-group/phenomeblast/tree/master/fixphenotypes.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Computational Bioscience Research Center (CBRC), King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
(2)
Computer, Electrical and Mathematical Sciences & Engineering Division (CEMSE), King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
(3)
College of Medical and Dental Sciences, Institute of Cancer and Genomic Sciences, Centre for Computational Biology, University of Birmingham, Birmingham, UK
(4)
Institute of Translational Medicine, University Hospitals Birmingham, NHS Foundation Trust, Birmingham, UK
(5)
Institute of Biological, Environmental and Rural Sciences, Aberystwyth University, Aberystwyth, UK
(6)
Department of Physiology, Development & Neuroscience, University of Cambridge, Cambridge, UK

References

  1. Schofield PN, Hoehndorf R, Gkoutos GV. Mouse genetic and phenotypic resources for human genetics. Hum Mutat. 2012; 33(5):826–36.View ArticleGoogle Scholar
  2. Hoehndorf R, Schofield PN, Gkoutos GV. The role of ontologies in biological and biomedical research: a functional perspective. Brief Bioinform. 2011. doi:10.1093/bib/bbv011. http://bib.oxfordjournals.org/content/early/2015/04/10/bib.bbv011.full.pdf+html.
  3. Hoehndorf R, Schofield PN, Gkoutos GV. Phenomenet: a whole-phenome approach to disease gene discovery. Nucleic Acids Res. 2011; 39(18):119.View ArticleGoogle Scholar
  4. Gkoutos GV, Green EC, Mallon A-MM, Hancock JM, Davidson D. Using ontologies to describe mouse phenotypes. Genome Biol. 2005; 6(1):5. doi:10.1186/gb-2004-6-1-r8.Google Scholar
  5. Hoehndorf R, Schofield PN, Gkoutos GV. An integrative, translational approach to understanding rare and orphan genetically based diseases. Interface Focus. 2013; 3(2):20120055. doi:10.1098/rsfs.2012.0055.View ArticleGoogle Scholar
  6. Hoehndorf R, Dumontier M, Gkoutos GV. Identifying aberrant pathways through integrated analysis of knowledge in pharmacogenomics. Bioinformatics. 2012; 28(16):2169–75. doi:10.1093/bioinformatics/bts350.View ArticleGoogle Scholar
  7. Hoehndorf R, Oellrich A, Rebholz-Schuhmann D, Schofield PN, Gkoutos GV. Linking PharmGKB to phenotype studies and animal models of disease for drug repurposing. Pac Symp Biocomput (PSB). 2012; 2012:388–99.Google Scholar
  8. Hoehndorf R, Hiebert T, Hardy NW, Schofield PN, Gkoutos GV, Dumontier M. Mouse model phenotypes provide information about human drug targets. Bioinformatics. 2014; 30(5):719–25. doi:10.1093/bioinformatics/btt613.View ArticleGoogle Scholar
  9. Mungall C, Torniai C, Gkoutos G, Lewis S, Haendel M. Uberon, an integrative multi-species anatomy ontology. Genome Biol. 2012; 13(1):5. doi:10.1186/gb-2012-13-1-r5.View ArticleGoogle Scholar
  10. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry MJ, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Tarver LI, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G. Gene ontology: tool for the unification of biology. Nat Genet. 2000; 25(1):25–9. doi:10.1038/75556.View ArticleGoogle Scholar
  11. Gkoutos GV, Schofield PN, Hoehndorf R. The anatomy of phenotype ontologies: principles, properties and applications. Brief Bioinform. 2017. in press.Google Scholar
  12. Köhler S, Doelken SC, Mungall CJ, Bauer S, Firth HV, Bailleul-Forestier I, Black GCM, Brown DL, Brudno M, Campbell J, FitzPatrick DR, Eppig JT, Jackson AP, Freson K, Girdea M, Helbig I, Hurst JA, Jähn J, Jackson LG, Kelly AM, Ledbetter DH, Mansour S, Martin CL, Moss C, Mumford A, Ouwehand WH, Park SM, Riggs ER, Scott RH, Sisodiya S, Vooren SV, Wapner RJ, Wilkie AOM, Wright CF, Vulto-van Silfhout AT, Leeuw ND, de Vries BBA, Washingthon NL, Smith CL, Westerfield M, Schofield P, Ruef BJ, Gkoutos GV, Haendel M, Smedley D, Lewis SE, Robinson PN. The human phenotype ontology project: linking molecular biology and disease through phenotype data. Nucleic Acids Res. 2014; 42(D1):966–74.View ArticleGoogle Scholar
  13. Smith CL, Goldsmith C-AW, Eppig JT. The mammalian phenotype ontology as a tool for annotating, analyzing and comparing phenotypic information. Genome Biol. 2004; 6(1):7. doi:10.1186/gb-2004-6-1-r7.View ArticleGoogle Scholar
  14. Faria D, Pesquita C, Santos E, Palmonari M, Cruz IF, Couto FM. In: Meersman R, Panetto H, Dillon T, Eder J, Bellahsene Z, Ritter N, De Leenheer P, Dou D, (eds).The AgreementMakerLight Ontology Matching System. Berlin, Heidelberg: Springer; 2013, pp. 527–41.Google Scholar
  15. Kibbe WA, Arze C, Felix V, Mitraka E, Bolton E, Fu G, Mungall CJ, Binder JX, Malone J, Vasant D, Parkinson H, Schriml LM. Disease ontology 2015 update: an expanded and updated database of human diseases for linking biomedical knowledge through disease data. Nucleic Acids Res. 2014; 43:1071–8. doi:10.1093/nar/gku1011.View ArticleGoogle Scholar
  16. Sarntivijai S, Vasant D, Jupp S, Saunders G, Bento AP, Gonzalez D, Betts J, Hasan S, Koscielny G, Dunham I, Parkinson H, Malone J. Linking rare and common disease: mapping clinical disease-phenotypes to ontologies in therapeutic target validation. J Biomed Semant. 2016; 7(1):1–11. doi:10.1186/s13326-016-0051-7.View ArticleGoogle Scholar
  17. Vasant D, Chanas L, Malone J, Hanauer M, Olry A, Jupp S, Robinson PN, Parkinson H, Rath A. Ordo: An ontology connecting rare disease, epidemiology and genetic data. In: Phenoday @ ISMB2014: 2014.Google Scholar
  18. Robinson PN, Köhler S, Bauer S, Seelow D, Horn D, Mundlos S. The human phenotype ontology: a tool for annotating and analyzing human hereditary disease. Am J Hum Genet. 2008; 83(5):610–5.View ArticleGoogle Scholar
  19. Smith CL, Eppig JT. The mammalian phenotype ontology: enabling robust annotation and comparative analysis. Wiley Interdiscip Rev Syst Biol Med. 2009; 1(3):390–9.View ArticleGoogle Scholar
  20. Schriml LM, Arze C, Nadendla S, Chang Y-WW, Mazaitis M, Felix V, Feng G, Kibbe WA. Disease ontology: a backbone for disease semantic integration. Nucleic Acids Res. 2011; 40(D1):940–6.View ArticleGoogle Scholar
  21. Faria D, Martins C, Nanavaty A, Oliveira D, Sowkarthiga B, Taheri A, Pesquita C, Couto FM, Cruz IF. AML results for OAEI 2015 In: Shvaiko P, et al, editors. Proceedings of the 10th International Workshop on Ontology Matching. Aachen: CEUR-WS;2015. p. 116–23.Google Scholar
  22. Noy NF, Shah NH, Whetzel PL, Dai B, Dorf M, Griffith N, Jonquet C, Rubin DL, Storey M-AA, Chute CG, Musen MA. Bioportal: ontologies and integrated data resources at the click of a mouse. Nucleic Acids Res. 2009; 37(Web Server issue):170–3. doi:10.1093/nar/gkp440.View ArticleGoogle Scholar
  23. Bello SM, Richardson JE, Davis AP, Wiegers TC, Mattingly CJ, Dolan ME, Smith CL, Blake JA, Eppig JT. Disease model curation improvements at mouse genome informatics. Database. 2012; 2012:063.View ArticleGoogle Scholar
  24. Resnik P. Semantic similarity in a taxonomy: An Information-Based measure and its application to problems of ambiguity in natural language. J Artif Intell Res. 1999; 11:95–130.MATHGoogle Scholar
  25. Pesquita C, Faria D, Falcao AO, Lord P, Couto FM. Semantic similarity in biomedical ontologies. PLoS Comput Biol. 2009; 5(7):1000443.MathSciNetView ArticleGoogle Scholar
  26. Mungall C, Gkoutos G, Smith C, Haendel M, Lewis S, Ashburner M. Integrating phenotype ontologies across multiple species. Genome Biol. 2010; 11(1):2.View ArticleGoogle Scholar
  27. Hoehndorf R, Oellrich A, Rebholz-Schuhmann D. Interoperability between phenotype and anatomy ontologies. Bioinformatics. 2010; 26(24):3112–8.View ArticleGoogle Scholar
  28. Boudellioua I, Mahamad Razali RB, Kulmanov M, Hashish Y, Bajic VB, Goncalves-Serra E, Schoenmakers N, Gkoutos GV, Schofield PN, Hoehndorf R. Semantic prioritization of novel causative genomic variants. PLOS Comput Biol. 2017; 13(4):1–21. doi:10.1371/journal.pcbi.1005500.View ArticleGoogle Scholar
  29. Motik B, Grau BC, Horrocks I, Wu Z, Fokoue A, Lutz C. OWL 2 Web Ontology Language Profiles (Second Edition). World Wide Web Consortium. 2012. https://www.w3.org/TR/owl2-profiles/. Accessed 4 Dec 2017.
  30. Hoehndorf R, Dumontier M, Oellrich A, Wimalaratne S, Rebholz-Schuhmann D, Schofield P, Gkoutos GV. A common layer of interoperability for biomedical ontologies based on OWL EL. Bioinformatics. 2011; 27(7):1001–8.View ArticleGoogle Scholar
  31. Kazakov Y, Krötzsch M, Simancik F. The incredible elk. J Autom Reason. 2014; 53(1):1–61. doi:10.1007/s10817-013-9296-3.View ArticleMATHGoogle Scholar
  32. Degtyarenko K, Matos P, Ennis M, Hastings J, Zbinden M, McNaught A, Alcantara R, Darsow M, Guedj M, Ashburner M. Nucleic Acids Res. 2007; 36(Database issue):344–50.Google Scholar
  33. Schofield PN, Sundberg JP, Sundberg BA, McKerlie C, Gkoutos GV. J Biomed Semant. 2013; 4(1):1–8. doi:10.1186/2041-1480-4-18.
  34. Balhoff JP, Mikó I, Yoder MJ, Mullins PL, Deans AR. A semantic model for species description applied to the ensign wasps (hymenoptera: Evaniidae) of new caledonia. Syst Biol. 2013; 62(5):639–59. doi:10.1093/sysbio/syt028. http://sysbio.oxfordjournals.org/content/62/5/639.full.pdf+html.View ArticleGoogle Scholar
  35. Dahdul WM, Balhoff JP, Engeman J, Grande T, Hilton EJ, Kothari C, Lapp H, Lundberg JG, Midford PE, Vision TJ, Westerfield M, Mabee PM. Evolutionary characters, phenotypes and ontologies: curating data from the systematic biology literature. PLoS ONE. 2010; 5(5):10708. doi:10.1371/journal.pone.0010708.View ArticleGoogle Scholar
  36. Bard J, Rhee SY, Ashburner M. An ontology for cell types. Genome Biol. 2005;6(2). doi:10.1186/gb-2005-6-2-r21.
  37. Hoehndorf R, Hancock JM, Hardy NW, Mallon AM, Schofield PN, Gkoutos GV. Analyzing gene expression data in mice with the Neuro Behavior Ontology. Mamm Genome. 2014; 25(1-2):32–40.View ArticleGoogle Scholar
  38. Hoehndorf R, Slater L, Schofield PN, Gkoutos GV. Aber-OWL: a framework for ontology-based data access in biology. BMC Bioinformatics. 2015; 16:26.View ArticleGoogle Scholar
  39. Jiménez-Ruiz E, Grau BC. Logmap: Logic-based and scalable ontology matching. In: International Semantic Web Conference. Heidelberg: Springer;2011. p. 273–88.Google Scholar
  40. Zhao M, Zhang S. FCA-Map results for OAEI 2016 In: Shvaiko P, et al, editors. Proceedings of the 11th International Workshop on Ontology Matching. Aachen: CEUR-WS;2016. p. 172–7.Google Scholar
  41. Harispe S, Ranwez S, Janaqi S, Montmain J. The semantic measures library and toolkit: fast computation of semantic similarity and relatedness using biomedical ontologies. Bioinformatics. 2014; 30(5):740–2. doi:10.1093/bioinformatics/btt581. http://bioinformatics.oxfordjournals.org/content/30/5/740.full.pdf+html.View ArticleGoogle Scholar
  42. Amberger J, Bocchini C, Hamosh A. A new face and new challenges for Online Mendelian Inheritance in Man (OMIM). Hum Mutat. 2011; 32:564–7.View ArticleGoogle Scholar
  43. Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006; 27(8):861–74. doi:10.1016/j.patrec.2005.10.010.MathSciNetView ArticleGoogle Scholar
  44. Lorena OC, Francisco JR-M, Alma GR. Ontology matching: A literature review. Expert Syst Appl. 2015; 42(2):949–71.View ArticleGoogle Scholar
  45. Djeddi WE, Khadir MT, Yahia SB. Xmap: results for oaei 2015 In: Shvaiko P, et al, editors. Proceedings of the 10th International Workshop on Ontology Matching. Aachen: CEUR-WS;2015. p. 216–21.Google Scholar
  46. Tigrine AN, Bellahsene Z, Todorov K. Lyam++ results for oaei 2015 In: Shvaiko P, et al., editors. Proceedings of the 10th International Workshop on Ontology Matching. Aachen: CEUR-WS;2015. p. 176–180.Google Scholar
  47. Wille R. In: Ganter B, Stumme G, Wille R, (eds).Formal Concept Analysis as Mathematical Theory of Concepts and Concept Hierarchies. Berlin, Heidelberg: Springer; 2005, pp. 1–33. doi:10.1007/11528784_1.Google Scholar
  48. Spiliopoulos V, Vouros GA, Karkaletsis V. Web Semant Sci Serv Agents World Wide Web. 2010; 8(1):69–88.Google Scholar
  49. Spiliopoulos V, Valarakos AG, Vouros GA. In: Bechhofer S, Hauswirth M, Hoffmann J, Koubarakis M, (eds).CSR: Discovering Subsumption Relations for the Alignment of Ontologies. Berlin, Heidelberg: Springer; 2008, pp. 418–31.Google Scholar
  50. Gkoutos GV, Schofield PN, Hoehndorf R. Computational tools for comparative phenomics: the role and promise of ontologies. Mamm Genome. 2012; 23(9-10):669–79.View ArticleGoogle Scholar
  51. Sardana D, Vasa S, Vepachedu N, Chen J, Gudivada RC, Aronow BJ, Jegga AG. PhenoHM: human-mouse comparative phenome-genome server. Nucleic Acids Res. 2010; 38(Web Server issue):W165–74.View ArticleGoogle Scholar
  52. Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2004; 32(Database issue):267–70.View ArticleGoogle Scholar
  53. Köhler S, Doelken SC, Ruef BJ, Bauer S, Washington N, Westerfield M, Gkoutos G, Schofield P, Smedley D, Lewis SE, Robinson PN, Mungall CJ. Construction and accessibility of a cross-species phenotype ontology along with gene annotations for biomedical research. F1000Research. 2013;2. doi:10.12688/f1000research.2-30.v1.
  54. Mungall CJ, McMurry JA, Koehler S, Balhoff JP, Borromeo C, Brush M, Carbon S, Conlin T, Dunn N, Engelstad M, Foster E, Gourdine JP, Jacobsen JOB, Keith D, Laraway B, Lewis SE, NguyenXuan J, Shefchek K, Vasilevsky N, Yuan Z, Washington N, Hochheiser H, Groza T, Smedley D, Robinson PN, Haendel MA. The monarch initiative: an integrative data and analytic platform connecting phenotypes to genotypes across species. Nucleic Acids Res. 2017; 45(D1):712–22.View ArticleGoogle Scholar
  55. McGary KL, Park TJ, Woods JO, Cha HJ, Wallingford JB, Marcotte EM. Systematic discovery of nonobvious human disease models through orthologous phenotypes. Proc Natl Acad Sci. 2010; 107(14):6544–9. doi:10.1073/pnas.0910200107.View ArticleGoogle Scholar
  56. Hoehndorf R, Hardy NW, Osumi-Sutherland D, Tweedie S, Schofield PN, Gkoutos GV. Systematic analysis of experimental phenotype data reveals gene functions. PLoS ONE. 2013; 8(4):60847. doi:10.1371/journal.pone.0060847.View ArticleGoogle Scholar
  57. Hoehndorf R, Harris MA, Herre H, Rustici G, Gkoutos GV. Semantic integration of physiology phenotypes with an application to the cellular phenotype ontology. Bioinformatics. 2012; 28(13):1783–9. doi:10.1093/bioinformatics/bts250. http://bioinformatics.oxfordjournals.org/content/28/13/1783.full.pdf+html.View ArticleGoogle Scholar
  58. Jiménez-Ruiz E, Cuenca Grau B, Horrocks I, Berlanga R. In: Aroyo L, Traverso P, Ciravegna F, Cimiano P, Heath T, Hyvönen E, Mizoguchi R, Oren E, Sabou M, Simperl E, (eds).Ontology Integration Using Mappings: Towards Getting the Right Logical Consequences. Berlin, Heidelberg: Springer; 2009, pp. 173–87.Google Scholar
  59. Santos E, Faria D, Pesquita C, Couto FM. Ontology alignment repair through modularization and confidence-based heuristics. PLOS ONE. 2016; 10(12):1–19. doi:10.1371/journal.pone.0144807.Google Scholar
  60. Meilicke C, Stuckenschmidt H, Tamilin A. Repairing ontology mappings. In: Proceedings of the 22Nd National Conference on Artificial Intelligence - Volume 2, AAAI’07. AAAI Press;2007. p. 1408–13. http://dl.acm.org/citation.cfm?id=1619797.1619871.
  61. Pesquita C, Faria D, Santos E, Couto FM. To repair or not to repair: Reconciling correctness and coherence in ontology reference alignments. In: Proceedings of the 8th International Conference on Ontology Matching - Volume 1111, OM’13. Aachen, Germany: CEUR-WS.org: 2013. p. 13–24. http://dl.acm.org/citation.cfm?id=2874493.2874495.Google Scholar
  62. Goldfain A, Smith B, Cowell L. Dispositions and the infectious disease ontology. In: Proceedings of Formal Ontologies in Information Systems (FOIS). Amsterdam: IOS Press: 2010. p. 400–13.Google Scholar

Copyright

© The Author(s) 2017

Advertisement

Journal of Biomedical Semantics

ISSN: 2041-1480