- Open Access
A histological ontology of the human cardiovascular system
Journal of Biomedical Semanticsvolume 8, Article number: 47 (2017)
In this paper, we describe a histological ontology of the human cardiovascular system developed in collaboration among histology experts and computer scientists.
The histological ontology is developed following an existing methodology using Conceptual Models (CMs) and validated using OOPS!, expert evaluation with CMs, and how accurately the ontology can answer the Competency Questions (CQ). It is publicly available at http://bioportal.bioontology.org/ontologies/HO and https://w3id.org/def/System.
The histological ontology is developed to support complex tasks, such as supporting teaching activities, medical practices, and bio-medical research or having natural language interactions.
Morphological science’s experts knowledge is an important source in histology studies and practices for human studies at cellular, tissue, organ and system levels. As many other domains, histology domain also suffers from problems like vocabulary heterogeneity, the use of ambiguous language, semantic differences and subjectivity that may affect research, analysis and information retrieval processes. Different terms are used to designate the same concept –or structure– or the same term is used with different meanings, in different texts.
Two main challenges are identified in the histology domain : (i) communicate specifically, clearly and precisely histology concepts and (ii) represent or model knowledge from histology data sources in order to interact and process it automatically. These challenges require a profound analysis of the structure and the concepts of histological terminologies. This analysis can be done by constructing histological domain ontologies. The use of ontologies for representing knowledge is common in medical applications, such as anatomy, and histology among others. The union between ontologies and medical information is considered as a necessary alternative to solve main problems regarding those sources of information [2–4].
The term “ontology” has many definitions depending on the author and the way an ontology is built and used by computer systems. One of the most widespread definition of ontology is: “Ontology is an explicit and formal specification of a shared conceptualisation” . Ontologies create models to formalise knowledge in the same way that it is used. From a histology perspective, an ontology would consist of concepts defined by histological knowledge. Additionally, relations, attributes, rules and axioms enrich and contribute to expand the vocabulary used to formalise knowledge. On the other hand, a taxonomy is a set of definitions that are organised by a hierarchy that starts at the most general description and gets more refined and specific terms as the hierarchy goes down.
Many ontologies and taxonomies are available in electronic form with Open Source licenses. Ones of the best known medical taxonomies are: GALEN  (basic clinical concepts — fracture, bone, and so on — controlling combinations of related concepts — bone fractures — and complex concepts — clavicle fracture), UMLS (Unified Medical Language System) , MeSH (Medical Subject Heading) , Kingsbury Center for Cancer Care Glossary , MedicineNet Medical Dictionary , Multilingual Glossary of Technical, and Popular Medical Terms in nine European Languages , ICD (International Classification of Diseases)  among others . Some ontologies are used in web retrieval systems , identification of relations between diseases , and diagnosis , among others . Some ontologies are used in web retrieval systems , identification of relations between diseases , and diagnosis , among others. Uberon ontology is an anatomy ontology, which is a common standard used by the biomedical research community . However, none of these ontologies covers histological knowledge of the human cardiovascular system without pathologies in the same kind of guidance and organisation to our research.
In this paper, we describe our work to build a histological ontology of the human cardiovascular system. This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 Generic1 license. We selected the cardiovascular system because it is one of the most committed to the development of diseases associated with modern life. To the best of our knowledge, and after a careful search in the most relevant repositories, there is no a histological ontology in the literature, thus we consider this one to be a relevant contribution to the research community in the histology domain. We left the histological ontology publicly available at http://bioportal.bioontology.org/ontologies/HO, the documentation at https://w3id.org/def/System and the OWL files at https://github.com/claxima/HistologicalOntology.
The rest of the paper is structured as follows: the methodology to build the histological ontology is presented in “Methods” section; the evaluation and the results are presented and discussed in “Results” section; in “Discussion” section we analyse the obtained results; and some conclusions are presented in “Conclusions” section.
The NeOn methodology is one of the most used methodologies for ontology engineering . This methodology does not prescribe a rigid ontology development workflow, but instead it suggests nine scenarios for developing ontologies. The methodology covers commonly occurring situations which mostly focus on reusing, merging, restructuring and re-engineering ontological resources. Taking into account that we will create a histological ontology without reusing ontological resources, according to our analysis of the State-of-the-Art, we decided to use the methodology proposed in . This methodology consists of the following steps: (i) identification of purpose, scope, CQs and scenarios, (ii) identification of those ontologies we could reuse, (iii) domain analysis and knowledge acquisition, (iv) iterative building of informal ontology models, (v) formalisation and (vi) evaluation. We modify minimally this methodology in steps i, iii and vi, Fig. 1 presents the resulting steps. Firstly, we merge step (i) and (iii) which will be our first step called capturing expert and histological knowledge. Secondly, we use three evaluation criteria — detecting pitfalls, expert evaluation and answering CQs — while  uses two evaluation criteria — CMs and the Protégé axiom language plug-in provided by Protégé.
Capturing expert and histological knowledge
In this step, the aim is domain knowledge extraction using a set of knowledge capture activities — meetings, discussions, histology classes, among others. We planned a series of activities with the experts through which the foundations of our ontology were built: purpose, scope, CQs and scenarios. We hosted a series of meetings with the group of histology experts conformed by members of the research group Teblami2, from the Universidad del Valle3, in which the domain experts discussed the terminology and the structure used to describe the processes to analyse a histological sample. The experts team was comprised by histology professors, with more than five years of teaching and research experience, and biomedical graduate students, with mayor on histology, all of them formed the research histology area.
The questions to answer, at this stage, were the following: (i) what is the ontology going to be used for?, (ii) what do we want the ontology to be aware of?, (iii) what is the scope of the knowledge that we want to have in the ontology?, and (iv) how is the ontology going to be used?, the answers are provided in the following subsections.
Purpose, Scope and Scenarios
Commonly, ontology development is not the final goal of the process. Instead, an ontology becomes an artefact to be used by other systems. Under this perspective, the purpose is defined by the main reasons that can lead to creating an ontology . Our Ontology was constructed for: (i) sharing a common understanding of histology knowledge between people and machines in processes such as automatic recognition and identification of cells, tissues and organs; (ii) allowing reuse of domain knowledge; (iii) allowing change specifications of histology knowledge, if changes occur in it. Therefore, our main target community are both, medical professors and biomedical researchers. In addition, explicit specifications of histology knowledge are useful for users who should learn the meaning of histological terms, to specialised users that want to develop a semantic visual information retrieval system, or to other users that want to label automatically histological images or teach to students histological’s structures and relations.
This work is focused on the human cardiovascular system, which is one of the most committed to the development of diseases associated with modern life. Three scenarios are described to illustrate and motivate the use for this histological ontology. These scenarios are later used to develop a set of CQs and to indicate how the ontology would be used in these cases.
a histology expert works as a professor in a university teaching histology of the cardiovascular system. The expert teaches different group levels, covering histology of cells, tissues, organs and systems. The professor should cover each topic considering components, relations and organisations. Additionally, she/he may also promote self-learning to on-campus students and facilitate on-line learning to external or remote students.
a researcher is interested in working with a big data set of histological images, which are not labelled. The researcher has to label each histological image with cells, tissue and organs using a controlled vocabulary, in short time, reducing subjectivity and increasing precision. Additionally, the researcher should search and recover images according to present structures to develop different steps in her or his research.
a histology expert works in a hospital analysing samples in the cardiovascular system context. When receiving a sample, the histologist analyses, labels and validates different characteristics of the sample.
Having defined the purpose, scope, and scenarios of the ontology, we discussed the CQs with our histology experts. These CQs were used at a later stage in order to evaluate the resulting ontology.
Competency questions (CQs)
CQs are the kind of questions for which we want the ontology to be able to provide support for representation or reasoning processes. Additionally, those questions are essential for evaluating ontologies . Experts should express the CQs in natural language without any constraint. Based on the above scenarios, we have identified four categories of CQs: classifications, properties, constraints and inferences. Examples of those CQs are presented in Table 1, and https://github.com/claxima/HistologicalOntology/blob/master/CompetencyQuestions.pdf contains the complete document.
Classes and properties
In this step, we illustrate the construction of our ontology and explain its primitive classes and properties. The core classes of our histological ontology are: cells, tissues, organs and systems. These are the main structures to represent. Some examples of relevant properties are: layers, cell morphology, ducts, specialisation, mechanism of secretion, nature of secretion, valves and nodes. Some examples of object properties of histology ontology are included in Table 2.
A modular implementation taking into account tissues, organs and systems was used in our ontology to facilitate integration and/or reuse of histological data.
Two tasks were developed in this stage: (i) build the glossary of terms with their definitions and synonyms, and (ii) build the taxonomy of concepts. Figure 2 shows the complete glossary of terms obtained for the human cardiovascular system. Figures 3, 4, 5, 6, 7, 8 and 9 show the CMs which represent the taxonomies for cells, tissues and organs; these taxonomies are divided to show in more detail the different components and relations.
Identifying reusable ontologies
Ontology research and analysis were carried out to assess whether there were elements that could be reused in our proposal . For that, we took into account the histological and the anatomical perspectives. BioPortal  contains some histological terms. However, this thesaurus has different kind of guidance to our research due to the fact that its organisation does not contain a specific order and some terms are randomly located, for this reason it cannot be reused. BioPortal  contains concepts similar to those required in our ontology such as tissues and cells. Nevertheless, this is a human histopathological ontology which contain abnormal cell types which can occur in either disease states or disease models, then this ontology cannot be used in our research. Additionally, this ontology does not contain the organs of the cardiovascular system nor the classification of tissues since it is focused on retinal, mammary, urethral, among others. Finally, some terms can be referenced as individual concepts. BioPortal  and  have similar terms to those required in our research, for instance terms related to the epithelial tissue. Nevertheless, these concepts are linked by a different route, tissues blood vessels. These ontologies contain many concepts but the hierarchical relations among them are not detailed in depth. Under this condition, if the hierarchy is represented as a tree, some of its branches are left inconclusive. This case is seen, for instance, for muscle tissue. Concepts are linked in one-way allowing to connect from a large to a small structure but not reverse. Due to the way the concepts are organised, the methods to search for a concept may not appear logical nor intuitive. Hence, the user may need specialised knowledge or spend more time and effort (e.g. exhaustive search) in finding possible routes for these terms. BioPortal  contains the cardiovascular system and its organs. It is a complete ontology and close to what is sought in our research. However, some terms are not in this ontology such as the type of epithelium, connective and muscle tissues, which has another classification — cutaneous, corneal and lymphatic. Moreover, it is a fairly complete cardiovascular system and organs ontology. It has large shortcomings regarding the fundamental tissues — epithelial tissue and muscle tissue can be referenced as individual terms. Uberon, the Uber-anatomy ontology,  is an anatomy ontology representing a variety of entities classified according to traditional anatomical criteria such as structure, function and developmental lineage. Uberon ontology takes into account Cardiovascular system. However, Uberon represents anatomical structures grouped in high-level categories and it is organised according to traditional anatomical classification criteria, being different to our histological classification criteria. BioPortal  is a mouse ontology with an adult gross anatomy focus, for this reason it does not contain microscopic terms such as cells, fibres, and tissue with histological information. However, this ontology contains some similar organ and system terms which can be referenced as individual concepts in our ontology.
Finally, we did not find in the State-of-the-Art an ontology of histology neither a similar organisation of hierarchies of histology terms that we may be able to reuse. We followed a ‘top-down’ approach  where histology experts work together to identify requirements and create the CMs. Finally, we did not reuse any available ontology, nevertheless, there is an open door to include terms which are related to existing ontologies by linking using rdfs:sameAs and rdfs:seeAlso.
Iterative building of informal ontology models
We use CMs in each step of our methodology. CMs are graphs comprised of nodes connected by arcs representing concepts and relations between them  (see Fig. 10). CMs are useful to share and capture knowledge, to facilitate communication with experts as well as to formalise use cases, and for evaluation purposes. Figure 10 illustrates the classification of the muscular tissue, in two ways: (i) muscular tissue is classified into smooth and striated, (ii) striated muscular tissue is classified into skeletal and cardiac.
Histology and expert knowledge are represented using instances and relations with as much detail as possible in CMs. Concept-predicate structures are easily identified with this knowledge modelling. Subjects are entities that perform or receive an action, whereas the predicate is everything that may be said about a subject. The subjects, predicates and objects are extracted from histological knowledge manually.
Classes and subclasses were identified using the CMs representation; for example, epithelial tissue is_a fundamental tissue and simple flat epithelium is_an epithelial tissue. Similarly, attributes were obtained. For instance, has_attribute or is_attribute_of. An iterative process was carried out to represent histological and expert knowledge by providing a full narration of the instances, specific properties, and relations. Experts did a validation process after obtaining our representation of the knowledge.
Informal models obtained, in the last step, with CMs are converted into formal models which are computationally valid, using Web Ontology Language Overview (OWL) . Formal languages enable the encoding of knowledge and often include reasoning rules. Our histological ontology is expressed in OWL and implemented using Protégé .
The transformation from CMs models into an OWL model requires an interdisciplinary work. Domain experts develop part of the ontology by modelling their knowledge, with the assistance of knowledge engineers. Experts defined classes, properties and relations, with as much detail as possible, to obtain a consistent OWL model. Interdisciplinary work has advantages and challenges. One of the most important advantages is the possibility of covering topics in more depth, considering that there are many and varied perspectives for exploring a topic, to develop important discoveries. Challenges include arranging time for meetings, developing a common language and a knowledge baseline, dealing proactively with expectations and misunderstandings, focusing on a CM, and providing timely feedback.
In this section we present the results obtained using a three-fold approach to validate our ontology before putting it into use. First of all, we detected some of the most common pitfalls using OOPS!. Secondly, we performed expert evaluation using conceptual models. Thirdly, we evaluated how accurately the ontology answered our CQs.
We used OOPS! , a web tool for detecting the most common pitfalls in ontologies. OOPS! detects warnings in cases such as: reasoning problems, naming conventions, unconnected elements, modelling as well as reasoning problems and many others described in the catalogue. This evaluation enables to improve the maintainability, the accessibility and the clarity of the ontology.
After executing OOPS! with the histological ontology, we obtained a summary of the pitfalls encountered as presenting in Figs. 11 and 12. Figures show two pitfalls being detected as well as one suggestion and one warning in each case.
We use CMs for evaluating the ontology taking into account that CMs represent the conceptual scaffold of the knowledge we are representing. Although several criteria are used to validate ontologies, we are interested in the formal correctness of the ontology, as described in : (i) completeness based on covering all terms related to the cardiovascular system, (ii) duplication errors to eliminate ontology elements which are redundant, (iii) disjunction errors to define a class as a conjunction of distinct classes, and (iv) consistency and coherence based on checking if the current definitions have been accurately represented — syntactically and semantically.
Abacha and Zweigenbaum  propose a validation of medical ontologies through simple questions with only two possible answers (Yes/No) and a textual feedback. This method makes the evaluation easier for medical experts and they can interpret feedback easier. We used this method through the construction of a survey. The elaboration of this survey was addressed with four basic objectives: (i) identify elements that need to be validated, (ii) organise the elements to be validated, (iii) identify the characteristics to be validated in these elements, and (iv)interpret the feedback and make the necessary updates. We have made the complete survey publicly available at the following URL http://survey-megaspace.rhcloud.com/survey/index.php/656146?lang=es. The second step consists in providing the survey to our group of experts. The third step consists in interpreting expert’s feedback to validate or modify the ontology. We applied two different surveys. The first survey was applied in order to do an initial evaluation on the first version of our ontology, which was enhanced following the expert recommendations. This survey was taken by 20 students in the third year of Medicine and Surgery at Universidad del Valle. The second survey was taken by 51 experts from Latin America with different specialties (See Fig. 13), from which 32 have over 10 years of experience. Additionally, the action fields are 22 professor, 1 researcher and 28 both. The results of the surveys are summarised in Figs. 14, 15 and 16. Taking into account our criteria to evaluate, the experts’ evaluation tackles issues concerning concepts and logical relations.
Where possible, the first version of the ontology was enhanced by following the student’s recommendations. However, one of the drawbacks of the first survey was the lack of experience of the participants. For this reason, their answers were previously revalidated by an expert in order to take them into account.
Each evaluated criterion increased, when it is compared to the first survey, by (i) completeness 35,196%, (ii) duplication and disjunction 17,156%, (iii) consistency and coherence 20,000%. The results confirm that the new version had improved regarding the first one using the experts’ suggestions. Additionally, our ontology was designed in a modular way that enables an easy integration or reuse. In this way, the integration of other systems, such as the digestive and the respiratory, can be done without modifying the cardiovascular system.
We evaluate the capability of the ontology to answer the CQs, using SPARQL . SPARQL was used to represent the CQs to retrieve data from the ontology according to the query. SPARQL queries were created to verify if the ontology gives a correct answer for each CQ, https://github.com/claxima/HistologicalOntology/blob/master/SPARQL_Queries.pdf contains the complete document. CQ, SPARQL query and a figure with the result obtained are presented in the following examples:
CQ-0: What are the fundamental tissues? Figure 17 shows the obtained results.
CQ-1: What are the types of connective proper tissue? Figure 18 shows the obtained results.
CQ-2: What are the layers present in the heart? Figure 19 shows the obtained results.
CQ-3: Which are the elastic arteries? Figure 20 shows the obtained results.
A three-fold approach to validate the histological ontology was used — detecting pitfalls using OOPS!, expert evaluation using CMs, and how accurately the ontology can answer the Competency Questions (CQ).
Regarding the detecting pitfalls, the results suggest that “the domain and range axioms are equal for two object properties” and a warning refers to the convention used. However, those are not pitfalls in our case and do not affect the correctness of our ontology. It does not represent a problem, since it is about appearance or style of the ontology and does not compromise the proper ontology functioning.
The results shown that the experts agreed with the following aspects of our ontology: completeness, duplication and disjunction, and consistency. Completeness was tackled by the first question in each CM; some relevant concepts were added to the ontology after the first evaluation. Duplication and disjunction were evaluated based on the second question at each CM and we have also ensured that there were neither duplication nor conflict in the concepts. Consistency and coherence were covered in the third question at each CM.
The obtained results in the experts survey were crucial for us due to the feedback provided based on the large experience in histology. This means that the feedback was valuable for our research and the fact that we obtained positive results makes it possible to put the ontology into use.
The criteria for an ontology evaluation (consistency, completeness, conciseness, expandability and sensitiveness) are used to addresses the possible types of errors made and the future use. Exist reliable indications of the quality of terms and definitions in ontologies and taxonomies . However, the results obtained cannot be compared to other approaches in the state-of-the-art because these other works addressed different disciplines. Additionally, a key factor in the ontology evaluation is to evaluate and compare the ideas within the area .
In this paper, we presented a histological ontology of the human cardiovascular system. The ontology enables to represent histological knowledge with the purpose of processing, inferring and obtaining new, and more complete, knowledge. The histological ontology was built from histological analysis perspective, potentiating its use in teaching, medical practices and biomedical research. We believe that our ontology meets the current need for teaching and learning the concepts of the cardiovascular system, using tissues without pathologies.
In the future, we will extend the ontology to other systems using the same methodology adopted for this ontology. Extending the ontology is possible taking into account that the ontology was implemented in a modular way — tissues, organs and systems. Moreover, we will use the ontology in four specific applications: (i) crossing-references to other ontologies in order to enable interoperability and integration among standards and applications, (ii) labelling and retrieval images of the BISCAR dataset [35, 36], (iii) refining the automatic classification of histological images of the human cardiovascular system  and (iv) teaching histology lectures at University of Valle using online histological images dataset (BISCAR) and the histological ontology. Additionally, since the development of a histological ontology was not our final goal, our future research will be focused on other applications of the ontology, such as supporting research in different ways.
- OOPS! :
Ontology Pitfall scanner!
Web ontology language overview
SPARQL protocol and RDF query language
Toussaint PJ, Coiera E. Supporting communication in health care. Int J Med Inform. 2005; 74:779–81. doi:10.1016/j.ijmedinf.2005.04.007.
Wang HT, Tansel AU. Composite ontology-based medical diagnosis decision support system framework. Commun IIMA. 2013; 13(2):43–52.
Guefack VD, Gounot VB, Duvauferrier R, Bourde A, Morelli J, Lasbleiz J. Ontology driven decision support systems for medical diagnosis - an interactive form for consultation in patients with plasma cell disease. Qual Life Qual Inf. 2012:108–112. doi:10.3233/978-1-61499-101-4-108.
Bertaud-Gounot V, Duvauferrier R, Burgun A. Ontology and medical diagnosis. Inform Health Soc Care. 2012; 37(2):51–61.
Studer R, Benjamins R, Fensel D. Knowledge engineering: Principles and methods. Data Knowl Eng. 1998; 25:161–98.
BioPortal. GALEN. 2007. https://bioportal.bioontology.org/ontologies/GALEN. Accessed 27 June 2017.
Bodenreider O. The unified medical language system (umls): integrating biomedical terminology. Nucleic Acids Res. 2004; 32(suppl 1):267–70.
Lipscomb CE. Medical subject headings (mesh). Bull Med Libr Assoc. 2000; 88(3):265–6.
BioPortal. Kingsbury center for cancer care glossary. 2015. https://bioportal.bioontology.org/ontologies/NCIT. Accessed 27 June 2017.
BioPortal. MedicineNet Medical Dictionary. 2015. http://www.medicinenet.com/script/main/alphaidx.asp?p=a_dict. Accessed 27 June 2017.
BioPortal. Multilingual glossary of technical and popular medical terms in nine European languages. 1995. https://users.ugent.be/~rvdstich/eugloss/welcome.html. Accessed 27 June 2017.
BioPortal. International classification of diseases. 2007. https://bioportal.bioontology.org/ontologies/ICD10. Accessed 27 June 2017.
Vasquez H, Aguilera A, Tineo L. Ontologias medicas: una revision. Tecnol Gerencia Educ. 2010; 11:9–29.
Paslaru Bontas E, Tietz S, Tolksdorf R, Schrader T. Generation and management of a medical ontology in a semantic web retrieval system. Berlin, Heidelberg: Springer; 2004, pp. 637–53. doi:10.1007/978-3-540-30468-5_41. http://dx.doi.org/10.1007/978-3-540-30468-5_41.
Schofield PN, Sundberg JP, Sundberg BA, McKerlie C, Gkoutos GV. The mouse pathology ontology, mpath; structure and applications. J Biomed Semant. 2013; 4(1):1–8. doi:10.1186/2041-1480-4-18.
Colantonio S, Martinelli M, Salvetti O, Gurevich IB, Trusova YO. Cell image analysis ontology. Pattern Recognit Image Anal. 2008; 18(2):332–41. doi:10.1134/S1054661808020211.
Mungall CJ, Torniai C, Gkoutos GV, Lewis SE, Haendel MA. Uberon, an integrative multi-species anatomy ontology. Genome Biol. 2012; 13(1):5. doi:10.1186/gb-2012-13-1-r5.
Suarez-Figueroa MC, Gomez-Perez A. NeOn Methodology for Building Ontology Networks: a Scenario-based Methodology. In: Software Services & Semantic Technologies S3T 2009 International Conference, editor. Proceedings of the International Conference on Software, Services & Semantic Technologies (S3T 2009).2009.
Castro AG, Rocca-Serra P, Stevens R, Taylor C, Nashar K, Ragan MA, Sansone SA. The use of concept maps during knowledge elicitation in ontology development processes – the nutrigenomics use case. BMC Bioinforma. 2006; 7(1):1–14. doi:10.1186/1471-2105-7-267.
Noy NF, Mcguinness DL. Ontology development 101: A guide to creating your first ontology. Technical report. 2001.
Grüninger M, Fox M. Methodology for the Design and Evaluation of Ontologies. In: IJCAI’95, Workshop on Basic Ontological Issues in Knowledge Sharing, April 13, 1995.1995. http://citeseer.ist.psu.edu/grninger95methodology.html. Accessed 27 June 2017.
Rubin DL, Moreira DA, Kanjamala P, Musen MA. Bioportal: A web portal to biomedical ontologies. In: AAAI Spring Symposium: Symbiotic Relationships Between Semantic Web and Knowledge Engineering. AAAI: 2008. p. 74–7. http://dblp.uni-trier.de/db/conf/aaaiss/aaaiss2008-7.html#RubinMKM08. Accessed 27 June 2017.
BioPortal. Medical subject headings. 2008. http://purl.bioontology.org/ontology/MESH. Accessed 26 June 2017.
BioPortal. National Cancer Institute Thesaurus. 2014. http://purl.bioontology.org/ontology/NCIT. Accessed 26 June 2017.
BioPortal. Robert Hoehndorf Version of MeSH. 2014. http://purl.bioontology.org/ontology/RH-MESH. Accessed 26 Mar 2017.
BioPortal. Mouse Adult Gross Anatomy Ontology. 2014. http://bioportal.bioontology.org/ontologies/MA?p. Accessed 26 Mar 2017.
Gandon F. Distributed artificial intelligence and knowledge management: Ontologies and multiagent systems for a corporate semantic web. PhD thesis, University of Nice - Sophia Antipolis, Doctoral School of Sciences and Technologies of Information and Communication. 2002.
Canas A, Leake D, Wilson D. Managing, mapping and manipulating conceptual knowledge. In: AAAI Workshop Technical Report WS-99-10: Exploring the Synergies of Knowledge Management & Case-Based Reasoning Menlo. California: AAAI Press: 1999.
Hitzler P, Krötzsch M, Parsia B, Patel-Schneider PF, Rudolph S. OWL 2 Web Ontology Language: Primer.W3C Recommendation; 2009. Available at http://www.w3.org/TR/owl2-primer/. Accessed 27 June 2017.
Horridge M, Knublauch H, Rector A, Stevens R, Wroe C. Practical Guide To Building OWL Ontologies With The Protege-OWL Plugin, A, 1st ed. University of Manchester; 2004. http://mowlpower.cs.man.ac.uk/protegeowltutorial/resources/ProtegeOWLTutorialP4_v1_3.pdf. Accessed 27 June 2017.
Poveda-Villalón M, Gómez-Pérez A, Suárez-Figueroa MC. Oops! (ontology pitfall scanner!): An on-line tool for ontology evaluation. Int J Semant Web Inf Syst. 2014; 10(2):7–34. doi:10.4018/ijswis.2014040102.
Gómez-Pérez A. Ontology evaluation In: Steffen S, Rudi S, editors. Handbook on Ontologies. Berlin, Heidelberg: Springer: 2004. p. 251–74. doi:10.1007/978-3-540-24750-0_13, https://doi.org/10.1007/978-3-540-24750-0_13.
Abacha AB, Zweigenbaum P. MEANS: A medical question-answering system combining NLP techniques and semantic web technologies. Inf Process Manage. 2015; 51(5):570–94.
Prud’hommeaux E, Seaborne A. SPARQL Query Language for RDF. W3C Recommendation. 2008. http://www.w3.org/TR/rdf-sparql-query/. Accessed 27 June 2017.
Santamaria M, Muñoz Y, Cuellar E, Mazo C, Scotti S, Salazar L, Trujillo M. BISCAR: Banco de imágenes histológicas del sistema cardiovascular. Revista de Investigaciones Universidad del Quindio- Armenia, Colombia. 2014;104–5.
Santamaria M, Muñoz Y, Cuellar E, Mazo C, Scotti S, Salazar L, Trujillo M. BISCAR: Banco de imágenes histológicas del sistema cardiovascular. 2014. http://biscar.univalle.edu.co. Accessed 4 July 2017.
Mazo C, Alegre E, Trujillo M. Classification of cardiovascular tissues using lbp based descriptors and a cascade svm. Comput Methods Prog Biomed. 2017; 147:1–10. doi:10.1016/j.cmpb.2017.06.003.
This work has been supported by COLCIENCIAS and Asociación Universitaria Iberoamericana de Postgrado (AUIP). We are also grateful to Jhon Mauro Gomez for their online survey support.
The work described in this publication has been supported by the Spanish MINECO and co-financed by the BEI and FEDER through 4V project Ref: TIN2013-46238-C4-2-R.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Availability of data and materials
The histological ontology is publicly available at http://bioportal.bioontology.org/ontologies/HO and https://w3id.org/def/System, CQs: https://github.com/claxima/HistologicalOntology/blob/master/CompetencyQuestions.pdf, The complete survey: http://survey-megaspace.rhcloud.com/survey/index.php/656146?lang=es, SPARQL queries to verify if the ontology gives the correct answer for each CQ: https://github.com/claxima/HistologicalOntology/blob/master/SPARQL_Queries.pdf.