Volume 5 Supplement 1
SEE: structured representation of scientific evidence in the biomedical domain using Semantic Web techniques
© Bölling et al; licensee BioMed Central Ltd. 2014
Published: 3 June 2014
Accounts of evidence are vital to evaluate and reproduce scientific findings and integrate data on an informed basis. Currently, such accounts are often inadequate, unstandardized and inaccessible for computational knowledge engineering even though computational technologies, among them those of the semantic web, are ever more employed to represent, disseminate and integrate biomedical data and knowledge.
We present SEE (S emantic E videncE), an RDF/OWL based approach for detailed representation of evidence in terms of the argumentative structure of the supporting background for claims even in complex settings. We derive design principles and identify minimal components for the representation of evidence. We specify the Reasoning and Discourse Ontology (RDO), an OWL representation of the model of scientific claims, their subjects, their provenance and their argumentative relations underlying the SEE approach. We demonstrate the application of SEE and illustrate its design patterns in a case study by providing an expressive account of the evidence for certain claims regarding the isolation of the enzyme glutamine synthetase.
SEE is suited to provide coherent and computationally accessible representations of evidence-related information such as the materials, methods, assumptions, reasoning and information sources used to establish a scientific finding by adopting a consistently claim-based perspective on scientific results and their evidence. SEE allows for extensible evidence representations, in which the level of detail can be adjusted and which can be extended as needed. It supports representation of arbitrary many consecutive layers of interpretation and attribution and different evaluations of the same data. SEE and its underlying model could be a valuable component in a variety of use cases that require careful representation or examination of evidence for data presented on the semantic web or in other formats.
Scientific evidence, as a concept, can be defined as information that is relevant to assess the likelihood that a particular scientific idea is correct. Representation of the corresponding evidence is therefore key to evaluating hypotheses and assessing claims contained in scientific articles, databases or any other repository of scientific information. Biomedical knowledge is often highly context-dependent and based on evidence obtained from the skilful combination and evaluation of individual results, involving, among other aspects, a range of model organisms, diverse experimental and computational techniques, different forms of interpretation, and various inference schemes. Consequently, all those aspects - the materials, methods and information sources used, the observations made, the reasoning employed and the context-specific assumptions made - are important for comprehensive evidence accounts. Likewise, when data, often from disparate sources, is integrated to study complex biological systems an account of the evidence that was used to infer a model's properties and those of and among its components is critical for correct and transparent understanding of that model.
Scientific findings are now routinely published as resources on the World Wide Web. Besides electronic versions of natural language texts more and more information from both new and legacy sources becomes available through databases  and web services  which provide through structured formats and interfaces consolidated views of and programmatic access to biomedical data. Semantic web technologies and standards in particular offer by virtue of their well-defined semantics and broad applicability potent means for the computational integration and analysis of biomedical data from heterogeneous and distributed sources on a large scale [3–5]. Accordingly, the Resource Description Framework (RDF, ) is increasingly employed to represent and disseminate new and legacy biomedical data [7, 8] and biomedical ontologies specified in the Web Ontology Language (OWL, ) are being developed to encode domain-specific knowledge and annotate data from biomedical investigations [10–12]. As with any other means for communicating scientific results, findings encoded in semantic web formats need to be accompanied by an account of how they have been established to evaluate their relevance. Towards this end different models, tools and methods have been proposed: for representing and evaluating research hypotheses [13, 14], contextualization , models of discourse , of argument , extended means for annotation [18, 19], or specific container formats . There is, however, currently no dedicated model supporting a coherent, extensible and semantic-web compatible representation of all those aspects routinely considered by a researcher inspecting the evidence for a given scientific finding, i.e. a representation of (i) the experimental and computational methods and settings that were used to establish the observational results and process the data, (ii) the reasoning including additional findings and assumptions used to infer the result in question, and (iii) information sources and agents through which the corresponding views were communicated and propagated.
Here we introduce SEE (S emantic E videncE), an RDF/OWL based approach for providing detailed, extensible and computationally accessible accounts of evidence even in complex settings. SEE is designed to enable the fabric of observations, methods, assumptions, and inferences examined by researchers to evaluate the evidence for a claim to be formally represented along with their sources using semantic web techniques. Evidence is captured in terms of the argumentative structure of the supporting background for a claim i.e., by a coherent representation of claims, of the entities the claims are about, of the argumentative relations between the claims and of claim provenance. SEE accommodates nested layers of interpretation and attribution and different evaluations based on the same data. We demonstrate its application in a case study that is typical for the task of collecting, representing and evaluating evidence for systems biology approaches such as genome-scale metabolic network reconstruction by providing an expressive account of evidence for the location of the enzyme glutamine synthetase.
Overview of the SEE approach
The SEE approach for representing evidence consists of providing (i) a formal representation of scientific claims, their provenance and the argumentative structure used to justify them by other claims, (ii) a formal representation of claim content and (iii) a coherent integration of the two. SEE relies on an abstract model for the representation of claims, provenance and argumentative structure specified in the Reasoning and Discourse Ontology (RDO), a lightweight OWL vocabulary developed for this purpose. Claim content e.g., what is claimed regarding the properties of biological entities or the results and methods of an investigation is represented in RDF graphs by using appropriately defined semantic web resources and design patterns which as a best practice should, if possible, be re-used from existing domain ontologies. The connection between claims as representational primitives and their content relies on named RDF graphs  which enable pointing to collections of RDF-triples or OWL-axioms serialized as such.
After outlining general requirements and design principles for representation of evidence we describe the RDO. We then demonstrate the application and design patterns of the SEE approach in a case study generating an expressive representation of evidence reported in the literature for the location of the enzyme glutamine synthetase.
Deriving design principles and requirements for representation of evidence
We posit two design principles for the representation of evidence and explain their rationale in the following:
DP1: Representation of evidence amounts to representation of claims and argumentative structure.
DP2: Evidence relations in the sense of "A is evidence for B" obtain between the things being claimed.
Accounts of evidence are directed towards the justification of scientific claims. The SEE approach is based on the notion that scientific claims put forward possible, more or less likely scenarios and outcomes - states of affairs  - as being accurate descriptions of a subject of scientific inquiry. Something is evidence for a certain state of affairs, if and only if it gives reason to believe that this state of affairs in fact obtains . A pairing of evidence and what it is claimed to be evidence for therefore corresponds to the set of premises and the conclusion of an argument in which the truth of the premises alleges to give reason to believe the conclusion is true. Therefore the evidence used by authors or agents to justify a claim, possibly using further unstated background assumptions, can be mirrored by an argumentative structure having the claim as its conclusion. Typically, what is used to justify the authors conclusions within this argumentative structure are claims in themselves accepted as true on the basis of observations or inferences of the same or of other investigators. SEE, therefore, models evidence relations in the sense of "A is evidence for B" specifically as relations between claims.
We derive two additional requirements:
DP3: A researcher's assessment of the evidence for a finding usually includes evaluation of which materials and methods were used, what kind of data was obtained and which properties were observed, inferred or assumed to establish the finding. Consequently, a representation of the materials, methods, data items and other elements forming the subject of a claim should be part of a computationally accessible evidence representation. In RDF and OWL the subject of a claim, a state of affairs, must be expressed, using appropriately defined resources, as (one or more) triples and axioms, respectively. It follows then, in accordance with DP2 that in an RDF/OWL-based representation of evidence that includes claim subjects the representation of evidential relationships should operate between claim subject representations, i.e. between sets of RDF-triples and/or OWL-axioms.
DP4: Representation of claims and hence representation of evidence must take into account claim provenance, in particular through which source and by which agents the claims were made. Knowing which agent made the claim is crucial for evaluating independence and reproducibility. Tracking the original source of a claim provides a natural reference point for all subsequent representations of the claim and its supporting background and for re-evaluation of the claim within the original context in which it was communicated.
We therefore identify as minimal components for modelling evidence elements representing (i) scientific claims and the argumentative structure used to justify them by other claims, (ii) the subjects of the claims i.e. that what is claimed with regard to a subject of inquiry, (iii) the agents making the claims and arguments, (iv) the sources in which claims were originally made e.g., the original scientific articles or database records.
Reasoning and Discourse Ontology (RDO)
Based on the foregoing we developed an abstract model for representation of evidence in terms of claims, their argumentative structure and their provenance. It is specified here as the Reasoning and Discourse Ontology (RDO) using the Web Ontology Language (OWL). This section outlines the core classes and properties of RDO. Full, formal specification of all RDO constructs is provided in the ontology file provided as additional file 1.
Application: representation and evaluation of evidence for a source of glutamine synthetase
Introducing the case study
We applied SEE to generate a computationally accessible, expressive and extensible account of evidence gathered in the literature regarding a claimed source of the enzyme glutamine synthetase (GS). We have chosen this particular test case because obtaining reliable information on location of enzyme activities is a subject area of particular importance for systems biology approaches such as the reconstruction of cell-type specific  or organism-level  metabolic networks. Furthermore, it embodies the typical task of acquiring knowledge on a subject of inquiry by extracting and combining evidence from different sources.
Starting point is our evaluation of a scientific journal article  (referred to as 'Meister 1985' in the following) authored by Alton Meister which asserts in the second paragraph of the text, among other things, that the enzyme glutamine synthetase (GS) was isolated from rat liver. This assertion is based, by way of citation, on the contents of another article by Tate, Leu and Meister  (referred to as 'Tate 1972' in the following). In Tate 1972 the isolation of GS from rat liver is reported. The finding is reported to be based on an investigation which involved, among other things, extraction of rat livers, protein purification and γ-glutamyl hydroxamate synthesis (γ-GHS) assays. In the following we show how this context is formalized using the SEE approach to yield a detailed formal account of the evidence presented through these articles for rat liver as source of GS. In doing so, we illustrate various design patterns used in SEE for representing the relevant items. For clarity assertion instances will be indexed as A1, A2, and so forth.
Representing the evidence
The prevalent pattern in SEE for recording individual and logically relevant steps of an investigation is for any such step to link its outcomes (data or material), the techniques used to produce these outcomes, and their objectives as exemplified in the composite assertions comprising assertions A9-A12 and A15-A20 (Figure 4). In A9-A12, for example, the experimental process type (γ-GHS assay) is linked to the objective of its application (GS-activity measurement) and in turn to the quality that is intended to be determined (GS-activity). Generally, the relations between these ontologically different entities are not trivial and not one-to-one (one objective can consist of the determination of several qualities recognized in a scientific domain, a certain quality can be the subject of inquiry in several objectives). However, in this particular case the objective and quality are narrowly defined and directly correlated.
Representation of assertion subjects
To generate the graph representations of the assertion subjects, the natural language expressions of the assertions identified in the Meister 1985 and Tate 1972 reports were formalized in RDF using appropriately defined resources (see additional files 2, 3 and 4). Most assertion subjects could be formalized in a straightforward manner applying OWL 2 RDF-based semantics . The principal claim that "glutamine synthetase was isolated from rat liver" which is the common subject of assertions A1 and A2 was formalized in RDF by instantiating the class gs_enzyme and is_isolated_from some rat_liver (shown as :proposition-1 in additional file 3). This exemplifies instantiation of the OWL-class (A and related_to some B) as a design pattern for formalization of statements which can, in natural language, be represented in the form "some A related to some B" (A B denoting OWL-classes used to represent the types A and B, respectively and related_to denoting an OWL-property used to represent the relation among some of their instances).
Labels of assertion and corresponding proposition instances are directly derived from the graph representation of the assertion subject (see methods section). In particular, the label "some A related_to some B" is used for proposition instances that represent statements of the form "some A related to some B" by applying the design pattern described above.
Representing consecutive layers of interpretation and own conclusions
Evaluating the test case evidence representation
The test case evidence representation that was created using the RDO constructs and design patterns was evaluated in terms of its potential to answer, within the confines of the case study, a list of competency questions reflecting different aspects of the evidence a researcher investigating glutamine synthetase knowledge would be interested in:
Q1: Which locations of GS have been asserted?
Q2: Where has rat liver GS been reported?
The Meister 1985 and Tate 1972 reports.
Q3: Do the assertions made in these reports pertain to independent observations?
No. Meister's assertion is based on Tate et al.'s assertion. Moreover, some of the authors of the two reports are identical.
Q4: Is there experimental evidence and where is it described?
Yes. In the Tate 1972 report.
Q5: Which observations and techniques were used for establishing rat liver as GS source?
1. extraction of a protein sample from rat liver (technique: TLM purification)
2. that sample has GS-activity (technique: γ-GHS assay)
Q6: Did Tate et al. really make these observations and conclusions? Who created this account of their findings?
all assertions which are directly or indirectly used to infer a given assertion
all assertions made in a given report
all assertions made by a given agent
all assertions on the same subject
all agents making assertions on a given subject
SEE offers a tangible interpretation of the concept of evidence in terms of the argumentative structure of the supporting background for a claim. It rests on the disctinction between claims as such (assertion), their subjects (proposition) and the linguistic form in which these subjects are communicated (text). As a consequence of this design evidential relations (as in "A is evidence for B") can be represented consistently as relations between assertions. This means that statements of the form "this dataset / experiment / publication / method is evidence for B" are regarded as figurative expressions. Instead, the relation between a dataset, an experiment or a publication and the state of affairs it is claimed to be evidence for is represented indirectly through relations between assertions the subjects of which relate to the entities in question. The advantage of this design is that it enables a coherent representation not only of extensive argumentative networks but also of arbitrary many layers of consecutive interpretations and alternative evaluations of the same observations or information sources. RDO offers clear, formally defined types and relations for representing claims, their subjects, their linguistic representations, related information sources and agents on the basis of well established concepts from epistemology and the philosophy of language [22, 24, 25, 33, 34]. The case study examples suggest that the SEE design principles and their implementation in RDO are capable of correctly representing, in a computationally accessible and coherent form, the entire 'evidence trail' for a claim needed to evaluate its relevance including observational data, research techniques, assumptions and information sources.
SEE represents argumentative structure at its foundational level of premises being used to infer a conclusion using the is_directly_inferred_from property and its transitive superproperty is_inferred_from. This allows for a coherent representation of different argument forms and larger rhetorical structures which can be mapped onto their underlying assertions.
SEE aims to capture arguments as they are presented in their sources rather than to evaluate their quality or to categorize them. How conclusive an argument is will typically depend on agent background knowledge or application-dependent requirements. The SEE design enables users to evaluate evidence according to their own, possibly domain- and application-specific criteria.
SEE-based accounts could also be used alongside specified rules, or argument forms considered as acceptable by individual researchers or within specific domains of inquiry which could then be leveraged to automatically infer new assertions on the basis of the already asserted information.
With regard to the extraction of assertion subjects and a specific argumentative structure from a natural language text SEE relies in its current form on a heuristic approach leveraging expert domain knowledge to identify assertions and formalize them in OWL. As OWL is a subset of first order logic there may be statements from natural or artificial languages which cannot directly be translated into OWL, constraining the formalization of assertion subjects in SEE. It is, however, not clear which actual limitations arise from this theoretical constraint for the representation of evidence in specific use cases. The test case presented here suggests that within a specified domain of discourse, using appropriate constructs and design patterns, the relevant contents of the statements made originally in a context-rich narrative format such as a scientific journal article can be adequately formalized.
Formalization of natural language statements is an important prerequisite for computational approaches to data evaluation. For applications that can forego this need the statements can be represented in their original form as texts or referenced by links to the original information sources. Both are by default designed to be provided in SEE as reference points for evaluation.
The presented design patterns make SEE-based accounts of evidence extensible. This design is in line with the open world assumption on which RDF and OWL as knowledge representation languages operate. The particular argumentative structure and level of detail presented in the case study are based on heuristics reflecting domain-specific requirements to understand how an enzyme was characterised. This representation can be extended or shortened as required. For example, details on the protein purification process performed by Tate et al. or indeed any other detail that becomes relevant for the evaluation of the presented evidence could be appended to the existing assertions. Likewise, as we have demonstrated, alternative views and conclusions can be accommodated. On the other hand, for applications which only require information on claim provenance, only the source publications of the main claims could be represented.
Evidence type schemes provide a useful shorthand categorization of research techniques used to establish a claim. SEE could be aligned with any categorization of research techniques and hence evidence type scheme to characterise the evidence for an assertion. Essentially, SEE provides a platform to define custom, extensible evidence types and apply them as needed. For example, the evidence for rat liver as a source of GS in the test case could be characterised as "experimental evidence" as "based on a direct assay" as "based on a γ-GHS-assay" or as "based on a γ-GHS assay, protein purification involving Sephadex chromatography, and samples from Sprague-Dawley rats" depending on the level of accuracy desired.
The flexibility and extensibility of the SEE approach may also be useful to characterise evidence where several techniques have been combined to establish a scientific result or evidence is characterised in combination with claim provenance. We illustrate this with a comparison to the Gene Ontology (GO) evidence codes which are meant to reflect the type of work or analysis described in the cited reference which supports the GO term to gene product association . GO evidence codes consist of a collection of terms arranged in a hierarchical format. In this taxonomy the terms representing justifications based on author statements (TAS, NAS) are unrelated to those representing experimental techniques (EXP and child terms). Consequently, GO associations marked as being made on the basis of an author statement are usually not qualified with respect to how this author statement came about. In contrast, as demonstrated in the case study, using SEE any author statement can be extensively qualified in terms of the experimental evidence or other author statements it is directly or indirectly based on.
providing supporting background information for biomedical knowledge bases,
creating digital abstracts of research publications,
adding a claim-level perspective on research publications which could be used by publishers, in bibliographic databases and in personal bibliography managers,
providing open linked data which can be integrated on an informed basis using varying, application specific evidence criteria.
Related and future work
The SWAN biomedical discourse ontology  developed in the context of the Semantic Web Applications in Neuromedicine (SWAN) project offers a formal model of scientific discourse based on two different classes of statements; swan:hypothesis and swan:claim. Claim subjects are to be represented in natural language and the resolution of their supporting background is confined to the document level. The Annotation Ontology (AO)  has been implied as a means to provide formalized accounts of claims and their supporting background conceptualized as annotations and document parts, respectively. While it is possible in this way to relate individual ontology terms to parts of documents, the AO semantics and use cases suggest that its main application area is representation and support of annotations of documents rather than representation and evaluation of extensive, possibly nested, networks of claims. Nanopublications have been proposed as a container format to encode and publish individual assertions using Semantic Web and Linked Data principles . Ideas to include basic evidence-related information such as references to an information source or a research technique in the provenance portion of a nanopublication have been sketched  but appear not to be formally defined as part of a normative specification. The recently drafted micropublications model  shares scope with SEE with regard to the representation of extensively justified claims. The models use structurally different conceptualizations which lead to different design patterns for representing claims, their provenance, and the evidence for a claim (see additional file 6).
The central focus of the SEE approach is to provide a formalized account of evidence as claims, their subjects and their argumentative structure using clearly defined concepts and semantics. From this perspective SEE and related works may be seen as complementary: The basic notion of a report part in RDO could be complemented with AO's rich set of selectors as pointers to various elements of scientific reports. Recent alignment of the Citation Typing Ontology (CiTO) and SWAN produced a consolidated set of constructs to characterise bibliographic references . Potentially, nanopublications could be enhanced by using SEE as a model for representing evidence. Also, exploring links of RDO constructs to upper-level ontologies such as SIO  or BFO  might be beneficial for integration of SEE with other biomedical ontologies.
Claims made in scientific research communications are usually embedded in a contextually and rhetorically rich narrative and attenuated by expressions of epistemic modality . Adding such assertions of certainty to the representation will be an important extension of the SEE approach. Likewise, definition of domain- and application-specific patterns of relevant claims and arguments will be of great value for streamlining the generation of formalized evidence accounts as well as for leveraging text mining approaches for computational identification and extraction of claim subjects and argumentative structure.
SEE (S emantic E videncE) is an approach to represent scientific evidence in terms of the argumentative structure of the supporting background. The presented case study suggests that SEE is capable to provide a computationally accessible account of evidence even in complex settings. SEE enables a coherent representation of evidence-related information such as the materials, methods, assumptions, reasoning and information sources used to establish a scientific finding by adopting a consistently claim-based perspective on scientific results. SEE allows for extensible evidence representations, in which the level of detail can be chosen as needed and existing accounts can be extended. Its design permits representation of arbitrary many layers of consecutive interpretation and attribution as well as different evaluations of the same data. SEE is specified as an RDF/OWL based approach for integration with other semantic web resources and linked open data environments but its underlying model can also be used in other knowledge engineering and knowledge representation approaches.
Protégé 4  was used as ontology engineering environment for developing and testing RDO. Named graph representations were prepared according to the TriG specification . Resources used to represent the case study entities were defined in the http://purl.org/see/gsexample# namespace to provide a homogeneous representation layer independent of mappings to other ontologies or resources. Mappings of individual constructs to other biomedical ontologies were researched using Ontobee  and are listed in additional file 4. Representation of biochemical entities (e.g. GS-enzyme, GS-activity) follows the approach described in . The representation of intermediate steps of the investigation described in Tate et al.  uses in part design patterns adapted from patterns originally specified for the Ontology for Biomedical Investigations (OBI) [45–47].
We have adopted the following nomenclature for labelling proposition and assertioninstances. Labels of proposition instances are derived from the labels of the resources used in its associated graph representation and the type of axiom involved. For restrictions, subclass axioms and type declarations the corresponding keywords of the Manchester OWL Syntax  are used. Proposition instances whose graph representation is derived from formalizing a statement of the form "some A related to some B" i.e. consists of the instantiation of a class (A and related_to some B) are alternatively labelled as "some A related_to some B". Assertion instance labels are specified on the basis of the labels of corresponding proposition instances (linked via rdo:asserts) and agents (linked via rdo:is_assertion_made_by). If "P" is the proposition label and "A" is the agent label, the assertion is labelled as "! P ! A". Multiple propositions are concatenated by " AND ". Multiple agents are separated by a space symbol. For our case study, author names are further abbreviated by their initials. The rationale of this nomenclature is that it allows to quickly understand what is asserted and who asserts, maintains a clear connection between assertion and proposition, maintains a connection to the formal representation of the assertion subject and singles out assertions as being labelled with a leading exclamation mark.
We thank Andreas Hoppe and Matthias König for helpful discussions and input. We also thank two anonymous reviewers for their comments which led to an improved presentation of this work. CB and MW were supported by the German Federal Ministry of Education and Research (BMBF) within the Virtual Liver Network (grant numbers 0315756, 0315746). This work was conducted using the Protégé resource, which is supported by grant GM10331601 from the National Institute of General Medical Sciences of the United States National Institutes of Health.
Publication of this article was funded by the Virtual Liver project of the German Federal Ministry of Education and Research, grant no. 0315741.
This article has been published as part of Journal of Biomedical Semantics Volume 5 Supplement 1, 2014: Proceedings of the Bio-Ontologies Special Interest Group 2013. The full contents of the supplement are available online at http://www.jbiomedsem.com/supplements/5/S1.
- Fernández-Suárez XM, Galperin MY: The 2013 Nucleic Acids Research Database Issue and the online molecular biology database collection. Nucleic Acids Res. 2013, 41: D1-D7. 10.1093/nar/gks1297.View ArticleGoogle Scholar
- Benson G: Editorial. Nucleic Acids Research. 2013, 41: W1-W2. 10.1093/nar/gkt559.View ArticleGoogle Scholar
- Ruttenberg A, Clark T, Bug W, Samwald M, Bodenreider O, Chen H, Doherty D, Forsberg K, Gao Y, Kashyap V: Advancing translational research with the Semantic Web. BMC Bioinformatics. 2007, 8 (Suppl 3): S2-10.1186/1471-2105-8-S3-S2.View ArticleGoogle Scholar
- Antezana E, Kuiper M, Mironov V: Biological knowledge management: the emerging role of the Semantic Web technologies. Brief Bioinform. 2009, 10: 392-407. 10.1093/bib/bbp024.View ArticleGoogle Scholar
- Chen H, Yu T, Chen JY: Semantic Web meets Integrative Biology: a survey. Brief Bioinform. 2013, 14: 109-125. 10.1093/bib/bbs014.View ArticleGoogle Scholar
- Schreiber G, Raimond Y: RDF 1.1 Primer. [http://www.w3.org/TR/2014/NOTE-rdf11-primer-20140225/]
- Callahan A, Cruz-Toledo J, Dumontier M: Ontology-Based Querying with Bio2RDF's Linked Open Data. J Biomed Semantics. 2013, 4 (Suppl 1): S1-10.1186/2041-1480-4-S1-S1.View ArticleGoogle Scholar
- Willighagen EL, Waagmeester A, Spjuth O, Ansell P, Williams AJ, Tkachenko V, Hastings J, Chen B, Wild DJ: The ChEMBL database as linked open data. J Cheminform. 2013, 5: 23-10.1186/1758-2946-5-23.View ArticleGoogle Scholar
- Hitzler P, Krötzsch M, Parsia B, Patel-Schneider PF, Rudolph S: OWL 2 Web Ontology Language: Primer. [http://www.w3.org/TR/owl2-primer/]
- Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, Goldberg LJ, Eilbeck K, Ireland A, Mungall CJ: The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007, 25: 1251-1255. 10.1038/nbt1346.View ArticleGoogle Scholar
- Luciano JS, Andersson B, Batchelor C, Bodenreider O, Clark T, Denney CK, Domarew C, Gambet T, Harland L, Jentzsch A: The Translational Medicine Ontology and Knowledge Base: driving personalized medicine by bridging the gap between bench and bedside. J Biomed Semantics. 2011, 2 (Suppl 2): S1-10.1186/2041-1480-2-S2-S1.View ArticleGoogle Scholar
- Whetzel PL: Powering semantically aware applications. J Biomed Semantics. 2013, 4 (Suppl 1): S8-10.1186/2041-1480-4-S1-S8.View ArticleGoogle Scholar
- Callahan A, Dumontier M, Shah NH: HyQue: evaluating hypotheses using Semantic Web technologies. J Biomed Semantics. 2011, 2 (Suppl 2): S3-10.1186/2041-1480-2-S2-S3.View ArticleGoogle Scholar
- Soldatova LN, Rzhetsky A: Representation of research hypotheses. J Biomed Semantics. 2011, 2 (Suppl 2): S9-10.1186/2041-1480-2-S2-S9.View ArticleGoogle Scholar
- Serafini L, Homola M: Contextualized knowledge repositories for the Semantic Web. Web Semantics: Science, Services and Agents on the World Wide Web. 2012, 64-87. 12-13
- Ciccarese P, Wu E, Wong G, Ocana M, Kinoshita J, Ruttenberg A, Clark T: The SWAN biomedical discourse ontology. J Biomed Inform. 2008, 41: 739-751. 10.1016/j.jbi.2008.04.010.View ArticleGoogle Scholar
- Rahwan I, Banihashemi B: Arguments in OWL: A Progress Report. In Proceedings of the 2008 conference on Computational Models of Argument (COMMA 2008); Amsterdam, The Netherlands. 2008, IOS Press, 297-310.Google Scholar
- Ciccarese P, Ocana M, Castro LJG, Das S, Clark T: An open annotation ontology for science on web 3.0. J Biomed Semantics. 2011, 2 (Suppl 2): S4-10.1186/2041-1480-2-S2-S4.View ArticleGoogle Scholar
- Ciccarese P, Ocana M, Clark T: Open semantic annotation of scientific publications using DOMEO. J Biomed Semantics. 2012, 3 (Suppl 1): S1-10.1186/2041-1480-3-S1-S1.View ArticleGoogle Scholar
- Gibson A, van Dam JCJ, Schultes EA, Roos M, Mons B: Towards Computational Evaluation of Evidence for Scientific Assertions with Nanopublications and Cardinal Assertions. In Proceedings of the 5th International Workshop on Semantic Web Applications and Tools for Life Sciences (SWAT4LS) Paris, France. 2012, 28-30.Google Scholar
- Carroll J, Bizer C, Hayes P, Stickler P: Named Graphs. Web Semantics: Science, Services and Agents on the World Wide Web. 2005, 3:Google Scholar
- Textor M: States of Affairs. The Stanford Encyclopedia of Philosophy. Edited by: Zalta EN. 2012, Summer 2012 edition, [http://plato.stanford.edu/archives/sum2012/entries/states-of-affairs/]Google Scholar
- Achinstein P: The book ef evidence. 2001, New York: Oxford University PressView ArticleGoogle Scholar
- Pagin P: Assertion. The Stanford Encyclopedia of Philosophy. Edited by: Zalta EN. 2008, Fall 2008 edition, [http://plato.stanford.edu/archives/fall2008/entries/assertion/]Google Scholar
- McGrath M: Propositions. The Stanford Encyclopedia of Philosophy. Edited by: Edited by Zalta EN. 2012, Summer 2012 editionGoogle Scholar
- Gille C, Bölling C, Hoppe A, Bulik S, Hoffmann S, Hübner K, Karlstädt A, Ganeshan R, König M, Rother K: HepatoNet1: a comprehensive metabolic reconstruction of the human hepatocyte for the analysis of liver physiology. Mol Syst Biol. 2010, 6: 411-View ArticleGoogle Scholar
- Thiele I, Swainston N, Fleming RMT, Hoppe A, Sahoo S, Aurich MK, Haraldsdottir H, Mo ML, Rolfsson O, Stobbe MD: A community-driven global reconstruction of human metabolism. Nat Biotechnol. 2013, 31: 419-425. 10.1038/nbt.2488.View ArticleGoogle Scholar
- Meister A: Glutamine synthetase from mammalian tissues. Methods Enzymol. 1985, 113: 185-199.View ArticleGoogle Scholar
- Tate SS, Leu FY, Meister A: Rat liver glutamine synthetase. Preparation, properties, and mechanism of inhibition by carbamyl phosphate. J Biol Chem. 1972, 247: 5312-5321.Google Scholar
- Schneider M, Carroll J, Herman I, Patel-Schneider PF: OWL 2 Web Ontology Language RDF-Based Semantics (Second Edition). [http://www.w3.org/TR/2012/REC-owl2-rdf-based-semantics-20121211/]
- Wellner VP, Meister A: Binding of adenosine triphosphate and adenosine diphosphate by glutamine synthetase. Biochemistry. 1966, 5: 872-879. 10.1021/bi00867a010.View ArticleGoogle Scholar
- SPARQL 1.1 Overview. The W3C SPARQL Working Group, [http://www.w3.org/TR/2013/REC-sparql11-overview-20130321/]
- Brown J, Cappelen H: Assertion: new philosophical essays. 2011, New York; Oxford: Oxford University PressView ArticleGoogle Scholar
- Werlich E: A text grammar of English. Edited by: Heidelberg: Quelle & Meyer. 1983, 2 ednGoogle Scholar
- du Plessis L, Skunca N, Dessimoz C: The what, where, how and why of gene ontology--a primer for bioinformaticians. Brief Bioinform. 2011, 12: 723-735. 10.1093/bib/bbr002.View ArticleGoogle Scholar
- Mons B, Velterop J: Nano-Publication in the e-science era. Proceedings of the Workshop on Semantic Web Applications in Scientific Discourse (SWASD 2009), collocated with the 8th International Semantic Web Conference (ISWC-2009), Washington DC, USA. 2009Google Scholar
- Clark T, Ciccarese P, Goble CA: Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications. [http://arxiv.org/abs/1305.3506]
- Ciccarese P, Shotton D, Peroni S, Clark T: CiTO + SWAN: The Web Semantics of Bibliographic Records, Citations, Evidence and Discourse Relationships. Semantic Web Journal: Interoperability, Usability, Applicability. 2013Google Scholar
- Dumontier M, Baker CJO, Baran J, Callahan A, Chepelev L, Cruz-Toledo J, Del Rio NR, Duck G, Furlong LI, Keath N: The Semanticscience Integrated Ontology (SIO) for biomedical research and knowledge discovery. J Biomed Semantics. 2014, 5: 14-10.1186/2041-1480-5-14. [http://www.jbiomedsem.com/content/5/1/14]View ArticleGoogle Scholar
- Grenon P, Smith B, Goldberg LJ: Biodynamic Ontology: Applying BFO in the biomedical domain. Pisanelli DM: IOS Press. 2004, 20-38.Google Scholar
- de Waard A, Schneider J: Formalising Uncertainty: An Ontology of Reasoning, Certainty and Attribution (ORCA). Proceedings of the Joint Workshop on Semantic Technologies Applied to Biomedical Informatics and Individualized Medicine (SATBI+SWIM 2012), collocated with the International Semantic Web Conference (ISWC 2012), Boston MA, USA, October 11, 2012. 2012Google Scholar
- The Protégé Ontology Editor and Knowledge Acquisition System. [http://protege.stanford.edu]
- Xiang Z, Mungall C, Ruttenberg A, He Y: Ontobee: A Linked Data Server and Browser for Ontology Terms. Proceedings of the 2nd International Conference on Biomedical Ontologies (ICBO); July 28-30. 2011, 279-281.Google Scholar
- Bölling C, Dumontier M, Weidlich M, Holzhütter H-G: Role-based representation and inference of biochemical processes. Proceedings of the 3rd International Conference on Biomedical Ontology (ICBO 2012) Graz, Austria, July 21-25, 2012. 2012, [http://ceur-ws.org/Vol-897/session3-paper14.pdf]Google Scholar
- Brinkman RR, Courtot M, Derom D, Fostel JM, He Y, Lord P, Malone J, Parkinson H, Peters B, Rocca-Serra P: Modeling biomedical experimental processes with OBI. J Biomed Semantics. 2010, 1 (Suppl 1): S7-10.1186/2041-1480-1-S1-S7.View ArticleGoogle Scholar
- OBI general model. [http://obi-ontology.org/page/Investigation]
- OBI case study. [http://obi-ontology.org/page/Lauwereyns2002]
- Horridge M, Patel-Schneider PF: OWL 2 Web Ontology Language Manchester Syntax (Second Edition). [http://www.w3.org/TR/2012/NOTE-owl2-manchester-syntax-20121211]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.