- Open Access
TermGenie – a web-application for pattern-based ontology class generation
Journal of Biomedical Semantics volume 5, Article number: 48 (2014)
Biological ontologies are continually growing and improving from requests for new classes (terms) by biocurators. These ontology requests can frequently create bottlenecks in the biocuration process, as ontology developers struggle to keep up, while manually processing these requests and create classes.
TermGenie allows biocurators to generate new classes based on formally specified design patterns or templates. The system is web-based and can be accessed by any authorized curator through a web browser. Automated rules and reasoning engines are used to ensure validity, uniqueness and relationship to pre-existing classes. In the last 4 years the Gene Ontology TermGenie generated 4715 new classes, about 51.4% of all new classes created. The immediate generation of permanent identifiers proved not to be an issue with only 70 (1.4%) obsoleted classes.
TermGenie is a web-based class-generation system that complements traditional ontology development tools. All classes added through pre-defined templates are guaranteed to have OWL equivalence axioms that are used for automatic classification and in some cases inter-ontology linkage. At the same time, the system is simple and intuitive and can be used by most biocurators without extensive training.
Biological ontologies such as the Gene Ontology (GO) and the Human Phenotype Ontology (HP) provide a rich set of constructs for describing biological entities such as genes, alleles and diseases. Like most data resources, ontologies are rarely complete, and healthy ontologies are continually growing and improving, as the state of knowledge progresses. One process by which ontologies grow is from requests for new classes (terms) by biocurators. These ontology requests can frequently create bottlenecks in the biocuration process, as ontology developers struggle to keep up with a deluge of requests.
Historically the process used in projects such as the GO Consortium would be for ontology developers to work through a set of requests collected in an issue tracking system, and to manually add them to the ontology, using a specialized Ontology Development Tool (ODT) such as OBO-Edit  – see Figure 1. Sometimes the ontology developers apply documented design patterns to guide this process, particularly where collections of classes follow a common structure. For example, most classes in the developmental process portion of the GO follow a consistent lexical form and relational structure as dictated in the GO developers documentation . However, even with this documentation in place, this has still largely been a time-consuming and error-prone manual process, especially where ontology developers need to rearrange to the ontology structure.
Use of the Web Ontology Language (OWL), and in particular providing computable definitions in the form of equivalence axioms can greatly assist in ontology development and maintenance through the use of OWL reasoners. However, reasoners do not in themselves help with the task of class generation. Furthermore, for many biological ontologies, the axioms necessary for reasoning have been added post-hoc [3, 4] rather than prospectively at the time of class creation. This kind of retrospective axiomatization is inefficient but has in part been dictated by limitations of OBO-Edit. This can be partly circumvented by using an ODT that fully supports OWL such as Protégé, but this tool can be difficult for biocurators to use, and even in the hands of experts it can be time consuming to generate new classes complete with axioms referencing external ontologies.
Here we describe an application called TermGenie that allows biocurators to generate new classes based on formally specified design patterns or templates. The system is web-based and can be accessed by any authorized curator through a web browser. Automated rules and reasoning engines are used to ensure validity, uniqueness and relationship to pre-existing classes. The system makes extensive use of OWL axioms, but can be easily used without understanding these axioms. TermGenie is used extensively in the GO and is currently also in use for the Cell Type Ontology and for phenotype ontologies.
The TermGenie server uses a set of modules and components to provide the required services for TermGenie. This set includes modules for basic functionalities such as loading ontologies, a persistence layer, reasoning, identifier generation, access to version control systems, and sending e-mails. Some modules are used for more complex components, such as the term generation, request submission, and review interface.
Ontology loading and synchronization
For ontology loading and the in-memory model, TermGenie relies on the OWL-API . This Java library provides an axiom-based ontology model with parsers and writers for many OWL serialization formats. In addition, we use a Java implementation for handling OBO format , which also executes the conversion to the OWL in-memory model from OBO format. Future versions of the OWL-API will integrate the OBO format library, removing the need for this extra step. An important TermGenie feature is the support of ontology file handling in a version control systems (VCS). Currently TermGenie supports Subversion  and future support for Git  is planned. In addition, for a more efficient load of imports and files not in a VCS, TermGenie uses a local file cache for ontology files. The caching duration is a configuration parameter of each TermGenie installation. TermGenie loads the required ontologies during the server start. To keep the ontologies up-to-date and in sync with the source file, TermGenie periodically updates the VCS files and reloads the ontologies.
Request queue and services
As shown in the workflow, TermGenie saves the requested classes for review in a queue. This request queue is separate from the ontology file and requires a separate persistent storage module. The persistence module is implemented via the Java Persistence API using OpenJPA  as object-relational mapper and HSQLDB  as a simple embedded database for storage on disk. This lightweight default implementation makes TermGenie independent from more complex database setups and configuration issues. Because TermGenie does not push the requests to the ontology until they are reviewed, TermGenie provides additional services to access information about the pending request. Option one, there is a separate TermGenie page, which list the currently pending and recently approved requests. This table is intended for users to quickly check their recent requests. Option two, there is a web service to query the status of requested class and whether it is an approved, pending, or unknown class identifier. This service is intended for the integration of TermGenie in curation tools. Currently Protein2GO  uses the service to verify the class identifiers and prevent curators from entering invalid identifiers, while still allowing the immediate usage of newly generated classes.
Sessions and user authentication
An important convenience feature for TermGenie users is autocompletion. TermGenie uses a Lucene in-memory index to provide appropriate suggestions. To optimize the suggested classes and restrict the classes for a template, TermGenie can be configured to use only a subset of all available classes. For example, to create a subset for the molecular functions in GO, the configured set just contains the root class GO:0003674 (molecular_function). Using a reasoner, this set is then extended to include all direct and indirect subclasses. The same configuration mechanism can also be used to allow the input of classes from multiple ontologies in an input field. For example, it is possible to use cell-type classes form the Cell Type Ontology and plant cell classes from the Plant Ontology.
All the different TermGenie components and modules are configured and combined via Google Guice , a lightweight dependency injection framework. TermGenie uses a combination of Java-based and compiler-checked defaults, configuration property files, and optional command-line overrides to configure a specific TermGenie installation. For example, the Guice modules are part of the Java configuration, creating a generic web application. The machine-specific details and secrets (e.g. passwords and private keys) are provided as a property file to override the default parameters. The location of the property file is declared via a command-line parameter. This helps to avoid the problem of accidental release of sensitive information into a public version control system.
The core of TermGenie is template-based class generation. The template-based approach allows the separation of ontology design tasks, a fairly involved process, and standard class generation, a relatively straightforward task. For the former, the ontology developers extract or create, and test appropriate patterns for the generation of new classes based on the design principles of the ontology. A template consists of the OWL equivalent class axiom for the formal definition and reasoning, label and textual definition building blocks and, if applicable, details for synonym generation. These templates can then be used by biocurators to generate desired standard classes without need for knowledge of the internal workings of the ontology.
TermGenie uses reasoning for two tasks: validation and relation inference. Both tasks rely on the equivalent class axioms specified in the templates. For the validation, TermGenie asks the reasoner for equivalent named classes for the given hypothetical new class. Similarly, for the inference and update of relations, we query the reasoner for the direct super- and subclasses of the hypothetical class. This is done by declaring a new class using a new temporary identifier and adding the corresponding equivalent class axioms. Next, TermGenie creates an up-to-date reasoner instance for the changed ontology. To prevent unpredictable inferences, the ontology is checked for inconsistency and unsatisfiable classes. Once these checks are completed, the actual new-class-related queries are done. After querying, the axiom changes are reverted and the reasoner is discarded. The inferred direct subclasses are used to assert the most specific superclasses. In addition the direct subclasses of the hypothetical new class are checked and their relations updated. This strategy allows the creation of not only the new leaf classes in the ontology graph, but also new intermediate classes with an automatic update of relations for existing classes. An example of an inference using equivalent class axioms and a reference ontology is available in Figure 4.
Using this workflow the reasoner creation and querying are the most time-consuming steps of a TermGenie template request. In theory, TermGenie can use any OWL-API compliant reasoner, but the requirements for an interactive web-application introduce a processing time limit for the reasoner. We have experimented with multiple reasoners and chose ELK  as the most convenient compromise for TermGenie.
In a typical workflow, the user begins by loading the relevant TermGenie web page, selecting and filling in the relevant template. After the class generation and validation, the class is submitted for user review and approval and assignment of a permanent identifier, see also Figure 5 for a workflow diagram.
On the user side, a TermGenie template consists of a set of required and optional input fields. TermGenie provides autocompletion for ontology classes for appropriate input fields. Before a user starts the new class generation and validation, a number of quick checks are executed. The checks include one for missing entries in required input fields, such as a missing literature reference. After passing these checks, the request is sent to the server. After the generation and reasoning step on the server, the users have the chance to review the proposed classes. They can also make modifications to textual parts if necessary (e.g. definition) or add additional synonyms. The next step is the submission of the generated classes for review. As part of this process, a new permanent identifier is generated using a customizable identifier pattern and range. To complete the submission step, the user must be logged in (authenticated), as the server will check for the appropriate permissions and will use the user metadata for provenance information of the generated classes and requested e-mail notifications.
Ideally, after generating the identifier, a biocurator can immediately use the generated identifiers for annotation. To facilitate this even while the identifier is not yet committed to the ontology, we provide a web service to check the validity of class identifiers.
After a user has submitted their generated class requests and generated the permanent identifiers, the requests are put into a queue for review by an ontology developer. During the review the ontology developer has the following three choices: approve, modify, or obsolete. There is no reject or delete option at that stage because a permanent identifier has already been generated. In most cases the classes can be approved without (or with minimal) modifications since they rely on tested templates. Should a developer need more details, he/she may contact the original requester without making a decision, and keep the request pending. The ontology developers can use the e-mail information available from the provenance information of each request.Once the ontology developer has determined which classes to commit to the ontology, he/she selects the corresponding checkboxes and initiates the commit. On the server, the classes from the requests are first quickly checked again. For the commit, the server uses the version control to create a clean checkout. From there TermGenie loads the ontology as a separate instance and applies the relevant changes. Depending on the original ontology file format this can either be OWL axioms or OBO term frames. After writing the changed ontology as a file, TermGenie tries to commit the updated file into the VCS. When there is more than one request selected for commit to the ontology, TermGenie processes each one separately with individual commits. This allows for a more fine-grained and aspect-oriented tracking of changes in the underlying VCS. See also Figure 6 for the workflow during the review process.
Results and discussion
Usage in the Gene Ontology The pattern-based TermGenie approach has been used for the Gene Ontology since July 2010, with the current Java implementation in place since November 2012. During the period from July 2010 until the end of June 2014, the Gene Ontology instance of TermGenie has been used to generate 4715 classes, which represents 51.4% of all new classes created in GO during that time. For a quarterly report of new classes in GO see Table 1. The number of available templates has been growing over time and currently stands at 38 templates, see also Table 2 for a list of the templates. Many of these templates utilize an external ontology.
As described before, TermGenie relies heavily on reasoning for automatic classification and validation. This requires that the ontology underlying a TermGenie instance be sufficiently axiomatized with equivalent class axioms. In the case of the Gene Ontology, with its considerable size and development history, a significant amount of time and effort was needed to introduce equivalent class axioms into the ontology. The formalization of GO started in the early 2000s  and is still an ongoing task. It not only includes intra-ontology definitions , but also makes use of existing other domain-specific ontologies, such as the Chemical Entities of Biological Interest (ChEBI) ontology . The most frequently referenced external ontology is ChEBI, but we also use the Plant Ontology (PO), Cell Type Ontology, Phenotypic Quality Ontology (PATO), and Uberon  to define class patterns in GO. One could argue that ontology formalization is critical in creating a scalable and affordable long-term maintenance strategy because it supports automatic inferences and reasoning. The template-based formalization process helps to make implicit design patterns and assumptions explicit.
Streamlining ontology development The template-based approach allows the separation of concerns and roles between ontology engineering and everyday ontology class requests. Most of the ontology work for creating a template can be done by the ontology developers and OWL experts during the design and test phase for each of the templates. Once a pattern has been created and is available in a TermGenie web application, adding a new class in that same pattern is vastly streamlined. The biocurators can quickly and safely create classes and permanent identifiers on the website within minutes and return to their annotation task. The effort for the final review by an ontology developer for each class in TermGenie is minimal as it relies on a pre-existing and tested solution. TermGenie also provides the convenient feature of e-mail notifications.
Bounds on complexity of composed classes Even though templates are usually tested and approved by the ontology developers, one interesting issue for Gene Ontology requests has come up. Some templates generate classes of the same category as the input class (e.g. process involved_in process, or regulation of processes). This means that it is possible to recursively compose classes with definitions that unfold to a deeply nested hierarchy, with complex textual definitions and labels that impose a cognitive burden on users. Most of these classes are requested for the annotation of complex biological processes and functions with a pre-composition strategy or legacy systems with a simplistic annotation model (e.g. single unrelated annotations). From the formal point of view these classes have a clear axiomatized definition and can be unfolded into simpler annotations . This kind of class request, although not very common in TermGenie, take longer to review as they often require further discussion and modifications by ontology developers. One proposal has been to design a strategy to prevent the creation of these multiply compounded classes and to instead redirect users to the issue tracker instead of proceeding with the request. The detection and redirection feature has not yet been implemented.
The most time-saving feature for biocurators is the immediate creation of permanent identifiers. Therefore, during the review by an ontology developer, this leaves only obsoletion as a way to reject a request. In theory this could lead to higher number of unnecessary obsoleted classes. However, this proved not to be an issue for the Gene Ontology TermGenie instance. Only 70 requested classes have been obsoleted since inception, about 1.6% of the TermGenie requests.
Non-templated class generation Biology and other complex subjects cannot always be axiomatized in a templatable way. Therefore, not all class requests can or should be done using a template. To address this issue and at the request of the ontology developers, we added a free-form option to TermGenie. This allows very experienced users to quickly specify all the relevant details of a class, validate, and generate the new class using TermGenie. The free-from workflow extends to the existing validation procedures with additional checks. It searches for and warns about existing similar class names and synonyms for a given class request. For example, a request for ‘omegasome’ via free-form, produces a warning that a similar class ‘megasome’ already exists. In this case the warning could be dismissed as the two classes refer to completely different cell components. This additional check helps the ontology developers to avoid the creation of redundant classes.
Due to the different use-case, this free-form template is implemented as a separate tool in the TermGenie webapp, but shares many services (e.g., autocomplete, e-mail notifications) and adds requests to the common review queue. Furthermore, we use a different set of permissions to restrict the access of users to this template. Due to the more experimental nature of the requests via the free-form template, the obsoletion rate is slightly higher, with 16 of 387 (4.1%) obsoleted requests.
Evaluation of OWL reasoners for use in TermGenie Because reasoning is a core task in TermGenie, we experimented with multiple OWL-API compliant reasoners. Currently, we haven chosen ELK  as the best compromise for TermGenie. ELK is an OWL 2 EL profile  reasoner and provides a good trade off between response time and supported inference. Other tested reasoners include HermiT , JFact , Pellet , MORe  as full OWL compliant reasoners and jcel  as another OWL 2 EL compliant reasoner. In general all full OWL2 reasoners proved to be too slow for usage in TermGenie. The other EL reasoner, jcel, is a viable alternative, but ELK using multithreading out-performed jcel in the initial classification step. A typical reasoning task for the Gene Ontology and the required external ontologies includes about 415,000 logical axioms. Using ELK, we can respond to a single request within a few seconds.
TermGenie for other ontologies The TermGenie system was designed from the outset to be ontology-neutral. In addition to the Gene Ontology instance , we have worked with the developers of other OBO Library ontologies to create custom TermGenie instances.
The OBO Cell Type Ontology (CL)  represents cell types found in animals. One of the main uses of the CL is to rigorously describe samples collected as part of large next-generation sequencing projects such as Functional Annotation of Mammalian Genomes 5 (FANTOM5) and the Encyclopaedia of DNA Elements (ENCODE), allowing analyses that yield insight into properties of different cell types . The ENCODE curators have found the CL instance of TermGenie useful as it provides a simple web-based way to generate new classes used to describe samples.
The Ontology of Biological Attributes (OBA)  was created as a unified representation of traits (for example ‘eye color’) encompassing ontologies for describing animals, plants and single-celled organisms. Many traits follow a trivial compositional pattern, encompassing a simple entity-attribute pattern, with the attribute being taken from the ‘attribute’ subset of PATO, and the entity taken from ontologies such as Uberon or PO. This ontology was originally created to be able to structure the ‘regulation of biological quality’ branch of the GO, but it has found uses in other areas. Curators in the Monarch Initiative project have used it to describe mouse strain phenotypes, and most recently it has incorporated into the Encyclopaedia of Life (EOL) TraitBank  project.
Ontologies of abnormal or variant phenotypes also benefit from a templated approach, as their classes can often be described using an Entity-Quality combinatorial approach, akin to that used in OBA. So far we have created instances for the Mammalian Phenotype Ontology  and the Human Phenotype Ontology (HP) , with plans to create instances for other species-specific phenotype ontologies. The HP instance was created in part to serve the needs of the NIH Undiagnosed Diseases Program (UDP), which is systematically describing the phenotypes of patients with undiagnosed diseases, so that phenotype comparison algorithms can be used to assist the hunt for the genomic underpinnings of these diseases. In this case, it is important that a diversity of ontology contributors can efficiently and effectively contribute to the HP. We believe that TermGenie will greatly facilitate contributions from the rare disease community.
Note that in order for these instances to work effectively, it was first necessary for the respective developers to make their ontologies ‘reasoner-ready’ by providing OWL equivalent class axioms, a process that has been underway for several years [3, 34]. In contrast, once the necessary OWL refactoring is complete, the configuration of the ontology-specific TermGenie instances takes about a week, with most of the time spent on testing the templates.
Comparison with other approaches
Creating new classes in ontologies is a common task, one that is typically done by a developer using an Ontology Development Tool (ODT) such as OBO-Edit  or Protégé . These are both comprehensive, general purpose environments, and are not intended for use by annotators and biocurators without requisite training. In addition, both are desktop applications, requiring an installation on the user’s machine. The limitations of desktop ontology development software, especially for collaborative work, led to the creation of WebProtégé, a web-based ontology development tool . All three applications are powerful tools with steep learning curves and are usually intended for knowledge/ontology engineers and ontology developers. They do not offer the separation of design and quick everyday use for non-experts. TermGenie is not intended to replace comprehensive ODTs; the pattern-based approach and ODTs complement each other in the ontology development workflow. In fact the comprehensive ODTs are required during the template design and testing.
Other related work exists in the form of the Term Generation plugin DOG4DAG . It is available as an OBO-Edit and Protégé plugin. The tool allows proposal of new classes based on phrases extracted from a given text corpus. The most common use case is to create or add domain-specific vocabulary to an ontology. The best use is in early stages of ontology projects as it generates mostly list of candidate classes. For a more mature and formalized ontology, a more axiomatized result is required.
The Network-Extracted Ontology (NeXO)  is an example of an orthogonal, data-driven approach to ontology generation. This approach takes as input a sufficiently large and dense network (i.e. gene and protein interactions), and applies a clustering algorithm to generate classes and relationships between these classes. So far, NeXO has been used to generate a yeast cellular component ontology. It remains to be seen how well the approach works for other portions of ontologies such as the GO.
Another template-driven class generation approach is Quick Term Templates . There are multiple implementations available for this approach: a MappingMaster plugin for Protégé, the OntoRat web application , or custom Perl code combined with spreadsheets. Each implementation still requires quite a bit of detailed knowledge of the ontology. One huge issue is the information flow back to the ontology developers, which also includes the assignment of valid/permanent identifier and access control. In the TermGenie application these details are controlled by the server and the built-in review mechanism.
The Cellular Phenotype Ontology (CPO) is an ontology that was entirely generated programmatically . A custom program was written using the java OWL-API to generate a class from the cross-product of the ‘cellular process’ branch of GO and a subset of PATO. This kind of en-mass class generation is in contrast to the TermGenie approach, in which biocurators flesh out a subset of the space of all possible classes on an as-needed basis. The resulting ontology is more compact and is arguably more usable than one in which the entire space of terms is fleshed out in advance.
Most recently, the Tawny-OWL framework provides an elegant and powerful way to generate an entire ontology programmatically using a high-level declarative domain-specific language . At this time, Tawny is difficult to integrate into a conventional ontology development workflow as it requires the source for the ontology to be stored as a Clojure program rather than in a non-programmatic format such as OBO or OWL. However, we are working with the Tawny developers to explore ways to integrate our approaches.
TermGenie is a web-based class-generation system that complements traditional ontology development tools. All classes added through pre-defined templates are guaranteed to have OWL equivalence axioms that are used for automatic classification and in some cases inter-ontology linkage. At the same time, the system is simple and intuitive and can be used by most biocurators without extensive training. Its use in the Gene Ontology has removed a significant curation bottleneck, and has freed up ontology developers from performing time-consuming repetitive tasks allowing them to work on high-level design issues. In the last 4 years the Gene Ontology TermGenie instance was used to generated 4715 new classes, about 51.4% of all new classes created. The immediate generation of permanent identifiers proved not to be an issue with only 70 (1.4%) obsoleted classes. TermGenie is now in use in other projects as well, including the Mammalian Phenotype Ontology, the Human Phenotype Ontology, the Cell Type Ontology and the Ontology of Biological Attributes.
Availability and requirements
Project name: TermGenie
Project home page: http://termgenie.org
Operating system(s): Platform independent
Other requirements: Java 6 or higher, Jetty 6 or higher, Maven 3.0.x
License: New BSD (BSD 3 Clause)
Any restrictions to use by non-academics: none
Ontology Development Tool
Web Ontology Language
Version Control System
Chemical Entities of Biological Interest
Cell Type Ontology
Phenotypic Quality Ontology
Ontology of Biological Attributes.
Day-Richter J, Harris MA, Haendel M, Lewis S, The Gene Ontology OBO-Edit Working Group: OBO-Edit-an ontology editor for biologists. Bioinformatics. 2007, 23 (16): 2198-2200. 10.1093/bioinformatics/btm112.
Gene ontology developer documentation.http://geneontology.org/page/development,
Mungall CJ, Gkoutos GV, Smith CL, Haendel MA, Lewis SE, Ashburner M: Integrating phenotype ontologies across multiple species. Genome Biol. 2010, 11: 2-
Mungall CJ, Torniai C, Gkoutos GV, Lewis SE, Haendel MA: Uberon, an integrative multi-species anatomy ontology. Genome Biol. 2012, 13 (1): 5-10.1186/gb-2012-13-1-r5.
Horridge M, Bechhofer S: The OWL API: A java api for OWL ontologies. Semantic Web. 2011, 2 (1): 11-21.
Barrell D, Dimmer E, Huntley RP, Binns D, O’Donovan C, Apweiler R: The GOA database in 2009 - an integrated Gene Ontology annotation resource. Nucleic Acids Res. 2009, 37 (Database-Issue): 396-403.
Kazakov Y, Krötzsch M, Simanc̆ík F: The incredible ELK - from polynomial procedures to efficient reasoning with EL ontologies. J Automated Reason. 2014, 53 (1): 1-61.
Hill DP, Blake JA, Richardson JE, Ringwald M: Extension and integration of the Gene Ontology (GO): Combining GO vocabularies with external vocabularies. Genome Res. 2002, 12 (12): 1982-1991. 10.1101/gr.580102.
Mungall CJ, Bada M, Berardini TZ, Deegan J, Ireland A, Harris MA, Hill DP, Lomax J: Cross-product extensions of the Gene Ontology. J Biomed Inform. 2011, 44 (1): 80-86. 10.1016/j.jbi.2010.02.002. Ontologies for Clinical and Translational Research
Hill D, Adams N, Bada M, Batchelor C, Berardini T, Dietze H, Drabkin H, Ennis M, Foulger R, Harris M, Hastings J, Kale N, de Matos P, Mungall C, Owen G, Roncaglia P, Steinbeck C, Turner S, Lomax J: Dovetailing biology and chemistry: integrating the Gene Ontology with the ChEBI chemical ontology. BMC Genomics. 2013, 14 (1): 513-10.1186/1471-2164-14-513.
Huntley RP, Harris MA, Alam-Faruque Y, Blake JA, Carbon S, Dietze H, Dimmer EC, Foulger RE, Hill DP, Khodiyar VK, Lock A, Lomax J, Lovering RC, Mutowo-Meullenet P, Sawford T, Van Auken K, Wood V, Mungall CJ: A method for increasing expressivity of Gene Ontology annotations using a compositional approach. BMC Bioinformatics. 2014, 15 (1): 155-10.1186/1471-2105-15-155.
OWL 2 web ontology language profiles.http://www.w3.org/TR/owl2-profiles/,
Glimm B, Horrocks I, Motik B, Stoilos G: Optimising ontology classification. Proceedings of The Semantic Web - ISWC 2010 - 9th International Semantic Web Conference: 7-11 November 2010; Shanghai, China. Edited by: Patel-Schneider PF, Pan Y, Hitzler P, Mika P, Zhang L, Pan JZ, Horrocks I, Glimm B. 2010, Springer: Lecture Notes in Computer Science, 225-240.http://dx.doi.org/10.1007/978-3-642-17746-0_15,
Romero AA, Grau BC, Horrocks I: MORe: Modular combination of OWL reasoners for ontology classification. Proceedings of The Semantic Web - ISWC 2012 - 11th International Semantic Web Conference: 11-15 November 2012; Boston, MA, USA. Edited by: Cudré-Mauroux P, Heflin J, Sirin E, Tudorache T, Euzenat J, Hauswirth M, Parreira JX, Hendler J, Schreiber G, Bernstein A, Blomqvist E. 2012, Springer: Lecture Notes in Computer Science, 1-16.http://dx.doi.org/10.1007/978-3-642-35176-1_1,
TermGenie for the GeneOntology.http://go.termgenie.org,
Bard J, Rhee SY, Ashburner M: An ontology for cell types. Genome Biol. 2005, 6 (2): 21-10.1186/gb-2005-6-2-r21.
Andersson R, Gebhard C, Miguel-Escalada I, Hoof I, Bornholdt J, Boyd M, Chen Y, Zhao X, Schmidl C, Suzuki T, Ntini E, Arner E, Valen E, Li K, Schwarzfischer L, Glatz D, Raithel J, Lilje B, Rapin N, Bagger FO, Jorgensen M, Andersen PR, Bertin N, Rackham O, Burroughs AM, Baillie JK, Ishizu Y, Shimizu Y, Furuhata E, Maeda S: An atlas of active enhancers across human cell types and tissues. Nature. 2014, 507 (7493): 455-461. 10.1038/nature12787.
TermGenie for the ontology of biological attributes (OBA).http://oba.termgenie.org,
Parr CS, Wilson N, Leary P, Schulz KS, Lans K, Walley L, Hammock JA, Goddard A, Rice J, Studer M, Holmes JTG, Corrigan RJ: The encyclopedia of life v2: providing global access to knowledge about life on earth. Biodivers Data J. 2014, 2: e1079-doi:10.3897/BDJ.2.e1079
TermGenie for the Mammalian Phenotype Ontology (MP).http://mp.termgenie.org,
TermGenie for the Human Phenotype Ontology (HP).http://hp.termgenie.org,
Meehan TF, Masci AM, Abdulla A, Cowell LG, Blake JA, Mungall CJ, Diehl AD: Logical development of the cell ontology. BMC Bioinformatics. 2011, 12 (1): 6-10.1186/1471-2105-12-6.
Horridge M, Tudorache T, Vendetti J, Nyulas C, Musen MA, Noy NF: Simplified OWL ontology editing for the web: Is WebProtégé enough?. Proceedings of The Semantic Web - ISWC 2013 - 12th International Semantic Web Conference: 21-25 October 2013; Sydney, NSW, Australia. Edited by: Alani H, Kagal L, Fokoue A, Groth PT, Biemann C, Parreira JX, Aroyo L, Noy NF, Welty C, Janowicz K. 2013, Springer: Lecture Notes in Computer Science, 200-215.http://dx.doi.org/10.1007/978-3-642-41335-3_13,
Wächter T, Schroeder M: Semi-automated ontology generation within OBO-Edit. Bioinformatics [ISMB]. 2010, 26 (12): 88-96. 10.1093/bioinformatics/btq188.
Dutkowski J, Kramer M, Surma MA, Balakrishnan R, Cherry JM, Krogan NJ, Ideker T: A gene ontology inferred from molecular networks. Nat Biotechnol. 2012, 31 (1): 38-45. 10.1038/nbt.2463.
Rocca-Serra P, Ruttenberg A, O’Connor MJ, Whetzel PL, Schober D, Greenbaum J, Courtot M, Brinkman RR, Sansone S-A, Scheuermann RH, Peters B: Overcoming the ontology enrichment bottleneck with quick term templates. Appl Ontol. 2011, 6 (1): 13-22.
Xiang Z, Yu L, He Y: Ontorat Web Server for Automatic Generation of New Ontology Terms. Proceedings of the 3rd International Conference on Biomedical Ontology - ICBO 2012, KR-MED Series. 2012, Graz, Austria
Hoehndorf R, Harris MA, Herre H, Rustici G, Gkoutos GV: Semantic integration of physiology phenotypes with an application to the cellular phenotype ontology. Bioinformatics. 2012, 28 (13): 1783-1789. 10.1093/bioinformatics/bts250.
Lord P: The semantic web takes wing: Programming ontologies with Tawny-OWL. Proceedings of the 10th International Workshop on OWL: Experiences and Directions (OWLED 2013) Co-located with 10th Extended Semantic Web Conference (ESWC 2013): 26-27 May 2013; Montpellier, France. Edited by: Rodriguez-Muro M, Jupp S, Srinivas K. 2013, vol. 1080 CEUR-WS.org: CEUR Workshop Proceedings,http://ceur-ws.org/Vol-1080/owled2013_16.pdf,
We thank all the GO curators who have provided feedback on the GO TermGenie instance. Thanks to Jen Hammock from the Encyclopaedia of Life for testing the OBA TermGenie instance.
All authors are supported by the National Human Genome Research Institute (NHGRI) P41 grant 5P41HG002273-09 to the Gene Ontology Consortium. In addition, JL is funded by the European Molecular Biology Laboratory (EMBL), European Bioinformatics Institute Outstation (EMBL-EBI) core funds. In addition, HD and CJM’s contribution was also supported by the Director, Office of Science, Office of Basic Energy Sciences, of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231.
The authors declare that they have no competing interests.
CJM conceptualized and implemented the initial prototype. HD designed, implemented, and maintains the current TermGenie system. CJM, TZB, REF, DPH, JL, DOS, PR provided the ontology expertise, templates, and test examples, and performed necessary ontology axiomatization and refactoring. All authors provided feedback, drove requirements and participated in testing and improving the system. All authors read and approved the final manuscript.