Predicting activities of daily living for cancer patients using an ontology-guided machine learning methodology
© The Author(s). 2017
Received: 23 October 2016
Accepted: 6 September 2017
Published: 16 September 2017
Bio-ontologies are becoming increasingly important in knowledge representation and in the machine learning (ML) fields. This paper presents a ML approach that incorporates bio-ontologies and its application to the SEER-MHOS dataset to discover patterns of patient characteristics that impact the ability to perform activities of daily living (ADLs). Bio-ontologies are used to provide computable knowledge for ML methods to “understand” biomedical data.
This retrospective study included 723 cancer patients from the SEER-MHOS dataset. Two ML methods were applied to create predictive models for ADL disabilities for the first year after a patient’s cancer diagnosis. The first method is a standard rule learning algorithm; the second is that same algorithm additionally equipped with methods for reasoning with ontologies. The models showed that a patient’s race, ethnicity, smoking preference, treatment plan and tumor characteristics including histology, staging, cancer site, and morphology were predictors for ADL performance levels one year after cancer diagnosis. The ontology-guided ML method was more accurate at predicting ADL performance levels (P < 0.1) than methods without ontologies.
This study demonstrated that bio-ontologies can be harnessed to provide medical knowledge for ML algorithms. The presented method demonstrates that encoding specific types of hierarchical relationships to guide rule learning is possible, and can be extended to other types of semantic relationships present in biomedical ontologies. The ontology-guided ML method achieved better performance than the method without ontologies. The presented method can also be used to promote the effectiveness and efficiency of ML in healthcare, in which use of background knowledge and consistency with existing clinical expertise is critical.
KeywordsMachine learning Bio-ontologies Quality of life Activities of daily living SEER-MHOS
Precision medicine is an emerging approach for disease prevention and treatment that takes into account individualized patient information including genomics, environment, and lifestyle . This new era in medicine and health requires advanced methodologies for analyzing, synthesizing, and disseminating heterogeneous data, as well as the ability to harness existing knowledge in order to discover relationships and create computational models for improving care and quality of life. The focus on big data analysis in the biomedical field creates an even greater need for advanced computational methodologies that can translate data into computer-interpretable knowledge and produce comprehensible models that can then be used to advance patient-centric healthcare. Machine learning (ML) is already widely used in creating predictive models within a variety of arenas of big data analysis, and is gaining popularity in medical and health applications .
One major challenge in ML is communicating the meaning of data attributes and their significance to the learning algorithm. Biomedical data are extremely complex, heterogeneous, and characterized by intricate semantics. Very few ML algorithms are capable of interpreting data beyond the mechanical fitting of input data/matrix of numbers into a given model. The majority of ML methods (including the most popular Support Vector Machines, Random Forests, Logistic Regression, etc.) work with and almost exclusively focus on numeric data stored in flat tables while ignoring the semantic relationships (meaning) of data elements. Two existing ML disciplines that address complex data are statistical relational learning [3, 4] and inductive logic programming . Both disciplines are concerned with the more general problem of learning from datasets with complicated structures (relational databases or predicates). However, while healthcare data are particularly rich in knowledge, the use of standard ML methods does not allow for the encoding of attribute types, hierarchies, ontologies, and other coding systems. Typically, in order to use any background knowledge or ontological relationships when applying ML methods, one needs to encode these in problem representations, i.e., by creating additional dimensions that correspond to interactions between existing ones. This is because the ML method for input is a matrix of numerical data. One example of using ontology in conjunction with ML is the work by Kassahun et al. , in which the researchers classified types of epilepsy patients and their localization using an ontology-based classification (OBC) methods that classified patients (slightly) more accurately than clinicians.
An ontology formally represents domain knowledge as a set of concepts and relationships between those concepts. In artificial intelligence (AI), ontologies have been applied as artifacts to represent human knowledge. They are also critical components of knowledge management, e.g. Semantic Web, business-to-business applications, and natural language processing [7–10]. In biomedicine, ontologies have been widely adopted and used in knowledge management, data integration, and decision support and reasoning [11, 12]. Bio-ontologies are slowly emerging in data-driven science, including data mining and ML, although mainly in the capacity and context of natural language processing applications .
There are many existing bio-ontologies, each with a scope, purpose, and role of its own with no industry standard. Consequently, there are communication barriers between the various information systems or applications when different vocabularies are used. In order to address these barriers, the Unified Medical Language System (UMLS) was developed by the National Library of Medicine (NLM) in 1986 [14, 15]. The 2016 AB version of the UMLS contains more than 3 million concepts (CUIs) and 13 million unique concept names (AUIs) from 199 source vocabularies . The UMLS establishes mappings between bio-ontologies by assigning a concept unique identifier (CUI) to names from various vocabularies that have the same meaning. The vocabulary mappings allow computer systems to translate data among the diverse information systems. Rich relationships (22 million) between concepts in the UMLS also provide a solid foundation for reasoning in medical knowledge .
Thus, given the advantages of bio-ontologies knowledge, UMLS mappings, and the ability of ML to develop and learn from predictive models, this paper aims to describe and apply an ontology-guided ML method (emphasis on rule learning) by incorporating hierarchical relationships from the UMLS. The UMLS is used to provide medical domain knowledge for the ML method to “understand” the meaning and significance of the biomedical data, with regards to the existence of specific hierarchical relationships between concepts. By applying the ontology-guided ML method to SEER-MHOS data, the technique is able to predict the cancer patients’ ability to perform activities of daily living (ADLs). The outcome of which is generated rules that are highly transparent and easy to understand. Thus, the rules can be interpreted by the non-technical end users. This proof of concept study suggests that the combination of bio-ontologies and ML methods provides an advanced computational and quantitative technique for analyzing biomedical data.
AQ21 rule learning
AQ21 is a multi-task ML and data mining system for attributional rule learning and rule testing that can be applied to a wide range of classification problems . It was developed in the Machine Learning and Inference Laboratory (MLI) at George Mason University. The system has been recently extended to include features specific for processing biomedical data . AQ21 is a type of natural induction system that seeks to identify patterns represented as attributional rules  that are easily interpretable to end users. The basic form of an attributional rule is: CONSEQUENT < = PREMISE where both CONSEQUENT and PREMISE are conjunctions of attributional conditions. Each attributional condition involves attributes present in the data or constructed by the program. Additionally, AQ21 can learn rules with exceptions given by the formula CONSEQUENT < = PREMISE |_ EXCEPTION. The AQ21 system can also handle inconsistencies in data. The system learns standard rules and generates exception phrases that represent covered negative examples. EXCEPTION can be either an attributional conjunctive description or a list of examples constituting exceptions to the rule. In the medical datasets, the exceptions are always negative examples such as cancer recurrence and disease progression.
Learning rules generated by AQ21 consist of several steps, which can be classified as input preprocessing, rule generation, and rule optimization. The steps are generally executed in this order, although AQ21’s learning process is iterative in several ways. Input preprocessing includes rearranging data into classes, removing ambiguous examples, and modifying representation space through simple preprocessing methods (i.e., discretization, attribute selection) or more advanced ones that employ constructive induction algorithms . At its core, rule learning implements modification of a simplified version of the algorithm quasi-optimal (Aq) for constructing rules, which is a well-known sequential covering algorithm . The algorithm starts with a randomly selected positive example, called the seed, and generates all possible (high quality) rules that cover the seed and do not cover (or approximately do not cover) any of the negative examples. The best quality top rules are then selected and stored. Among positive examples not covered by these selected rules, another random seed is selected and the operation is repeated. This process results in a number of very general rules (typically more than needed) that need to be optimized and prepared for output. Optimization of rules includes their trimming, adjusting of generality through following hierarchies, selection, and mapping of attributes. The overall goal of AQ21 is to produce rules that maximize user-defined quality criteria that typically provide tradeoff between accuracy (precision/recall) and their simplicity and transparency. Finally, the program employs a number of methods designed to provide output in human-oriented forms, including the generation of the rules into a natural language representation (layman terms) .
AQ21 is the latest development from a series of AQ rule learners that dates back to the 1970s . A number of well-known rule learners have been developed over the last decades [24–26], but many are not utilized in mainstream research at the present time. In the past few years the ML field has been dominated by statistical methods that focused primarily on providing highly accurate models. However, the community has begun to slowly transition back to understandability and transparency of models produced, which is particularly important in biomedical applications.
Ontology-guided AQ21 (AQ21-OG)
Step 1: Mapping data to the UMLS CUIs. This step is used to identify the base CUIs. The candidate CUIs are identified automatically (SQL) and then reviewed by experts for the problematic mappings.
Step 2: Extracting complete sub-hierarchies by following IS-A relationships using base CUIs. This is done by following IS-A relationships in the UMLS for each concept until the complete parent, child, and sibling sub-hierarchy is extracted. The complete sub-hierarchy is defined as the path from base CUI (furthest child(ren) in the hierarchy) to the root (“super parent”, i.e. a parent that is not also a child). This extraction is the basis for the input file (in Step 4) that AQ21 will use to find the farthest common ancestors for base CUIs (in Step 5).
Step 3: Resolving inconsistencies in the hierarchy. Due to nature of the UMLS, a number of inconsistencies (e.g., cycles, duplicates) may happen when due to being constructed from multiple source terminologies [28–31]. Cycles are not permitted in AQ21, so they are resolved by breaking links that connect back to concepts higher in the hierarchy, as measured by distance from the root. Other types of inconsistencies are removed from the final hierarchy.
Step 4: Encoding extracted hierarchies into ML-software readable format. AQ21 requires a list of parent-child pairs for all relationships that form the hierarchy. The data is read from text files that include all semantic information required to correctly reason with the data. Specifically, in the AQ21, hierarchical relationships are part of the definition of attributes’ domains (set of possible values) that describe data.
Step 5: Optimizing the rules by using the extracted UMLS hierarchies from Step 2. AQ21-OG finds the highest level of generalization in the hierarchy, which is either consistent with data or maximizes the rule quality measures. This is particularly valuable when analyzing coded medical data with potentially hundreds of thousands of binary attributes. For example, ICD-9-CM diagnosis codes can result in the need to create close to 10,000 binary attributes. Therefore, the need to generalize those codes to reduce the number of features is a necessity.
SEER-MHOS (Surveillance, Epidemiology, and End Results - Medicare Health Outcomes Survey) data from 1998 to 2011 (1,849,311 records) were used to extract comorbidities and activities of daily living (ADLs), as well as cancer characteristics. This dataset links two large population-based data that provide detailed information about Medicare beneficiaries with cancer . The SEER data extracted from the cancer registry contains clinical, demographic and cause of death information for persons with cancer, while the MHOS data is extracted from survey responses and provides information about the health-related quality of life (HRQOL) of Medicare Advantage Organization (MAO) enrollees.
A number of steps were followed to create the study population dataset. First, the study population was limited to those who completed at least one survey before their cancer diagnosis and one survey roughly one year after the diagnosis. If a patient completed multiple surveys, the surveys closest to before the cancer diagnosis and the 1-year follow-up were used. These very strict criteria significantly reduced the sample size and resulted in a cohort of 723 cancer patients.
Dependent/Output Variables: the primary outcomes were six ADLs (walking, dressing, bathing, moving in/out of chair, toileting, and eating) reported in a patient survey taken one year after the cancer diagnosis.
Patient demographics: age, race and marital status
Six ADLs reported in a patient survey taken before the cancer diagnosis
Thirteen self-reported comorbidities extracted from a patient survey taken before the cancer diagnosis: Angina Pectoris/Coronary Artery Disease, Arthritis of Hand/Wrist, Arthritis of Hip/Knee, Back pain, Congestive heart failure, Emphysema/Asthma/Chronic obstructive pulmonary disease, Diabetes, Crohn’s Disease/Ulcerative Colitis/Inflammatory Bowel Disease, Hypertension, Myocardial Infarction, Other Heart Conditions, Sciatica and Stroke
Six cancer characteristics namely grade, staging, tumor size, histology, tumor extension, and behavior extracted from the SEER registry
Cancer radiation and surgery treatment indicators extracted from the SEER registry
Analysis of the SEER-MHOS data with AQ21 and AQ21-OG
The w is a weight (from 0 to 1) that represents the tradeoff between completeness and consistency gain. The lower the w is, the more consistent the rules need to be (fewer negative examples covered). The higher the w is, the more complete the rules need to be (more positive examples covered). Based on experimental evaluation of the rules, we decided to select w = 0.3 which indicates slightly higher weight for more consistent rules. This value was used in both cases, with and without ontology. Completeness is frequently referred to as recall in machine learning. Consistency gain can be viewed as normalized precision that measures how much precision we gain over a random guess.
Characteristics of Patients in the final dataset (n = 723)
Top 5 Comorbidities
Arthritis of Hip
Arthritis of Hand
Number of patients reported ADL disabilities before and after cancer diagnosis
No. of patients before cancer diagnosis
No. of patients after cancer diagnosis
Rule induction from the SEER-MHOS
Sample 1: AQ21
[Bathing impairment] < ==
[Race = Black, White, Chinese: 70, 245, 22%]
[Hispanic = No: 64, 241, 20%]
[Smoking = Some days, Not at all: 68, 238, 22%]
[Surgery = 51,40,27,0,45: 45, 113, 28%]
[Histology = Squamous cell neoplasm, Transitional cell papillomas and carcinomas, Adenomas and adenocarcinomas, Nevi and melanomas, Cystic, mucinous and serous neoplasm, Ductal and lobular neoplasm, Epithelial neoplasms, NOS: 74, 252, 22%]
[Stage = In situ, Localized only, Regional by direct extension only: 69, 244, 22%]
[Primary site and morphology = C0153458,C0153492,C0153532,
C0242787, C0949022,C0235653, C0153483,C0153611,
C0153555,C0153435,C0346782,C0153491,C0153612: 30, 34, 46%]
: p = 22, n = 2, q = 0.642
Sample 2: AQ21-OG
[Bathing impairment] < ==
[Race = White, Chinese: 64, 219, 22%]
[Hispanic = No: 64, 241, 20%]
[Smoking = Some days, Not at all: 68, 238, 22%]
[Surgery = 32,51,40,0,45: 40, 95, 29%]
[Histology = Squamous cell neoplasm, Adenomas and adenocarcinomas, Nevi and melanomas, Cystic, mucinous and serous neoplasm, Ductal and lobular neoplasm, Epithelial neoplasms, NOS: 68, 229, 22%]
[Cancer site = Lung and Bronchus, Melanoma, Descending Colon, Rectum, Pancreas, Urinary Bladder, Breast, Larynx
: 61, 169, 26%]
[Primary site and morphology = C0154077, C0007102, C0153532, C0005684, C0153555, C0024624, C0006142, C0235652, C0864875, C0346647, C0345921, C0242379, C0346629, C0345865, C0242788, C0034885, C0007107, C0345713, C0587060, C1263771: 38, 49, 43%]
: p = 23, n = 2, q = 0.653
Quality metrics for the AQ21 and AQ21-OG for the sample rules
Sample 1 (AQ21)
Sample 2 (AQ21-OG)
Note that the rules presented above correspond to each other; however, AQ21 and AQ21-OG are not guaranteed to generate similar rules. The ability to generalize available data differentially within the hierarchies derived from an ontology may steer the process in a different direction causing the rules to differ. Consequently, the quality of rules improves.
Q(R, w*), precision, recall and F1-score calculated for a selected rule for each ADL
AQ21 Q(R, w)
AQ21-OG Q(R, w)
T-test results for comparison of two methods
AQ21 and its ontology-guided version, AQ21-OG, are highly configurable and robust systems with features especially valuable for: learning from biomedical data such as individual patient data, learning from aggregated data, and using medical knowledge. One major advantage is that AQ21-OG can optimize attributional rules with the assistance of medical knowledge from the UMLS, for the purposes of rule generalization based on the hierarchical relationships. In this research, the rule generalization procedure continued until negative data against medical knowledge was found. This was done automatically by the AQ21 to increase accuracy of the predictive models.
One big challenge for the ontology-guided ML method is performance. Performance is impacted by: (1) the extreme size and complexity of UMLS and other medical ontologies which limit the application of standard search methods and (2) the size of the SEER-Medicare dataset. Although this study only worked with a small subset of SEER-MHOS data, the hierarchical structure from the UMLS was already large and complicated. As previously discussed many concepts in the UMLS contain more than one parent, thus the generalized rules may contain more CUIs due to the complexity of the UMLS.
One limitation of this study was that the method was tested and validated based on a small sample of SEER-MHOS patients (n = 723). Additionally, survey data are typically not best suited for ML applications because of their biases and subjectivity and limited potential use in real decision support applications. Future work will include increasing the sample size by using the entire SEER-MHOS data as an opposed to a subset of a 5% sample. On the methodological side, AQ21 will be extended to handle other types of semantic relationships in the UMLS. Further, more experimental evaluation is needed to improve accuracy of the generated rules in order to match the accuracy of state-of-the-art statistical methods.
This paper presents how AQ21 and its ontology-guided ML version AQ21-OG were successfully applied to the SEER-MHOS data set and generated a set of models for describing and predicting cancer patients’ deficiencies in performing six ADLs. These models are highly transparent and relatively easy to understand. The results show that the AQ21-OG outperforms the original AQ21 since AQ21-OG can optimize attributional rules with the assistance of medical knowledge from the UMLS. This research further demonstrates that bio-ontologies can be used to promote the effectiveness and efficiency of ML in healthcare.
We thank our undergraduates Sava Vukomanovic and Ilirjeta Krasniqi for preparing earlier version of this work as a conference paper.
The study was supported by the Thomas F. and Kate Miller Jeffress Memorial Trust, Bank of America, Trustee. Publication of this article was funded in part by the George Mason University Libraries Open Access Publishing Fund.
Availability of data and materials
The datasets generated and/or analyzed during the current study are not publicly available due to the SEER-MEDICARE HEALTH OUTCOMES SURVEY DATA USE AGREEMENT (DUA).
HMin and JW conceived and designed the analysis. HM, KI, and SA ran the analysis. All authors contributed to the interpretation of the data, revisions of the manuscript and read and approved the final manuscript.
Ethics approval and consent to participate
It was a secondary data analysis of the SEER-MHOS.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Precision Medicine. Available from: https://www.nih.gov/precision-medicine-initiative-cohort-program. Accessed 16 Sept 2017.
- Marr B. How machine learning, big data and AI are changing healthcare forever, in Forbes magazine. 2016.Google Scholar
- De Raedt L. Logical and relational learning. Berlin, Heidelberg: Springer-Verlag; 2008.Google Scholar
- Getoor L, Taskar B. Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning). The MIT Press; 2007.Google Scholar
- Muggleton S, De Raedt L. Inductive logic programming: Theory and methods. J Log Program. 1994;19:629–79.MathSciNetView ArticleMATHGoogle Scholar
- Kassahun Y, et al. Automatic classification of epilepsy types using ontology-based and genetics-based machine learning. Artif Intell Med. 2014;61(2):79–88.View ArticleGoogle Scholar
- Ristoski P, Paulheim H. Semantic Web in data mining and knowledge discovery. Web Semant. 2016;36(C):1–22.View ArticleGoogle Scholar
- Devi MS, Mittal H. Machine learning techniques with ontology for subjective answer evaluation. Int J Nat Lang Comput (IJNLC). 2016;5(2):1–11.View ArticleGoogle Scholar
- Savova GK, et al. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J Am Med Inform Assoc. 2010;17(5):507–13.View ArticleGoogle Scholar
- Spasic I, et al. KneeTex: an ontology-driven system for information extraction from MRI reports. J Biomed Semantics. 2015;6:34.View ArticleGoogle Scholar
- Bodenreider O. Biomedical ontologies in action: role in knowledge management, data integration and decision support. Yearb Med Inform. 2008:67–79.Google Scholar
- Madsen M. Health care ontologies: knowledge models for record sharing and decision support. Stud Health Technol Inform. 2010;151:104–14.Google Scholar
- Hoehndorf R, Schofield PN, Gkoutos GV. The role of ontologies in biological and biomedical research: a functional perspective. Brief Bioinform. 2015;16(6):1069–80.View ArticleGoogle Scholar
- Lindberg DA, Humphreys BL, McCray AT. The Unified Medical Language System. Methods Inf Med. 1993;32(4):281–91.Google Scholar
- Lindberg C. The Unified Medical Language System (UMLS) of the National Library of Medicine. J Am Med Rec Assoc. 1990;61(5):40–2.Google Scholar
- UMLS. Available from: https://www.nlm.nih.gov/pubs/techbull/nd16/nd16_umls_2016ab_release.html. Accessed 16 Sept 2017.
- Wojtusiak J. AQ21 User’s guide. Fairfax: George Mason University; 2004.Google Scholar
- Wojtusiak J. Recent advances in AQ21 rule learning system for healthcare data. In: American Medical Informatics Annual Symposium; 2012.Google Scholar
- Michalski R. Attributional calculus: a logic and representation language for natural induction. In: Reports of the Machine Learning and Inference Laboratory, MLI 04–2. Fairfax: George Mason University; 2004.Google Scholar
- Bloedorn E, Michalski RS. Data driven constructive induction in AQ17-PRE: a method and experiments. In: Proceedings of the Third International Conference on Tools for AI. San Jose: IEEE Computer Society Press; 1991. p. 30-7.Google Scholar
- Michalski RS. On the Quasi-Minimal Solution of the General Covering Problem. In: Proceedings of the 5th International Symposium on Information Processing (FCIP 69) Vol. A3 (Switching Circuits). Yugoslavia; 1969. p. 125-8.Google Scholar
- Michalski RS, Wojtusiak J. Generalizing Data in Natural Language. In: International Conference Rough Sets and Emerging Intelligent Systems Paradigms, RSEISP 07. Lecture Notes in Computer Science, Springer; 2007.Google Scholar
- Michalski R. AQVAL/1 computer implementation of a variable-valued logic system VL 1 and examples of its application to pattern recognition. In: Proceedings of the First International Joint Conference on Pattern Recognition. Washington, DC; 1973. p. 3-17.Google Scholar
- Michalski R, et al. The multipurpose incremental learning system AQ15 and its testing application to three medical domains. In: Proceedings of the Fifth AAAI National Conference on Artificial Intelligence (AAAI'86). Philadelphia: AAAI Press; 1986. p. 1041-45.Google Scholar
- Kaufman K, Michalski R. The AQ18 Machine Learning and Data Mining System: an Implementation and User’s Guide. Fairfax: George Mason University; 1999.Google Scholar
- Cervone G, Franzese P, Keesee APK. Algorithm quasi-optimal (AQ) learning. Wiley Interdisciplinary Reviews: Computational Statistics. 2010.Google Scholar
- Kaufman K, Michalski RS. A Method for Reasoning with Structured and Continuous Attributes in the INLEN-2 Multistrategy Knowledge Discovery System. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96). Portland; 1996. p. 232-7.Google Scholar
- Geller J, et al. Comparing inconsistent relationship configurations indicating UMLS errors. AMIA Annu Symp Proc. 2009;2009:193–7.Google Scholar
- Cimino JJ. Auditing the Unified Medical Language System with semantic methods. J Am Med Inform Assoc. 1998;5(1):41–51.View ArticleGoogle Scholar
- Cimino JJ, Min H, Perl Y. Consistency across the hierarchies of the UMLS Semantic Network and Metathesaurus. J Biomed Inform. 2003;36(6):450–61.View ArticleGoogle Scholar
- Mougin F, Bodenreider O. Approaches to eliminating cycles in the UMLS Metathesaurus: Naïve vs. formal. AMIA Annu Symp Proc. 2005;2005:550-4.Google Scholar
- Clauser SB, Haffer SC. SEER-MHOS: a new federal collaboration on cancer outcomes research. Health Care Financ Rev. 2008;29(4):1–4.Google Scholar
- Briganti A, et al. Impact of age and comorbidities on long-term survival of patients with high-risk prostate cancer treated with radical prostatectomy: a multi-institutional competing-risks analysis. Eur Urol. 2013;63(4):693–701.View ArticleGoogle Scholar
- Taneja SS. Re: impact of age and comorbidities on long-term survival of patients with high-risk prostate cancer treated with radical prostatectomy: a multi-institutional competing-risks analysis. J Urol. 2013;189(3):901.View ArticleGoogle Scholar
- Vissers PA, et al. The impact of comorbidity on Health-Related Quality of Life among cancer survivors: analyses of data from the PROFILES registry. J Cancer Surviv. 2013;7(4):602–13.View ArticleGoogle Scholar
- Agborsangaya CB, et al. Health-related quality of life and healthcare utilization in multimorbidity: results of a cross-sectional survey. Qual Life Res. 2013;22(4):791–9.View ArticleGoogle Scholar
- Amemiya T, et al. Activities of daily living and quality of life of elderly patients after elective surgery for gastric and colorectal cancers. Ann Surg. 2007;246(2):222–8.View ArticleGoogle Scholar
- Michalski RS, Kaufman K. A Measure of Description Quality for Data Mining and its Implementation in the AQ18 Learning System. In: Proceedings of the ICSC Congress on Computational Intelligence Methods and Applications (CIMA-99). Rochester; 1999. p. 369-75.Google Scholar