Bayesian network data imputation with application to survival tree analysis

Paola M.V. Rancoita, Marco Zaffalon, Emanuele Zucca, Francesco Bertoni, Cassio P. de Campos

Research output: Contribution to journalArticle

9 Citations (Scopus)
262 Downloads (Pure)

Abstract

Retrospective clinical datasets are often characterized by a relatively small sample size and many missing data. In this case, a common way for handling the missingness consists in discarding from the analysis patients with missing covariates, further reducing the sample size. Alternatively, if the mechanism that generated the missing allows, incomplete data can be imputed on the basis of the observed data, avoiding the reduction of the sample size and allowing methods to deal with complete data later on. Moreover, methodologies for data imputation might depend on the particular purpose and might achieve better results by considering specific characteristics of the domain. The problem of missing data treatment is studied in the context of survival tree analysis for the estimation of a prognostic patient stratification. Survival tree methods usually address this problem by using surrogate splits, that is, splitting rules that use other variables yielding similar results to the original ones. Instead, our methodology consists in modeling the dependencies among the clinical variables with a Bayesian network, which is then used to perform data imputation, thus allowing the survival tree to be applied on the completed dataset. The Bayesian network is directly learned from the incomplete data using a structural expectation–maximization (EM) procedure in which the maximization step is performed with an exact anytime method, so that the only source of approximation is due to the EM formulation itself. On both simulated and real data, our proposed methodology usually outperformed several existing methods for data imputation and the imputation so obtained improved the stratification estimated by the survival tree (especially with respect to using surrogate splits).
Original languageEnglish
Pages (from-to)373–387
Number of pages15
JournalComputational Statistics & Data Analysis
Volume93
Early online date03 Jan 2015
DOIs
Publication statusPublished - Jan 2016

Fingerprint Dive into the research topics of 'Bayesian network data imputation with application to survival tree analysis'. Together they form a unique fingerprint.

  • Cite this