Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Medicine and Health Sciences
Bayesian Nonparametric Cross-Study Validation Of Prediction Methods, Lorenzo Trippa, Levi Waldron, Curtis Huttenhower, Giovanni Parmigiani
Bayesian Nonparametric Cross-Study Validation Of Prediction Methods, Lorenzo Trippa, Levi Waldron, Curtis Huttenhower, Giovanni Parmigiani
Publications and Research
We consider comparisons of statistical learning algorithms using multiple data sets, via leave-one-in cross-study validation: each of the algorithms is trained on one data set; the resulting model is then validated on each remaining data set. This poses two statistical challenges that need to be addressed simultaneously. The first is the assessment of study heterogeneity, with the aim of identifying a subset of studies within which algorithm comparisons can be reliably carried out. The second is the comparison of algorithms using the ensemble of data sets. We address both problems by integrating clustering and model comparison. We formulate a Bayesian …