Engineering Commons^™

Sampling With Prior Knowledge For High-Dimensional Gravitational Wave Data Analysis, He Wang, Zhoujian Cao, Yue Zhou, Zong-Kuan Guo, Zhixiang Ren

Big Data Mining and Analytics

Extracting knowledge from high-dimensional data has been notoriously difficult, primarily due to the so-called "curse of dimensionality" and the complex joint distributions of these dimensions. This is a particularly profound issue for high-dimensional gravitational wave data analysis where one requires to conduct Bayesian inference and estimate joint posterior distributions. In this study, we incorporate prior physical knowledge by sampling from desired interim distributions to develop the training dataset. Accordingly, the more relevant regions of the high-dimensional feature space are covered by additional data points, such that the model can learn the subtle but important details. We adapt the normalizing flow …