Other Statistics and Probability Commons^™

Reference Priors For Exponential Families With Increasing Dimension, Bertrand Clarke, Subhashis Ghosal

Department of Statistics: Faculty Publications

In this article, we establish the asymptotic normality of the posterior distribution for the natural parameter in an exponential family based on independent and identically distributed data. The mode of convergence is expected Kullback-Leibler distance and the number of parameters p is increasing with the sample size n. Using this, we give an asymptotic expansion of the Shannon mutual information valid when p = pm increases at a sufficiently slow rate. The second term in the asymptotic expansion is the largest term that depends on the prior and can be optimized to give Jeffrey's prior as the reference prior in …