Statistical Methodology Commons^™

Cross-Validation And Hypothesis Testing In Neuroimaging: An Irenic Comment On The Exchange Between Friston And Lindquist Et Al., Philip T. Reiss

Philip T. Reiss

The “ten ironic rules for statistical reviewers” presented by Friston (2012) prompted a rebuttal by Lindquist et al. (2013), which was followed by a rejoinder by Friston (2013). A key issue left unresolved in this discussion is the use of cross-validation to test the significance of predictive analyses. This note discusses the role that cross-validation-based and related hypothesis tests have come to play in modern data analyses, in neuroimaging and other fields. It is shown that such tests need not be suboptimal and can fill otherwise-unmet inferential needs.