Social and Behavioral Sciences Commons^™

Fast Permutation Tests That Maximize Power Under Conventional Monte Carlo Sampling For Pairwise And Multiple Comparisons, J. D. Opdyke

Journal of Modern Applied Statistical Methods

While the distribution-free nature of permutation tests makes them the most appropriate method for hypothesis testing under a wide range of conditions, their computational demands can be runtime prohibitive, especially if samples are not very small and/or many tests must be conducted (e.g. all pairwise comparisons). This paper presents statistical code that performs continuous-data permutation tests under such conditions very quickly – often more than an order of magnitude faster than widely available commercial alternatives when many tests must be performed and some of the sample pairs contain a large sample. Also presented is an efficient method for obtaining a …