Social and Behavioral Sciences Commons^™

An Empirical Demonstration Of The Existence Of Measurement Dependence In The Results Of A Meta-Analysis, William R. Nugent, Sukyung Yoon, Jayme E. Walters

Sociology, Social Work and Anthropology Faculty Publications

Objective: Findings from meta-analytic studies that use standardized mean differences (SMDs) may be overly dependent on the original measures that were used to generate SMDs. This may be particularly true when measures have arbitrary metrics or when measures fail to meet measurement equivalence. We test the hypothesis that in such cases, meta-analytic results may vary significantly— statistically and practically—as a function of the measures used to derive SMDs. Methods: We conducted 5 secondary random-effects meta-analyses of SMDs—each under a different measurement scenario—from a published meta-analysis comparing the efficacy of cognitive–behavioral therapy with that of reminiscence therapy for depression in older …