Education Commons^™

Empirical Evaluation Of Different Features Of Design In Confirmatory Factor Analysis, Deyab Almaleki

Dissertations

Factor analysis (FA) is the study of variance within a group. Within-subject variance (WSV) is affected by multiple features in a study context, such as: the study experimental design (ED) and sampling design (SD), thus anything that influences or changes variance may affect the conclusions related to FA.

The aim of this study was to provide empirical evaluation of the influence of different aspects of ED and SD on WSV in the context of FA in terms of model precision and model estimate stability. Four Monte Carlo population correlation matrices were hypothesized based on different communality magnitudes (high, moderate, low, …

Improving The Design Of Cluster-Randomized Trials In Education: Informing The Selection Of Variance Design Parameter Values For Science Achievement Studies, Carl D. Westine

Dissertations

The purpose of this three-essay dissertation is to provide practical guidance to evaluators planning cluster-randomized trials (CRTs) of science achievement. In an educational setting, interventions are often administered at the cluster level, while outcomes are typically measured at the student level through standardized achievement testing. When evaluating an intervention, a CRT is appropriate because it allows for treatment to be modeled at a different level than the unit of analysis, and properly accounts for the violation of independence that occurs due to nesting. Accurately designing a CRT involves estimating variance parameters (i.e., intraclass correlations [ICCs] and percent of variance explained …

A Comparative Study Of Exact Versus Propensity Matching Techniques Using Monte Carlo Simulation, Mukaria J. J. Itang'ata

Dissertations

Often researchers face situations where comparative studies between two or more programs are necessary to make causal inferences for informed policy decision-making. Experimental designs employing randomization provide the strongest evidence for causal inferences. However, many pragmatic and ethical challenges may preclude the use of randomized designs. In such situations, subject matching provides an alternative design approach for conducting causal inference studies. This study examined various design conditions hypothesized to affect matching procedures’ bias recovery ability.

See attachment for full abstract.

Bayesian Item Response Theory: Statistical Inference And Power Analysis, Jason W. Bodnar

Dissertations

The regulatory pharmaceutical approval process is flawed in that industry clinical trials (ICTs) are always powered for efficacy and rarely powered for safety. The key safety parameter is the adverse event (AE). This practice may result in efficacious products with confounded safety. An ICT’s ability to be powered for detecting AE trends may improve patient safety. Therefore, this dissertation’s purpose was to determine if power analysis resulted in feasible sample sizes for substantiating AE hypotheses. AEs were modeled with three Bayesian 2PL IRT models. The unidimensional latent trait, transfusion-related AE, was modeled as a patient predisposition for experiencing an AE. …

Death By Boredom: The Role Of Visual Processing Theory In Written Evaluation Communication, Stephanie D. H. Evergreen

Dissertations

Evaluation reporting is an educational act and, as such, should be communicated using principles that support cognition. This study drew upon visual processing theory and theory-based graphic design principles to develop the Evaluation Report Layout Checklist intended to guide report development and support cognition in the readers of evaluation reports. It was then reviewed by an expert panel and applied by a group of raters to a set of evaluation reports obtained from the Informal Science Education evaluation website with maximum variability sampling. Results showed fairly high exact percent agreement and strong to very strong correlation with the author’s ratings. …

A Comparative Study Of Interrater Reliability Coefficients Obtained From Different Statistical Procedures Using Monte Carlo Simulation Techniques, Ebrima Nying

Dissertations

Reliability estimation is a key research component within the global area of educational assessment. The literature reports numerous studies using different statistical techniques for estimating reliability of educational measures. However, few have focused on the estimation of interrater reliability of performance assessment (Abedi, Baker, & Herl, 1995). Specifically, this study compared three different methods for estimating interrater reliability to determine if there are differences among these estimates as a function of: sample size, measurement scale, number of raters and the theoretical population reliability (rho). The three methods of estimation were the Intraclass Correlation (ICC(2, k )) (Shrout & Fleiss, 1979), …

An Investigation Into Relationships Between Alternative Assessment And Pre-Service Elementary Teachers’ Beliefs About Mathematics, David Charles Coffey

Dissertations

The purpose of this study was to examine how including alternative assessments in a reform-based mathematics course affects pre-service teachers’ mathematical beliefs. A single section of a mathematics course designed for elementary education majors that employed three different alternative assessments was the setting for the study.

A pre- and post-belief survey completed by students enrolled in the section under study represented the first level of data collection and analysis. The results of the pre-belief survey guided the selection of seven informants from the section and provided belief statements for the informants to verify during subsequent interviews. Based on the data …