Physical Sciences and Mathematics Commons^™

An Analog Experiment Comparing Goal-Free Evaluation And Goal Achievement Evaluation Utility, Brandon W. Youker

Dissertations

Goal-free evaluation (GFE) is the process of determining the merit of an evaluand independent of the stated or implied goals and objectives, whereas goal achievement evaluation (GAE), as the most rudimentary form of goal-based evaluation, determines merit according to the evaluand’s level of accomplishment with regard to its goals. This study examines the utility of GAE and GFE from the perspective of the evaluation’s intended users. In the study, two evaluation teams, goal achievement and goal-free, independently and simultaneously evaluate the same human service program. Each team produced a final evaluation report, which was read by the evaluation’s users, who …

Bayesian Item Response Theory: Statistical Inference And Power Analysis, Jason W. Bodnar

Dissertations

The regulatory pharmaceutical approval process is flawed in that industry clinical trials (ICTs) are always powered for efficacy and rarely powered for safety. The key safety parameter is the adverse event (AE). This practice may result in efficacious products with confounded safety. An ICT’s ability to be powered for detecting AE trends may improve patient safety. Therefore, this dissertation’s purpose was to determine if power analysis resulted in feasible sample sizes for substantiating AE hypotheses. AEs were modeled with three Bayesian 2PL IRT models. The unidimensional latent trait, transfusion-related AE, was modeled as a patient predisposition for experiencing an AE. …

Death By Boredom: The Role Of Visual Processing Theory In Written Evaluation Communication, Stephanie D. H. Evergreen

Dissertations

Evaluation reporting is an educational act and, as such, should be communicated using principles that support cognition. This study drew upon visual processing theory and theory-based graphic design principles to develop the Evaluation Report Layout Checklist intended to guide report development and support cognition in the readers of evaluation reports. It was then reviewed by an expert panel and applied by a group of raters to a set of evaluation reports obtained from the Informal Science Education evaluation website with maximum variability sampling. Results showed fairly high exact percent agreement and strong to very strong correlation with the author’s ratings. …

Summative Confidence, Paul Cristian Gugiu

Dissertations

Often the singular goal of an evaluation is to render a summative conclusion of merit, worth or feasibility that is based on multiple streams of multidimensional data. Exacerbating this difficulty, conducting evaluations in real-world settings often necessitates implementation of less than ideal study designs. This reality gets further complicated by the standard method for estimating the precision of results via the confidence interval (CI). Traditional CIs offer a limited approach for understanding the precision of a summative conclusion. This dissertation develops and presents a unified approach for the construction of a CI for a summative conclusion (SC).

This study derived …