Physical Sciences and Mathematics Commons^™

Summative Confidence, Paul Cristian Gugiu

Dissertations

Often the singular goal of an evaluation is to render a summative conclusion of merit, worth or feasibility that is based on multiple streams of multidimensional data. Exacerbating this difficulty, conducting evaluations in real-world settings often necessitates implementation of less than ideal study designs. This reality gets further complicated by the standard method for estimating the precision of results via the confidence interval (CI). Traditional CIs offer a limited approach for understanding the precision of a summative conclusion. This dissertation develops and presents a unified approach for the construction of a CI for a summative conclusion (SC).

This study derived …

Robust Adaptive Scheme For Linear Mixed Models, Gabriel Asare Okyere

Dissertations

If the underlying distribution of a statistical model is known then a procedure which maximizes power and efficiency can be selected. For example, if the distribution of errors is known to be normal in a linear model then inference based on least squares maximizes power and efficiency. More generally, if this distribution is known then a ranked based inference based on the appropriate rank score function has maximum efficiency. In practice, though, this distribution is not known. Adaptive schemes are procedures which hopefully select appropriate methods to optimize the analysis.

Hogg (1974) presented an adaptive rank-based scheme for testing in …

Robust Nonparametric Methods For Regression To The Mean Model, Therawat Wisadrattanapong

Dissertations

Regression to the mean is a statistical phenomenon that often confounds treatment effects in experiments. Consider an experiment involving a treatment, in which a response is measured (baseline) on a subject then a treatment is applied and a second measurement is taken. Then under many bivariate models for the pair of responses (including the bivariate normal), the predicted response of the second measurement will regress to the mean. In experiments where the second response is only taken for a select sample, say above a cutoff value, then this regression to the mean effect may mistakenly be thought of as a …

An Analog Experiment Comparing Goal-Free Evaluation And Goal Achievement Evaluation Utility, Brandon W. Youker

Dissertations

Goal-free evaluation (GFE) is the process of determining the merit of an evaluand independent of the stated or implied goals and objectives, whereas goal achievement evaluation (GAE), as the most rudimentary form of goal-based evaluation, determines merit according to the evaluand’s level of accomplishment with regard to its goals. This study examines the utility of GAE and GFE from the perspective of the evaluation’s intended users. In the study, two evaluation teams, goal achievement and goal-free, independently and simultaneously evaluate the same human service program. Each team produced a final evaluation report, which was read by the evaluation’s users, who …

Bayesian Item Response Theory: Statistical Inference And Power Analysis, Jason W. Bodnar

Dissertations

The regulatory pharmaceutical approval process is flawed in that industry clinical trials (ICTs) are always powered for efficacy and rarely powered for safety. The key safety parameter is the adverse event (AE). This practice may result in efficacious products with confounded safety. An ICT’s ability to be powered for detecting AE trends may improve patient safety. Therefore, this dissertation’s purpose was to determine if power analysis resulted in feasible sample sizes for substantiating AE hypotheses. AEs were modeled with three Bayesian 2PL IRT models. The unidimensional latent trait, transfusion-related AE, was modeled as a patient predisposition for experiencing an AE. …

Death By Boredom: The Role Of Visual Processing Theory In Written Evaluation Communication, Stephanie D. H. Evergreen

Dissertations

Evaluation reporting is an educational act and, as such, should be communicated using principles that support cognition. This study drew upon visual processing theory and theory-based graphic design principles to develop the Evaluation Report Layout Checklist intended to guide report development and support cognition in the readers of evaluation reports. It was then reviewed by an expert panel and applied by a group of raters to a set of evaluation reports obtained from the Informal Science Education evaluation website with maximum variability sampling. Results showed fairly high exact percent agreement and strong to very strong correlation with the author’s ratings. …