Open Access. Powered by Scholars. Published by Universities.®
- Discipline
- Keyword
-
- Confirmatory factor analysis (2)
- Higher education (2)
- Mixture modeling (2)
- ANOVA (1)
- Anchoring vignettes (1)
-
- Assessment (1)
- Bayesian inference (1)
- Change scores (1)
- Classification analysis (1)
- Cluster analysis (1)
- Coefficient alpha (1)
- Construct-irrelevant variance (1)
- Correlated errors (1)
- DIRC (1)
- Difference scores (1)
- Differential interpretation of response categories (1)
- Examinee effort (1)
- Factor analysis (1)
- Faculty expectations (1)
- Heatmap (1)
- Higher education assessment (1)
- Honors Program assessment (1)
- Learning gains (1)
- Learning improvement (1)
- Longitudinal (1)
- Longitudinal methods (1)
- Measurement (1)
- Mediation (1)
- Mixed methods (1)
- Model fit evaluation (1)
Articles 1 - 11 of 11
Full-Text Articles in Quantitative Psychology
Test Emotions, Value, And Self-Efficacy: A Longitudinal Model Predicting Examinee Effort And Performance On A Low-Stakes Test, Paulius Satkus
Test Emotions, Value, And Self-Efficacy: A Longitudinal Model Predicting Examinee Effort And Performance On A Low-Stakes Test, Paulius Satkus
Masters Theses, 2010-2019
The validity of scores from low-stakes tests may be compromised by examinee motivation. Expectancy-Value theory (EV) has been used to frame the antecedents of examinee motivation in low-stakes testing contexts. According to EV theory, the perceived value of the test and the expectancy to succeed on the test directly affect examinee effort, which then affects test performance. Cross-sectional research studies in low-stakes testing contexts offer some support of EV theory. Control-Value theory (CV) serves as another theory to understand motivation toward a task. CV theory encompasses the constructs of expectancy and value from EV theory, but incorporates test emotions as …
Posterior Predictive Model Checking Of Local Misfit For Bayesian Confirmatory Factor Analysis, Chi Hang Au
Posterior Predictive Model Checking Of Local Misfit For Bayesian Confirmatory Factor Analysis, Chi Hang Au
Masters Theses, 2010-2019
Posterior predictive model checks (PPMC) are one Bayesian model-data fit approach. Thus far, PPMC for Confirmatory Factor Analytic applications focused primarily on global fit evaluation, ignoring the nuanced information in local misfit diagnostics. This study developed a PPMC approach for local misfit and applied it to a test-taking motivation scale. If the PPMC approach is effective, fit conclusions derived from the PPMC approach should be congruent with the fit conclusions derived from the Frequentist approach. Number of item-pairs flagged as misfitting and number of disagreements were computed to evaluate congruence. Congruence is achieved if the number of item-pairs flagged as …
Beyond Motivation: Differences In Score Meaning Between Assessment Conditions, Nikole Gregg
Beyond Motivation: Differences In Score Meaning Between Assessment Conditions, Nikole Gregg
Masters Theses, 2010-2019
Written communication is a skill necessary for not only the success of undergraduate students, but for post-graduates in the workplace. Furthermore, according to employers the writing skills of post-graduates tend to be below expectations. Therefore, the assessment of such skills within higher education is in high demand. Written communication assessments tend to be administered in one of two conditions: 1) course embedded and 2) a low-stakes, non-embedded condition. The current study investigated possible construct-irrelevant variance in writing assessment scores by using data from a mid-sized public university in the Mid-Atlantic region of the United States. Specifically, 157 student products were …
Examining The Type I Error And Power Of 18 Common Post-Hoc Comparison Tests, Derek Sauder
Examining The Type I Error And Power Of 18 Common Post-Hoc Comparison Tests, Derek Sauder
Masters Theses, 2010-2019
Researchers utilizing either experimental or quasi-experimental research often want to compare group means. However, with more than two groups, comparing group means may result in an inflated Type I error rate, the probability of wrongly rejecting a null hypothesis. Researchers often employ analysis of variance (ANOVA) methodology to compare more than two group means. Post-hoc comparison procedures (PCPs) are utilized to indicate which group means differ following a significant ANOVA. SPSS provides 18 options for PCPs. The purpose of this study was to determine which PCP provides the best power while maintaining Type I error control when assumptions of ANOVA …
Retrospective Versus Prospective Measurement Of Examinee Motivation In Low-Stakes Testing Contexts: A Moderated Mediation Model, Aaron J. Myers
Retrospective Versus Prospective Measurement Of Examinee Motivation In Low-Stakes Testing Contexts: A Moderated Mediation Model, Aaron J. Myers
Masters Theses, 2010-2019
Expectancy-value theory applied to examinee motivation suggests examinees’ perceived value of a test indirectly affects test performance via examinee effort. This empirically supported indirect effect, however, is often modeled using importance and effort scores measured after test completion, which does not align with their theoretically specified temporal order. Retrospectively measured importance and effort scores may be influenced by examinees’ test performance, impacting the estimate of the indirect effect. To investigate the effect of timing of measurement, first-year college students were randomly assigned to one of three conditions where (1) importance and effort were measured retrospectively; (2) importance was measured prospectively; …
Student Learning Gains In Higher Education: A Longitudinal Analysis With Faculty Discussion, Catherine E. Mathers
Student Learning Gains In Higher Education: A Longitudinal Analysis With Faculty Discussion, Catherine E. Mathers
Masters Theses, 2010-2019
Student learning is the primary desired outcome of a college education. To understand how educational programming and curricula affect students, colleges and universities must collect evidence of student learning gain. In this study, a longitudinal design was employed to investigate how a math and science general education curriculum impacted college students’ quantitative and scientific reasoning. Quantitative and scientific reasoning gain scores were computed and predicted from personal (i.e., prior knowledge, gender) and curriculum (i.e., number of completed courses in the domain) characteristics to uncover what factors relate to learning gain. Collapsing across personal and curriculum variables, gain scores were moderate …
Examining Latent Change Classes: An Application Of Factor Mixture Modeling To Change Scores, Thai Q. Ong
Examining Latent Change Classes: An Application Of Factor Mixture Modeling To Change Scores, Thai Q. Ong
Masters Theses, 2010-2019
Although change scores are used in a variety of statistical methods (e.g., analysis of variance and regression), there is a lack of application of latent variable modeling methods to change scores. This thesis provides a detailed description of two latent variable modeling methods applied to change scores: factor analysis of change scores and change score factor mixture modeling. To illustrate advantages of these methods, both were applied to change score data from undergraduates. Students responded to sense of identity items during a university-wide assessment day on two occasions, once as incoming freshmen and again as second-semester sophomores. Change scores were …
The Effect Of Anchoring Vignettes On Factor Structures: Student Effort As An Example, Carolyn A. Miesen
The Effect Of Anchoring Vignettes On Factor Structures: Student Effort As An Example, Carolyn A. Miesen
Masters Theses, 2010-2019
Anchoring vignettes are used as a methodological technique for removing differential interpretation of response categories (DIRC) from scores on subjective self-report measures (King, Murray, Slomon, & Tandon, 2004). This technique requires participants to read one or more short scenarios, or vignettes, designed to represent various levels of a construct. Vignette ratings are used as an indication of DIRC, which is a source of differential item functioning (DIF). Prior research primarily used indirect methods for evaluating vignette quality. In response, the present set of studies proposes using invariance testing as a more direct evaluation of how the use of anchoring vignettes …
The Effects Of Ordinal Data On Coefficient Alpha, Kathryn E. Pinder
The Effects Of Ordinal Data On Coefficient Alpha, Kathryn E. Pinder
Masters Theses, 2010-2019
Given coefficient alpha’s wide prevalence as a measure of internal reliability, it is important to know the conditions under which it is an appropriate estimate of reliability. The present paper explores alpha’s assumption of uncorrelated errors when used with ordinal data. Alpha overestimates true reliability when correlated errors are present. In this paper, I use a simulation study to recreate three mechanisms proposed to create correlated errors in ordinal data. The first mechanism, misclassification error, occurs when there are correlated measurement errors present in the data. The second mechanism, grouping error, occurs when there are not enough categories to represent …
Propensity Score Matching In Higher Education Assessment, Heather D. Harris
Propensity Score Matching In Higher Education Assessment, Heather D. Harris
Masters Theses, 2010-2019
The applied nature of higher education assessment does not lend itself to rigorous experimental research designs. However, assessment practitioners would like to make claims about the influence of educational programs on student learning outcomes. Propensity score matching (PSM) methods are quasi-experimental techniques that allow researchers to control for known confounding variables. In the context of higher education, PSM techniques allow assessment practitioners to control for confounding variables related to students’ self-selected participation in university programs. Research and recommendations on how to apply PSM techniques are scattered throughout several disciplines. However, additional research is needed to evaluate how well PSM techniques …
Persons Can Speak Louder Than Variables: Person-Centered Analyses And The Prediction Of Student Success, Elisabeth M. Pyburn
Persons Can Speak Louder Than Variables: Person-Centered Analyses And The Prediction Of Student Success, Elisabeth M. Pyburn
Masters Theses, 2010-2019
In order to ensure that analyses are appropriate for one’s research question(s), it is important to consider whether a person-centered or variable-centered approach is needed. Person-centered approaches are often not considered in situations for which they would be appropriate. To that end, a description of the characteristics and procedures of two common person-centered analyses (cluster analysis and mixture modeling) are provided. Although both analyses accomplish the same general aim – to group persons based on their similarity on a series of variables, thus providing ease of interpretation – the methods employed for each analysis differ considerably. As illustration, both analyses …