Psychology Commons^™

A Novel Examination Of None-Of-The-Above As It Influences Examinee Item Responses, Kathryn N. Thompson

Dissertations, 2020-current

It is imperative to collect validity evidence prior to interpreting and using test scores. During the process of collecting validity evidence, test developers should consider whether test scores are contaminated by sources of extraneous information. This is referred to as construct irrelevant variance, or the “degree to which test scores are affected by processes that are extraneous to the test’s intended purpose” (AERA et al., 2014, p. 12). One possible source of construct irrelevant variance is violating item-writing guidelines, such as to “avoid the use of none-of-the-above” in multiple-choice items (Rodriguez, 2016, p. 268).

Numerous studies have been conducted with …

Student Engagement In The Assessment Context: An Examination Of The Cognitive Engagement Scale-Extended Version (Ces-E), Ashley Brianne Charsha

Masters Theses, 2010-2019

Increasing pressure on institutions of higher education to demonstrate what students are learning has resulted in an increase in assessment testing. Because these assessments are often low-stakes for students, educators often question whether inferences based on the resulting student scores are valid. Not unexpectedly, questions often arise regarding the extent to which students are engaged on low-stakes assessments. Additionally, how their level of engagement impacts their performance is also questioned. These questions are empirical in nature. Before such questions can be examined, a psychometrically sound instrument of cognitive engagement appropriate for the assessment context must be identified. This study sought …

Measuring Employability Among College Students: A Validity Study, Megan Rodgers

Masters Theses, 2010-2019

The practice of assessment in higher education is often focused on measuring outcomes of student success. However, the potential for a student to obtain a job (i.e., their employability) after graduation is often not directly measured. This reality is unfortunate given the competitive job market and rising cost of an education. One scale, the Employability Skills Inventory (ESI) has been identified as a potential assessment instrument that purports to measure skills necessary for employment in most occupations. Before deciding to use any scale for a particular purpose, one must establish that the scale is both reliable and valid. The focus …