Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 6 of 6
Full-Text Articles in Education
An Experiential Approach To Test Design And Validation, Sergio Andres Araneda Galarce
An Experiential Approach To Test Design And Validation, Sergio Andres Araneda Galarce
Doctoral Dissertations
In this Dissertation, I will present the theoretical basis and two proof-of-concept studies of something I will call an “Experiential” approach to Test Design and Validation. This approach finds its origins in Game design, where the effort goes around the experience elicited by a device (a game). The idea of the experiential approach is to apply the mindset of game design into test design. First, I present a literature review of conceptual frameworks referring to “Experience” and a novel conceptual framework for the context of Educational Testing. Then, I do a literature review of scientific epistemologies and feminist epistemologies in …
Differential Prediction And Validity Of Advanced Placement (Ap®) For Student Subgroups, Minji K. Lee
Differential Prediction And Validity Of Advanced Placement (Ap®) For Student Subgroups, Minji K. Lee
Doctoral Dissertations
Concerns over fairness permeates every aspect of the testing enterprise, and one characterization of fairness in testing defined by the Standards (AERA, APA, & NCME, 1999) is a fairness as lack of bias. One important way to study bias in college admission context concerns the degree to which prediction equations are equivalent for different groups. To the extent that the AP variables are used together with admission test scores and previous academic records to predict future academic achievement, it is important to know if members of one group are systematically predicted to obtain lower or higher grades than they actually …
Evaluating The Validity Of Accommodations For English Learners Through Evidence Based On Response Processes, Katrina Crotts
Evaluating The Validity Of Accommodations For English Learners Through Evidence Based On Response Processes, Katrina Crotts
Open Access Dissertations
English learners (ELs) represent one of the fastest growing student populations in the United States. Given that language can serve as a barrier in EL performance, test accommodations are provided to help level the playing field and allow ELs to better demonstrate their true performance level. Test accommodations on the computer offer the ability to collect new types of data difficult to obtain via paper-and-pencil tests. Specifically, these data can be used as additional sources of validity evidence when examining test accommodations. To date, limited research has examined computer-based accommodations, thus limiting these additional sources of validity evidence. The purpose …
Application Of Item Response Theory Models To The Algorithmic Detection Of Shift Errors On Paper And Pencil Tests, Robert Joseph Cook
Application Of Item Response Theory Models To The Algorithmic Detection Of Shift Errors On Paper And Pencil Tests, Robert Joseph Cook
Open Access Dissertations
On paper and pencil multiple choice tests, the potential for examinees to mark their answers in incorrect locations presents a serious threat to the validity of test score interpretations. When an examinee skips one or more items (i.e., answers out of sequence) but fails to accurately reflect the size of that skip on their answer sheet, that can trigger a string of misaligned responses called shift errors. Shift errors can result in correct answers being marked as incorrect, leading to possible underestimation of an examinee's true ability. Despite movement toward computerized testing in recent years, paper and pencil multiple choice …
Evaluating The Validity Of Mcas Scores As An Indicator Of Teacher Effectiveness, Jenna M. Copella
Evaluating The Validity Of Mcas Scores As An Indicator Of Teacher Effectiveness, Jenna M. Copella
Open Access Dissertations
The Massachusetts Department of Secondary and Elementary Education (DESE) has implemented an Educator Evaluation Framework that requires MCAS scores be used as a significant indicator of teacher effectiveness when available. This decision has implications for thousands of Massachusetts public school teachers. To date, DESE has not provided evidence to support the validity of using MCAS scores to make interpretations about teacher effectiveness. A review of the literature reveals much variation in the degree to which teachers use state-adopted content standards to plan instruction. The findings in the literature warrant investigation into teacher practice among Massachusetts public school teachers. The research …
Using Item Mapping To Evaluate Alignment Between Curriculum And Assessment, Leah Tepelunde Kaira
Using Item Mapping To Evaluate Alignment Between Curriculum And Assessment, Leah Tepelunde Kaira
Open Access Dissertations
There is growing interest in alignment between state's standards and test content partly due to accountability requirements of the No Child Left Behind (NCLB) Act of 2001. Among other problems, current alignment methods almost entirely rely on subjective judgment to assess curriculum-assessment alignment. In addition none of the current alignment models accounts for student actual performance on the assessment and there are no consistent criteria for assessing alignment across the various models. Due to these problems, alignment results employing different models cannot be compared. This study applied item mapping to student response data for the Massachusetts Adult Proficiency Test (MAPT) …