Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 7 of 7

Full-Text Articles in Education

I’Ve (Urn)Ed This: An Application And Criterion-Based Evaluation Of The Urnings Algorithm, Ted Daisher Nov 2023

I’Ve (Urn)Ed This: An Application And Criterion-Based Evaluation Of The Urnings Algorithm, Ted Daisher

Doctoral Dissertations

There is increased interest in personalized learning and making e-learning environments more adaptable. Some e-learning systems may use an Item Response Theory (IRT)-based assessment system. An important distinction between assessment and learning contexts is that learner proficiency is expected to remain constant across an assessment, while it is expected to change over time in a learning context. Constant learner proficiency during an assessment enables conventional approaches to estimating person and item parameters using IRT. These IRT-based systems could be abandoned for alternative approaches to modeling learners and system learning content, but assessments may provide more functions than adapting learning material …


Aberrant Response Detection: Incorporating Cumulative Sum Control Chart And Change-Point Analysis, Siyu Wan Nov 2023

Aberrant Response Detection: Incorporating Cumulative Sum Control Chart And Change-Point Analysis, Siyu Wan

Doctoral Dissertations

The detection of aberrant responses in psychological and educational testing is crucial for maintaining the validity and reliability of assessment scores. This dissertation evaluates the performance of a new detection method, known as the bootstrap method, specifically targeting random guessing behaviors. A simulation design is used to compare the bootstrap method with traditional cumulative sum control chart (CUSUM) and change-point analysis (CPA) methods, considering various test lengths and severity rates. The findings indicate that the bootstrap method did not exhibit superior performance in detecting aberrant responses compared to the traditional methods. It demonstrated lower detection power and higher type I …


The Evaluation Of "The Wrong Answer Project" As Validity Evidence For The Social Consequences Of Testing, Darius D. Taylor Aug 2023

The Evaluation Of "The Wrong Answer Project" As Validity Evidence For The Social Consequences Of Testing, Darius D. Taylor

Doctoral Dissertations

The use of educational tests for making high stakes decisions has had societal consequences for decades. Parents, teachers, and administrators have been willing to pay off, lie, cheat, and steal so that their children, students, and they themselves would not fall prey to the negative consequences of subpar performance on educational assessments. Respected psychometric scholars have supported Samuel Messick’s claim over the years, but their advocacy has caught minimal traction. I founded an initiative in 2019 – The Wrong Answer Project – that shows promise as a vehicle for collecting validity evidence based on the social consequences of testing and …


The Impact Of Special Education Status And Text-To-Speech On Test-Taker Engagement, Maura O'Riordan Aug 2023

The Impact Of Special Education Status And Text-To-Speech On Test-Taker Engagement, Maura O'Riordan

Doctoral Dissertations

If a student is not engaged during a test, their test score will not be an accurate representation of what they are capable of. This is a concern because of the possible negative impact on the validity of test score interpretations and decisions being made based on such test scores that are not in the best interest of the student. If this is negatively impacting an entire subgroup of students, such as special education students, differentially, there may be larger-scale impact. To date, limited research has examined the relationship between test-taker engagement and special education status. The purpose of this …


Accreditation Of Teaching And Research Universities In Afghanistan: A Policy Implementation Analysis, Sayed Javid Mussawy Apr 2023

Accreditation Of Teaching And Research Universities In Afghanistan: A Policy Implementation Analysis, Sayed Javid Mussawy

Doctoral Dissertations

The quest for quality has encouraged many countries to establish quality assurance and accreditation models to sustain and improve quality. While some established their own procedures, a great majority of the countries including those in the developing world have adopted quality assurance policies developed in the Global North to respond to internationalization and to participate in the knowledge economy. However, most universities in developing countries lack adequate infrastructure to implement accreditation standards. Thus, investigating the implementation of accreditation policies in developing nations provides new insight into the opportunities and challenges posed by internationalization of quality assurance and accreditation. This study …


An Experiential Approach To Test Design And Validation, Sergio Andres Araneda Galarce Apr 2023

An Experiential Approach To Test Design And Validation, Sergio Andres Araneda Galarce

Doctoral Dissertations

In this Dissertation, I will present the theoretical basis and two proof-of-concept studies of something I will call an “Experiential” approach to Test Design and Validation. This approach finds its origins in Game design, where the effort goes around the experience elicited by a device (a game). The idea of the experiential approach is to apply the mindset of game design into test design. First, I present a literature review of conceptual frameworks referring to “Experience” and a novel conceptual framework for the context of Educational Testing. Then, I do a literature review of scientific epistemologies and feminist epistemologies in …


Validating Middle School Principals' Opinions About The Impact Of Investments, David Adler Apr 2023

Validating Middle School Principals' Opinions About The Impact Of Investments, David Adler

Doctoral Dissertations

Accountability for American public education systems, which spend more than $750 billion annually as of 2019, has been a topic of longstanding controversy. The test-based accountability movement has led to conditions that penalize schools that educate traditionally underserved students (low socioeconomic status, English language learners and students with disabilities are examined in this paper). Further, leaders of these schools lack evidence-based guidance to help make high-impact improvements, as schools serving high proportions of these students are rarely cited as exemplars of high-quality education. In three phases, this study demonstrates the feasibility of using a demographically normed, test-based status metric to …