Open Access. Powered by Scholars. Published by Universities.®
- Keyword
-
- Assessment (5)
- Collaboration (3)
- Equating (3)
- Item response theory (3)
- Teacher Professional Development (3)
-
- Black women (2)
- Classical test theory (2)
- Decision Accuracy (2)
- Education (2)
- Higher education (2)
- IRT (2)
- Kindergarten (2)
- Latinas (2)
- Literacy (2)
- Measurement invariance (2)
- Psychometrics (2)
- Reliability (2)
- Teacher Collaboration (2)
- Teacher attitudes (2)
- Teacher knowledge (2)
- Translanguaging (2)
- Validity (2)
- ADHD (1)
- Aberrant Response (1)
- Academic Performance (1)
- Access (1)
- Accessibility features (1)
- Accommodations (1)
- Accountability (1)
- Active Learning With Authenticity (1)
- Publication Year
Articles 1 - 30 of 59
Full-Text Articles in Education
Interrelationship Among Students’ Ict Usage, Attitude, And Academic Performance In Nordic Countries: Multilevel Structural Equation Modeling On Pisa 2018 And Timss 2019, Dukjae Lee
Doctoral Dissertations
The usage of digital devices has been an interest in the field of education as one of the useful instructional methods for students’ better learning. Although the usage seemed to be related to their academic performance (e.g., Pekto et al., 2017; Skryabin et al., 2015), it was still unclear if the usage itself directly affected better academic results. Therefore, this dissertation explored an interrelationship between students’ usage of digital devices and academic performance with a mediation effect of their attitude toward using digital devices. The study analyzed the datasets of five Nordic countries collected from PISA 2018 and TIMSS 2019, …
I’Ve (Urn)Ed This: An Application And Criterion-Based Evaluation Of The Urnings Algorithm, Ted Daisher
I’Ve (Urn)Ed This: An Application And Criterion-Based Evaluation Of The Urnings Algorithm, Ted Daisher
Doctoral Dissertations
There is increased interest in personalized learning and making e-learning environments more adaptable. Some e-learning systems may use an Item Response Theory (IRT)-based assessment system. An important distinction between assessment and learning contexts is that learner proficiency is expected to remain constant across an assessment, while it is expected to change over time in a learning context. Constant learner proficiency during an assessment enables conventional approaches to estimating person and item parameters using IRT. These IRT-based systems could be abandoned for alternative approaches to modeling learners and system learning content, but assessments may provide more functions than adapting learning material …
Aberrant Response Detection: Incorporating Cumulative Sum Control Chart And Change-Point Analysis, Siyu Wan
Aberrant Response Detection: Incorporating Cumulative Sum Control Chart And Change-Point Analysis, Siyu Wan
Doctoral Dissertations
The detection of aberrant responses in psychological and educational testing is crucial for maintaining the validity and reliability of assessment scores. This dissertation evaluates the performance of a new detection method, known as the bootstrap method, specifically targeting random guessing behaviors. A simulation design is used to compare the bootstrap method with traditional cumulative sum control chart (CUSUM) and change-point analysis (CPA) methods, considering various test lengths and severity rates. The findings indicate that the bootstrap method did not exhibit superior performance in detecting aberrant responses compared to the traditional methods. It demonstrated lower detection power and higher type I …
The Evaluation Of "The Wrong Answer Project" As Validity Evidence For The Social Consequences Of Testing, Darius D. Taylor
The Evaluation Of "The Wrong Answer Project" As Validity Evidence For The Social Consequences Of Testing, Darius D. Taylor
Doctoral Dissertations
The use of educational tests for making high stakes decisions has had societal consequences for decades. Parents, teachers, and administrators have been willing to pay off, lie, cheat, and steal so that their children, students, and they themselves would not fall prey to the negative consequences of subpar performance on educational assessments. Respected psychometric scholars have supported Samuel Messick’s claim over the years, but their advocacy has caught minimal traction. I founded an initiative in 2019 – The Wrong Answer Project – that shows promise as a vehicle for collecting validity evidence based on the social consequences of testing and …
The Impact Of Special Education Status And Text-To-Speech On Test-Taker Engagement, Maura O'Riordan
The Impact Of Special Education Status And Text-To-Speech On Test-Taker Engagement, Maura O'Riordan
Doctoral Dissertations
If a student is not engaged during a test, their test score will not be an accurate representation of what they are capable of. This is a concern because of the possible negative impact on the validity of test score interpretations and decisions being made based on such test scores that are not in the best interest of the student. If this is negatively impacting an entire subgroup of students, such as special education students, differentially, there may be larger-scale impact. To date, limited research has examined the relationship between test-taker engagement and special education status. The purpose of this …
Accreditation Of Teaching And Research Universities In Afghanistan: A Policy Implementation Analysis, Sayed Javid Mussawy
Accreditation Of Teaching And Research Universities In Afghanistan: A Policy Implementation Analysis, Sayed Javid Mussawy
Doctoral Dissertations
The quest for quality has encouraged many countries to establish quality assurance and accreditation models to sustain and improve quality. While some established their own procedures, a great majority of the countries including those in the developing world have adopted quality assurance policies developed in the Global North to respond to internationalization and to participate in the knowledge economy. However, most universities in developing countries lack adequate infrastructure to implement accreditation standards. Thus, investigating the implementation of accreditation policies in developing nations provides new insight into the opportunities and challenges posed by internationalization of quality assurance and accreditation. This study …
An Experiential Approach To Test Design And Validation, Sergio Andres Araneda Galarce
An Experiential Approach To Test Design And Validation, Sergio Andres Araneda Galarce
Doctoral Dissertations
In this Dissertation, I will present the theoretical basis and two proof-of-concept studies of something I will call an “Experiential” approach to Test Design and Validation. This approach finds its origins in Game design, where the effort goes around the experience elicited by a device (a game). The idea of the experiential approach is to apply the mindset of game design into test design. First, I present a literature review of conceptual frameworks referring to “Experience” and a novel conceptual framework for the context of Educational Testing. Then, I do a literature review of scientific epistemologies and feminist epistemologies in …
Validating Middle School Principals' Opinions About The Impact Of Investments, David Adler
Validating Middle School Principals' Opinions About The Impact Of Investments, David Adler
Doctoral Dissertations
Accountability for American public education systems, which spend more than $750 billion annually as of 2019, has been a topic of longstanding controversy. The test-based accountability movement has led to conditions that penalize schools that educate traditionally underserved students (low socioeconomic status, English language learners and students with disabilities are examined in this paper). Further, leaders of these schools lack evidence-based guidance to help make high-impact improvements, as schools serving high proportions of these students are rarely cited as exemplars of high-quality education. In three phases, this study demonstrates the feasibility of using a demographically normed, test-based status metric to …
The Gendered, Racialized, & Dis/Abled Experiences Of Neurodivergent Black Women Graduate Students Across Higher Education, Kat Stephens
The Gendered, Racialized, & Dis/Abled Experiences Of Neurodivergent Black Women Graduate Students Across Higher Education, Kat Stephens
Doctoral Dissertations
Black women graduate students with dis/abilities; those identifying as neurodivergent are scarce in contemporary research. Throughout widespread disability studies, research, and the research on neurodiversity, this lack is consistent regarding minoritized race and gender groupings (Matthews, 2019; Strong et al., 2020). Larger neurodivergent, ADHD, and Autism conversations tend to skew toward White boys and men (Travers, 2018). The convergence of disability (race, gender, and place/space) as another marginalized community and diverse student population, is an additional gap in the literature, despite the benefits of DisCrit (Annamma et al., 2013). Black women graduate students with disabilities, specifically those identifying as neurodivergent …
How Well Does The New York State Higher Education Opportunity Program Work For Black Men? A Mixed Methods Study, Michael A. Dejesus Iii
How Well Does The New York State Higher Education Opportunity Program Work For Black Men? A Mixed Methods Study, Michael A. Dejesus Iii
Doctoral Dissertations
Previous research trended towards a deficit-oriented approach to understanding and explaining Black male underachievement. The past education research has focused on discussing the underachievement of Black males in Higher education. Finding solutions often were prescriptive in “fixing” behaviors in Black males to improve academic achievement. Additionally, there has been a trend towards race-neutrality in education policies, programs, and admissions criteria. And there is a lack of research on whether race-neutrality further exacerbates Black male underachievement by ignoring key race and gender targeted supports services that could improve Black male academic outcomes in higher education. While Black men have historically struggled …
Avatars & Choice: Fostering Student Agency, Engagement, And Equity In Assessment, Sandra M. Sweeney
Avatars & Choice: Fostering Student Agency, Engagement, And Equity In Assessment, Sandra M. Sweeney
Doctoral Dissertations
Provision of item choice and use of digital avatars in reading assessment contexts may play a critical role in fostering student agency, engagement, and equity in assessment. Using a mixed methods approach, this study was conducted over four phases within an equity framework. Phase I consisted of a survey, during Phase II an iOS software application and reading test was developed, Phase III was an experimental study, and during phase IV post-experiment interviews were conducted. Research questions for this study (1) explored student interests and experiences related to assessments and technology use, (2) investigated the effect of item choice and …
Measurement Invariance Across Immigrant And Non-Immigrant Populations On Pisa Cognitive And Non-Cognitive Scales, Maritza Casas
Measurement Invariance Across Immigrant And Non-Immigrant Populations On Pisa Cognitive And Non-Cognitive Scales, Maritza Casas
Doctoral Dissertations
International large-scale educational assessments (ILSAs) have played a relevant role in educational policies targeting immigrant students across countries as their results are used by governments as input for decision-making purposes. Given the potential impact that ILSAs can have, the psychometric features of these assessments must be carefully assessed and empirical evidence about the extent to which the inferences made based on test results are valid must be collected. To do so, the first step is to determine if the test results have the same meaning across countries and groups of examinees that is, if the measures are invariant so that …
Using Generalizability And Rasch Measurement Theory To Ensure Rigorous Measurement In An International Development Education Evaluation, Louise Bahry
Doctoral Dissertations
Between the United States and Great Britain, over 30 billion USD was spent in 2018 on international aid, over a billion of which is dedicated to education programs alone. Recently, there has been increased attention on the rigorous evaluation of aid-funded programs, moving beyond counting outputs to the measurement of educational impact. The current study uses two methodological approaches (Generalizability (Brennan, 1992, 2001) and Rasch Measurement Theory (Andrich, 1978; Rasch, 1980; Wright & Masters, 1982) to analyze data from math and literacy assessments, and self-report surveys used in an international evaluation of an educational initiative in the Democratic Republic of …
Financing Public Higher Education In Afghanistan: Alternative Sources And Options, Hassan Aslami
Financing Public Higher Education In Afghanistan: Alternative Sources And Options, Hassan Aslami
Doctoral Dissertations
Adequate financing is key to achieving the priority goals of higher education – access, quality, and relevance. In Afghanistan, the demand for higher education has increased remarkably while public higher education institutions still rely heavily on inadequate government funding. In addition, the constitutional provision guaranteeing free higher education up to the bachelor’s level in public institutions, the overall weak economy of the country, and the lack of institutional autonomy, contribute to financial austerity in public higher education institutions. This study explored alternative funding sources and options for financing public universities in Afghanistan. An integrated theoretical framework guided this study as …
Evaluating Approaches For Dealing With Omitted Items In Large-Scale Assessments, Seong Eun Hong
Evaluating Approaches For Dealing With Omitted Items In Large-Scale Assessments, Seong Eun Hong
Doctoral Dissertations
Large-scale assessments (LSAs), such as the National Assessment of Educational Progress (NAEP) are low-stakes tests for examinees; consequently, they might randomly guess or generate no responses. Such disengaged test-taking behavior can undermine the validity of test score interpretation. To account for such behavior, various methods have been proposed over the years, which can be classified as ad hoc or model-based. For instance, the Programme for the International Assessment of Adult Competencies (PIAAC) uses a common time threshold (e.g., 5 seconds) method for all items: if an examinee spends more than or equal to five seconds on an item, the omitted …
Defining Inclusion: Surveying Educator Perceptions And Practices In Chile, Christina A. Bosch
Defining Inclusion: Surveying Educator Perceptions And Practices In Chile, Christina A. Bosch
Doctoral Dissertations
Despite earlier attempts to arrive at unified theories or conceptualizations, the international literature on inclusive education has increasingly documented the proliferation of operationalizations of inclusion in and even within single instances of policy, research, and practice, and called for further scholarly attention to such subjectivity. Specifically, there is a dearth of international research linking definitions to perceptions to practices within special and/or inclusive education, and findings on the efficacy of interventions to promote inclusive education practices in Spanish-speaking contexts or literature are similarly sparse. This study investigates how Latinx educators in K-12 schools conceptualize and practice inclusion with respect to …
Educators Perceptions Of Ebd, Inclusion, And Evidence-Based Practices, Andrea Larmon
Educators Perceptions Of Ebd, Inclusion, And Evidence-Based Practices, Andrea Larmon
Doctoral Dissertations
The field of education has been changing with regard to inclusion of students with disabilities in general education classrooms. Not only are we seeing more students with disabilities being educated in public schools, but we are seeing students with more significant special education needs. Although schools are expected to provide a Free and Appropriate Public Education (FAPE) in the Least Restrictive Environment (LRE), many of the staff within the school, such as special education teachers, general education teachers, related service providers, paraprofessionals, and even administrators, aren’t sure how to provide the services and implement the strategies to allow the students …
An Investigation Of Fit Criteria Within Mg-Cfa For Examining Non-Negligible Measurement Invariance, Abdolvahab Khademi
An Investigation Of Fit Criteria Within Mg-Cfa For Examining Non-Negligible Measurement Invariance, Abdolvahab Khademi
Doctoral Dissertations
One desirable property of a measurement process or instrument is the maximum invariance of the results across subpopulations with similar distribution of the traits. Determining measurement invariance (MI) is a statistical procedure in which different methods are used given different factors, such as the nature of the data (e.g. continuous, or discrete, completeness), sample size, measurement framework (e.g. observed scores, latent variable modeling), and other context-specific factors. To evaluate the statistical results, numerical criteria are often used, derived from theory, simulation, or practice. One statistical method to evaluate MI is multiple-group confirmatory factor analysis (MG-CFA) in which the amount of …
It’S All The Rage: An Animated Approach To Screening For Postpartum Depression, Amanda Gorham
It’S All The Rage: An Animated Approach To Screening For Postpartum Depression, Amanda Gorham
Doctoral Dissertations
Postpartum depression presents a complication for mothers which can, in some cases, be severe and even life-threatening. Instruments commonly used to screen for this psychological condition have been challenged by an extensive body of literature, with many mothers being unidentified and even untreated for their symptoms. The presented research introduces a newly developed screening instrument for detecting probable postpartum depression using text-free scenario-based animations, based on the lived experience of the condition as qualified by empirical research and the existing body of literature. Developed items were controlled for quality via Think Aloud Protocol and alignment studies with subject matter experts …
The Institutional Pillars Of China's National College Entrance Exam: A Case Study Of Gaozhong High School And Ncee Reforms, Mei Lan Frame
The Institutional Pillars Of China's National College Entrance Exam: A Case Study Of Gaozhong High School And Ncee Reforms, Mei Lan Frame
Doctoral Dissertations
This dissertation is based on a case study of a Beijing high school (referred to as “Gaozhong”) during the initial wave of reforms to the National College Entrance Exam (NCEE). Using the conceptual framework of Richard Scott’s “three pillars” of institutions (2008) to analyze stake holder perception toward the NCEE (administrators, teachers, parents, and students), this study identifies and examines the regulatory, normative, and cultural-cognitive elements that comprise the NCEE. Congruent with Scott’s theory that these the combined strength and interdependency between institutional elements prevent institutional change, this study also analyzes the three pillars as barriers to the implementation of …
What's In A Label? Unpacking The Meaning Of Achievement Labels From Tests, Francis O'Donnell
What's In A Label? Unpacking The Meaning Of Achievement Labels From Tests, Francis O'Donnell
Doctoral Dissertations
As a result of federal accountability policies, achievement level labels from statewide assessments are ascribed to public school students 17 times between grades 3 and 12. Depending on students’ performance and state of residence, they may be labeled inadequate or in need of support, below proficient or approaching expectations, level 3 or on track—to name a few examples. These labels are delivered through individual reports for students and parents as well as group reports for teachers. In spite of their widespread use, research on how achievement level labels are interpreted is minimal. The aim of this …
Are Some Horizons Broader Than Others? Study Abroad, Inequality, And The Influence On Careers And Education., Suzan Kommers
Are Some Horizons Broader Than Others? Study Abroad, Inequality, And The Influence On Careers And Education., Suzan Kommers
Doctoral Dissertations
Study abroad is one of the main ways in which higher education institutions provide students with the opportunity to gain international experiences. While study abroad is mostly discussed in terms of the beneficial effects on students’ learning and development, the results in this dissertation indicate that study abroad works for some but disadvantages other students. Based on nationally representative U.S. data, I examined 1) disparities in students’ opportunities to study abroad as well as the effect of study abroad on the socioeconomic outcomes 2) early career income and 3) graduate school enrollment. The combined studies in this dissertation provided insight …
A Top-Down Approach For Optimally Designing Multistage-Adaptive Tests, Hwanggyu Lim
A Top-Down Approach For Optimally Designing Multistage-Adaptive Tests, Hwanggyu Lim
Doctoral Dissertations
In multistage-adaptive testing (MST), there are many interrelated design variables that impact the nature and quality of ability estimation. Previous research has identified general principles for the effective design of MSTs in terms of measurement performance. However, those principles are unlikely to apply uniformly to every testing context. The purpose of this dissertation is to propose a process of finding an MST design that has optimal measurement properties, given a specific set of test circumstances. To achieve this goal, an efficient strategy was introduced at each of three phases to discover the optimal design of the MST; constructing MSTs, systematically …
Bringing Learning Back In: Examining Three Psychometric Models For Evaluating Learning Progression Theories, Duy Pham
Doctoral Dissertations
Learning progressions provide potentially valuable information to teachers about how to develop a scope and sequence for a group of learning objectives. However, for the learning progressions to be valuable, the progressions must be supported. Although there are several approaches and models that can be used to evaluate the validity of a learning progression, there is a dearth of research examining the advantages and limitations of each approach. The purpose of this study was to examine a multi-dimensional item response theory model and two cognitive diagnostic models (DINA and HO-DINA) for evaluating two learning progressions via a simulation study. In …
Urban Biodiversity Experience And Exposure: Intervention And Inequality At The Local And Global Scale, Evan Kuras
Urban Biodiversity Experience And Exposure: Intervention And Inequality At The Local And Global Scale, Evan Kuras
Masters Theses
As cities expand globally, researchers must clarify how human activities and institutions shape biodiversity and conversely, how ecological processes shape human outcomes. Two features of contemporary cities motivate this thesis. First, urban residents, and especially children, are spending less time in nature and consequently, miss out on healthy and formative experiences with biodiversity. Second, residents with the least access to biodiversity tend to be those with the lowest socioeconomic status (SES). Together, these patterns convey a multi-layered environmental injustice: not only might urbanites become increasingly estranged from biodiversity, disinterested from its conservation, and disconnected from its benefits, but these outcomes …
Using Strategic Discourse For Building Understanding In Elementary Mathematics: What Do Teachers And Students Think?, Mary Coakley
Using Strategic Discourse For Building Understanding In Elementary Mathematics: What Do Teachers And Students Think?, Mary Coakley
Doctoral Dissertations
The mathematics reform movement has not had a significant or lasting impact on the practice of teachers and learning of students throughout the country (Boylan, 2010, Kazemi & Stipek, 2001). Students are not developing the types of skills critical thinking skills needed to solve problems in mathematics. Research suggests a need for structural changes that include providing opportunities for students to develop more autonomy and authority in the mathematics classroom (Cuban, 2013). To meet these challenges, teachers and students must make significant changes to implement instruction that fulfills this demand. This expectation has left teachers struggling to determine essential changes …
Examining The Effects Of Changes In Automated Rater Bias And Variability On Test Equating Solutions, Michelle Boyer
Examining The Effects Of Changes In Automated Rater Bias And Variability On Test Equating Solutions, Michelle Boyer
Doctoral Dissertations
Many studies have examined the quality of automated raters, but none have focused on the potential effects of systematic rater error on the psychometric properties of test scores. This simulation study examines the comparability of test scores under multiple rater bias and variability conditions, and addresses questions of their effects on test equating solutions. Effects are characterized by a comparison of equated and observed raw scores and estimates of examinee ability across the bias and variability scenarios. Findings suggest that the presence of, and changes in, rater bias and variability affect the equivalence of total raw scores, particularly at higher …
Teacher Education And Professional Development On Classroom Assessment In Bangladesh: Exploring Policy And Practice Through A Vertical Case Study, Sumera Ahsan
Doctoral Dissertations
Formative Classroom Assessment (FCA) can be the single most powerful activity to promote students’ learning (Hattie, 2009). In Bangladesh FCA is not in practice (Ahsan, 2009). Policies and teacher preparation on FCA are the two factors that influence the practice of formative assessment in classrooms (Stiggins, 1999; Plake, 1993). In my research I aimed to learn how different actors, discourses, and materials come together to produce policies on FCA in policy network and translate the policies in a Teachers’ Training College (TTC), and in classrooms in an urban school. I used ‘critical socio-cultural approach to policy as practice’ (Levinson, Sutton …
Investigation Repeater Effects On Small-Sample Equating: Include Or Exclude?, Hongyu Diao
Investigation Repeater Effects On Small-Sample Equating: Include Or Exclude?, Hongyu Diao
Doctoral Dissertations
In licensure testing programs, some examinees might attempt the test multiple times till they are satisfied with their final score, those who take the same test repeatedly are referred to as repeaters. Previous studies suggested that repeaters should be removed from the total sample before implementing equating procedures for two reasons: 1) repeater group is distinguishable from the non-repeater group and the total group, 2) repeaters may memorize anchor items and cause an item drift in common items in the non-equivalent anchor test (NEAT) design. However, removing repeaters might not be the best solution if the testing program only has …
Exploring The Effectiveness Of A Mindfulness-Based Social Emotional Learning Program On Kindergarteners’ Risk For Social, Academic, And Emotional Problems, Molly Alvin
Doctoral Dissertations
This intervention study explored the effectiveness of a mindfulness-based social emotional learning program, Calmer Choice, on kindergarten students’ risk for social, academic, and emotional problems. The study used a quasi-experimental design with two measures collected as pretests and posttests for students in an intervention group and students in a wait-list control group. Kindergarten teachers completed the Social Academic Emotional Behavior Rating Scale (SAEBRS; Kilgus & von der Embse, 2014) and the Devereux Student Strengths Assessment-mini (DESSA-mini; Naglieri, LeBuffe & Shapiro, 2014) for each student at these two time points. The intervention, Calmer Choice, consisted of 16 lessons taught twice a …