Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 7 of 7

Full-Text Articles in Education

Subscore Reliability And Classification Consistency: A Comparison Of Five Methods, Fen Fan Nov 2016

Subscore Reliability And Classification Consistency: A Comparison Of Five Methods, Fen Fan

Doctoral Dissertations

Previous studies focused on reporting subscores themselves; however, most proficiency tests are criterion-referenced, reporting classification consistency and accuracy of student placement into performance categories within each subdomain are thus more suitable. Therefore, the primary purpose of this study was to investigate the decision consistency (DC) and decision accuracy (DA) of student placement into performance categories within each of the subdomains measured by the test of interest. A second purpose of this study was to compare the performance of five subscoring methods under some realistic conditions in terms of subscore reliability and classification. To do so, a simulation study was designed …


Detecting Candidate Preknowledge Of Items Using A Predictive Checking Method, Xi Wang Nov 2016

Detecting Candidate Preknowledge Of Items Using A Predictive Checking Method, Xi Wang

Doctoral Dissertations

In on-demand high-stakes testing programs such as GRE and TOEFL, some items are repeatedly used across test administrations to reduce the cost of developing new items constantly. Item exposure provides an opportunity for examinees to have knowledge of particular test items in advance of their administration. It poses a threat to test security and ultimately will result in invalid test scores. Therefore, many testing programs conduct quality control to monitor test compromise at individual and/or group level. A predictive checking method is proposed in this study to detect examinee preknowledge on exposed items. We consider a scenario where a test …


Identifying Examinees Who Possess Distinct And Reliable Subscores When Added Value Is Lacking For The Total Sample, Joseph A. Rios Nov 2016

Identifying Examinees Who Possess Distinct And Reliable Subscores When Added Value Is Lacking For The Total Sample, Joseph A. Rios

Doctoral Dissertations

Research has demonstrated that although subdomain information may provide no added value beyond the total score, in some contexts such information is of utility to particular demographic subgroups (Sinharay & Haberman, 2014). However, it is argued that the utility of reporting subscores for an individual should not be based on one’s manifest characteristics (e.g., gender or ethnicity), but rather on individual needs for diagnostic information, which is driven by multidimensionality in subdomain scores. To improve the validity of diagnostic information, this study proposed the use of Mahalanobis Distance and HT indices to assess whether an individual’s data significantly departs …


Differential Prediction And Validity Of Advanced Placement (Ap®) For Student Subgroups, Minji K. Lee Jul 2016

Differential Prediction And Validity Of Advanced Placement (Ap®) For Student Subgroups, Minji K. Lee

Doctoral Dissertations

Concerns over fairness permeates every aspect of the testing enterprise, and one characterization of fairness in testing defined by the Standards (AERA, APA, & NCME, 1999) is a fairness as lack of bias. One important way to study bias in college admission context concerns the degree to which prediction equations are equivalent for different groups. To the extent that the AP variables are used together with admission test scores and previous academic records to predict future academic achievement, it is important to know if members of one group are systematically predicted to obtain lower or higher grades than they actually …


Turning Around The Culture Of Teaching And Learning: A Turnaround School Success Story, Rachael B. Lawrence Jul 2016

Turning Around The Culture Of Teaching And Learning: A Turnaround School Success Story, Rachael B. Lawrence

Doctoral Dissertations

In 2009-2010, Riverton Elementary School in Portland, ME was awarded a School Improvement Grant (SIG), supported by the Federal Department of Education (Federal DOE) through the Maine Department of Education. With this funding, Riverton undertook the challenge of the turnaround school model between 2010-2013, which resulted in positive change in academic achievement for their students and an improved teaching and learning climate and culture. This dissertation examines why the turnaround model may work, what is currently known about SIG funded turnaround schools, and what the specific actions and changes that led to the successful turnaround of this school were. While …


The Development And Validation Of The Emotion Knowledge And Awareness Test, Catherine A. Rossi Jul 2016

The Development And Validation Of The Emotion Knowledge And Awareness Test, Catherine A. Rossi

Doctoral Dissertations

The purpose of this study was to develop, test, and pilot a general outcome measurement tool that will allow educators to test young children’s knowledge of factors of emotional development: emotional identification and fluency, understanding situations where multiple emotions are present, understanding that others may feel differently in situations, and emotional regulation (CASEL, 2014). There are few assessments that reliably measure emotion knowledge in early elementary grades. The Emotion Knowledge and Awareness Test (EKAT) has been developed for kindergarten through second grade students to measure emotion awareness across two domains: knowledge and management. It was developed as a pre/posttest assessment …


Who Is Like Whom? Reclassification And Performance Patterns For Different Groupings Of English Learners, Molly M. Faulkner-Bond Jul 2016

Who Is Like Whom? Reclassification And Performance Patterns For Different Groupings Of English Learners, Molly M. Faulkner-Bond

Doctoral Dissertations

Approximately 10 percent of the US K-12 population consists of English learners (ELs), or students who are learning English in addition to academic content in areas like English language arts (ELA) and mathematics. In addition to meeting the same academic content and performance standards set for all students, it is also a goal for ELs to be reclassified – i.e., to master English so that they can shed the EL label and participate in academic settings where English is used without needing special support. Working with a longitudinal cohort of ~28,000 ELs in grades 3 through 8 from one state, …