Education Commons^™

Family Experiences With Standardized Assessments Leading To Participation In The Opt Out Movement, Christy Lee Evans

Doctoral Dissertations

With the hope of giving voice to individuals who are usually left out of conversations regarding standardized assessments—the families who live with the effects of those tests on their children—this study was designed to answer the following research questions:

1) Who are some of the individuals who are participating in the opt out movement?

2) How are some individuals making the decision to participate in the opt out movement?

a) What knowledge do these individuals who are participating in the opt out movement have regarding the standardized assessments that their children are being given in public schools?

b) How have …

Development And Validation Of The Statistics Assessment Of Graduate Students, Dammika Lakmal Walpitage

Doctoral Dissertations

This study developed the Statistics Assessment of Graduate Students (SAGS) instrument, and established its preliminary item characteristics, reliability, and validity evidence. Even though there are limited number of assessments available for measuring different aspects of statistical cognition, these previously available assessments have numerous limitations. The SAGS instrument was developed using Rasch modeling approach to create a new measure of statistical research methodology knowledge of graduate students in education and other behavioral and social sciences. Thirty-five multiple-choice questions were written with stems representing applied research situations and response options distinguishing between appropriate use of various statistical tests or procedures. A focus …

Learning To Teach Online: An Investigation Of The Impacts Of Faculty Development Training On Teaching Effectiveness And Attitudes Toward Online Instruction, Karen Elizabeth Brinkley

Doctoral Dissertations

The purpose of this study was to examine the relationship between one approach to training for online faculty and the ways in which the program influenced the participants’ teaching effectiveness and attitudes toward online instruction. Two research questions guided this study: (1) how did participating in an intensive course redesign intervention influence instructors’ teaching effectiveness in the online environment? and (2) how did participating in the training influence instructors’ beliefs or attitudes about online teaching? The theoretical framework guiding this study was the Technological Pedagogical Content Knowledge (TPACK) model, developed by Mishra and Koehler (2005). Using a concurrent, mixed-methods design, …

Subscore Reliability And Classification Consistency: A Comparison Of Five Methods, Fen Fan

Doctoral Dissertations

Previous studies focused on reporting subscores themselves; however, most proficiency tests are criterion-referenced, reporting classification consistency and accuracy of student placement into performance categories within each subdomain are thus more suitable. Therefore, the primary purpose of this study was to investigate the decision consistency (DC) and decision accuracy (DA) of student placement into performance categories within each of the subdomains measured by the test of interest. A second purpose of this study was to compare the performance of five subscoring methods under some realistic conditions in terms of subscore reliability and classification. To do so, a simulation study was designed …

Detecting Candidate Preknowledge Of Items Using A Predictive Checking Method, Xi Wang

Doctoral Dissertations

In on-demand high-stakes testing programs such as GRE and TOEFL, some items are repeatedly used across test administrations to reduce the cost of developing new items constantly. Item exposure provides an opportunity for examinees to have knowledge of particular test items in advance of their administration. It poses a threat to test security and ultimately will result in invalid test scores. Therefore, many testing programs conduct quality control to monitor test compromise at individual and/or group level. A predictive checking method is proposed in this study to detect examinee preknowledge on exposed items. We consider a scenario where a test …

Identifying Examinees Who Possess Distinct And Reliable Subscores When Added Value Is Lacking For The Total Sample, Joseph A. Rios

Doctoral Dissertations

Research has demonstrated that although subdomain information may provide no added value beyond the total score, in some contexts such information is of utility to particular demographic subgroups (Sinharay & Haberman, 2014). However, it is argued that the utility of reporting subscores for an individual should not be based on one’s manifest characteristics (e.g., gender or ethnicity), but rather on individual needs for diagnostic information, which is driven by multidimensionality in subdomain scores. To improve the validity of diagnostic information, this study proposed the use of Mahalanobis Distance and H^T indices to assess whether an individual’s data significantly departs …

Development And Initial Validation Of A Flipped Classroom Adoption Inventory In Higher Education, Taotao Long

Doctoral Dissertations

The purpose of this study is to develop and initially validate an inventory to learn about the critical variables involved in a higher education instructor’s decision to adopt a flipped classroom instructional model. A flipped classroom is an instructional model in which students’ learning is divided into two phases, the self-directed pre-class learning phase and the in-class student-centered active learning phase. Both phases are typically technology-enhanced. This study addresses a gap in the recent research regarding the identification and assessment of the critical variables that are related to a higher education instructor’s decision to adopt a flipped classroom instructional model. …

A Comparison Of Comprehension Accuracy And Rate: Repeated Readings And Listening While Reading, Megan Amber Schall

Doctoral Dissertations

There is a need for effective and efficient reading interventions in American schools. Two empirically supported reading interventions are Repeated Readings and Listening While Reading. Previous researchers have evaluated the effects of these interventions individually on reading fluency and comprehension, and in comparison on students’ reading fluency. This is the first study to compare the relative effectiveness of each intervention on students’ comprehension, which is the typical purpose of reading. The current study extends previous research by considering the instructional time required to complete each intervention, and converting students’ comprehension accuracy scores into a comprehension rate measure. Additionally, students read …

Differential Prediction And Validity Of Advanced Placement (Ap®) For Student Subgroups, Minji K. Lee

Doctoral Dissertations

Concerns over fairness permeates every aspect of the testing enterprise, and one characterization of fairness in testing defined by the Standards (AERA, APA, & NCME, 1999) is a fairness as lack of bias. One important way to study bias in college admission context concerns the degree to which prediction equations are equivalent for different groups. To the extent that the AP variables are used together with admission test scores and previous academic records to predict future academic achievement, it is important to know if members of one group are systematically predicted to obtain lower or higher grades than they actually …

Turning Around The Culture Of Teaching And Learning: A Turnaround School Success Story, Rachael B. Lawrence

Doctoral Dissertations

In 2009-2010, Riverton Elementary School in Portland, ME was awarded a School Improvement Grant (SIG), supported by the Federal Department of Education (Federal DOE) through the Maine Department of Education. With this funding, Riverton undertook the challenge of the turnaround school model between 2010-2013, which resulted in positive change in academic achievement for their students and an improved teaching and learning climate and culture. This dissertation examines why the turnaround model may work, what is currently known about SIG funded turnaround schools, and what the specific actions and changes that led to the successful turnaround of this school were. While …

The Development And Validation Of The Emotion Knowledge And Awareness Test, Catherine A. Rossi

Doctoral Dissertations

The purpose of this study was to develop, test, and pilot a general outcome measurement tool that will allow educators to test young children’s knowledge of factors of emotional development: emotional identification and fluency, understanding situations where multiple emotions are present, understanding that others may feel differently in situations, and emotional regulation (CASEL, 2014). There are few assessments that reliably measure emotion knowledge in early elementary grades. The Emotion Knowledge and Awareness Test (EKAT) has been developed for kindergarten through second grade students to measure emotion awareness across two domains: knowledge and management. It was developed as a pre/posttest assessment …

Who Is Like Whom? Reclassification And Performance Patterns For Different Groupings Of English Learners, Molly M. Faulkner-Bond

Doctoral Dissertations

Approximately 10 percent of the US K-12 population consists of English learners (ELs), or students who are learning English in addition to academic content in areas like English language arts (ELA) and mathematics. In addition to meeting the same academic content and performance standards set for all students, it is also a goal for ELs to be reclassified – i.e., to master English so that they can shed the EL label and participate in academic settings where English is used without needing special support. Working with a longitudinal cohort of ~28,000 ELs in grades 3 through 8 from one state, …

Pre-College Characteristics And Online Homework Learning: Factors Associated With First Year Engineering Students’ Academic Success, Wenshu Li

Doctoral Dissertations

The purpose of the study was to develop a working model to predict at risk students in an Introduction to Engineering course. The model considers both students’ pre-college characteristics, psychological traits, and online homework learning behavior. The study assisted the course instructor in the creation of an early warning system and the development of targeted interventions for students at risk. A reliable and valid instrument to measure engineering students’ pre-college characteristics was initially developed. The study also applied data mining to analyze the student online homework logs in order to observe engineering students’ homework learning process. A decision tree model …

Solving The Migrant Children Public School Enrollment Issue In Urban China: A Policy Study Perspective, Hui Huang

Doctoral Dissertations

This dissertation is designed to learn lessons from China’s experiences of seeking to solve the migrant children’s education issue, specifically, the city public school enrollment issue. In China, access to public schools is the main channel for migrant children to be well educated. With the hope to inspire education policy makers and researchers on solving this issue, it is important to find out how the central and local governments work out proper policies to ensure equal compulsory education for migrant children. Qualitative research methods including content analysis and historical analysis are deployed in this dissertation to review related policy documents …

Building Communicative Competence: An Evaluation Of The Effectiveness Of An Intensive Japanese-Language Program, Yukiko Konishi

Doctoral Dissertations

Even though language-program evaluations provide educators with various types of information on teaching practices and the programs in which they work, insufficient literature discusses issues related to language-program evaluation. This mixed-methods study examined the effectiveness of a Japanese-language program offered at a government-sponsored Institute located in northern California on language-program evaluation and developing communicative competence at postsecondary schools.

Data comprised two sets of surveys, six individual interviews, and one group interview. Survey respondents were 35 former students of the institute and 12 Japanese instructors who are currently teaching Japanese or have taught Japanese at the Institute. Of the 35 students, …