Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Theses/Dissertations

Educational evaluation

Discipline
Institution
Publication Year
Publication

Articles 1 - 30 of 64

Full-Text Articles in Education

School Climate Measurement And Analysis, Adrian J. Vandenberg May 2023

School Climate Measurement And Analysis, Adrian J. Vandenberg

Master of Education Program Theses

This action research project examined the concept of school climate and measured and analyzed school climate data in a mixed methods study at an independent school in British Columbia. In this study, 341 students participated in a survey which included demographic questions and items from the School Climate Measure (SCM). The quantitative data from the survey measured the school climate in 10 different domains at the school and was used to compare and analyze different subgroups within the student population. Six students were also interviewed to collect qualitative data and analyze the school climate more comprehensively. The data and subsequent …


Beating The Odds: Counter Narratives Of Thriving Students Of Color At Dominantly White Faith-Based Institutions, Rebecca Kuhn Jul 2022

Beating The Odds: Counter Narratives Of Thriving Students Of Color At Dominantly White Faith-Based Institutions, Rebecca Kuhn

Faculty Dissertations

Graduation rates of students of color in the United States remain virtually unchanged, despite 50 years of institutions implementing programs and services to increase success among students of color (de Brey et al., 2019). The disparity in undergraduate degree completion rates between White college students and students of color indicates systemic barriers to student success remain pervasive. This qualitative study employs hermeneutic phenomenology to analyze and interpret the lived experiences of 10 thriving students of color at dominantly White faith-based institutions. Schreiner’s (2010a) holistic student success construct of thriving and Harper’s (2012a) Anti-Deficit Achievement Framework provide the conceptual frameworks for …


Curriculum Design And Instructional Practices : A Case Study Use Of Theory In Accelerated Adult Learning Programs, Lorraine V. Beach Dec 2020

Curriculum Design And Instructional Practices : A Case Study Use Of Theory In Accelerated Adult Learning Programs, Lorraine V. Beach

Legacy Theses & Dissertations (2009 - 2024)

This is a qualitative case study that examined four institutions of higher education in New York to assess how well they have done at implementing a quality standard established by the Commission on Accelerated Programs (CAP) in 2011 and 2019 calling for accelerated adult programs to incorporate adult learning theory within their curricula and instructional practices. Data collection consisted of interviews with faculty and staff, documentation reviews, and classroom observations. Through iterative case review processes, the author used this data to: a) clarify organizational policy and practices at each of the colleges/universities; and then b) to identify the impact of …


An Empirical Study Of Design Parameters For Planning Two-Level And Three-Level Cluster Randomized Trials To Detect Moderator Effects, Qi Zhang Jun 2020

An Empirical Study Of Design Parameters For Planning Two-Level And Three-Level Cluster Randomized Trials To Detect Moderator Effects, Qi Zhang

Dissertations

In the last two decades, we have seen an increasing number of impact studies in education that are designed to detect a meaningful average treatment effect, which answers the what works question. Recently, researchers have started to consider how to expand the design of impact studies to answer questions regarding the treatment effect heterogeneity across different contexts, such as for whom and under what conditions programs work. Answering these questions is imperative in the quest to make evidence-based and context-relevant decisions to improve educational outcomes for all students.

Many of the impact studies utilize a cluster randomized trial (CRT). CRTs …


The Evaluation Of Schools To College And Career (S2c) Readiness Program For Middle School Student, Sima D. Gandhi Jan 2020

The Evaluation Of Schools To College And Career (S2c) Readiness Program For Middle School Student, Sima D. Gandhi

University of the Pacific Theses and Dissertations

There is a lack of research on what it means to be college and career ready at the middle school level, and this creates confusion for students when they enter high school and must select courses that are aligned with their college and career goals. This study sought to understand how the Schools to College and Career (S2C) Readiness Program impacts middle school students at the charter school. In order to understand this impact, the study looked at how the S2C Readiness Program relates to students’ understanding and awareness of CCR at the school.

Using a quantitative approach this study …


Charter Schools’ Accountability: A Program Evaluation Of The Charter Oversight Unit Of The California Department Of Education, Chaddrick L. Owes Jan 2020

Charter Schools’ Accountability: A Program Evaluation Of The Charter Oversight Unit Of The California Department Of Education, Chaddrick L. Owes

University of the Pacific Theses and Dissertations

This dissertation is a qualitative-based program evaluation that explored the existing charter school accountability measures, processes, and oversight systems of the California Department of Education (CDE) in relation to State Board of Education (SBE)-authorized charter schools. This dissertation further explored the potential program improvements that could be implemented to improve the charter school oversight functions of the SBE and CDE. After a charter school receives authorization and approval to operate, the degrees of accountably and oversight vary dependent upon the charter authorizer and the oversite entity. This dissertation study aimed to discover how charter schools authorized by the SBE are …


Validity Of The Responses To Feedback Survey : Operationalizing And Measuring Students' Cognitive And Affective Responses To Teacher Feedback, Angela M. Lui Jan 2020

Validity Of The Responses To Feedback Survey : Operationalizing And Measuring Students' Cognitive And Affective Responses To Teacher Feedback, Angela M. Lui

Legacy Theses & Dissertations (2009 - 2024)

In 1998, Black and Wiliam used the term the black box to illustrate how little was known about what happens in classrooms. Their review spawned a great deal of research on formative assessment, including strategies for giving feedback to students. More recently, scholars in the field of classroom assessment and measurement have expressed the need for research on how students understand, interpret, and process feedback. I call this the new black box.


The Reliability Of Single-Item Assessments, Sijun Zhang Jan 2020

The Reliability Of Single-Item Assessments, Sijun Zhang

Legacy Theses & Dissertations (2009 - 2024)

Single-item assessments have become more popular recently in distinct areas, even though there is no consensus about whether they are sufficiently reliable. Researchers have developed methods to estimate the reliability of single-item assessments, some are based on factor analysis (method FA), correction for attenuation (method CA), and others employ Molenaar and Sijtsma’s theory (method MS), coefficient λ6 (method λ6), or latent class model (method LCRC). However, no empirical study has investigated which method estimates the reliability of single-item assessment most precisely. This study investigated this question via a simulation study. To represent assessments as found in practice, the simulation study …


Expanding Outcomes In Educational Program Evaluation: Student Outcomes, Systemic Effects, And Policy Implications, Heidi Lauren Holmes May 2019

Expanding Outcomes In Educational Program Evaluation: Student Outcomes, Systemic Effects, And Policy Implications, Heidi Lauren Holmes

Graduate Theses and Dissertations

Education policy debates over the last twenty years have focused on the need to increase students’ test scores. The federal government and states have implemented and expanded a variety of test-based, school accountability policies. Accountability pressures have incentivized schools to narrow their curriculum, decrease time allocated to extracurricular activities, and focus on short-term student outcomes. This dissertation focuses on expanding outcomes in educational program evaluations and demonstrates the value of looking beyond the goal of increasing student test scores. The first chapter, using random assignment, estimates the causal effects of culturally enriching field trips on various student outcomes. Such field …


Identifying Exceptionally Performing Third Grades In Indiana: Who Is To Blame?, Emily Troyer 19 Apr 2019

Identifying Exceptionally Performing Third Grades In Indiana: Who Is To Blame?, Emily Troyer 19

Honor Scholar Theses

Federal and state governments want to know that their constituents' tax dollars are being spent well, and that public education is serving the People well. To assess a school's efficacy, they calculate an accountability score. Although state-level scoring systems vary, neither the federal law nor a single state's law require that demographic characteristics of a school's student population be held constant when it is being evaluated. This complicates the assessment of a school's adequacy because factors outside of a school's control influence student performance; when a school is evaluated without taking this into account, it is being unfairly credited with …


Predictive Validity Of I-Ready Diagnostic Scores For High-Stakes Test Outcomes With Middle School Students : A Program Evaluation, Rachel Eva Aguilar Jan 2019

Predictive Validity Of I-Ready Diagnostic Scores For High-Stakes Test Outcomes With Middle School Students : A Program Evaluation, Rachel Eva Aguilar

Legacy Theses & Dissertations (2009 - 2024)

Assessment is a powerful tool that can be utilized to enhance teaching and learning. Within a response-to-intervention (RtI) framework, data collected via assessment are used to measure student proficiency, track progress, and subsequently align instruction with student learning needs. The purpose of this program evaluation was to explore the use of a computer-adaptive testing (CAT) measure, i-Ready Diagnostic, as part of a rural middle school’s assessment process, within an RtI model. This program evaluation sought to gather evidence regarding the ability of different i-Ready reading and math measures, administered in the fall, winter, and spring, to predict student performance on …


Positive Behavior Intervention And Supports Impact On Discipline In An Alternative School, Alina Michelle Harges Jan 2019

Positive Behavior Intervention And Supports Impact On Discipline In An Alternative School, Alina Michelle Harges

Electronic Theses and Dissertations

The purpose of this sequential-explanatory mixed methods study was to first determine what impact if any did Positive Behavior Intervention and Support (PBIS) have on the number of office disciplinary referrals (ODRs) received by students after three years of implementation. The second part of the study was to obtain feedback through interviews from the administrator and certified teachers on their perspectives of PBIS implementation in this rural alternative school setting. Quantitative data was collected first folloby the collection of the qualitative data. This method of data collection was necessary in order for the researcher to make better sense of quantitative …


The Associations Between The Perception Of Helpfulness Of Teacher Induction Programs, Teacher Self-Efficacy, And Anticipated First-Year Teacher Retention In Shanghai Public Primary Schools, Xiaotian Han Jan 2019

The Associations Between The Perception Of Helpfulness Of Teacher Induction Programs, Teacher Self-Efficacy, And Anticipated First-Year Teacher Retention In Shanghai Public Primary Schools, Xiaotian Han

University of the Pacific Theses and Dissertations

The purpose of the study was to: (a) determine to what extent the formalized teacher induction programs (TIPs) in Shanghai are perceived to be helpful for first-year public primary school teachers; (b) measure teacher self-efficacy and anticipated job retention of first-year teachers in Shanghai public primary schools; and (c) examine the degree to which these perceptions of helpfulness, teacher self-efficacy, and anticipated job retention are associated. In this study, retention is defined as remaining in a public primary school in Shanghai. Shanghai TIPs are one-year long, mandatory programs for first-year teachers in Shanghai public primary schools. The conceptual framework of …


Exploring The Relationship Between Innovation In Nursing Education And Clinical Practice, Francia Ianthia Reed Jan 2018

Exploring The Relationship Between Innovation In Nursing Education And Clinical Practice, Francia Ianthia Reed

Legacy Theses & Dissertations (2009 - 2024)

ABSTRACT


Childhood Fitness And Academic Achievement: An Exploration Into The Effect Of Physical Fitness Scores On Academic Assessment Tests, Kevin Vanderwal Apr 2017

Childhood Fitness And Academic Achievement: An Exploration Into The Effect Of Physical Fitness Scores On Academic Assessment Tests, Kevin Vanderwal

Master of Education Program Theses

This research study examines the correlation between the effects of physical fitness scores on academic assessment tests. The study examines students’ PACER scores and what impact that causes with the MAP (Measures of Academic Progress) test. The study included a sample of 147 students from a large Midwestern elementary school of fifth graders. The study found that PACER scores seems to have a positive relationship with students’ MAP scores; that improving on the PACER does not show significant gains to show a connection between the two variables; that high BMI scores can indicate lower MAP scores and that lower BMI …


Visual Formative Assessment And Learning Styles, Julie Pickard Apr 2017

Visual Formative Assessment And Learning Styles, Julie Pickard

Master of Education Program Theses

This action research study investigated the impact of visual formative assessments on the achievement levels of students with visual, auditory, and kinesthetic learning styles. The study was conducted in four classes of freshmen at Southwest Christian High School in Chaska, MN, with a total of eighty-four participants. Two pairs were created for the study with control and treatment groups in each pair. Students were classified according to learning style, and a unit pre-test was administered to identify growth. Treatment groups were instructed using daily visual formative assessments for the duration of the unit. Students were assessed again at the end …


The Impact Of A Value-Added Model On Educational Leadership Practices In Northwest Louisiana, Candice D. Webert Apr 2017

The Impact Of A Value-Added Model On Educational Leadership Practices In Northwest Louisiana, Candice D. Webert

Doctoral Dissertations

This study addressed the impact of VAM, concerns with VAM data, uses and interventions educational leaders provided teachers, and components perceived as necessary for VAM effectiveness as an evaluation tool. The demographics used for this study were position, school size, and experience. Due to the documented need for educational accountability from the 1960s to present, the knowledge gained in this study was valuable. While the initiative was implemented as a response to increased accountability, the perceptions and understanding of such new initiatives can impact their effectiveness; in turn, impacting educational leadership. This study focused on the effectiveness of VAM.

In …


Support Networks Of “Educational Pioneers”: A Methodological Approach For Examining The Impact Of A Residential Learning Community On First-Generation Students, Ryan R. Setari Jan 2017

Support Networks Of “Educational Pioneers”: A Methodological Approach For Examining The Impact Of A Residential Learning Community On First-Generation Students, Ryan R. Setari

Theses and Dissertations--Educational Policy Studies and Evaluation

The purpose of this study is to demonstrate the use of social network analysis to examine the peer involvement and supportive relationships of students living within an exclusively first-generation RLC. Using network surveys targeted toward a first-generation population, the networks of first-year residents were visualized and measured. The supportive peer relationships that provided students with encouragement, validation, and academic assistance were identified, as well as the networks for friendship and study partnership. The networks identified for this study were examined to find if change occurred between the start and the end of the semester. Multiple regression QAPs were performed to …


Exploring Validity Of Computer-Based Test Scores With Examinees' Response Behaviors And Response Times, Fusun Sahin Jan 2017

Exploring Validity Of Computer-Based Test Scores With Examinees' Response Behaviors And Response Times, Fusun Sahin

Legacy Theses & Dissertations (2009 - 2024)

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees’ rapid-guessing and insufficient familiarity with computers have been found to be major issues that


A Study Of Theatre Teacher And School Administrator Perceptions Of Traits, Characteristics, And Instructional Practices And Their Possible Role In Teacher Evaluation, James D. Chrismon Dec 2016

A Study Of Theatre Teacher And School Administrator Perceptions Of Traits, Characteristics, And Instructional Practices And Their Possible Role In Teacher Evaluation, James D. Chrismon

Education Dissertations and Projects

This applied dissertation was designed to gather similarities and differences in the perceptions of theatre teachers and administrators regarding instructor traits, instructor characteristics, and instructional practices of effective theatre teacher. Current teacher evaluation systems focus on teacher effectiveness on student learning, and typically do not provide valuable feedback for teachers in highly specialized fields such as the arts, and specifically theatre arts.

One-on-one interviews were conducted with eight theatre teachers and eight administrators from eight different schools across the state of South Carolina to gather qualitative data on the similarities and differences in perceptions of instructor traits, instructor characteristics, and …


Investigating The Impact Of Cad Simulations On Student Design Thinking, Manaz R. Taleyarkhan Aug 2016

Investigating The Impact Of Cad Simulations On Student Design Thinking, Manaz R. Taleyarkhan

Open Access Theses

Facilitating students to become informed designers is a goal in engineering education that has been proposed by multiple studies. The use of Computer-Aided Design (CAD) software has been used as a learning tool to promote design thinking in practical settings for undergraduate students. However, very little is known about the informed design process undertaken by these students while using the interactive and learning focused CAD tool to solve design challenges. This paper analyzes the nature of design thinking that happens when students use a particular CAD tool. In this study, I have adapted Crismond and Adams' Informed Design Teaching and …


Assessing Formative Assessment: An Examination Of Secondary English/Language Arts Teachers' Practices, Leigh M. Tolley May 2016

Assessing Formative Assessment: An Examination Of Secondary English/Language Arts Teachers' Practices, Leigh M. Tolley

Dissertations - ALL

This study examined how “formative assessment” (FA), a term that encompasses all of the assessment and instructional activities undertaken by teachers and their pupils to improve student learning, occurs in a secondary English/language arts (ELA) context. A sequential explanatory mixed methods approach, using a series of weekly self-report checklists about teachers’ assessment practices and semi-structured interviews, was used to address the following: (a) what assessment practices secondary ELA teachers use; (b) how these teachers determine what assessment practices to use and when to use them; (c) what these teachers’ perceptions of the effectiveness of the assessment practices that they use …


Keeley Probes As A Tool For Uncovering Student Ideas: How Do Teachers Use Formative Assessment Probes To Plan And Adapt Instruction?, Kalin Tobler Jan 2016

Keeley Probes As A Tool For Uncovering Student Ideas: How Do Teachers Use Formative Assessment Probes To Plan And Adapt Instruction?, Kalin Tobler

Dissertations and Theses

Formative assessment probes, known as Keeley probes, are one tool teachers use to reveal students' scientific misconceptions, so that they can move them closer to conceptual understanding. The purpose of this research was to document how four elementary school teachers used formative assessment probes to plan and adapt instruction to improve student learning. Specifically:

  • How did teachers choose appropriate probes? What learning goals did teachers hope to address by using the probe??
  • What instructional sequences did teachers envision when planning to use a probe?
  • What did teachers notice when analyzing student data from a probe?
  • How did teachers use the …


The New York State Annual Professional Performance Review And Teacher Morale : Constructive Guidance Or Demoralization?, Joseph William Lloyd Jan 2016

The New York State Annual Professional Performance Review And Teacher Morale : Constructive Guidance Or Demoralization?, Joseph William Lloyd

Legacy Theses & Dissertations (2009 - 2024)

Recent educational reform efforts such as the No Child Left Behind Act (NCLB) and the Race to the Top Initiative (RTT) have exhibited a proclivity to use centralized, top-down reform tactics to improve student achievement. The requirement of states to revise their previous teacher evaluation systems, in order to procure funding from the Race to the Top Initiative, represents a signature example of such tactics. Emerging research suggests that these policies may also unintentionally reduce teachers’ autonomy, deteriorate professional interactions, decrease teachers’ sense of worth and subsequently weaken teacher morale. Additional research indicates that early career teachers tend to respond …


The Role Of The Standards For Educational And Psychological Testing In The Development Of Student Evaluations Of Teaching Effectiveness In Higher Education, Anna Valentinova Valcheva Jan 2016

The Role Of The Standards For Educational And Psychological Testing In The Development Of Student Evaluations Of Teaching Effectiveness In Higher Education, Anna Valentinova Valcheva

Legacy Theses & Dissertations (2009 - 2024)

The purposes of this study were to 1) investigate the extent to which the standards for instrument development, as articulated by the Standards for Educational and Psychological Testing (AERA/APA/NCME, 2014) are applied during the process of creating student evaluations of teaching (SETs) in order to ensure their reliability and validity, and 2) the factors affecting the application of the standards. The results were analyzed in terms of the percentage of reported standards followed, as well as in terms of the three relevant sections of the Standards. Eighty-nine professionals involved in the process of developing and/or using SETs at their institutions …


Assessment Of Student Learning In A Business Department With An Entrepreneurial Focus, Suzanne C. Calvert Jan 2015

Assessment Of Student Learning In A Business Department With An Entrepreneurial Focus, Suzanne C. Calvert

Graduate Dissertations and Theses

This multi-faceted, action-research project utilized researched assessment practices and current practices acquired through case study research. The research question of this study was: How could a department in a small liberal arts college best measure and evaluate the student-learning outcomes to inform the business department with an entrepreneurial focus? The researcher answered this question by comparing assessment best practices to the home-institution department assessment plan and conducting case study analyses of assessment practices utilized by similar departments of other selected institutions. An action plan was developed and focused on home departmental collaboration and use of data.


Students And Faculty Indivisible: Crafting A Higher Education Culture Of Flourishing, Eileen K. Camfield Jan 2015

Students And Faculty Indivisible: Crafting A Higher Education Culture Of Flourishing, Eileen K. Camfield

University of the Pacific Theses and Dissertations

This dissertation is comprised of three separate articles addressing related issues central to the culture and future of higher education. The questions that animate the investigations are: In what ways is writing self-efficacy forged in the learning relationships between student and instructor? In what ways, if any, do traditional assessment practices impact student development? In what ways, if any, does institutional culture shape faculty identity, and what is gained or lost in the process? These queries stem from concerns about possible disconnects between visions of higher education's potential and actual practices in the classroom. The dissertation uses grounded theory to …


A Case Study Of The Impact Of A Sytematic Evaluation Process In A Graduate Medical Education Residency Program, Heidi T. Kromrei Jan 2014

A Case Study Of The Impact Of A Sytematic Evaluation Process In A Graduate Medical Education Residency Program, Heidi T. Kromrei

Wayne State University Dissertations

The Accreditation Council for Graduate Medical Education has charged institutions that sponsor accredited Graduate Medical Education programs (residency and fellowship specialty programs) with overseeing implementation of mandatory annual program evaluation efforts to ensure compliance with regulatory requirements. Physicians receive scant, if any, training in program evaluation methodology. Human Performance Technology (HPT) offers models suitable for residency program evaluation as well as trained evaluators who are experts in evaluation. Leaders in the field of HPT have called for empirical studies to examine the impact of HPT models in a variety of contexts.

This single case study examined the impact of using …


Evaluating A Ninth Grade Transition Program : Link Crew, Luke Saechao Jan 2014

Evaluating A Ninth Grade Transition Program : Link Crew, Luke Saechao

Graduate Dissertations and Theses

For U.S. students, ninth grade is a critical year in the educational pipeline, often dictating a school-to-school transition period. The author evaluates the ramification on achievement following such a school-to-school transition. The purpose of this study was to evaluate a ninth grade transition program called Link Crew, which was implemented by a large comprehensive urban high school. Do transition programs assist in maintaining achievement and readiness? Participants in the study were transitioning grade nine students from two high schools in central Virginia, in which only one received treatment via the Link Crew transition program. The quantitative study utilized school division …


Faculty Perception And Use Of Learning-Centered Strategies To Assess Student Performance, Matthew Lynn Johnson Aug 2013

Faculty Perception And Use Of Learning-Centered Strategies To Assess Student Performance, Matthew Lynn Johnson

Masters Theses and Doctoral Dissertations

In this study, the researcher explored collegiate faculty use and perception of learning- centered strategies to assess student performance on various learning tasks. Through this study, the researcher identified the assessment strategies that faculty participants most frequently used, as well as the strategies that they perceived to be most effective. In addition to an analysis of the most frequently used assessment strategies for the entire sample, the researcher also investigated differences in strategies used by faculty members in specific discipline sub-groups: Arts and Humanities, Natural and Health Sciences, and Social and Behavioral Sciences. Participants taking part in this study were …