Educational Assessment, Evaluation, and Research Commons^™

Teacher Perceptions Of School Climate: A New Instrument And Validity Study, Rui Jin

Theses and Dissertations--Education Sciences

The United States government has growingly emphasized school climate, as it has been involved as an accountability indicator in the Every Student Succeeds Act. However, there remains considerable debate on both conceptualizing and measuring school climate. Moreover, teachers, a critical informant of school climate, have been ignored because most previous studies have paid attention to the students.

To better inform the research and practice related to the teacher perceptions of school climate and its measurement, this dissertation first identified the related instruments in the literature. The results showed only one survey measured three domains of school climate (academic climate, community, …

The “Case” For Assessments: An Evaluation Of Case End Of Course Assessments And Teacher Motivation, Andrew Lawrence Hauser

Theses and Dissertations--Community & Leadership Development

Curriculum for Agricultural Science Education (CASE) End of Course (EoC) assessments are summative assessments used to evaluate the CASE curriculum. This quantitative study explored the effects teacher motivation has on student performance on CASE EoC assessments. CASE teachers (n= 55) who participated in the study responded to the 28-item CASE End of Course Assessment Teacher Motivation Questionnaire on a 5-point Likert-type scale. The researcher conducted a Pearson r Correlation test to determine a relationship between questionnaire mean values and secondary student assessment data. Results from the study outline frequency of responses, perceived value and expectancy mean values, and correlations …

A Digital Ethnography Of Teach For America: Analysis Of Counternarrative From The Truth For America Podcast, Julian Vasquez Heilig, T. Jameson Brewer, Amber K. Kim, Miguel Sanchez

Educational Policy Studies and Evaluation Faculty Publications

To analyze the counternarrative in the public discourse surrounding Teach For America (TFA), this paper represents the first digital ethnography in education policy. We conduct a qualitative analysis of Truth For America, an education policy podcast. We found four overarching themes that arose from conversations with respondents: (1) problematic practice, preparation, and pedagogy; (2) concerns linked to critiquing TFA and the organization’s responses to that critique; (3) issues related to race and diversity; and (4) disconcerting funding practices and political power. We conclude by discussing the implications of how individual-level stakeholder experiences inform the public discourse about TFA.

Applying The Rasch Model To Evaluate The Self-Directed Online Learning Scale (Sdols) For Graduate Students, Hongwei Yang, Jian Su, Kelly D. Bradley

Educational Policy Studies and Evaluation Faculty Publications

With the rapid growth of online learning and the increased attention paid to student attrition in online programs, much research has been aimed at studying the effectiveness of online education to improve students’ online learning experience and student retention. Utilizing the online learning literature as a multi-faceted theoretical framework, the study developed and employed a new survey instrument. The Self-Directed Online Learning Scale (SDOLS) was used to examine graduate student perceptions of effectiveness of online learning environments as demonstrated by their ability to take charge of their own learning, and to identify key factors in instructional design for effective improvements. …

What Do Grades Mean? Variation In Grading Criteria In American College And University Courses, Anastasiya A. Lipnevich, Thomas R. Guskey, Dana M. Murano, Jeffrey K. Smith

Educational, School, and Counseling Psychology Faculty Publications

This study examined differences in the criteria used by college and university instructors in the United States to assign course grades. Two hundred and fifty course syllabi (159 from universities and 91 from four-year colleges) developed by randomly selected instructors from five academic disciplines (education, maths, science, psychology, and English) were examined to determine the extent to which instructors employed different criteria in assigning course grades in introductory-level courses. Sources of variation in grade assignment included the use of product versus process criteria, the prevalence of using performance exams, and the framing criteria for grades. Differences between institution types and …

Encouraging Healthy Eating Among Older Adults Using The Transtheoretical Model: An Evaluation Of A Pilot Intervention, Lauren Brinkman Roberson

Theses and Dissertations--Communication

Older adults, defined as those age 60 and above, are at an increased risk for many health-related complications that are directly related to nutrition (Centers for Disease Control and Prevention, 2015). This study highlights the lack of nutrition education material developed for older adults in Kentucky. Such material has great potential to influence the health of older adults (Chernoff, 2001). This study evaluated an intervention developed, by means of formative research, to teach older adults nutrition basics. Both direct and indirect measures related to stages of change for healthy eating behaviors were collected six weeks pre-intervention and then immediately post-intervention. …

Sexual Health Education In Kentucky's Public High Schools, Marjorie Stanek

Theses and Dissertations--Education Sciences

This dissertation seeks to enhance the understanding of sexual health education efforts, as they currently exist in Kentucky’s public high schools. It will include an examination of the factors that influence the provision of sexual health education in Kentucky schools, including relevant legislation, directives from the Kentucky Department of Education, and the presence of site-based councils within the Commonwealth. Additionally, the suggested curriculum elements from the Kentucky Department of Education’s Academic Standards, which were implemented during the 2019-2020 school year, will be compared to those established within the National Sexuality Education Standards (NSES), which serve as a gold standard …

A Comparison Of Multiple Baseline Family Of Designs, An Analysis Of A Multiple Probe Study, And Coaching For Practitioners, Katherine Jordan

Theses and Dissertations--Early Childhood, Special Education, and Counselor Education

Overview of Alternative Thesis Project

During the Spring 2020 semester, students within the applied behavior analysis program were conducting applied thesis projects within typical contexts as part of their fulfillment of the requirements of a master’s degree program. Due to the coronavirus disease 2019 (COVID-19), public schools and related facilities closed with no plans to reopen within the time frame to allow for graduation for students in the last semester of their graduate program. Students were allowed to complete an alternative thesis assignment in the form of responding to writing prompts followed by an oral defense of the written products, …

Engaging Patients To Prevent Harm: Implementation Of Hospital Acquired Pressure Injury Prevention Education Videos, Sarah Buschmann

DNP Projects

PURPOSE: The purpose of this proposal is to evaluate the introduction of pressure ulcer prevention videos to at risk adult patients in the intensive care unit within the acute care health setting.

METHODS: The study design is a retrospective chart review to analyze the effect of the pressure ulcer prevention videos on the number of pressure ulcers and incidence rate while comparing Jackson/Cubbin scores. As pressure ulcers continue to rise, patient education through the Get Well Network is a required intervention. This project is relevant in reducing pressure ulcers and increasing patient safety. Data collection took place from July 1 …

Interpreting Average Effect Sizes: Never A Center Without A Spread, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

School leaders today are making important decisions regarding education innovations based on published average effect sizes, even though few understand exactly how effect sizes are calculated or what they mean. This article explains how average effect sizes are determined in meta-analyses and the importance of including measures of variability with any average effect size. By considering the variation in effect sizes among studies of the same innovation, education leaders can make better decisions about innovations and greatly increase the likelihood of achieving optimal results from implementation.

Opportunities For Self-Evaluation Increase Student Calibration In An Introductory Biology Course, Jennifer L. Osterhage, Ellen Usher, Trisha A. Douin, William M. Bailey

Biology Faculty Publications

Accurate self-evaluation is critical for learning. Calibration describes the relationship between learners’ perception of their performance and their actual performance on a task. Here, we describe two studies aimed at assessing and improving student calibration in a first-semester introductory biology course at a 4-year public institution. Study 1 investigated students’ (n = 310) calibration (the difference between estimated and actual exam performance) across one semester. Students were significantly miscalibrated for the first exam: their predicted scores were, on average, significantly higher than their actual scores. The lowest-performing students had the most inaccurate estimates. Calibration improved with each exam. By …

A Multi-Institutional Analysis Of Instructional Beliefs And Practices In Gateway Courses To The Sciences, Joseph J. Ferrare

Educational Policy Studies and Evaluation Faculty Publications

This paper builds on previous studies of instructional practice in science, technology, engineering, and mathematics courses by reporting findings from a study of the relationship between instructors’ beliefs about teaching and learning and their observed classroom practices. Data collection took place across six institutions of higher education and included in-depth interviews with 71 instructors and more than 140 hours of classroom observations using the Teaching Dimensions Observation Protocol. Thematic coding of interviews identified 31 distinct beliefs that instructors held about the ways students best learn introductory concepts and skills in these courses. Cluster analysis of the observation data suggested that …

Cat In The Classroom: Understanding Instructor Behavior And Student Perceptions Through Communication Accommodation Theory, Terrell Kody Frey

Theses and Dissertations--Communication

Adjusting one’s communication is a fundamental requirement for human interaction (Gasiorek, 2016a). Individuals adapt communication behavior according to the circumstances surrounding the situation, resulting in different patterns and forms of speech relative to spouses, family members, coworkers, or friends. Yet, researchers in instructional communication have not yet substantially applied adjustment as a theoretical lens for understanding instructor-student classroom interactions (Gasiorek & Giles, 2012; Soliz & Giles, 2014; Soliz & Bergquist, 2016). Apart from overlooking this useful theoretical approach, instructional communication scholarship can also be improved by accounting for 1) shifting group identities in higher education that change how instructors and …

The Effect Of Increased Physical Activity On Academic Performance, Lauren Michelle Willis

Theses and Dissertations--Education Sciences

Increased levels of obesity, particularly among American youth, have consistently been cause for concern over the last few decades. Additionally, the amount of time youth spend being active throughout the day has consistently decreased. Physical activity levels among school-aged children in America are effected by any number of reasons, but this study points to the possibility of time spent being physically active during the school day having the greatest effect on a student’s overall level of physical activity. Increased pressures from different entities on local schools to improve student performance on standardized test scores have contributed to a decline in …

Targeting Food Selectivity In Young Children In A Preschool Classroom Using A Multi-Component Treatment Package, Christina Challed Hesley

Theses and Dissertations--Early Childhood, Special Education, and Counselor Education

The purpose of the study was to evaluate the effectiveness of using a video model, graduated exposure (i.e., touch, smell, try, eat), and positive reinforcement to first increase food exploration, and then increase consumption of non-preferred foods in young children that exhibit food selectivity in a school setting. A multiple probe design across behaviors replicated across participants was used to evaluate the effectiveness of a treatment package. The treatment package consisted of a video model of each target behavior (touch, smell, try, eat) and positive reinforcement which included preferred foods and materials. The results indicated that the treatment package was …

Martin School Alumni Survey, Carl Sims

MPA/MPP/MPFM Capstone Projects

The Martin School of Public Policy and Administration is subject to reaccreditation from the Network of Schools of Public Policy, Affairs, and Administration (NASPAA) every seven years. To initiate the reaccreditation process, the Martin School must conduct a programmatic self-study that analyzes the program’s mission, governance, faculty, students, competencies, resources, and communication. The self-study is beneficial not only for the purpose of reaccreditation but also can better inform the school’s strategic planning process

To assist in providing the self-study relevant data, the Martin School can solicit information from its alumni. Alumni data can be used to establish how well the …

Exploring Influences And Using Intentionality To Develop Work-Based Learning Opportunities: A Faculty Perspective, Lauren Mccrary

Theses and Dissertations--Educational Policy Studies and Evaluation

Understanding the practical implications related to experiential learning is complex. It is important to first view experiential learning as an umbrella term under which work-based learning (WBL) is housed. To further particularize, there are different avenues for students to pursue work-based learning opportunities (WBLOs), with internships and cooperative education being two. Although these are not new learning environments, understanding and clearly defining them (to both internal and external bodies) is increasingly necessary. In Kentucky, WBLOs are part of the political discourse on postsecondary education. The Council on Postsecondary Education (CPE) and local economic development agencies have incorporated strengthening and growing …

A Low-Intensity, Hybrid Design Between A "Traditional" And A "Course-Based" Research Experience Yields Positive Outcomes For Science Undergraduate Freshmen And Shows Potential For Large-Scale Application, Thushani Rodrigo-Peiris, Lin Xiang, Vincent M. Cassone

Biology Faculty Publications

Based on positive student outcomes, providing research experiences from early undergraduate years is recommended for science, technology, engineering, and mathematics (STEM) majors. To this end, we designed a novel research experience called the “STEMCats Research Experience” (SRE) for a cohort of 119 second-semester freshmen with diverse college preparatory levels, demographics, and academic majors. The SRE targeted student outcomes of enhancing retention in STEM majors, STEM competency development, and STEM academic performance. It was designed as a hybrid of features from apprenticeship-based traditional undergraduate research experience and course-based undergraduate research experience designs, considering five factors: 1) an authentic research experience, 2) …

Scoring Reliability By Early Childhood Educators On A Curriculum Based Assessment, Brigid S. Taylor

Theses and Dissertations--Early Childhood, Special Education, and Counselor Education

The purpose of this study was to investigate if early childhood educators could reliably score items using a new scoring system for the Assessment, Evaluation, and Programming System for Infants and Children (AEPS; Bricker, 2002). The participants were university students completing their certification in Interdisciplinary Early Childhood Education (IECE) at the University of Kentucky (UK). The six participants completed training on implementing the AEPS and administered the AEPS to measure child outcomes. The results of this study validated the new scoring system for the AEPS by illustrating that the participants could reliably score a curriculum based assessment.

Toward Assessment Leadership: Study Of Assessment Practices Among School And Classroom Leaders, Carrie Elizabeth Eubank Morris

Theses and Dissertations--Education Sciences

Traditionally, models of instructional leadership espouse data-informed decision making in response to student assessment outcomes as one of the core school leader behaviors. In recent years, rising expectations from accountability policies and related assessment practices have myriad implications for school districts, specifically in the areas of standards-driven reform, student assessment systems, and professional development models. As a result, demands on schools to collect and use student assessment data to inform curricular and instructional decisions has expanded. While principals are typically held responsible for school improvement efforts, more contemporary models of instructional leadership incorporate teachers as classroom-based leaders of assessment practices …

The Departmental Work Lives Of Full-Time Non-Tenure Track Faculty, Pamela Jane Clouse

Theses and Dissertations--Educational Policy Studies and Evaluation

This qualitative phenomenological dissertation explored The Departmental Work Lives of Full-Time Non-Tenure Track Faculty (FTNTT) at two public four-year universities located in the Southeastern region of the United States. This study is based on interviews with twelve (FTNTT) faculty members representing departments traditionally associated within the College of Arts and Sciences. This study found FTNTT faculty participants highly credentialed and reasonably satisfied in their positions. This study adds the descriptor heterogeneous to FTNTT faculty members’ job roles, work environments, daily engagements, and work experiences and contradicts existing literature that finds FTNTT faculty positions to be resource deficit and administratively non-supporting. …

Assessing Stem Literacy In An Informal Learning Environment, Maureen Ann Lafemina Cavalcanti

Theses and Dissertations--Education Sciences

This mixed methods study investigated methods for assessing STEM literacy amongst middle grades students participating in an informal learning environment, specifically, a summer STEM camp. Adopting a situated perspective on STEM literacy, this dissertation employed psychometric techniques and discourse analysis to answer the overarching research question: How can STEM literacy amongst middle school students be assessed in the context of a summer STEM camp? An integrated review of literacy within and across STEM disciplines first offered a new direction for conceptualizing STEM literacy. With this understanding, subsequent research methods applied novel approaches for investigating STEM literacy in the context of …

The Exploration Of Teacher Efficacy And Influences Of Context At Two Rural Appalachian High Schools, Justin Aaron Blevins

Theses and Dissertations--Educational Policy Studies and Evaluation

This study examines teachers’ sense of personal and collective efficacy in two similar schools in Appalachian communities that achieved different results regarding students’ accountability test scores. Prior work in teacher efficacy, which is predominantly quantitative, is extended by the addition of teacher interviews that explore how teachers define the problems they face regarding student performance and how they work individually and collectively on strategies to support students’ success. The findings support that teachers with higher levels of efficacy in their work are associated with higher levels of student success. Further, the study offers insights into how teachers perceive problems and …

Quality Measures Of Universities And The Determinants Of Tuition In South Korea, Young Hoon Ko

MPA/MPP/MPFM Capstone Projects

University tuition had increased in highly excess of the inflation rate from 1990s until 2008. Many people are wondering whether the quality of university education is proportional to the tuition level. Thus, this capstone project examines whether the quality measures in higher education can predict the tuition level.

After analyzing eight-year data of 146 private universities in South Korea, I get the result that university tuition is not a function of quality measures in terms of educational costs. However, tuition is a function of quality measures related with attractiveness, accomplishment, and satisfaction. Incoming student recruitment rate, and drop-out rate have …

Assessing Student Performance In Written Communication: An Evaluation Of The University Of Kentucky's Quality Enhancement Plan, Abigail Stockwell

MPA/MPP/MPFM Capstone Projects

University of Kentucky assessment findings reveal that UK undergraduate students are not meeting expectations in the area of written communication. More specifically, compared to other four-year institutions, UK students are not achieving expected levels of value-added from their junior to senior year in analytic writing tasks. In response to these findings, UK launched the Quality Enhancement Plan (QEP), Presentation U – a multimodal communication training initiative. One of the initiative’s core components is the Faculty Fellows Program. Faculty members who choose to participate in the program receive training in oral, written, and visual communication instruction. UK has invested a great …

Setting A Standard For Chemistry Education In The Next Generation: A Retrosynthetic Analysis, Gregory T. Rushton, Andrew Dewar, Herman E. Ray, Brett A. Criswell, Lisa Shah

Science, Technology, Engineering, and Mathematics (STEM) Education Faculty Publications

A diverse and highly qualified chemistry teaching workforce is critical for preparing equally diverse, qualified STEM professionals. Here, we analyze National Center for Education Statistics (NCES) Schools and Staffing Survey (SASS) data to provide a demographic comparison of the U.S. secondary chemistry teaching population in high-needs and non-high-needs public schools as well as private schools during the 2011–2012 academic year. Our analysis reveals that the chemistry teaching workforce is predominantly white and significantly lacks in-field degrees or certification across school types, though high-needs and private schools are most affected by this lack of teacher qualification. Given these results, we attempt …

Change In Perceived Teacher Self-Efficacy Of Agricultural Educators After A Greenhouse Management Workshop, Shari R. Dutton

Theses and Dissertations--Community & Leadership Development

Agricultural educators encounter unique teaching challenges as they teach applications of plant production in the greenhouse classroom. The teacher self-efficacy construct has been used broadly to link student learning outcomes to teachers' beliefs in their ability to attain certain instructional goals in the classroom. Few studies have used this construct to examine teacher-efficacy in the greenhouse classroom. This study uses the teacher self-efficacy construct within the agricultural educator domain. It seeks to measure change in agricultural educator self-efficacy beliefs using established self-efficacy scales to determine if a professional development experience in greenhouse operation and management effects educator beliefs in their …

A Debriefing Technique In High-Fidelity Patient Simulation And Competent Decision-Making Abilities Among Nursing Students, Trena Seago

Theses and Dissertations--Curriculum and Instruction

Nursing faculty are utilizing high-fidelity patient simulation (HPS) with debriefing to help engage nursing students in making competent clinical decisions. This quasi-experimental study examined the use of HPS with debriefing and students’ ability to make nursing care decisions using standardized exams. The experimental group received debriefing after HPS and the control group did not receive debriefing after HPS. The pre- and post-test assessed participants’ ability to make clinical care decisions. The analysis of the pre-test and post-test HESI scores showed that there was no significant difference between the two groups.

An Internal Evaluation Of A Health Program For Adults With Mild, Moderate, And Severe Intellectual Disabilities, Shelley C. Sellwood-Davis

Theses and Dissertations--Educational Policy Studies and Evaluation

Adults with intellectual disabilities are not only more likely to be obese, but they are also more prone to medical complications, including diabetes, cardiovascular disease, thyroid disorder and osteoporosis. Therefore, health programs targeting this population are becoming more frequent in nature, and learning what makes such programs effective will be important in serving this population. A health program for adults between the ages of eighteen and forty with mild, moderate, and severe intellectual disabilities was evaluated in order to learn how the individual health program could be improved and in what ways the program itself could serve as a model …

Determinants Of Student Engagement In Undergraduate Research At The University Of Kentucky, Tricia Coakley

MPA/MPP/MPFM Capstone Projects

No executive summary.