Educational Assessment, Evaluation, and Research Commons^™

Undergraduate Students' Attitudes About The Collection, Use, And Privacy Of Search Data In Academic Libraries, Laura W. Gariepy

Theses and Dissertations

The purpose of this study was to understand undergraduate students’ attitudes about search data privacy in academic libraries and their preferences for how librarians should handle information about what students search for, borrow, and download. This is an important area of study due to the increasingly data-driven nature of evaluation, accountability, and improvement in higher education, along with libraries’ professional commitment to privacy, which has historically limited the amount of data collected about student use. Using a qualitative approach through the lens of interpretive description, I used the constant comparative method of data collection and analysis to conduct semi-structured interviews …

An Evaluation Of Islamic Moral Teaching For Students Of Madrasah Aliyah Negeri (Man), Siti Amanah, Haryanto Haryanto

REID (Research and Evaluation in Education)

This research is aimed at evaluating: the preparation, implementation, and outcome of the moral teaching program using Stake Countenance evaluation model (antecedent, implementation, and outcome). The study was conducted at Madrasah Aliyah Negeri (MAN) Cilacap, MAN Kroya, and MAN Majenang. The subjects were the principals, teachers of Aqidah Akhlak, chairpersons of the Madrasah Committee, and 276 grade XII students. Interview, observation, questionnaire, and documentation were used as data collection techniques. The data analysis method used was the quantitative-qualitative descriptive analysis. The result of the evaluation shows that: (1) the preparation of the moral teaching is in 'good' category; (2) …

Developing An Instrument Of National Examination Of Equivalency Education Package C Of Mathematics Subject, Ian Harum Prasasti, Edi Istiyono

REID (Research and Evaluation in Education)

The national examination of equivalency education is a competency test to equalize non-formal education with formal education. Departing from the importance of the quality and expectations of the national examination of equivalency education package C mathematics subjects and because the results are inseparable from the implementation process, developing an evaluation instrument to assess the implementation of the national examination of equivalency education package C mathematics subjects is important. The purpose of this study is to develop a suitable instrument for conducting an evaluation of the national examination implementation of the equivalency education package C mathematics subject. The respondents in this …

A Different Way To Provide Feedback Of Student Learning, Dr. Deborah Bracke

Education: Faculty Scholarship & Creative Works

This article provides an alternative to traditional letter grading.

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Higher education research

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey Review by …

Teacher And Administrator Perceptions Of The Teacher Excellence And Support System (Tess) In Arkansas, Allison Louise Byford

Graduate Theses and Dissertations

The purpose of this study was to investigate differences in Arkansas teachers’ and building-level administrators’ perceptions regarding the purpose of the Arkansas TESS teacher evaluation system, whether TESS authentically assesses teacher effectiveness, how teacher evaluation data are used, and how the TESS process supports learner-centered professional development. Additionally, the relationship of teacher and administrator demographics on their perceptions of TESS was explored. The results of this study highlight the differences in perceptions in all areas questioned along with misalignment in perceptions among teachers. Overall, the study points toward the need for clear communication and the cultivation of relationships among building …

Apology Not Accepted: The Impact Of Executive Rhetoric, Communication Strategies, Media Coverage And Time On Crisis Management And Public Perception During Major Oil Spills, Todd D. Harcek

Dissertations

This research builds upon the scholarship in crisis communication strategies and apologia employed by companies during a crisis. Within the expansive domain of crisis management, this work evaluates the media coverage and crisis communication strategies during three major oil spills: the Exxon Valdez, the American Trader, and the BP Gulf oil spill. The purpose of this study is to provide practitioners, researchers and others additional insight into the impact of media coverage on prior, current and future crises and how this coverage, coupled with the communication strategies of companies during a crisis, can influence public awareness or perception. Furthermore, …

Student Social Services In Kentucky’S Schools: Understanding The Impact Of Fryscs On Student Achievement, Stephen W. Lin

Graduate Theses, Dissertations, and Capstones

This study examines the impact of a public policy intervention, called Family Resource and Youth Service Centers (FRYSC), on student achievement in Kentucky. The author provides a quantitative evaluation of FRYSC, supplementing a void in prior research on FRYSC effectiveness. FRYSC-eligible schools (n = 1263) included in this study had no center, an elementary center, a middle or high school center, or a combined center. The researcher analyzed data obtained from government databases reporting school-level statewide assessment results. Student achievement metrics reflect reading and mathematics proficiency outcomes for at-risk students, whom are typically served by a FRYSC. For reading and …

Do Impacts On Test Scores Even Matter? Lessons From Long-Run Outcomes In School Choice Research, Collin Hitt, Michael Q. Mcshane, Patrick Wolf

Education Reform Faculty and Graduate Students Publications

We have attempted to collect every experimental and quasi-experimental study of school choice in the US that examines attainment impacts. Most of these studies also examine impacts on test scores. We use an expansive definition of school choice, including private school voucher programs, charter schools, early college high schools, magnet schools, and vocational schools. We compare impacts on test scores to impacts on later attainment outcomes. Our question is, across all studies, do program impacts on test scores predict impacts on later outcomes?

Monitoring And Evaluation: Foundation Level, Australian Council For Educational Research (Acer)

Education Analytics Service

The purpose of this module is to provide introductory information about monitoring and evaluation (M&E), including the purpose, application of M&E frameworks, and key issues in education M&E. It provides a foundation to engage in this topic and apply advice from staff with operational or expert levels of knowledge in education M&E.

Monitoring And Evaluation: Practitioner Level, Australian Council For Educational Research (Acer)

Education Analytics Service

This Practitioner level module is designed to ensure staff members who manage education investments, can understand the concepts and monitoring and evaluation (M&E) practices needed for designing and supervising education investments. It is recommended that staff complete the Monitoring and Evaluation: Foundation level module as background information to this Practitioner level module. Topics covered in this module include: monitoring versus evaluation; monitoring and evaluation standards; monitoring and evaluation in practice; evaluation considerations; education indicators; monitoring and evaluation reporting; and gender and social inclusion considerations.

Utilizing A Learning Management System To Support Access To Study Abroad: A Program Evaluation At The University Of Denver, Christopher Chaves E Silva

Higher Education: Doctoral Research Projects

This doctoral research project investigated issues of access to study abroad at the University of Denver (DU). The study evaluated the use of the learning management system Canvas during Fall 2017, in preparation for student applications for study abroad during Fall 2018. The evaluation utilized qualitative data from focus groups with students and families, interviews with higher education professionals and analytics data on the usage of Canvas. The findings identified that the usage of Canvas during Fall 2017 was low in comparison to the number of individuals who applied to study abroad and was focused on the preparation for the …

Action Research: Teacher Evaluation And Reflection, Courtney Lynne Landry

Educational Leadership and Policy Studies: Doctoral Research Projects

The purpose of this qualitative action research study was to create an improved learning log procedure, based on the theory of action that the use of professional learning logs will improve self-reflection, which will increase teacher self-efficacy. Data collected through interviews, focus groups, and a research action committee have led to the assertions that (a) reflection is a necessary and welcomed part of being a professional; (b) procedures for reflection must be easily accessed and consistent; (c) teachers should have autonomy over their choice of reflection method to gain meaning; (d) though the learning log process allows for autonomy, the …

A Phenomenological Study Of Teachers' Emotional Responses To Tkes, A High-Stakes Evaluation System, Kristina J. Hirsch

College of Graduate Studies: Theses & Dissertations

Teachers experience a plethora of emotions relating to being evaluated and we are losing a lot of good teachers due to some of these emotions. The purpose of this phenomenological study was to investigate how teachers at one rural high school describe their emotional responses to evaluation and the implementation of TKES as well as if there were gender differences in their responses. This research is important because teachers need to understand that their emotions are not taboo and they are not alone in the evaluation process. Additionally, evaluators benefit from knowing how teachers respond to evaluation so that they …

An Elementary Perspective Of The Value-Added Model, Pat Mccoy

Walden Dissertations and Doctoral Studies

In a small, rural school district in the southeastern United States, elementary school teachers were receiving positive evaluation ratings while student proficiency on state assessments was below the state average. Due to changes in federal and state laws, school personnel evaluate methods have undergone significant reform. The purpose of this study was to answer the guiding research questions of teachers and administrators perceptions toward the value-added model (VAM) of evaluation and how those perceptions affect teacher performance. Taylor's scientific management theory, which suggests examining human productivity through the lens of applied science served as the conceptual framework. Data were collected …

Effects Of Collaborative Teaching Evaluation Process On Teacher/Administrator Collegiality, Gary A. Storts Jr.

Cal Poly Humboldt theses and projects

The job of the professional educator is becoming ever more complex. Research has shown that effective teacher evaluation processes and collegial relationships between the teacher and the principal both positively impact student achievement. This study investigates how a collaborative teacher evaluation process effects collegiality between the teacher and the site administrator. Four teachers who had experienced both traditional and collaborative reviews in a small rural school district in Northern California were interviewed to assess the impact that a collaborative evaluation had on their professional relationship with their principal.

The results of this research confirmed that teaching evaluations, however they are …

Strengthening Families In Santa Cruz County, Yajaira Rubio-Mendoza

Capstone Projects and Master's Theses

Parenting is very rewarding and enjoyable, yet it can be challenging and exhausting. Therefore, there is no right way to be a parent. At La Manzana Community Resources (LMCR), a family program of Community Bridges, there is a strong belief in strengthening families within the Santa Cruz County community. That is why LMCR provides various services such as, Triple-P Positive Parenting Program. Triple-P, funded by First 5, provides parents and caregivers parenting support ranging from birth to 12 years of age, with additional support for families with teens, and families of children with special needs. The …

Effects Of A Hospital-Wide Physician Communication Skills Training Workshop On Self-Efficacy, Attitudes And Behavior, Minna Saslaw, Dana R. Sirota, Deborah P. Jones, Marcy Rosenbaum, Steven Kaplan

Patient Experience Journal

Hospital systems interested in improving patient experience and physician engagement may look to physician communication skills training (CST) as a means of improving both. This study examines a 7.5-hour, multi-specialty, hospital-wide physician CST workshop in a large academic hospital system and its effects on participants’ self-efficacy, attitudes, and behaviors related to communicating with patients. Data was gathered from October 2014 through June 2016 through a web-based questionnaire sent to participants 6-weeks post-workshop which focused on skills taught in the course, attitudes toward communication training, and provider behaviors when communicating with patients. Along with demographic questions, a ten question retrospective pre-post …

An Evaluation Of The Effects Of The Search For Education, Elevation, And Knowledge (Seek) Program On Short- And Intermediate-Term Outcomes, Raymond Galinski

Dissertations, Theses, and Capstone Projects

The Search for Education, Elevation, and Knowledge (SEEK) program is an educational opportunity program within the City University of New York designed to provide economically and academically disadvantaged students, who otherwise would not have such access, the opportunity to attend college and to succeed once enrolled. However, despite being in existence for a half-century, surprisingly little is known about how the SEEK program contributes to student achievement and success. This study was the first to empirically measure the short- and intermediate-term impacts of this program on student outcomes.

Using propensity scores to match SEEK students to similar non-SEEK students to …

What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney

Publications and Research

This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course material. The purpose of the study was to learn how OER impacted students. Data were collected in Fall 2015 with students from New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded OER pilot initiative. Two research instruments …

Evaluating The Performance Of Propensity Score Matching Methods: A Simulation Study, Jessica N. Jacovidis

Dissertations, 2014-2019

In education, researchers and evaluators are interested in assessing the impact of programs or interventions. Unfortunately, most education programs do not lend themselves to random assignment; participants generally self-select into programs. Lack of random assignment limits the claims that researchers can make about the impact of the program because individuals who self-select into the program may be qualitatively different from individuals who do not self-select into the program. Propensity score matching allows researchers to mimic random assignment by creating a matched comparison group that is similar to the treatment group on researcher-identified variables.

There are a number of matching methods …

Investigating Personality Traits Of Registered Nurses: Implications For Personnel Evaluation, Stephanie N. Means

Dissertations

The United States is currently facing a registered nurse (RN) shortage that is expected to reach the millions in the next few years. Since the beginning of the century, healthcare professionals and administrators have strived to develop and implement ways to increase recruitment and retention in the nursing field. It has been recognized that the key to recruitment and retention is to get the right nurse in the right place, which means focusing on clinical proficiencies as well as personality qualities and characteristics. Personality assessment has long been used to evaluate person-job (P-J) fit of applicants for positions across the …

Formative Evaluation Of Byu Internship Course Syllabi, Shiloh Marie Howland

Instructional Psychology and Technology Graduate Student Projects

ABSTRACT

Annually, approximately 4,000 undergraduate and graduate students participate in the 133 academic internship courses offered at BYU. Each course is required to comply with the university Internship Policy. The university Internship Policy provides guidelines of how internship courses operate, responsibilities of the intern, site supervisor, and faculty advisor, and how students earn academic credit for internships. Compliance with these guidelines is supposed to be monitored by the Internship Office; however, due to personnel and time constraints, the degree to which the courses comply with that policy had not been studied prior to this evaluation. This project evaluated the syllabi …

What Do Employers Really Want? Helping Vocational Learners Crack The Code, Kate Perkins

Vocational, adult and professional education research

In the majority of vocational qualifications, assessment of competence incorporates a structured work placement (SWP). Increasingly, host employers are using these placements as part of recruitment strategies, particularly for entry level roles. In effect, the placement is becoming the new ‘interview’, and the new interview is morphing into an extended audition where a learner’s non-technical, ‘employability’ skills may play a critical role. But do learners know what their host employers are really looking for, and to what extent are their training programs helping them to develop and demonstrate the skills that are most likely to influence an employer’s recruitment decisions? …

Evaluación De Criterios E Indicadores Curriculares Como Estrategia Para Aseguramiento De La Calidad En Programas Académicos Universitarios, Erika Rivera Gutiérrez

Theses and Dissertations

La presente disertación surge de la necesidad de evaluar el nivel de cumplimiento decriterios e indicadores curriculares como estrategia para contribuir al aseguramiento de la calidad en programas académicos universitarios. La institución pública de educación superior se ubica en el municipio de Ixtlahuaca, estado de México.

El propósito de este estudio fue evaluar el nivel de cumplimiento de los criterios eindicadores de calidad del Plan de Estudios (PE), conocer la apreciación de los profesores, así como definir las áreas de oportunidad del programa académico (PA) de Diseño Gráfico (DG). Por tanto, se determinó una perspectiva metodológica de corte cualitativo con …

Secondary Teachers' Perceptions Of The Effectiveness Of A Professional Learning Community, Catina Shontelle Stewart

Walden Dissertations and Doctoral Studies

The implementation of professional learning communities (PLCs) in schools has been shown to serve as a catalyst in transforming school culture and increasing the academic performance of students. Our school district mandated that PLCs were established at the research site, an urban Louisiana school, for the primary purpose of closing the achievement gap. Yet, recent data from the local district indicate that these PLCs have not resulted in capacity building for sustainable improvement. Ineffective implementation of the current PLCs may have contributed to the poor outcomes. One purpose of this qualitative case study was to examine teachers' perceptions of the …

Kemampuan Berpikir Tingkat Tinggi Siswa Smp Di Kabupaten Jember Dalam Menyelesaikan Soal Berstandar Pisa, Dian Kurniati, Romi Harimukti, Nur Asiyah Jamil

Jurnal Penelitian dan Evaluasi Pendidikan

Tujuan penelitian ini adalah mendeskripsikan kemampuan berpikir tingkat tinggi (Higher Order Thinking Skills/HOTS) siswa dalam menyelesaikan soal PISA berdasarkan indikator yang telah disusun. Kemampuan berpikir tingkat tinggi dalam penelitian ini meliputi kemampuan logika dan penalaran, analisis, evaluasi, serta kreasi. Penelitian ini merupakan penelitian deskriptif dengan pendekatan kualitatif. Metode pengumpulan data meliputi metode dokumentasi, tes, dan wawancara. Hasil penelitian dari 30 siswa yang tersebar di beberapa SMP di Kabupaten Jember didapatkan bahwa 18 siswa mampu melakukan kemampuan logika dan penalaran, analisis, evaluasi, serta kreasi dengan baik dalam menyelesaikan beberapa soal, sehingga tergolong memiliki kemampuan berpikir tingkat tinggi dengan level …

A Formative Evaluation Of A Program Providing Support To College Students With Autism Spectrum Disorder, Kourtney Kay Bakalyar

Dissertations

Young adults with autism spectrum disorder (ASD) are attending institutions of higher education more than ever before (Smith, 2007). All college students with disabilities have the right to accommodations under the American with Disabilities Act Amendments Act of 2008 (ADAAA; P.L. 110-325); however, these accommodations frequently do not address barriers that prevent students with ASD from successfully completing their academic programs. The Autism Services Center at a public, four-year university provides services to its college students with ASD to address difficulties with communication and social skills, unique emotional and behavior characteristics, insufficient executive function, and difficulties with independent living skills. …

Three Empirical Investigations Into The Logic Of Evaluation And Valuing Practices, Satoshi Ozeki

Dissertations

This three-paper dissertation investigates the logic of evaluation proposed by Michael Scriven using two different methods of inquiry: content analysis and a survey method. Scriven’s logic of evaluation is one of the central concepts in evaluation, but has not been empirically investigated. Therefore, the purpose of this three-paper dissertation is to accumulate empirical knowledge on Scriven’s logic of evaluation to investigate the extent to which evaluators follow his logic and their perceptions of and familiarity with his logic. Furthermore, this dissertation aims to explore valuing practices in terms of Scriven’s logic of evaluation. Scriven’s logic of evaluation is important because …

The Relationship Between Instructional Strategies And Teacher Evaluation In Michigan Public Schools, Stephen D. Laatsch

Master's Theses and Doctoral Dissertations

The purpose of this quantitative study was to determine whether teachers altered instructional strategies based on their local school district’s teacher evaluation framework. Further, if changes were made to their use of instructional strategies, specific factors that influenced the changes were explored. This information is important because school districts across Michigan spend time, energy, and money for new teacher evaluation frameworks. Thus, it is essential to know if these frameworks change the use of instructional strategies in the classroom.

Teachers in 10 southeastern Michigan public school districts were surveyed to determine use of research-based instructional strategies before and after the …