Education Commons^™

University Evaluation Toolkit: Navigating Evaluative Practices Across All Levels With Rufdatae, Elizabeth J. Cook, Kena Cabral Morales

Research outputs 2022 to 2026

University stakeholders have mixed feelings about evaluation, and mixed understandings, skills and knowledge about how to effectively evaluate. How much do you know about evaluation? Could you plan an evaluation if asked? This poster provides a toolkit of strategies for enhancing evaluation in universities, based on Cook’s (2021) “Evaluation of work-integrated learning: A realist synthesis and toolkit to enhance university evaluative practices”. RUFDATAE is a modified version of Saunders’ (2000) approach.

The poster: defines evaluation; clarifies the difference between evaluation and research; summarises the four domains of evaluation in higher education; and outlines RUFDATAE, an evaluation planning framework, for prompting …

Student Assessment In Madhya Pradesh, Acer India

ACER India

ACER will build a student assessment system in Madhya Pradesh as part of Rajya Shiksha Kendra (RSK)’s School Certification Programme. Under this initiative, schools will be certified as gold, silver, and bronze based on their performance. We will develop assessments for students in grades 3, 5, 8, and 10 in schools that meet the qualifying criteria.

How Eagle Public Schools' Gifted Program Works As A System: A Case Study, Casey Rae Ward

Doctoral Dissertations and Projects

Learners who are gifted often underachieve due to various issues related to how they are served in their gifted programs. The purpose of this qualitative single-instrumental, embedded case study was to describe how the components of the gifted program of Eagle Public Schools, a small suburban school district in northern Virginia that recently implemented a new talent search approach in its gifted program, work together as a system to address the problem of underachieving gifted learners. The study sought to answer the central question: How do the components of Eagle Public Schools’ gifted program work together as a system? The …

Can School-Based Physical Activity Interventions Be Effective Without A Facilitator? A Step-Back Approach To School-Based Intervention Delivery, Yvonne Larrissa O’Byrne, Joan Dineen, Tara Coppinger

Publications

Irish children’s physical activity (PA) levels are below national guidelines. Schools are an ideal setting to promote PA but it remains challenging. This study evaluates the effectiveness of a step-back approach to Project Spraoi (PS); a facilitator (Energizer) led school-based PA intervention. Each Energizer in year one had 2 contact days per week with all classes (n = 11). A ‘step-back’ progression, with 50% less Energizer contact time, in year two and no Energizer contact in year three, was adopted. Objectively measured PA and cardiorespiratory fitness (CRF) were measured annually with the same children (n = 85). Stakeholders …

The First Annual Teaching And Research Showcase Poster Tu Dublin – The Proof Is In The Pudding – Using Perceived Stress To Measure Short-Term Impact In Initiatives To Enhance Gender Balance In Computing Education, Alina Berry, Sarah Jane Delany

Other resources

The problem of gender imbalance in computing higher education has forced academics and professionals to implement a wide range of initiatives. Many initiatives use recruitment or retention numbers as their most obvious evidence of impact. This type of evidence of impact is, however, more resource heavy to obtain, as well as often requires a longitudinal approach. There are many shorter term initiatives that use other ways to measure their success.

First, this poster presents with a review of existing evaluation measures in interventions to recruit and retain women in computing education across the board. Three main groups of evaluation come …

Alternative Assessment In Education, Eugene Jack Constandaki

Student Research Projects

No abstract provided.

Chapter 13- Improving Mentoring Relationships And Programs Through Assessment And Evaluation, Laura Gail Lunsford

Making Connections

Chapter 13, Improving Mentoring Relationships and Programs Through Assessment and Evaluation, presents frameworks for deciding how to improve mentoring experiences. Assessment activities solicit feedback from or about the participants and focus on participant learning and in situ improvement opportunities. Evaluation efforts determine if the program achieved organizational goals. The chapter has four goals. First, the chapter clarifies the difference between assessment, evaluation, and research. Second, the chapter presents frameworks to guide assessment and evaluation efforts. Third, the chapter describes tools for assessment. Fourth, the chapter describes how to evaluate mentoring programs, what data to collect, when to collect it, …

Administrator Feedback To Teachers, Regina Frazier, Candace Wilkerson, Jacquie Cioffi, Patrick Simmons, Makeba Lindsay D'Abreu, Thea Racelis, Amanda Simmons, Melissa Yancey, Deanna Fierro, David B. Naff

MERC Publications

This brief from the Metropolitan Educational Research Consortium (MERC) curates peer-reviewed scholarship as well as state and school board policies in Virginia related to administrator feedback to teachers. It explores the following questions: 1) What is the purpose of administrators providing feedback to teachers? 2) How do administrators typically provide feedback to teachers? 3) How do teachers typically receive feedback from administrators? 4) What are research-based strategies for administrators to provide productive feedback to teachers? It concludes with key takeaways and recommendations for how administrators provide feedback to teachers.

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) investigates the preparation of young people to undertake their roles as citizens. It gathers and analyzes data from representative national samples on students’ conceptual knowledge and understanding of civics and citizenship, as well as their attitudes to, and engagement with, aspects of civics and citizenship. ICCS builds on a succession of IEA studies in this field dating back to 1971, and especially since 2009. The 2022 study has been developed to build on previous perspectives on, and monitor changes in, such enduring issues as: levels of civic knowledge and understanding; patterns of …

Faculty Handbook, Georgia Southern University

Faculty Handbooks

Faculty Handbook for Georgia Southern University for the 2022-2023 academic year. The Faculty Handbook is published online by the Office of the Vice President for Academic Affairs and archived in Digital Commons@Georgia Southern.

Spotlight On Teacher Supports. Evaluation Of Australia’S Investment In Teacher Development In Lao Pdr (Lao Version), Australian Council For Educational Research

Education Analytics Service

The Australian Government is supporting the Government of Lao PDR to undertake significant primary education reforms through its flagship Basic Education Quality and Access in Lao PDR program (BEQUAL), including the roll-out of a new primary curriculum. Phase 1 of BEQUAL (2015-22) supported the Ministry of Education and Sports (MoES) to roll out the new primary curriculum in schools. BEQUAL support included teaching and learning materials, orientation training on the new curriculum, and education support grants. Phase 2 (2022-26) is focused on inclusive teaching practices, student engagement and improved learning outcomes. To understand progress and to make necessary adjustments, the …

Spotlight On Student Engagement. Evaluation Of Australia’S Investment In Teacher Development In Lao Pdr (Lao Version), Australian Council For Educational Research

Education Analytics Service

The Australian Government is supporting the Government of Lao PDR to undertake significant primary education reforms through its flagship Basic Education Quality and Access in Lao PDR program (BEQUAL), including the roll-out of a new primary curriculum. Phase 1 of BEQUAL (2015-22) supported the Ministry of Education and Sports (MoES) to roll out the new primary curriculum in schools. BEQUAL support included teaching and learning materials, orientation training on the new curriculum, and education support grants. Phase 2 (2022-26) is focused on inclusive teaching practices, student engagement and improved learning outcomes. To understand progress and to make necessary adjustments, the …

Feasibility And Reliability Of Health-Related Physical Fitness Tests In Children And Adolescents With Hearing Impairment, Jiafu Huang, Jianmei Yang, Justin A. Haegele, Lijuan Wang, Sitong Chen, Chunxiao Li

Human Movement Sciences Faculty Publications

Although research supports the feasibility and reliability of health-related physical fitness (HRPF) tests in typically developing children and adolescents, little is known regarding the feasibility and reliability of these tests for those with hearing impairments (HI). The aim of this study was to evaluate the feasibility and reliability of a HRPF test battery for children and adolescents with HI. A test–retest design with a one-week interval was conducted with 26 participants with HI (mean age: 12.7 ± 2.8 years; 9 male). The feasibility and reliability of seven field-based HRPF tests (i.e., body mass index, grip strength, standing long jump, vital …

Effective Practices Of Feedback Of Elementary School Administrators During The Post-Observation Conference, Michael Galvin

Masters Theses & Specialist Projects

Research identifies two purposes for teacher evaluation: measurement and professional growth; however, the literature provides limited research on the impact of the post-observation conference in teacher evaluation on professional growth (Marzano, 2012). The purpose of this qualitative, phenomenological study is to examine the perceptions of Indiana public elementary school principals on the impact of the post-observation conference on professional growth of teachers. The study uses an Elementary Administrators’ Background Questionnaire and semi-structured interviews to gather an in-depth understanding of administrators’ perceptions.

Four research questions framed this study as I examined public elementary school administrators’ perceptions of post-observation feedback within the …

Hci Education And Ux Practice: Highlights From Singapore, Tamas Makany, Dharani Perera-Schulz

Research Collection Lee Kong Chian School Of Business

This position paper highlights trends in education, practice, and support of HCI/UX in Singapore, a small city-state island in Southeast Asia. The paper was prepared for the 2022 Southeast Asia Computer-Human Interaction (SEACHI'22) virtual workshop on Apr 14, 2022, as part of the ACM CHI Conference on Human Factors in Computing Systems (CHI'22) international conference.

Iea International Civic And Citizenship Education Study 2022: Assessment Framework [Early Online Version], Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Study (ICCS) 2022 continues IEA’s investigation into the ways in which young people understand and are prepared to be citizens in a world where contexts of democracy and civic participation continue to change. This assessment framework provides insight into the study’s conceptual background, cognitive, affective-behavioral and contextual content, and assessment design. It also describes content relevant for the measurement of the United Nations’ Sustainable Development Goals (SDGs) that is related to Global Citizenship Education (GCED) and Education for Sustainable Development (ESD). Countries that participated in ICCS 2009, ICCS 2016, and ICCS 2022 will be able …

Course Outline And Weekly Plans For Eds 741 Psychoeducational Evaluation Of Children With Learning Problems, Lisa Cavallero

Open Educational Resources

Topics covered in this course include: psychoeducational evaluations, IEPs, standardized tests, fair assessments, measures of intelligence, disproportionality of linguistically and culturally non-dominant backgrounds in special education, assessment of adaptive behavior, learning disabilities, attention, and social and emotional behavior, functional behavior assessment, assessment of multilingual learners, math and literacy assessments, response to intervention.

This course outline includes:

• all assignments for the course (link to assignments packet).
• links to lecture slides
• instructor notes
• additional resources

Note: users will be prompted to make their own copy of documents when clicking on links to Google Docs and Google Slides.

Kindytxt: A Free Text Messaging Program For Kindergarten Children And Families, Lennie Barblett, Nicola Johnson, Caroline Barratt-Pugh, Susan Hill

Research outputs 2022 to 2026

• This project focused on developing, delivering and evaluating a literacy text-messaging program for parents / carers with a child at kindergarten in WA.
• Texts were delivered weekly over 30 weeks, in collaboration with Better Beginnings. Families were invited to participate through a flyer in the book gifting bag delivered by local librarians to families attending kindergarten across Western Australia.
• Kindergarten teachers and librarians from 16 LGAs attended workshops to establish kindergarten-family library partnerships, along with the production and evaluation of a partnership framework and implementation materials.
• Evaluation involved all participants, with in-depth data collected from participants in six communities.

Texas Administrators' Perspective Of Music Educators In Classroom Evaluations In Regards To T-Tess, Thomas C. Kennedy

Doctoral Dissertations and Projects

Despite the perspectives of music educators in classroom evaluation processes, the perspectives of Texas administrators using the newest teacher evaluation process, the Texas Teacher Evaluation and Support System (T-TESS), have yet to be examined. The administrators’ perspectives matter because the complexity of the T-TESS process coupled with the uncertainty of music educational knowledge may lead to inconsistency in evaluation. This qualitative study aims to examine the perspectives of Texas administrators concerning their preparation in music teacher evaluation. Current research fails to identify the perspectives of Texas administrators in the evaluation of music educators in classroom instruction. Views on evaluation training, …

Effects Of Nonmusical Factors On Virginia High School Band Concert Performance Assessment Results, Larry Michael Seipp

Doctoral Dissertations and Projects

Nonmusical factors affect the Virginia Band and Orchestra Directors Association (VBODA) concert performances and subsequent assessment results; namely, school size, ethnicity, and socioeconomic status. A comparison of ratings given by individual trained evaluators demonstrates interrater reliability. A comparison of final ratings given at different assessment locations and times reflects the reliability of ratings. However, administrators and evaluators must consider nonmusical factors to report instrumental music performance results accurately. Predictor variables included SES, school size, and minority percentage. Outcome variables included overall band rating and band performance literature difficulty. Using an MLR design, the researcher compared data from the 2019 VBODA …

Online Prehealth Advising: Impact Analysis Spring 2017 To Fall 2020, Alasdair Ekpenyong, Mykel Beorchia

Publications

At Utah State University, various online, Canvas-based advising programs complement the traditional in-person advising program. The online prehealth advising service assists students who are considering health professions graduate school.

This report explored the association between online prehealth advising participation and student persistence to the next term at Utah State University.

Opening Act: The Academic Library's Role In Orientation Planning And Evaluation, Zachary Lewis, Katy Kelly

Roesch Library Faculty Publications

This article describes a private, mid-sized university library’s experience of hosting a music festival-themed event in the library building as part of new student orientation, with program evaluation and student learning assessment at the forefront of planning. The authors and co-planners will discuss four years of data to explore the connection between library outreach and students’ use of the library, their perceptions of the institution, and the role the event plays in shaping student success. It offers recommendations for collaborating with academic libraries and approaches in future cross-campus collaborations, including using a scaffolding approach to outline the goals and assessment …

Scaling Professional Development: Integrity Of Implementation As A Measurement Approach, Brooke A. Whitworth, Lori Rubino-Hare, Nena E. Bloom

Publications

Professional learning about an innovative teaching method is a demonstrated way to improve teacher practices, and ultimately impact student learning. One way to scale up professional learning is a facilitator development model, in which professional learning and development (PLD) designers prepare facilitators to understand the innovation and they in turn, teach teachers. To understand the effectiveness of this model, identifying how facilitators implement the model with teachers is critical. As such, the Power of Data (POD) team scaled-up effective PLD by providing Facilitation Academies to teach others to facilitate POD Teacher Workshops (TWs). The expectation was that changes based on …

Pre-Reading Activities And Students’ Achievement In French Oracy: Implication For Evaluation In Library And Information Science, Kenneth O. Eze Phd, Grace C. Offorma Phd, Christian S. Ugwuanyi Phd, Chinedu I.O. Okeke Phd

Library Philosophy and Practice (e-journal)

Library and Information Science is a profession that is full of people who are passionate about making a positive change in the world. In this profession, the workers are known as Librarians whose duty is to bridge the gaps that exist between people, information and technology. Librarians work to create reader’s advisory resources to encourage young students to develop a lifelong love of reading and learning through pre-reading activities. This paper thus, investigated the effect of pre-reading activities on students’ achievement in French oracy. Using quasi-experimental research design, 154 senior secondary one students participated in the study. French Oracy Achievement …

Evaluation Of Work-Integrated Learning: A Realist Synthesis And Toolkit To Enhance University Evaluative Practices, Elizabeth J. Cook

Research outputs 2014 to 2021

Situated in the context of work-integrated learning (WIL), this paper aims to build the evaluative capacity of universities in response to an increasing need for evaluation in higher education. It contributes a realist synthesis of international peer-reviewed literature on university evaluation of WIL, which revealed no use of evaluation theory or approaches by the authors. In response, to support the enhancement of university evaluative practices, this paper offers a toolkit of evaluation theory and approaches, with examples relating to WIL, featuring an evaluation planning tool (RUFDATAE). RUFDATAE is demonstrated using a study from the realist synthesis, to highlight its relevance, …

Deadly Sista Girlz Final Evaluation Report, Elizabeth Jackson-Barrett, Anne Price, Jen Featch

Research outputs 2014 to 2021

Background

The Deadly Sista Girlz (DSG) program is one of several school-based mentoring programs currently operating in Australia to improve educational outcomes of Indigenous girls. Deadly Sista Girlz runs programs on 12 DET WA school sites, 1 Catholic Education school site in Broome and 1 in Victoria. Each school site has a dedicated DSG room where DSG coordinators and mentors support the girls individually and communally whilst also running regular program workshops. There are currently over 732 high school aged girls enrolled in the program. DSG is part of the large and well established Wirrpanda Foundation.

Overall aims

This External …

Chart A Clear Course: Evaluation Is Key To Building Better, More Relevant Learning, Chase Nordengren, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

When we engage in professional learning, we do it for one big reason: to get better at supporting students. Rigorous and thoughtful program evaluations can provide the critical connection between well-designed programs or initiatives and continuous improvement that builds essential knowledge and skills for educators. Evaluation helps us examine what has been accomplished in a professional learning initiative and identify course corrections that can help the initiative improve.

The Future Of International Education: Why Agility Is Now Integral To Strategic Planning, Aaron Clevenger, Elaine Meyer-Lee

Publications

Based on my experience, agility is truly based on the principles of resiliency. Resiliency is an approach to sustainability that focuses on building capacity to deal with disasters, unexpected changes and/or shifts to our daily routines.

● Kampala, Uganda example shows mild disruption, poor maintenance, and insufficient infrastructure creates a lack of resiliency.

At Embry-Riddle, hurricanes are the norm.

Towards A Sociotechnical Reconfiguration Of Engineering And An Education For Ethics : A Critical Realist Investigation Into The Patterns Of Education And Accreditation Of Ethics In Engineering Programmes In Ireland, Diana Adela Martin

Doctoral

The focus of this thesis is on the provision and evaluation of ethics in engineeringprogrammes in Ireland, by placing this examinationin the wider cultural context of engineering education.The study benefitted from the support of the national accrediting body Engineers Ireland, and included 23 engineering programmes from 2 institutes of technology and 4 universities in Ireland which underwent accreditation between 2017-2019.By using a Critical Realistframe, the study undertakes a multi-layeredinvestigation of the engineering education system that takes into consideration theindividual level of single agents such as instructors and evaluators, the institutional level comprised of engineering programmes, as well as the policy …

The Relationship Between The Average Number Of Principal Walkthroughs And School Accountability Grade Of Florida High Schools, Robert Leslie Bennett

Doctoral Dissertations and Projects

This quantitative correlational study sought to determine if the administrative time and financial investment in administrative walkthroughs is an effective practice that leads to improved student achievement. This study sought to determine if a predictive relationship existed between the predictor variable mean of principal school-wide walkthroughs, and the criterion variable school grade in Florida high schools. This study was designed to determine if the principal walkthrough is an effective tool to improve teaching practice to improve student achievement to meet accountability measures. The sample include 72 high school principals in Florida. Data was collected through a self-report survey in which …