Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Series

Educational Assessment, Evaluation, and Research

Evaluation

Institution
Publication Year
Publication
File Type

Articles 1 - 30 of 60

Full-Text Articles in Education

Assessing The Effectiveness Of Computer Science Rpps: The Case Of Cafecs, Erin Henrick, Steven Mcgee, Ronald I. Greenberg, Lucia Dettori, Andrew M. Rasmussen, Don Yanek, Dale F. Reed Feb 2019

Assessing The Effectiveness Of Computer Science Rpps: The Case Of Cafecs, Erin Henrick, Steven Mcgee, Ronald I. Greenberg, Lucia Dettori, Andrew M. Rasmussen, Don Yanek, Dale F. Reed

Computer Science: Faculty Publications and Other Works

Research Practice Partnerships (RPPs) are a relatively

recent development as a potential strategy to address the

complex challenges in computer science education. Consequently,

there is little guidance available for assessing the effectiveness of

RPPs. This paper describes the formative evaluation approach

used to assess the progress of the first year of the formalized RPP,

Chicago Alliance for Equity in Computer Science (CAFE´CS).

This paper contributes to the RPP literature by providing a case

study of how an RPP effectiveness framework can be adapted

and used to inform partnership improvement efforts in computer

science education.


Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock Jan 2019

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of ...


Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock Jan 2019

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Faculty Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of ...


Data Parties I Have Known: Lessons Learned And Best Practices For Success, Nancy K. Franz Aug 2018

Data Parties I Have Known: Lessons Learned And Best Practices For Success, Nancy K. Franz

Education Publications

Increased focus on data-driven decision making requires Extension professionals to excel at data analysis and interpretation. Data parties have become increasingly popular for involving stakeholders in making sense of data. As these parties become more frequently used by Extension professionals, best practices are emerging from lessons learned to improve the process and enhance the outcomes. These practices include designing discussion questions to fit the specific goals of the process, engaging a team of key partners, setting a theme and party environment that appeals to the participants and fits the context, providing appropriate data visualization tools, and using strong facilitation practices.


Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke Aug 2018

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Higher Education Research

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey ...


Using Immediate Feedback To Improve Short-Term Learning In Extension, Erin W. Hodgson Jan 2018

Using Immediate Feedback To Improve Short-Term Learning In Extension, Erin W. Hodgson

Entomology Publications

Program evaluation is an important part of any extension program and is often a required component by funding agencies. Given declining resources in land-grant universities, we must be creative in evaluating the learning and adoption of our research-based recommendations. I used a survey tool to give immediate feedback to participants in a wide variety of situations. Results indicate adults were receptive to this evaluation method, and close-ended questions can provide reliable evaluation data in an extension program. People showed improved significant learning with this technique and it is a model for other extension personnel.


What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney Jun 2017

What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney

Publications and Research

This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course material. The purpose of the study was to learn how OER impacted students. Data were collected in Fall 2015 with students from New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded OER pilot initiative. Two research instruments ...


Evaluate Naturally And Quickly With Just-In-Time Program Evaluation, Nancy K. Franz, John F. Munsell, Tiffany N. Brown, Holly K. Chittum Feb 2017

Evaluate Naturally And Quickly With Just-In-Time Program Evaluation, Nancy K. Franz, John F. Munsell, Tiffany N. Brown, Holly K. Chittum

Education Publications

A just-in-time evaluation approach can help Extension professionals expand their program evaluation readiness, interest, and competence. A pilot test of this efficient approach helped organizers of a forest farming conference determine important information about the event's processes and content to be better positioned for future work. The conference evaluation team and conference participants enjoyed this approach that integrated evaluation methods and evaluative thinking into all the conference activities. This approach to evaluation is especially appropriate for gathering real-time data for determining the value of educational processes taking place while making evaluation more visible and easier to accomplish.


Formative Evaluation Of Byu Internship Course Syllabi, Shiloh Marie Howland Feb 2017

Formative Evaluation Of Byu Internship Course Syllabi, Shiloh Marie Howland

Instructional Psychology and Technology Graduate Student Projects

ABSTRACT

Annually, approximately 4,000 undergraduate and graduate students participate in the 133 academic internship courses offered at BYU. Each course is required to comply with the university Internship Policy. The university Internship Policy provides guidelines of how internship courses operate, responsibilities of the intern, site supervisor, and faculty advisor, and how students earn academic credit for internships. Compliance with these guidelines is supposed to be monitored by the Internship Office; however, due to personnel and time constraints, the degree to which the courses comply with that policy had not been studied prior to this evaluation. This project evaluated the ...


A Meta-Analysis Of The Effects Of Enrichment Programs On Gifted Students, Mihyeon Kim Feb 2016

A Meta-Analysis Of The Effects Of Enrichment Programs On Gifted Students, Mihyeon Kim

Articles

Although descriptions of enrichment programs are valuable for practitioners, practices, and services for gifted students, they must be backed by evidence, derived through a synthesis of research. This study examined research on enrichment programs serving gifted students and synthesized the current studies between 1985 and 2014 on the effects of enrichment programs. A total of 26 studies were included in this meta-analysis, and the findings show that enrichment programs had a positive impact on both gifted students’ academic achievement (g = 0.96, 95% CI [0.64, 1.30], under a random-effects model) and socioemotional development (g = 0.55, 95% CI ...


Applications Of Peer Assessment And Self-Assessment In Music, Christopher Valle, Heidi Andrade, Maria Palma, Joanna Hefferen Jan 2016

Applications Of Peer Assessment And Self-Assessment In Music, Christopher Valle, Heidi Andrade, Maria Palma, Joanna Hefferen

Educational & Counseling Psychology Faculty Scholarship

Feedback is crucial to students’ growth as musicians. Fortunately, the teacher is not the sole source of feedback in the music classroom. Under the right conditions, students can provide actionable feedback to themselves and each other. This article showcases the work of three elementary music specialists who have innovatively incorporated formative peer assessment and self-assessment in their music lessons to promote student learning and self-direction.


Data-Based Decision Making In School Counseling: Utilizing Multiple Single-Case Indicators To Evaluate Interventions, Ryan J. Mcgill, Kelly S. Kennedy, Randy T. Busse Jan 2016

Data-Based Decision Making In School Counseling: Utilizing Multiple Single-Case Indicators To Evaluate Interventions, Ryan J. Mcgill, Kelly S. Kennedy, Randy T. Busse

Education Faculty Articles and Research

As the field of professional school counseling continues to move toward a data-based decision making model of service delivery, there is a need for dissemination of best practice methods for evaluating whether school-based counseling interventions are effective. In that vein, the purpose of this article is to review several methods of data-based decision making within a single-case outcome evaluation model, as well as their potential applications for school counseling interventions. To aid practitioners, the potential use of these methods is demonstrated in a case example and accompanying graphic displays.


Achievement Gaps - The Continuing Challenge, Geoff N. Masters Ao Jun 2015

Achievement Gaps - The Continuing Challenge, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Professor Geoff Masters AO discusses the challenges of closing achievement gaps.


Service Learning And Assessment: A Brief Overview, Katherine Paschetto Apr 2015

Service Learning And Assessment: A Brief Overview, Katherine Paschetto

Assessment & Accountability in Student Affairs & Higher Education (CNS 610)

No abstract provided.


Week One Evaluation, Judith Longfield Apr 2015

Week One Evaluation, Judith Longfield

Teaching Academy

Help me make the Academy a good learning experience for you by rating today’s session. Please write a BRIEF response to the following statements.


Evaluation Of Weeks 1-3, Judith Longfield Apr 2015

Evaluation Of Weeks 1-3, Judith Longfield

Teaching Academy

Rate the first three weeks of the Academy by writing a BRIEF response to the following statements.


Plunging Beneath The Surface: Uncovering Internal Dispositions, Lori Piowlski, Karen Colum Feb 2015

Plunging Beneath The Surface: Uncovering Internal Dispositions, Lori Piowlski, Karen Colum

Elementary and Literacy Education Faculty Publications

Teacher preparation programs face the challenge of measuring candidates’ competencies that can be considered internal dispositions; which impact the quality of their instruction. This study delves into candidate edTPA scores in correlation with their IDI mindsets to support program development.


Weaving Leadership Longitudinally: A Qualitative Study On Faculty Development, Pauline Joyce Feb 2015

Weaving Leadership Longitudinally: A Qualitative Study On Faculty Development, Pauline Joyce

Institute of Leadership Articles

Purpose

The purpose of this study was to explore if faculty who undertake teacher preparation, which has a leadership intervention across each module, are better prepared to take on educational leadership roles.

Methods

A cross sectional qualitative approach was used as part of a longitudinal evaluation of a program. The aim was to explore the perceptions of a purposive sample across three cohorts of students. Data was collected via semi-structured interviews and were analyzed by thematic analysis.

Results

Data from ten semi-structured interviews suggested that perceived leadership development included confidence to change day-to-day practice, see the bigger picture, and manage ...


Investing In Teachers, Australian Department Of Foreign Affairs And Trade Office Of Development Effectiveness, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs Jan 2015

Investing In Teachers, Australian Department Of Foreign Affairs And Trade Office Of Development Effectiveness, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs

Teacher Education

This evaluation compares evidence from the literature with Australia’s experience in supporting teacher development in a range of developing countries. It uses case studies to good effect in explaining choices made, the extent to which expectations were or were not met, and the lessons for future Australian assistance for teacher development. The evaluation found mixed results. In cooperation with governments and other donors, Australia has made positive contributions, such as improving teacher frameworks and curriculums, and training teachers through a range of interventions. However, there is room to improve—for example, in enhancing policy, strengthening analysis and negotiating new ...


An Evaluation Of Formative Audio Feedback Within Part Time Professional Development Programmes In Dit., Claire M. Mcdonnell, Roisin Donnelly, Claire Mcavinia Jan 2015

An Evaluation Of Formative Audio Feedback Within Part Time Professional Development Programmes In Dit., Claire M. Mcdonnell, Roisin Donnelly, Claire Mcavinia

Other resources

Evidence from the literature indicates that learners often view feedback in terms of assessment only, even though it can play an important role in improving engagement and consolidating and enriching learning. It is well accepted that the feedback strategy used should be appropriate to the purpose and context of the work, but in order for feedback to be truly helpful, it needs to be goal-referenced, tangible, transparent, actionable, user-friendly (specific and personalized), timely, ongoing and consistent. Technology can also play a useful supporting role in achieving this. This paper explores the impact of formative audio feedback across part time programmes ...


Beware Of The Collision Between Cultural Proficiency And Teacher Candidate Performance Assessment, Lori Piowlski Oct 2014

Beware Of The Collision Between Cultural Proficiency And Teacher Candidate Performance Assessment, Lori Piowlski

Elementary and Literacy Education Faculty Publications

An issue facing teacher preparation programs is that higher education must be able to measure teacher candidates' competencies that can be considered internal dispositions, which directly impact the quality of their instruction. This session delves into the teacher performance assessment (edTPA) scores candidates are earning in correlation to their Intercultural Development Inventory (IDI) levels


Tech Edge Student Rubric Grades 2-3, Laurie A. Friedrich, Guy Trainin Oct 2014

Tech Edge Student Rubric Grades 2-3, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Literacy and Technology

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades 2-3.


Tech Edge Student Rubric K-1, Laurie A. Friedrich, Guy Trainin Oct 2014

Tech Edge Student Rubric K-1, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Literacy and Technology

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades K-1.


Tech Edge Student Rubric Grades 4-5, Laurie A. Friedrich, Guy Trainin Oct 2014

Tech Edge Student Rubric Grades 4-5, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Literacy and Technology

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades 4-5.


Successive Study Of Diversity Conference Evaluations Of Presenters By Race, Gender, Sexual Orientation, And Disability, Autumn M. Palmer, Christine M. Wilson, Judith Puncochar Apr 2014

Successive Study Of Diversity Conference Evaluations Of Presenters By Race, Gender, Sexual Orientation, And Disability, Autumn M. Palmer, Christine M. Wilson, Judith Puncochar

Conference Presentations

A Midwestern university’s annual diversity conference hosts about 1,500 attendees from a campus of 9,000 students. Using a successive independent samples design, a series of cross-sectional surveys were conducted to answer the research question, how does a presenter’s race, gender, and ability/disability affect participant responses on conference evaluations. A review of the literature has determined that our research represents the largest and longest empirical study of a higher education diversity conference in the United States. The research is a comparative study of evaluation trends of conference attendees toward diversity conference presenters based on race, gender ...


Technology-Mediated L2 Strategy Instruction And Its Potential To Enhance Evaluation And Research, Jim Ranalli Jan 2014

Technology-Mediated L2 Strategy Instruction And Its Potential To Enhance Evaluation And Research, Jim Ranalli

English Publications

This paper discusses the potential of technology-mediated forms of L2 strategy instruction (SI) to not only facilitate SI but to enhance evaluation of SI interventions and L2 strategy research more generally. It uses results from a recent empirical study to show how computer-based forms of SI may offer remedies for problematic features of evaluation, including access to process data showing how learners actually perform strategy-related tasks, the timing and frequency of collection of learner perception data, and most importantly, data about task perception and meta-cognitive monitoring, which can position L2 strategies within frameworks for self-regulated learning. The underlying premise of ...


Evaluation Of Gogirlgo!; A Practitioner Based Program To Improve Physical Activity, Jennifer L. Huberty, Danae M. Dinkel, Michael W. Beets Jan 2014

Evaluation Of Gogirlgo!; A Practitioner Based Program To Improve Physical Activity, Jennifer L. Huberty, Danae M. Dinkel, Michael W. Beets

Health and Kinesiology Faculty Publications

Background:
GoGirlGo! (GGG) is designed to increase girls’ physical activity (PA) using a health behavior and PA-based curriculum and is widely available for free to afterschool programs across the nation. However, GGG has not been formally evaluated. The purpose of this pilot study was to evaluate the effectiveness of the GGG curricula to improve PA, and self-efficacy for and enjoyment of PA in elementary aged girls (i.e., 5-13 years).

Methods:
Nine afterschool programs were recruited to participate in the pilot (within subjects repeated measures design). GGG is a 12-week program, with a once a week, one-hour lesson with 30 ...


Preparing Culturally Proficient Teachers, Lori Piowlski Oct 2013

Preparing Culturally Proficient Teachers, Lori Piowlski

Elementary and Literacy Education Faculty Publications

This session helps frame the demographic and educational changes that are resulting in the restructuring of teacher preparation programs. Discussion of qualitative study provides a platform to begin reflecting on how to deliver a comprehensive teacher education program that instills cultural proficiency.


The Impact Of National And International Assessment Programmes On Education Policy, Particularly Policies Regarding Resource Allocation And Teaching And Learning Practices In Developing Countries, Maura Best, Pat Knight, Petra Lietz, Craig Lockwood, Dita Nugroho, Mollie Tobin Jan 2013

The Impact Of National And International Assessment Programmes On Education Policy, Particularly Policies Regarding Resource Allocation And Teaching And Learning Practices In Developing Countries, Maura Best, Pat Knight, Petra Lietz, Craig Lockwood, Dita Nugroho, Mollie Tobin

Assessment and Reporting

There is a documented global rise in the number of countries undertaking national learning assessments, as well as international and regional learning assessments. Much of this growth, especially in national learning assessments, has occurred in economically developing countries. Little is known, however, on how these assessments affect education policy and practice in developing countries. This review examined the impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries. This particular focus on policies regarding resources and teaching and learning practices stemmed from an observation that, particularly in ...


Reflections On A Decade Of Global Rankings: What We've Learned And Outstanding Issues, Ellen Hazelkorn Jan 2013

Reflections On A Decade Of Global Rankings: What We've Learned And Outstanding Issues, Ellen Hazelkorn

Articles

Ten years after the first global rankings appeared, it is clear that they have had an extraordinary impact on higher education. While there are fundamental questions about whether rankings measure either quality or what’s meaningful, they have succeeded in exposing higher education to international comparison. Moreso, because of the important role higher education plays as a driver of economic development, rankings have exposed both an information deficit and national competitiveness. Accordingly, both nations and institutions have sought to maximise their position vis-á-vis global rankings with positive and perverse effects. Their legacy is evident in the way rankings have become ...