Education Commons^™

University Evaluation Toolkit: Navigating Evaluative Practices Across All Levels With Rufdatae, Elizabeth J. Cook, Kena Cabral Morales

Research outputs 2022 to 2026

University stakeholders have mixed feelings about evaluation, and mixed understandings, skills and knowledge about how to effectively evaluate. How much do you know about evaluation? Could you plan an evaluation if asked? This poster provides a toolkit of strategies for enhancing evaluation in universities, based on Cook’s (2021) “Evaluation of work-integrated learning: A realist synthesis and toolkit to enhance university evaluative practices”. RUFDATAE is a modified version of Saunders’ (2000) approach.

The poster: defines evaluation; clarifies the difference between evaluation and research; summarises the four domains of evaluation in higher education; and outlines RUFDATAE, an evaluation planning framework, for prompting …

Faculty Handbook, Georgia Southern University

Faculty Handbooks

Faculty Handbook for Georgia Southern University for the 2022-2023 academic year. The Faculty Handbook is published online by the Office of the Vice President for Academic Affairs and archived in Digital Commons@Georgia Southern.

Hci Education And Ux Practice: Highlights From Singapore, Tamas Makany, Dharani Perera-Schulz

Research Collection Lee Kong Chian School Of Business

This position paper highlights trends in education, practice, and support of HCI/UX in Singapore, a small city-state island in Southeast Asia. The paper was prepared for the 2022 Southeast Asia Computer-Human Interaction (SEACHI'22) virtual workshop on Apr 14, 2022, as part of the ACM CHI Conference on Human Factors in Computing Systems (CHI'22) international conference.

Online Prehealth Advising: Impact Analysis Spring 2017 To Fall 2020, Alasdair Ekpenyong, Mykel Beorchia

Publications

At Utah State University, various online, Canvas-based advising programs complement the traditional in-person advising program. The online prehealth advising service assists students who are considering health professions graduate school.

This report explored the association between online prehealth advising participation and student persistence to the next term at Utah State University.

Opening Act: The Academic Library's Role In Orientation Planning And Evaluation, Zachary Lewis, Katy Kelly

Roesch Library Faculty Publications

This article describes a private, mid-sized university library’s experience of hosting a music festival-themed event in the library building as part of new student orientation, with program evaluation and student learning assessment at the forefront of planning. The authors and co-planners will discuss four years of data to explore the connection between library outreach and students’ use of the library, their perceptions of the institution, and the role the event plays in shaping student success. It offers recommendations for collaborating with academic libraries and approaches in future cross-campus collaborations, including using a scaffolding approach to outline the goals and assessment …

Evaluation Of Work-Integrated Learning: A Realist Synthesis And Toolkit To Enhance University Evaluative Practices, Elizabeth J. Cook

Research outputs 2014 to 2021

Situated in the context of work-integrated learning (WIL), this paper aims to build the evaluative capacity of universities in response to an increasing need for evaluation in higher education. It contributes a realist synthesis of international peer-reviewed literature on university evaluation of WIL, which revealed no use of evaluation theory or approaches by the authors. In response, to support the enhancement of university evaluative practices, this paper offers a toolkit of evaluation theory and approaches, with examples relating to WIL, featuring an evaluation planning tool (RUFDATAE). RUFDATAE is demonstrated using a study from the realist synthesis, to highlight its relevance, …

The Future Of International Education: Why Agility Is Now Integral To Strategic Planning, Aaron Clevenger, Elaine Meyer-Lee

Publications

Based on my experience, agility is truly based on the principles of resiliency. Resiliency is an approach to sustainability that focuses on building capacity to deal with disasters, unexpected changes and/or shifts to our daily routines.

● Kampala, Uganda example shows mild disruption, poor maintenance, and insufficient infrastructure creates a lack of resiliency.

At Embry-Riddle, hurricanes are the norm.

Library Services: Impact Analysis Spring 2018 To Fall 2018, Amanda M. Hagman, Lindsay Ozburn, Hayden Hoopes, Erik Dickamore, Bradford R. Cole, Mitchell Colver

Publications

Libraries are an essential element of learning on university campuses. The content housed within libraries supports academic exploration and growth. Physically, libraries are designed to provide access to materials and spaces that facilitate learning. This report explored the impact of student library resource use on student persistence to the next term.

Students' library resource use was captured with EZ Proxy log-ins and library material check-outs. Students who had a record of using library resources were compared to similar students who did not have a record of library resource use. They were compared using prediction-based propensity score matching. Students who used …

Aggie First Scholars: A Quality Workforce Initiative For Promoting First-Generation Student Success, Amanda M. Hagman, John Louviere, Heidi Kesler, Mykel Beorchia, Lisa Simmons, Mitchell Colver

Publications

Introduction: First-generation students lag behind continuing-generation peers in terms of graduation rates and average time to graduation. This phenomenon has been extensively studied in higher education with the intent of closing the gap seen between generational statuses. Utah State University provides services to support first-generation students. In the 2018/2019 academic year, USU initiative a full-kit initiative to help first-generation student participate in several proven first-year student milestones. This report explores the impact of full-kit use of services and the individual impact of each service on first-generation student persistence. METHODS: Students who self-identified as first-generation on their USU application were invited …

Aggie Recreation Center Impact Report Fall 2015 To Spring 2019, Amanda M. Hagman, Erik Dickamore, Daniel Lawrence, Mitchell Colver

Publications

Recreation facilities are an integral part of the university community. The Aggie Recreation Center is a place that helps foster a well balanced student. The ARC provides students with a myriad of opportunities for recreation, exercise, and community that can support students on their academic journey. This report explored the association between ARC facility use and student persistence to the next term at Utah State University. METHODS: Students recreation center use was captured with entry log-ins as students entered the facility. Students who had a record of using the facility were compared to similar students who did not have a …

Student Nutrition Access Center: Impact Analysis 2019, Amanda M. Hagman, Hayden Hoopes, Nelda Ault-Dyslin

Publications

Introduction: Access to nutritional food items is crucial to student well-being, which in turn is crucial to student success. Student success emerges from “the amount of physical and psychological energy that the student devotes to the academic experience” (Astin, 1984). Campus nutrition programs help students eliminate food security issues so that they can devote more energy to the academic experience. However, creating efficient and convenient nutrition programs requires that administrators understand the complexities of their implementation, their effect on specific student segments, and their effect on decisions to either persist at or leave an institution. This report explores the impact …

Exploratory Advising Impact Report: Spring 2016 To Spring 2019, Amanda M. Hagman, Mykel Beorchia, Stephanie Hamblin, Mitchell Colver

Publications

Academic advising performs a pivotal contribution to student success by providing information about univeristy expectations and avenues towards graduation. Exploratory student advising has the additional task of supporting students in major selection. This analysis investigated the relationship between academic advising and student persistence for exploratory students to better understand the impact of current advising practices. METHODS: Exploratory academic advisors met with an average 53% of exporatory students each semester. Students with a record of meeting with an academic advisor were compared to similar exploratory students who did not. Students were compared using prediction-based propensity score matching. Students who met with …

University Academic Advising: Impact Analysis, Amanda M. Hagman, Mykel Beorchia, Erik Dickamore

Publications

abstract: Academic advising performs a pivotal contribution to student success by providing information about university expectations and avenues towards graduation. The impact of academic advising is routinely assessed to explore its influence on student persistence. This report explores the impact of academic advising between 2016 to 2019 on student persistence to the next term. METHODS: Academic advising met with nearly 40% of students at USU each semester. Students who had a record of meeting with an academic advisor were compared to similar students who did not. Students were compared using prediction-based propensity score matching. Students who met with an advisor …

Evaluation Of Student Perceptions Of Introductory Pharmacy Practice Experiences, Jaclyn Boyle, Zach Jenkins, Thad Franz, Charles Cather, Nicole K. Stute, Nicole G. Harper, Alison Dittmer, Christy Hartline

Pharmacy Practice Faculty Publications

No abstract provided.

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Higher education research

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey Review by …

Developing Meaningful Higher Education Evaluation Systems: Putting China In Context, Ellen Hazelkorn, Lu Liu

Articles

This paper firstly reviews how issues of accountability and transparency have become some of the key drivers of government policy over recent years. It finds that the drive for greater higher education accountability and transparency has encouraged the growth of an international evaluation industry. It secondly discusses issues related to different types of policy and evaluation instruments across Europe, as well as the importance of rankings. It finds that traditional approaches have relied on collegiality, expert judgment, and peer review, and there is a growing focus on indicator-led systems in the belief that indicators are value-free and statistically robust so …

What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney

Publications and Research

This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course material. The purpose of the study was to learn how OER impacted students. Data were collected in Fall 2015 with students from New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded OER pilot initiative. Two research instruments …

Web Of Science V. Scopus: Presentation For The Uri Deans' Council, Peter Larsen, Andrée Rathemacher

Technical Services Faculty Presentations

Slides from a presentation to the University of Rhode Island Deans' Council comparing the databases Web of Science and Scopus, in the context of the University Libraries' plans to cancel Web of Science and become a Scopus-only campus. The presentation took place in Green Hall at the University of Rhode Island on April 19, 2017.

A handout given to attendees is included as a supplementary file.

Assessing The Long-Term Impact Of The Preparing Future Faculty Seminar, Laura N. Schram, Tershia Pinder-Grover, Stefan Turcic Ii

To Improve the Academy: A Journal of Educational Development

The Preparing Future Faculty (PFF) initiative for graduate students was launched in the United States in 1993 as a partnership between the Council of Graduate Schools and the Association of American Colleges and Universities to prepare graduate students for faculty careers at different institutional types and to provide them with teaching-related professional development. PFF programs have proliferated U.S. universities over the last two decades, but there has been limited research on the long-term impact of these programs. This study at the University of Michigan examines the career paths and attitudes of graduate students who participated in an annual, intensive, five-week …

Evaluating Centers For Teaching And Learning: A Field-Tested Model, Susan R. Hines

To Improve the Academy: A Journal of Educational Development

This paper provides a program evaluation model, along with field-testing results, that was developed in response to the need for an evaluation model able to support systematic evaluation of teaching and learning centers (CTLs). The model builds upon the author’s previous studies investigating the evaluation practices and struggles experienced at 53 CTLs. Findings from these studies attribute evaluation struggles to contextual issues involving evaluation capacity, ill- structured curricula, and ill-conceived evaluation frameworks. This field-tested Four-Phase Program Evaluation Model addresses these issues by approaching evaluation in a comprehensive manner that includes an evaluation capacity analysis, curricular conceptualization, evaluation planning, and plan …

Designing An Evaluation Of Instructional Consultation In A Higher Education Context, Karen Elizabeth Brinkley Etzkorn, David Schumann, Beth White, Tiffany Smith

To Improve the Academy: A Journal of Educational Development

Individual instructor consultation is a common service provided by centers focused on educational development in higher education. The importance of this service has been reflected in its history, increasing demand, and strong anecdotal evidence to its effectiveness. However, the extant literature reveals that comprehensive assessment of consultation effectiveness has proved challenging. Thus, the purpose of this paper is to (a) provide an overview of consultation and summarize the relevant work evaluating this service, and (b) propose a comprehensive process for evaluating consultation services that was piloted at one large research intense university. The goal is to provide a systematic method …

Apps In Higher Education: Criteria And Evaluation, Rebecca Arzola, Stefanie Havelka

Publications and Research

In this article, the authors will consider different evaluation methods for mobile applications. A closer look is taken at app criteria and benchmarks by librarians, by topic, accessibility, and rubrics.

Week One Evaluation, Judith Longfield

Teaching Academy

Help me make the Academy a good learning experience for you by rating today’s session. Please write a BRIEF response to the following statements.

Evaluation Of Weeks 1-3, Judith Longfield

Teaching Academy

Rate the first three weeks of the Academy by writing a BRIEF response to the following statements.

Development And Evaluation Of A Model For Secondary Evolution Educators’ Professional Development Needs, William L. Romine, Ellen Barnett, Patricia J. Friedrichsen, Aaron J. Sickel

Biological Sciences Faculty Publications

Background

Professional development (PD) efforts have improved acceptance and pedagogical practice related to the theory of evolution in high school biology teachers. However, these teachers express need for more PD related to evolution. It therefore becomes necessary to understand teachers’ PD needs prior to structuring PD efforts.

Methods

We formulated and validated a model to explain secondary teachers’ PD needs using data from a survey of 276 secondary biology teachers who reported teaching evolution.

Results

In addition to reliable subscales, we found that obstacles to teaching evolution, school and community support for evolution instruction, confidence in evolution instruction, and prior …

Impact Of A Diversity Conference On University Curriculum, Recruitment, And Accreditation Efforts, Christine M. Wilson, Autumn M. Palmer, Judith Puncochar

Conference Presentations

Diversity of students, faculty, administrative staff, community, and curriculum is an asset thought to strengthen and enrich students’ academic experiences. Responding to a charge from a Northern Michigan University president to place diversity at the center of a University Strategic Plan, members of a diversity advisory council proposed a plan to prepare the university and its students for a future in an increasingly diverse and globalized society. Integral to this plan was a diversity conference, UNITED (Uniting Neighbors in the Experience of Diversity), which went from an annual September event to an integral part of the university's academic fabric. Our …

Successive Study Of Diversity Conference Evaluations Of Presenters By Race, Gender, Sexual Orientation, And Disability, Autumn M. Palmer, Christine M. Wilson, Judith Puncochar

Conference Presentations

A Midwestern university’s annual diversity conference hosts about 1,500 attendees from a campus of 9,000 students. Using a successive independent samples design, a series of cross-sectional surveys were conducted to answer the research question, how does a presenter’s race, gender, and ability/disability affect participant responses on conference evaluations. A review of the literature has determined that our research represents the largest and longest empirical study of a higher education diversity conference in the United States. The research is a comparative study of evaluation trends of conference attendees toward diversity conference presenters based on race, gender, and disability over eight years …

Self-Assessment Of Employability Skill Outcomes Among Undergraduates And Alignment With Academic Ratings, Denise Jackson

Research outputs 2014 to 2021

Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in overrating and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in more than 1000 Australian business undergraduates. It evaluates the extent to which student self-assessments differ from academics, in what ways and the influence of certain individual and background characteristics - such as stage of degree, gender and academic ability - on rating accuracy. Explanations for documented disparities are presented, in addition to implications and strategies …