Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

PDF

Assessment

Higher Education and Teaching

To Improve the Academy: A Journal of Educational Development

Articles 1 - 12 of 12

Full-Text Articles in Education

Development Of A Faculty Appreciation Of Pedagogy Scale, Carol A. Hurney, Jordan D. Troisi, Lori H. Leaman Oct 2020

Development Of A Faculty Appreciation Of Pedagogy Scale, Carol A. Hurney, Jordan D. Troisi, Lori H. Leaman

To Improve the Academy: A Journal of Educational Development

Evidencing the value of programs and services challenges educational developers to measure a range of outcomes. While direct measures of faculty use of effective teaching behaviors and student learning are desirable, these methods are time consuming and resource intensive. We provide a scale that is easy to deploy and can be adapted to different programs. Our psychometrically sound scale measures one facet of faculty learning about teaching—appreciation of pedagogy. The scale measures awareness, knowledge integration, emotions, beliefs, and self-reported behaviors related to the appreciation of pedagogy. We also examine scale correlates, including teaching identity, confidence, and control.


Students Helping Students Provide Valuable Feedback On Course Evaluations, Adriana Signorini, Mariana Abuan, Gautam Panakkal, Sandy Dorantes Oct 2020

Students Helping Students Provide Valuable Feedback On Course Evaluations, Adriana Signorini, Mariana Abuan, Gautam Panakkal, Sandy Dorantes

To Improve the Academy: A Journal of Educational Development

The purpose of the student evaluations of teaching (SET) are to help instructors enhance the teaching and learning experience in their courses; however, student feedback can often be more unconstructive than useful because students are usually requested to evaluate instruction with little or no formal training. As a result, SET become missed opportunities for students to effectively communicate their learning needs and for instructors to collect actionable information about how the course is perceived. This project aims to improve the quality of student responses to the open-ended questions that instructors receive by partnering with undergraduates in demonstrating to their peers …


Assessment Literacy In College Teaching: Empirical Evidence On The Role And Effectiveness Of A Faculty Training Course, Kyle D. Massey, Christopher Deluca, Danielle Lapointe-Mcewan Apr 2020

Assessment Literacy In College Teaching: Empirical Evidence On The Role And Effectiveness Of A Faculty Training Course, Kyle D. Massey, Christopher Deluca, Danielle Lapointe-Mcewan

To Improve the Academy: A Journal of Educational Development

This research explores how faculty members’ conceptions of assessment and confidence in assessment change as a result of an instructor training course. Based on a sample of 27 faculty members enrolled in a semester-long instructional development course, this survey-based study provides initial evidence that faculty members can develop confidence in assessment while adopting increasingly complex conceptions of assessment. Based on this study’s findings, we argue that instructional development programs for college faculty have a critical role to play in stimulating faculty learning about assessment of student learning and are an important component in promoting a positive assessment culture.


Cultivating And Sustaining A Faculty Culture Of Data-Driven Teaching And Learning: A Systems Approach, Marsha Lovett, Chad Hershock Apr 2020

Cultivating And Sustaining A Faculty Culture Of Data-Driven Teaching And Learning: A Systems Approach, Marsha Lovett, Chad Hershock

To Improve the Academy: A Journal of Educational Development

A prominent goal of colleges and universities today is to enact data-driven teaching and learning. Faculty clearly play a key role, and yet they tend to have limited time, a lack of training in assessment or education research, and few incentives for engaging in this work. We describe a framework designed to address the practical and cultural aspects of these challenges via a cycle of educational development and support: motivate, educate, facilitate, disseminate. We illustrate this systems approach with concrete examples and conclude with lessons learned from our experiences that should translate to a variety of institutional contexts.


Broaching Threshold Concepts: The Trouble With “Skills” Language In Defining Student Learning Goals, Angela J. Zito Jan 2019

Broaching Threshold Concepts: The Trouble With “Skills” Language In Defining Student Learning Goals, Angela J. Zito

To Improve the Academy: A Journal of Educational Development

This essay argues that description of student learning goals as various “skills” presents a conceptual threshold lying between and connecting routinely dichotomized characterizations of student learning—most notably, “concrete” versus “abstract.” Qualitative analysis of instructor interviews shows that “skills” language tends to conceal abstract (that is, affective) learning goals behind more concrete (that is, cognitive) ones. Ultimately, this essay proposes that cognitive and affective student learning goals might be more clearly articulated using threshold concepts within and across disciplines, and that the recognition of “skills” as both affective and cognitive is itself a threshold concept in educational development.


The Fearless Teaching Framework: A Model To Synthesize Foundational Education Research For University Instructors, Alice E. Donlan, Sandra M. Loughlin, Virginia L. Byrne Jan 2019

The Fearless Teaching Framework: A Model To Synthesize Foundational Education Research For University Instructors, Alice E. Donlan, Sandra M. Loughlin, Virginia L. Byrne

To Improve the Academy: A Journal of Educational Development

There is often a disconnect between the unit of analysis in rigorous education research, and the types of recommendations that instructors find the most useful to improve their teaching. Research often focuses on narrow slices of the student experience, and university instructors often require broad recommendations. We present the Fearless Teaching Framework to address this gap between research and practice. In this framework, we define four pieces of effective teaching: classroom climate, course content, teaching practices, and assessment strategies. We argue that these are appropriate areas of focus for instructor growth, based on their relations to student engagement.


Educational Development Efforts Aligned With The Assessment Cycle, Phyllis Blumberg Jan 2017

Educational Development Efforts Aligned With The Assessment Cycle, Phyllis Blumberg

To Improve the Academy: A Journal of Educational Development

Using an assessment cycle as an organizing framework, this article illustrates how educational development and assessment mutually complement each other. It describes an assessment study conducted to determine if two colleges at a small university met their strategic goals to increase the adoption of learning-centered teaching. This study served the parallel function of assessing the impact of sustained educational development efforts by the Centers for Teaching and Learning (CTL) to promote learning-centered teaching. The majority of interviewed faculty reported using learning-centered approaches. The data collection method itself also served as a teachable moment for faculty who do not attend CTL …


The Aspirational Curriculum Map: A Diagnostic Model For Action-Oriented Program Review, Eric Metzler, George Rehrey, Lisa Kurz, Joan Middendorf Jan 2017

The Aspirational Curriculum Map: A Diagnostic Model For Action-Oriented Program Review, Eric Metzler, George Rehrey, Lisa Kurz, Joan Middendorf

To Improve the Academy: A Journal of Educational Development

When the process of curriculum mapping begins with the faculty’s articulations of the knowledge, skills, and attitudes students should master upon graduation, a curriculum map results that enables faculty to review the curriculum for effectiveness, see the workings of the whole curriculum at a glance, plan assessments, and recognize where adjustments or changes need to be made. This article explains these benefits and lays out a step by step process for building such a curriculum map that can be adapted to any institutional context. We also describe a variety of outcomes from and reactions to our process.


Evaluating Centers For Teaching And Learning: A Field-Tested Model, Susan R. Hines Jan 2017

Evaluating Centers For Teaching And Learning: A Field-Tested Model, Susan R. Hines

To Improve the Academy: A Journal of Educational Development

This paper provides a program evaluation model, along with field-testing results, that was developed in response to the need for an evaluation model able to support systematic evaluation of teaching and learning centers (CTLs). The model builds upon the author’s previous studies investigating the evaluation practices and struggles experienced at 53 CTLs. Findings from these studies attribute evaluation struggles to contextual issues involving evaluation capacity, ill- structured curricula, and ill-conceived evaluation frameworks. This field-tested Four-Phase Program Evaluation Model addresses these issues by approaching evaluation in a comprehensive manner that includes an evaluation capacity analysis, curricular conceptualization, evaluation planning, and plan …


Assessment From An Educational Development Perspective, Mary C. Wright, Molly Goldwasser, Wayne Jacobson, Christopher Dakes Jan 2017

Assessment From An Educational Development Perspective, Mary C. Wright, Molly Goldwasser, Wayne Jacobson, Christopher Dakes

To Improve the Academy: A Journal of Educational Development

As assessment, already well established in higher education, gains attention in the field of educational development (ED), we ask: What does it mean to practice assessment from an ED perspective? In response, we examine four principles that are central to this endeavor: (a) bridging work across communities and multiple institutional levels; (b) collective, collaborative ownership; (c) action-oriented focus on student-centered learning; and (d) intentionality about inclusiveness to recognize diverse experiences of participants and stakeholders. We apply these principles to four examples of assessment practice at different institutions and offer a rationale for why this lens has utility for the improvement …


Don’T Box Me In: Rubrics For Ártists And Designers, Natasha Haugnes, Jennifer L. Russell Jan 2016

Don’T Box Me In: Rubrics For Ártists And Designers, Natasha Haugnes, Jennifer L. Russell

To Improve the Academy: A Journal of Educational Development

Two faculty developers at a professional art and design university were met with uneasy faculty attitudes toward grading when they opened their CTL 13 years ago. Conversations revealed that the faculty artists and designers suspected that grading would somehow shatter the fragile muse of creativity, which is so central to the processes of producing art and design. The developers’ quest for transparent, consistent grading, and assessment practices resulted in an approach to rubric creation that taps into artists’ reverence for the critique. This narrative account reveals how the approach allowed an interactive introduction of rubrics as teaching tools, ensured their …


Measuring The Promise: A Learning Focused Syllabus Rubric, Michael Palmer, Dorothe Bach, Adriana Streifer Jan 2014

Measuring The Promise: A Learning Focused Syllabus Rubric, Michael Palmer, Dorothe Bach, Adriana Streifer

To Improve the Academy: A Journal of Educational Development

To enrich the resources for measuring the impact of educational development work, we have created a rubric to assess the degree to which a syllabus achieves a learning orientation. The rubric provides qualitative descriptions of components that distinguish learning focused syllabi and uses a quantitative scoring system that places syllabi on a spectrum from content focused to learning focused. It is flexible enough to accommodate a diverse range of levels, disciplines, institutions, and learning environments, yet nuanced enough to provide summative information to developers using the tool for assessment purposes and formative feedback to instructors interested in gauging the focus …