Education Commons^™

Deep Change Theory: Implications For Educational Development Leaders, Caitlin Martin, Elizabeth Wardle

Publications

While chapters 1 and 2 explore the promise of theoretical frameworks for making conceptual change that leads to innovative action around teaching and learning in higher education, they also point out the challenges to this kind of work as teams of faculty strive to lead change in their programs and departments after completing the program. To summarize our claims thus far: one of the goals for the HCWE Faculty Writing Fellows Program is to empower faculty who participate to return to their departments to make programmatic changes—changes they identify as central to their work and values and program culture. The …

The Value Of The Useless: Erin Manning, Impact, Higher Education Research, Progress, Laura Elizabeth Smithers

Educational Foundations & Leadership Faculty Publications

This article brings the work of Erin Manning to bear on common sense practices and conversations of the value of a college education. Manning’s work provides a productive alternative to the neoliberal discourse of college impact that has dominated higher education research for the past half century. Neoliberalism produces the common sense of the value of education as privatized, datafied (or dividuated), and measurable outcomes. This common sense reduces American higher education to the sum of its parts. To produce worlds to which campus marketing departments on occasion gesture, worlds where college produces spaces of community transformation, we must come …

Development Of A Faculty Appreciation Of Pedagogy Scale, Carol A. Hurney, Jordan D. Troisi, Lori H. Leaman

To Improve the Academy: A Journal of Educational Development

Evidencing the value of programs and services challenges educational developers to measure a range of outcomes. While direct measures of faculty use of effective teaching behaviors and student learning are desirable, these methods are time consuming and resource intensive. We provide a scale that is easy to deploy and can be adapted to different programs. Our psychometrically sound scale measures one facet of faculty learning about teaching—appreciation of pedagogy. The scale measures awareness, knowledge integration, emotions, beliefs, and self-reported behaviors related to the appreciation of pedagogy. We also examine scale correlates, including teaching identity, confidence, and control.

Students Helping Students Provide Valuable Feedback On Course Evaluations, Adriana Signorini, Mariana Abuan, Gautam Panakkal, Sandy Dorantes

To Improve the Academy: A Journal of Educational Development

The purpose of the student evaluations of teaching (SET) are to help instructors enhance the teaching and learning experience in their courses; however, student feedback can often be more unconstructive than useful because students are usually requested to evaluate instruction with little or no formal training. As a result, SET become missed opportunities for students to effectively communicate their learning needs and for instructors to collect actionable information about how the course is perceived. This project aims to improve the quality of student responses to the open-ended questions that instructors receive by partnering with undergraduates in demonstrating to their peers …

Assessment Literacy In College Teaching: Empirical Evidence On The Role And Effectiveness Of A Faculty Training Course, Kyle D. Massey, Christopher Deluca, Danielle Lapointe-Mcewan

To Improve the Academy: A Journal of Educational Development

This research explores how faculty members’ conceptions of assessment and confidence in assessment change as a result of an instructor training course. Based on a sample of 27 faculty members enrolled in a semester-long instructional development course, this survey-based study provides initial evidence that faculty members can develop confidence in assessment while adopting increasingly complex conceptions of assessment. Based on this study’s findings, we argue that instructional development programs for college faculty have a critical role to play in stimulating faculty learning about assessment of student learning and are an important component in promoting a positive assessment culture.

Cultivating And Sustaining A Faculty Culture Of Data-Driven Teaching And Learning: A Systems Approach, Marsha Lovett, Chad Hershock

To Improve the Academy: A Journal of Educational Development

A prominent goal of colleges and universities today is to enact data-driven teaching and learning. Faculty clearly play a key role, and yet they tend to have limited time, a lack of training in assessment or education research, and few incentives for engaging in this work. We describe a framework designed to address the practical and cultural aspects of these challenges via a cycle of educational development and support: motivate, educate, facilitate, disseminate. We illustrate this systems approach with concrete examples and conclude with lessons learned from our experiences that should translate to a variety of institutional contexts.

Teac 413m: Teaching Multilingual Learners In Content Areas – A Peer Review Of Teaching Benchmark Portfolio, Lydiah Kananu Kiramba

UNL Faculty Course Portfolios

The purpose of this benchmark portfolio was to trace the process of designing, teaching and assessing TEAC 413M: Teaching Multilingual Learners in Content Areas, a required course for the B.Ed secondary education major. My objectives for this portfolio are to: a) document the impacts of different instructional strategies employed in TEAC 413M, and to b) reflect on the course success and shortcomings and develop pathways for the future course design and development. A secondary goal was to examine translation of course content into students’ own teaching and planning for their students through a variety of activities and assessments throughout the …

Broaching Threshold Concepts: The Trouble With “Skills” Language In Defining Student Learning Goals, Angela J. Zito

To Improve the Academy: A Journal of Educational Development

This essay argues that description of student learning goals as various “skills” presents a conceptual threshold lying between and connecting routinely dichotomized characterizations of student learning—most notably, “concrete” versus “abstract.” Qualitative analysis of instructor interviews shows that “skills” language tends to conceal abstract (that is, affective) learning goals behind more concrete (that is, cognitive) ones. Ultimately, this essay proposes that cognitive and affective student learning goals might be more clearly articulated using threshold concepts within and across disciplines, and that the recognition of “skills” as both affective and cognitive is itself a threshold concept in educational development.

The Fearless Teaching Framework: A Model To Synthesize Foundational Education Research For University Instructors, Alice E. Donlan, Sandra M. Loughlin, Virginia L. Byrne

To Improve the Academy: A Journal of Educational Development

There is often a disconnect between the unit of analysis in rigorous education research, and the types of recommendations that instructors find the most useful to improve their teaching. Research often focuses on narrow slices of the student experience, and university instructors often require broad recommendations. We present the Fearless Teaching Framework to address this gap between research and practice. In this framework, we define four pieces of effective teaching: classroom climate, course content, teaching practices, and assessment strategies. We argue that these are appropriate areas of focus for instructor growth, based on their relations to student engagement.

Short Case Study: The First Year Experience: Students’ Perceptions On Assessment, Fiona Mcsweeney, Roisin Donnelly

Other resources

This case study reports on the results of a pilot study with first year students in the Department of Social Sciences in a Higher Education Institution (HEI) in Ireland. It discussed the findings in relation to student perceptions on the assessment process for first years.

Vmed 646: Animal Physiology Ii—A Peer Review Of Teaching Project Benchmark Portfolio, Renee M. Mcfee

UNL Faculty Course Portfolios

This Peer Review of Teaching Project portfolio focuses on the Animal Physiology II course which is required for first year veterinary medicine students. Weekly quizzes assess baseline knowledge and had been administered individually and in groups. I hypothesized the discontinuation of group quizzes would increase student effort when preparing for quizzes. Unit exams involve scenario-based questions and require students to apply information. I hypothesized the implementation of group exams would help under-performing students improve their ability to apply information they had learned. Exams were still taken individually prior to being taken in groups to encourage adequate preparation. Student impacts were …

Educational Development Efforts Aligned With The Assessment Cycle, Phyllis Blumberg

To Improve the Academy: A Journal of Educational Development

Using an assessment cycle as an organizing framework, this article illustrates how educational development and assessment mutually complement each other. It describes an assessment study conducted to determine if two colleges at a small university met their strategic goals to increase the adoption of learning-centered teaching. This study served the parallel function of assessing the impact of sustained educational development efforts by the Centers for Teaching and Learning (CTL) to promote learning-centered teaching. The majority of interviewed faculty reported using learning-centered approaches. The data collection method itself also served as a teachable moment for faculty who do not attend CTL …

The Aspirational Curriculum Map: A Diagnostic Model For Action-Oriented Program Review, Eric Metzler, George Rehrey, Lisa Kurz, Joan Middendorf

To Improve the Academy: A Journal of Educational Development

When the process of curriculum mapping begins with the faculty’s articulations of the knowledge, skills, and attitudes students should master upon graduation, a curriculum map results that enables faculty to review the curriculum for effectiveness, see the workings of the whole curriculum at a glance, plan assessments, and recognize where adjustments or changes need to be made. This article explains these benefits and lays out a step by step process for building such a curriculum map that can be adapted to any institutional context. We also describe a variety of outcomes from and reactions to our process.

Evaluating Centers For Teaching And Learning: A Field-Tested Model, Susan R. Hines

To Improve the Academy: A Journal of Educational Development

This paper provides a program evaluation model, along with field-testing results, that was developed in response to the need for an evaluation model able to support systematic evaluation of teaching and learning centers (CTLs). The model builds upon the author’s previous studies investigating the evaluation practices and struggles experienced at 53 CTLs. Findings from these studies attribute evaluation struggles to contextual issues involving evaluation capacity, ill- structured curricula, and ill-conceived evaluation frameworks. This field-tested Four-Phase Program Evaluation Model addresses these issues by approaching evaluation in a comprehensive manner that includes an evaluation capacity analysis, curricular conceptualization, evaluation planning, and plan …

Assessment From An Educational Development Perspective, Mary C. Wright, Molly Goldwasser, Wayne Jacobson, Christopher Dakes

To Improve the Academy: A Journal of Educational Development

As assessment, already well established in higher education, gains attention in the field of educational development (ED), we ask: What does it mean to practice assessment from an ED perspective? In response, we examine four principles that are central to this endeavor: (a) bridging work across communities and multiple institutional levels; (b) collective, collaborative ownership; (c) action-oriented focus on student-centered learning; and (d) intentionality about inclusiveness to recognize diverse experiences of participants and stakeholders. We apply these principles to four examples of assessment practice at different institutions and offer a rationale for why this lens has utility for the improvement …

Multiple Problem-Solving Strategies Provide Insight Into Students’ Understanding Of Open-Ended Linear Programming Problems, Marla A. Sole

Publications and Research

Open-ended questions that can be solved using different strategies help students learn and integrate content, and provide teachers with greater insights into students’ unique capabilities and levels of understanding. This article provides a problem that was modified to allow for multiple approaches. Students tended to employ high-powered, complex, familiar solution strategies rather than simpler, more intuitive strategies, which suggests that students might need more experience working with informal solution methods. During the semester, by incorporating open-ended questions, I gained valuable feedback, was able to better model real-world problems, challenge students with different abilities, and strengthen students’ problem solving skills.

Are We Teaching Them Anything?: A Model For Measuring Methodology Skills In The Political Science Major, Christi Siver, Seth W. Greenfest, G. Claire Haeg

Political Science Faculty Publications

While the literature emphasizes the importance of teaching political science students methods skills, there currently exists little guidance for how to assess student learning over the course of their time in the major. To address this gap, we develop a model set of assessment tools that may be adopted and adapted by political science departments to evaluate the effect of their own methods instruction. The model includes a syllabi analysis, evaluation of capstone (senior) papers, and a transcript analysis. We apply these assessment tools to our own department to examine whether students demonstrate a range of basic-to-advanced methodological skills. Our …

An Exploration Of Fairness In The Assessment And Process Of Student Group Work, Rita Gibson, Emma Geoghegan, Oscar Macananey, Andrew Hines, Lorraine D'Arcy

Practitioner Research Projects

This project was driven by a motivation to be as fair as possible in the assessment of students' group work. Achieving fairness in assessment is a recurrent them in group project assessment literature (Nordberg, 2009). All authors of this report teach modules with group projects, and acknowledged that discrepancies often exist between a mark assigned to a group and an individual's contribution. Our aims were to (a) collectively enhance our understanding of the issues that need to be considered when assessing a group work project and (b) collectively build our confidence in approaches chosen to overcome these challenges. The findings …

Methods For Deriving Individual Marks From Group Work, Miriam Delaney, Lucy Bowe, Breiffni Fitzgerald, Peter Maccann, Christina Ryan

Practitioner Research Projects

Group assessment is a valuable teaching and learning method (Springer et al., 1999). This has been comprehensively demonstrated in the teaching and learning literature both in general (Johnson et al., 1991) and in specific contexts. This assessment practice promotes questioning, discussion and debate and encourages students to become active team players (DIT, 2013). However, when using this form of assessment, it is important to recognise that it is "individuals who graduate and gain qualifications" (Gibbs, 2009, p.4). The problem of freeloading has been identified and one of the suggested methods of reducing this is to incorporate individual assessment into the …

Facilitating Group Work: A Guide To Good Practice, Ronan Mccrea, Irene Neville, David Rickard, Ciara Walsh, David Williams

Practitioner Research Projects

Oakley et al. (2004) and Gibbs (2009) observe that owing to the extensive literature on group work, lecturers searching for a succinct guide on how to facilitate this activity effectively would find it challenging to digest such a large corpus. We extensively reviewed the literature in order to produce a quick and accessible guide for lecturers to use. It is our aspiration that this could be referred to when planning and facilitating group work projects with insights and recommendations informed by our research. Moreover, as this work draws on publications from educators in a wide range of disciplines, we expect …

Don’T Box Me In: Rubrics For Ártists And Designers, Natasha Haugnes, Jennifer L. Russell

To Improve the Academy: A Journal of Educational Development

Two faculty developers at a professional art and design university were met with uneasy faculty attitudes toward grading when they opened their CTL 13 years ago. Conversations revealed that the faculty artists and designers suspected that grading would somehow shatter the fragile muse of creativity, which is so central to the processes of producing art and design. The developers’ quest for transparent, consistent grading, and assessment practices resulted in an approach to rubric creation that taps into artists’ reverence for the critique. This narrative account reveals how the approach allowed an interactive introduction of rubrics as teaching tools, ensured their …

Authentic Assessment, Sinead Freeman, James Fox, Vanessa Murphy, Nicola Hughes

Practitioner Research Projects

No abstract provided.

Msym 109: Physical Principles In Agriculture And Life Sciences—A Peer Review Of Teaching Project Benchmark Portfolio, David Mabie

UNL Faculty Course Portfolios

This benchmark course portfolio was developed for MSYM 109 - Physical Principles in Agriculture and Life Sciences. The class is a general service course taken by majors as a prerequisite for future coursework along with several other CASNR majors to fulfill their physics course requirement. MSYM 109 is a high enrollment course, with 115 students in lecture, along with four separate 30 person recitation sections. This portfolio was developed to assess the following objectives: 1. Identify, evaluate, and justify the course objectives 2. Assess and evaluate the course pedagogy and assessment methodology 3. Analyze the historical students assessment results against …

Teac 452v/852v: Curriculum Principles And Practices—A Peer Review Of Teaching Project Benchmark Portfolio, Elizabeth B. Lewis

UNL Faculty Course Portfolios

Objective: My goal for this teacher action research project was to better understand how to improve students' learning of how to teach science through active and inquiry-based learning experiences.

Abstract: I framed the course under study around an essential question which was: How does a scientific classroom discourse community support student learning? Inquiry-based instruction is a cornerstone of science teaching, thus I investigated preservice science teachers' learning about how to teach science through inquiry-based instruction. By the end of the course all of the students had improved their understanding of inquiry-based instruction and were able to generate better science lessons …

Measuring The Promise: A Learning Focused Syllabus Rubric, Michael Palmer, Dorothe Bach, Adriana Streifer

To Improve the Academy: A Journal of Educational Development

To enrich the resources for measuring the impact of educational development work, we have created a rubric to assess the degree to which a syllabus achieves a learning orientation. The rubric provides qualitative descriptions of components that distinguish learning focused syllabi and uses a quantitative scoring system that places syllabi on a spectrum from content focused to learning focused. It is flexible enough to accommodate a diverse range of levels, disciplines, institutions, and learning environments, yet nuanced enough to provide summative information to developers using the tool for assessment purposes and formative feedback to instructors interested in gauging the focus …

Muop 356/856: Intermediate/Advanced Opera Techniques—A Peer Review Of Teaching Project Benchmark Portfolio, Jamie M. Reimer

UNL Faculty Course Portfolios

I began the investigation of this course and subsequent course portfolio with the following objectives in mind:

1. To solidify and articulate the skills I intend students enrolled in this course to achieve by the end of the semester;
2. To think creatively about the presentation of course material to most effectively engage and empower students' success; and
3. To assess the effectiveness of the course activities in achieving course goals stated in the syllabus.

I am also excited to explore the options available for different methods of content delivery in this course, particularly the application of recorded performance for assessment. In the …

Metr 200: Weather And Climate—A Peer Review Of Teaching Project Benchmark Portfolio, Matthew S. Van Den Broeke

UNL Faculty Course Portfolios

This benchmark portfolio is meant to be an assessment of how well the objectives of METR 200 (Weather and Climate) are being attained by students in several classifications of academic major. Students from a wide range of backgrounds enroll in this course as a general science elective, and for many, it will be the only science course taken in college. Thus, it is important that course material be sufficiently accessible for all students, while providing meaningful information which will be applicable by students of all backgrounds once they leave the course. In this portfolio, an analysis will be presented showing …

Chem 109: General Chemistry I—A Peer Review Of Teaching Project Benchmark Portfolio, Eric D. Dodds

UNL Faculty Course Portfolios

This portfolio has been developed for CHEM 109: General Chemistry I. The course is the first of a freshman level two semester sequence in General Chemistry taken by students with majors in a wide variety of technical and scientific disciplines. CHEM 109 is a high enrollment class, with class sizes for individual sections nearing 200 students. The development of this portfolio was conducted with the following objectives: 1. Clearly identify, justify, and codify the major learning objectives for this course, 2. Describe and rationalize the course structure and learning assessment methods, 3. Analyze and reflect on student achievement in the …

Law 799: Clinical Practice-Criminal—A Peer Review Of Teaching Project Benchmark Portfolio, Steven Schmidt

UNL Faculty Course Portfolios

This portfolio provides a broad overview of my teaching of Law 799. It not only gives the reader an understanding of the goals I have for the course, but also how I endeavor to reach those goals. Finally, through the use of student assessment, this portfolio provides insight as to whether my goals were reached and to what degree. Thus, the portfolio serves to inform me of areas needing improvement.

Chme 223: Chemical Engineering Thermodynamics I—A Peer Review Of Teaching Project Benchmark Portfolio, Hossein Noureddini

UNL Faculty Course Portfolios

This portfolio was intended to provide a broad overview of the course. Initially, when I decided to write this portfolio my intention was for it to help me in the student's outcome assessment of teaching for the course and in a broader scope, for my department's effort in establishing a systematic student outcome assessment process. However, as I became more familiar with the program I realized other aspects of the course could also benefit from this portfolio. My goal for this portfolio is to be broad with emphasis on course objectives, delivery methods and their assessment. I like for this …