Curriculum and Instruction Commons^™

Instructional Decision Making In A Gateway Quantitative Reasoning Course, Deependra Budhathoki, Gregory D. Foley, Stephen Shadik

Numeracy

Many educators and professional organizations recommend Quantitative Reasoning as the best entry-level postsecondary mathematics course for non-STEM majors. However, novice and veteran instructors who have no prior experience in teaching a QR course often express their ignorance of the content to choose for this course, the instruction to offer students, and the assessments to measure student learning. We conducted a case study to investigate the initial implementation of an entry-level university quantitative reasoning course during fall semester, 2018. The participants were the course instructor and students. We examined the instructor’s motives and actions and the students’ responses to the course. …

Student Proficiency On High School Math Assessments And Their Relation To College And University Math Readiness, Tiffany Robinson

Dissertations

Data indicate that a significant number of first-year college students were inadequately prepared in high school to complete university-level mathematics courses. The purpose of this study is to evaluate student proficiency on high school mathematics assessments and their relation to student preparedness for university-level mathematics courses. The context of my study is a cohort of diverse, high school senior students in one state in the United States who have shown proficiency on mathematics assessments. The methodology I used was a mixture of qualitative and quantitative data, comprised of student and faculty index surveys at the high school and university level …

Reevaluating Student Engagement: Exploring And Applying Alternative Assignments In Higher Education Undergraduate Applied Saxophone, Anthony S. Cincotta Ii

Dissertations, 2020-current

Undergraduate applied saxophone study revolves around the conservatory model. This inflexible model, often referred to as a master-apprentice relationship, can create an instructor-centric power dynamic which does not address the needs of the modern student. A classroom where the power lies so heavily with the instructor can stifle student engagement and can create a sense of disenfranchisement. In this setting, students have limited input on their assignment selections. While curricula have evolved with regards to being more culturally diverse, relevant, and inclusive, the approach that educators use to deliver the material has remained largely unchanged. There is limited research on …

Securing The Right Skills: A Longitudinal Assessment Of College Students’ Writing And Public Speaking Self-Efficacy, T. Kody Frey, Jessalyn I. Vallade

Basic Communication Course Annual

This research investigated the developmental patterns of students’ writing and public-speaking self-efficacy throughout their experience in the basic communication course (BCC). Questions were posed regarding (a) whether students grew in their reported writing and public speaking self-efficacy over two semesters, (b) whether growth differed based on biological sex, and (c) whether affinity and apprehension (as sources of performance self-efficacy) played a role in student growth. Two multilevel models revealed significant differences in students’ initial status and rate of growth for each outcome. Specifically, sex, affinity, and apprehension influenced students’ starting positions in the course, while only apprehension had a significant …

A 5-Week Personalized Training Workshop To Assess And Evaluate Faculty Members Teaching Online, Felix O. Quayson, Christopher Zirkle

Journal of Research Initiatives

The authors developed the Skills of Inquiry (SoI) model accompanied by a logic model to assess and evaluate faculty members teaching online. The Skills of Inquiry is based on faculty members’ abilities to understand the online environments, skills development pertaining to online teaching, and acquisition of specific online skills. The Skills of Inquiry model was used to personalize a 5-week workshop training and development module specifically for faculty members teaching online. The training workshop is effective in training faculty members to acquire specific online teaching skills through customized and individualized professional development learning. The training is a self-paced asynchronous online …

Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner

Numeracy

Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students’ reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 …

Evaluating The Assessment Of Resident Assistant Training, Diego Ulloa

Masters Theses

This poster provides the findings from a qualitative study of four housing professionals responsible for Resident Assistant (RA) training at four institutions in the Great Lake Association of College and University Housing Officers (GLACUHO) professional association that includes the states of Illinois, Indiana, Michigan, and Ohio. This study looked at how those four institutions assessed, evaluated, and improved the centralized training provided to RAs by the department. Key findings include the importance of the use of learning outcomes for training sessions, developing, and maintaining strong relationships with key campus partners, and the issues around prioritizing session topics and departmental needs …

Instructional Resources To Assess Applied Projects As A Culminating Graduate Communication Student Experience, Michael G. Strawser, Bridget Rubenking, Kelsey Lunsford, Margaret Gravelyn

Journal of Communication Pedagogy

This study reviews the traditional culminating graduate student experiences, theses, and comprehensive exams, as well as a newer, more professionally relevant option, applied research projects. We conceptualize applied projects as student-led, client-connected, hands-on, experiential projects that address a real-world communication problem or topic through the creation of relevant deliverables. We used Glassick et al.’s (1997) scholarship assessed model and the National Communication Association’s communication learning outcomes to determine perceived differences between culminating experiences. Survey results (N = 32) of recent alumni and current master’s level Communication students demonstrate near-equal ratings of applied projects and theses in their ability to both …

Developing Rubrics Using The New Oru Outcomes, Kim Boyd, Trevor Ellis, Leighanne Locke, Terry Shannon, Rachael Valentz

Professional Development Resources

The development and examples of key program assessments (KPAs) are shared. Dr. Boyd opens the presentation. Dr. Shannon (B.S. Sports Management) begins by providing an overview of aligning program and ORU outcomes. Prof. Locke (B.S. Mathematics) walks through how current assignments were chosen to be used as key program assessments and then how the rubrics were revised to improve alignment. Dr. Valentz (B.S. Nursing) discusses how to improve the foundational alignment between program outcomes and the criterion (rubric row headings) used to measure them. She shares how criterion can be contextualized in different assignments and demonstrates in Brightspace, by D2L, …

Book Review: Going Gradeless, Grades 6–12: Shifting The Focus To Student Learning, Ana De Jesús, Alesia Mickle Moldavan

Excelsior: Leadership in Teaching and Learning

This book review of Going Gradeless, Grades 6–12: Shifting the Focus to Student Learning by E. Burns and D. Frangiosa (2021) provides an alternative pedagogical method to assessment that uses a “gradeless” approach to learning for purposes of removing the stress and negative impacts of traditional grading practices while maintaining accountability with equity in mind. In this review, we describe the foundational underpinnings that frame the book and summarize some of the observed benefits as well as challenges faced by the authors who implemented this approach. We provide an overview of the chapters situated in four major takeaways guiding this …

Lessons Learned: Curriculum Map As An Assessment Tool, Paul Antonellis

Academic Chairpersons Conference Proceedings

During this session, participants will learn about the steps taken to use curriculum mapping as an assessment tool, what worked well, challenges encountered, and recommendations going forward at the graduate and undergraduate level. The program will demonstrate how the program curriculum map can be linked to the general educational outcomes and aligned with intuition outcomes (Banta, 2014; Hundley & Kahn, 2019). Curriculum mapping will reveal program strengths and weaknesses before beginning the assessment process, avoiding costly mistakes in the assessment process. The mapping process will assist in determining which outcomes are assessed, when the outcome is assessed, and in which …

My First Time Ungrading: Approach Used And Reflections, Heather Leslie

Feminist Pedagogy

A few months ago, I began devouring information about ungrading with a fervent appetite. I started with the book Ungrading: Why Rating Students Undermines Learning (and What To Do Instead) edited by Susan Blum and listened to just about every podcast where she was interviewed about this topic. I then read other books she recommended like Wad-Ja-Get: The Grading Game in American Education by Howard Kirschenbaum and Punished By Rewards: The Trouble with Gold Stars, Incentive Plans, A’s, and Praise by Alfie Kohn. Recently, I have become much more dialed into the ungrading movement by reading articles from Teachers Going …

Assessing Teacher Candidates’ Pedagogical Judgement: An Analysis Of Clinically-Based Instructional Assignments, Sonia Janis, Mardi Schmeichel, Joseph Mcanulty, Chantelle Grace, Kaitlin Wegrzyn

Journal of Educational Supervision

Research on clinically-based teacher education indicates that facilitating clinical experiences for teacher candidates improves their preparation for the profession. While we have answered the call to implement rich clinical experiences in our teacher education program, we have found that we also needed to design new, robust strategies to assess what the candidates are taking away from their clinical experiences. This paper describes our use of Horn and Campbell’s (2015) notion of “pedagogical judgment” to analyze the work of social studies teacher candidates in clinical placements. We describe a rubric developed to evaluate candidates’ pedagogical judgment and offer insights into the …

Leadership In Physical Therapist Education: Instructional Strategies And Assessment Methods Used Among U.S. Capte Accredited Programs, Gretchen R. Prather

Theses, Dissertations and Capstones

The physical therapy profession has recently placed greater significance on leadership education and research at all levels of professional development. Excellence and innovation in physical therapy practice must address leadership development beginning in professional education. This call for reform has been adopted broadly, including from an accreditation standpoint. The challenge now becomes to determine the most effective ways for preparing student physical therapists to lead in today’s fluid healthcare environment. This study examined leadership content among U.S. CAPTE accredited physical therapist education programs and, specifically, the instructional strategies and assessment methods frequently used to develop emerging leaders. An online survey …

The Promise Of Labor-Based Grading Contracts For The Teaching Of Psychology And Neuroscience, Jasmine Mena, Jennie Stevenson

Faculty Journal Articles

Introduction: Instructors assign grades to communicate to students how well they are learning the course content. However, students and instructors are often displeased with the process and outcome of grading. Statement of the Problem: We contend that conventional grading inadvertently detracts from student learning and simultaneously replicates systems of oppression in academia. We discuss Labor Based Grading Contracts (LBGC) as an alternative to conventional grading. Literature Review: We review the conceptual and empirical literature on LBGCs as an alternative method of assessing student work and extend its application to psychology and neuroscience courses. Teaching Implications: We present recommendations for implementing …

Unlocking Student Engagement Opportunities In Learning, Teaching And Assessment Through Active Blended Practice In The Faculty Of Business, Faculty Of Business, Technological University Dublin

Cross Faculty Publications

No abstract provided.

Leading Leaders In Rethinking Grading: A Case Study Of Implementation Of Standards-Based Grading In Educational Leadership, Erin E. Lehmann

Journal of Research Initiatives

The purpose of this paper is to share the process of how one university instructor worked toward a shift to standards-based grading (SBG) in a graduate Educational Leadership program. Educational leadership programs use standards to guide coursework and instruction in an accountability era, but grading practices remain as subjective as they were 50 years ago. Educators of future leaders must address this need. In addition, instructors need to effectively communicate essential learning to students to understand their learning progression clearly; standards-based grading is designed to do this. The author shares best practices in grading as well as the challenges of …

Beyond The Checklist Approach: A Librarian-Faculty Collaboration To Teach The Beam Method Of Source Evaluation, Jenny Mills, Rachael Flynn, Nicole Fox, Dana Shaw, Claire Wiley

Library Faculty Scholarship

Evaluating information is an essential skill, valued across disciplines. While librarians and instructors share the responsibility to teach this skill, they need a common framework in order to collaborate to design assignments that give students multiple opportunities to learn. Librarians and First Year Seminar faculty at Belmont University collaborated to design a unit of instruction on source evaluation using the BEAM method. BEAM requires students to apply a use-based approach to evaluation, to read and engage with sources more closely, and to think about how they might use a source for a specific purpose. Structured annotated bibliographies that included BEAM …

Covid-19 Modifications To A Service-Learning Project Designed To Prepare Special Education Students To Be Effective Participants In Transdisciplinary Collaborations, Kathy R. Doody, Katrina Fulcher-Rood, Pamela Schuetze

Excelsior: Leadership in Teaching and Learning

This research study examined the impact of COVID-19 on university students’ perceptions about the effectiveness of a community-based service-learning project designed to prepare graduate students in special education and undergraduate students in psychology and speech-language pathology to work in transdisciplinary teams in early childhood settings. Students were placed into transdisciplinary teams and assigned to one of two community-based early childhood programs to administer a universal screening tool that assessed young children in several domains. The project was in its sixth year when the country stood still because of the COVID-19 pandemic. The project was re-envisioned, mid-course, to provide an equitable …

Uptodate Use As A Predictor Of Medical Student Success, Connor Buechler, Kurt Wendland, Jason Booza, Diane Levine

Medical Student Research Symposium

Background

Both practicing physicians and student learners prioritize speed of access and ease of use over most other criteria in choosing how to look up clinical information, with electronic resources far outpacing books for these reasons. While there are many variations of electronic reference materials available, UpToDate is one of, if not the most, frequently referenced clinical knowledge resources. It is professionally written and edited by practicing clinicians with frequent updates as new information or studies become available to inform care, allowing the learner to answer clinical questions rapidly, correctly, and fully. Given its proven popularity, the usefulness of UpToDate …

Assessment As A Learning Opportunity: Feedforward With Multiple Attempts, Emily Faulconer

Publications

High quality feedback is well-known to provide multiple student benefits, especially if students are provided the opportunity to apply the feedback. It reasons, then, that we can support student success on summative assessments by combining multiple attempts with high-quality immediate feedback. This study explores student behaviors, performance, and perspectives regarding this strategy.

A Psychologist’S Perspective For Coordinating Interdisciplinary Courses, Amanda L. Almond

Publications and Research

Developing a student evaluation for interdisciplinary teaching revealed a clearer goal for interdisciplinary course assessment. This chapter summarizes how interdisciplinary course assessment is a cooperative and reflexive process. Using professional judgment and a working group of peers, interdisciplinary courses maintain their integrity through regular reviews. A reflection on experiences with team-teaching, guest lecturing, and learning-communities is also included. Best practices for interdisciplinary course maintenance and concepts of validity are applied to the debate between evaluation and assessment methods. By fostering transparency, accountability, and peer-led critiques, interdisciplinary learning objectives within courses are sustained each semester. Recognizing concerns regarding evaluation, flexible approaches …

Assessment Of Pre-Service Teacher Dispositions, Elizabeth Bradley, Patricia Isaac, Joseph King

Excelsior: Leadership in Teaching and Learning

Measurement of pre-service teacher dispositions is an important part of teacher preparation programs. A strong correlation exists between dispositions of teachers and the quality of their student’s learning. Teachers, in addition to sharing content knowledge, are responsible for demonstrating and sharing core values relating to virtues such as honesty, justice, fairness, care, empathy, integrity, courage, respect, and responsibility, and these values must guide their own conduct and interpersonal relations. As teachers serve pupils who are minors, their conduct and potential to serve effectively and ethically in the profession must be evaluated. However, a thorough faculty-led instrument to assess pre-service teacher …

Development Of A Faculty Appreciation Of Pedagogy Scale, Carol A. Hurney, Jordan D. Troisi, Lori H. Leaman

To Improve the Academy: A Journal of Educational Development

Evidencing the value of programs and services challenges educational developers to measure a range of outcomes. While direct measures of faculty use of effective teaching behaviors and student learning are desirable, these methods are time consuming and resource intensive. We provide a scale that is easy to deploy and can be adapted to different programs. Our psychometrically sound scale measures one facet of faculty learning about teaching—appreciation of pedagogy. The scale measures awareness, knowledge integration, emotions, beliefs, and self-reported behaviors related to the appreciation of pedagogy. We also examine scale correlates, including teaching identity, confidence, and control.

Students Helping Students Provide Valuable Feedback On Course Evaluations, Adriana Signorini, Mariana Abuan, Gautam Panakkal, Sandy Dorantes

To Improve the Academy: A Journal of Educational Development

The purpose of the student evaluations of teaching (SET) are to help instructors enhance the teaching and learning experience in their courses; however, student feedback can often be more unconstructive than useful because students are usually requested to evaluate instruction with little or no formal training. As a result, SET become missed opportunities for students to effectively communicate their learning needs and for instructors to collect actionable information about how the course is perceived. This project aims to improve the quality of student responses to the open-ended questions that instructors receive by partnering with undergraduates in demonstrating to their peers …

Assessment Literacy In College Teaching: Empirical Evidence On The Role And Effectiveness Of A Faculty Training Course, Kyle D. Massey, Christopher Deluca, Danielle Lapointe-Mcewan

To Improve the Academy: A Journal of Educational Development

This research explores how faculty members’ conceptions of assessment and confidence in assessment change as a result of an instructor training course. Based on a sample of 27 faculty members enrolled in a semester-long instructional development course, this survey-based study provides initial evidence that faculty members can develop confidence in assessment while adopting increasingly complex conceptions of assessment. Based on this study’s findings, we argue that instructional development programs for college faculty have a critical role to play in stimulating faculty learning about assessment of student learning and are an important component in promoting a positive assessment culture.

Cultivating And Sustaining A Faculty Culture Of Data-Driven Teaching And Learning: A Systems Approach, Marsha Lovett, Chad Hershock

To Improve the Academy: A Journal of Educational Development

A prominent goal of colleges and universities today is to enact data-driven teaching and learning. Faculty clearly play a key role, and yet they tend to have limited time, a lack of training in assessment or education research, and few incentives for engaging in this work. We describe a framework designed to address the practical and cultural aspects of these challenges via a cycle of educational development and support: motivate, educate, facilitate, disseminate. We illustrate this systems approach with concrete examples and conclude with lessons learned from our experiences that should translate to a variety of institutional contexts.

Reflective Essay On Assessment, Kerwin A. Livingstone

Kerwin A. Livingstone

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …