Education Commons^™

The Triple Jump In Problem-Based Learning: Unpacking Principles And Practices In Designing Assessment For Curriculum Alignment, Monaliza M. Chian, Susan M. Bridges, Edward C.M. Lo

Interdisciplinary Journal of Problem-Based Learning

Assessment validity, reliability, and constructive alignment to planned learning outcomes are less understood in the context of integrated, problem-based curricula. This conceptual paper examines a Triple Jump Assessment (TJA) employed as a formative and summative assessment system in the first year of an undergraduate dental program. Specifically, we deconstructed this instantiation of a TJA in terms of management and co-ordination; assessment design and item development; assessment administration; and assessment review, refinement and modification. Four core principles of TJA design for constructive alignment in an integrated, problem-based curriculum were identified as: (a) viewing the assessment design process as a collaborative and …

Teaching Students To Critically Evaluate Textbooks, Christopher Mchale, Ian Mcdermott, Steven Ovadia

Publications and Research

This chapter is a case study describing how library faculty combined service learning and information literacy to help students evaluate textbooks, comparing commercial ones to Open Education Resources. The underlying idea was to give students not only a scholarly grounding that would help them as they move through their academic careers but also a practical vocational orientation to help them succeed in the workforce and, hopefully, become future contributors to the free culture movement.

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Toward The Development Of A Quick, Reliable Assessment Tool For Reflective Journals, April Garrity, Casey Keck, Janet L. Bradshaw, Keiko Ishikawa

Teaching and Learning in Communication Sciences & Disorders

Reflective practice, including reflective writing, can facilitate enriched learning, especially when implemented as part of a service-learning (SL) experience. Reflection is a central component of service-learning (SL) experiences. Students’ reflective abilities are often measured through reflective journaling; however, assessment of students’ reflective journals is not always efficient and straightforward. The goal of the present study was to establish a simple, reliable, and relatively quick tool for use by busy college instructors seeking to encourage students’ deep learning through reflective writing. A total of 258 reflective journals from 43 graduate students in speech-language pathology were evaluated by three raters using a …

Developing And Using A Rubric To Provide Feedback And Improve Csd Clinical Writing, Laura B. Willis, Lindsey Piazza

Teaching and Learning in Communication Sciences & Disorders

The benefits of rubrics have long been established and their use encouraged in various fields of study. The authors sought to create a rubric specific to the needs in CSD to more clearly share expectations for student clinical writing and more comprehensively assess the quality of their writing. The faculty collaborated with the Office of Academic Assessment to develop a rubric to address these issues. The rubric was developed using VALUE rubrics as guidance, as well as the unique requirements for Communication Sciences and Disorders documentation. This specific rubric may be used to grade and provide feedback to improve the …

Placement Testing Instruments For Modality Streams In An English Language Program, Aimee Hilgers

Dissertations, Theses, and Projects

The purpose of this study was to determine placement testing instruments for the modality streams in the English Language Program (ELP) at Minnesota State University Moorhead (MSUM). The study involved research into and consideration of types and purposes of tests. A placement test was determined to be the appropriate test type for the program’s current student placement needs. An investigation was performed regarding characteristics placement tests need to possess for our program. With these characteristics guiding research, placement test options for the modality streams were reviewed, including standardized tests and in-house assessments. This project determined that in-house placement testing instruments …

Are We At A Watershed Moment For The Quantitative Literacy Movement?: Review Of Shifting Context, Stable Core: Advancing Quantitative Literacy In Higher Education, By Luke Tunstall, Gizem Karaali, And Victor Piercey, Eds., Maura Mast

Numeracy

Luke Tunstall, Gizem Karaali, and Victor Piercey, eds. 2019. Shifting Concepts, Stable Core: Advancing Quantitative Literacy in Higher Education. Math Notes 88. (Mathematics Association of America, MAA Press). Print ISBN 978-0-88385-198-2. Electronic ISBN 978-1-61444-324-7.

The thematic approach of the edited MAA Notes volume Shifting Contexts, Stable Core: Advancing Quantitative Literacy in Higher Education is that the “construct” of quantitative literacy is now fairly stable, but the contexts in which quantitative literacy is taught (and practiced) continue to change. Several chapters give the reader much to consider regarding what constitutes the foundation of this stable core and, relatedly, how quantitative …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …

Developing A Rubric To Assess Critical Thinking In A Multidisciplinary Context In Higher Education, Sadia Muzaffar Bhutta, Sahreen Chauhan, Syeda Kauser Ali, Raisa B. Gul, Shanaz Hussein Cassum, Tashmin Khamis

School of Nursing & Midwifery

Critical thinking (CT) is a generic attribute that is greatly valued across academic disciplines in higher education, and around the globe. It is also defined as one of the graduate attributes of higher education for the sample private university where this research was conducted, as it is perceived that CT helps the graduate to become ‘engaged citizens’ in the twenty-first century. Despite the well-documented importance of CT, its assessment remains a challenge. This study addresses this challenge through the systematic development and field-testing of a rubric for assessing critical thinking in a multidisciplinary context in higher education. A multidisciplinary group …

How Students Information Literacy Skills Change Over Time: A Longitudinal Study, Veronica Wells

Veronica Wells

How do students’ information literacy skills change over the course of their undergraduate education? We assume or at least hope they will improve. But do they? And if so, by how much? At the University of the Pacific, we are using the SAILS (Standardized Assessment of Information Literacy Skills) Test to assess undergraduate students’ information literacy skills and to see how they have changed over time. The SAILS Test is a multiple-choice test that has been used by more than 200 universities across the world. According to their website, the SAILS Test can “determine how well your students can navigate …

Sulitest®: A Mixed-Method, Pilot Study Of Assessment Impacts On Undergraduate Sustainability-Related Learning And Motivation, Alicia Mason

Faculty Submissions

A United Nations international collaboration between the Education for Sustainable Development (ESD) and the Principles for Responsible Management Education (PRME) resulted in the creation of Sulitest® (aka Sustainability Literacy Test) an open, online training and assessment tool freely available to higher education institutions globally. This study analyzes the effectiveness of the newly developed Sulitest® to not only measure sustainability literacy of higher education student populations, but also act as a catalyst for boosting affective learning outcomes by: (a) generating interest in sustainability-related issues, (b) improving sustainability-related understandings, and (c) enhancing students’ interests in the subject matter. In order to do …

Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley

Journal of Research Initiatives

The purpose of this paper is to provide a model for educational leadership faculty who aspire to walk the talk of effective feedback by embedding standards-based grading (SBG) in their courses. Rather than focusing on learning, points are the currency of K-12 classrooms across the country. Over 100 years of grading research suggests typical grading practices are subjective at best. Some schools are responding by implementing SBG, yet few articles describe how higher education embeds this philosophy in educator preparation coursework. In this essay, the author documents how to design assessments, align rubrics, and provide feedback to aspiring school leaders …

Improving The Rigor Of Online Education: Exploring Characteristics Of Faculty And Syllabi Within An Online Program Assessment Process, Brad J. Hamel

All NMU Master's Theses

As online course enrollments grow, overall perception of rigor still lags compared to that of traditional face-to-face education. The purpose of this research was to tie faculty and syllabi characteristics to the rigor of online courses. This study explored the relationship between faculty and syllabi characteristics and performance on an online entry-level course design quality assurance assessment (pass, pass with concern, or fail). A decision tree analysis was used to predict the relationship of the independent (faculty and syllabi characteristics) and the dependent (entry-level course design assessment) variables. Findings suggest that faculty rank and writing intensive are key characteristics predictive …

Profiles Of A Non-Profit Statewide College Women's Leadership Training Program's Effectiveness, Wendy Grey Huckabee Broyles

Doctoral Dissertations and Projects

The purpose of this intrinsic, multiple case study has been to describe the effectiveness of the non-profit statewide college women's leadership training program, Leading Edge Institute, through profiles of the program’s key stakeholders. The study participants included key stakeholders: members of the organization’s faculty, staff, and alumnae. The theory guiding this study was the transformational theory of leadership (Burns, 2010; Bass & Riggio, 2006; Caldwell, McConkie, & Licona, 2014; Kendrick, 2011), as it appreciates the individualization of diversity that informs different perceptions of reality (ontological philosophical assumption) and considers how social context helps those individuals develop personal values (social constructivism …

Mastery-Based Testing In Undergraduate Mathematics, J.B. Collins, Amanda Harsy, Jarod Hart, Katie Anne Haymaker, Alyssa Marie Hoofnagle, Mike Janssen, Jessica Stewart Kelly, Austin Tyler Mohr, Jessica O'Shaughnessy

Faculty Work Comprehensive List

Mastery-based testing is an assessment scheme that challenges students to provide complete solutions to problems derived from clear course concepts. Students are allowed multiple attempts to demonstrate mastery, which helps create a classroom environment where students value persistence toward thorough understanding. In this paper, we describe in detail the benefits and implementation of mastery-based testing in college mathematics courses. We also summarize student response data that show positive reactions to this testing method.

Setting The Foundation For Democratization: Assessing The Quality Of A Political Science Program In Egypt, Yasmin Khodary

Political Science

Purpose – The purpose of this paper is to investigate the quality of a political science program in an Egyptian private university through assessing three particular dimensions: knowledge of political science core facts and theories; reading comprehension skills; and critical thinking (CT).

Design/methodology/approach – A case study research approach was used. The study relies also on a quantitative methodology. Quantitative data were collected from students in the second and fourth years of political science to assess their knowledge of core political science facts and theories, reading comprehension and CT through the online California Critical Thinking Skills Test.

Findings – Unlike …

How Students Information Literacy Skills Change Over Time: A Longitudinal Study, Veronica Wells

University Libraries Librarian and Staff Presentations

How do students’ information literacy skills change over the course of their undergraduate education? We assume or at least hope they will improve. But do they? And if so, by how much? At the University of the Pacific, we are using the SAILS (Standardized Assessment of Information Literacy Skills) Test to assess undergraduate students’ information literacy skills and to see how they have changed over time. The SAILS Test is a multiple-choice test that has been used by more than 200 universities across the world. According to their website, the SAILS Test can “determine how well your students can navigate …

University Libraries Co-Curricular Outreach Plan July 2017 – June 2019, Rosan Mitola

Instruction Session and Workshop Materials

The purpose of this document is to align new co-curricular outreach efforts for undergraduate and graduate students with the University Libraries’ Strategic Framework

July 2017 - June 2019. The University Libraries contribute to student learning that takes place outside of the curriculum through a number of ways, throughout the academic year. This plan will be adapted and updated as needed to stay in alignment with the work of the Educational Initiatives department and the University Libraries.

When Assessment Is Surveillance, Jennifer Thomson

Bucknell: Occupied

Jennifer Thomson, assistant professor of History at Bucknell University, interviews Steve Jordan, professor of Biology at Bucknell University. The pair discuss administrative decisions on campus that contribute to feelings of powerlessness, of automation, and of surveillance.

Concept Inventories As A Resource For Teaching Evolution, Robert E. Furrow, Jeremy L. Hsu

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Understanding evolution is critical to learning biology, but few college instructors take advantage of the body of peer-reviewed literature that can inform evolution teaching and assessment. Here we summarize the peer-reviewed papers on tools to assess student learning of evolutionary concepts. These published concept inventories provide a resource for instructors to design courses, gauge student preparation, identify key misconceptions in their student population, and measure the impact of a lesson, course, or broader curriculum on student learning. Because these inventories vary in their format, target audience, and degree of validation, we outline and explain these features. In addition to summarizing …

Anxiety And Communication Competence In The Honors Basic Public Speaking Course: An Intervention And Formative Assessment, Joshua N. Westwick, Karla M. Hunter, Barbara A. Kleinjan

Basic Communication Course Annual

This case study examines the effectiveness of a formative assessment intervention in an honors section of a basic public speaking course. Previous research has found significantly higher levels of public speaking anxiety among honors students than among non-honors students and has therefore identified these students as a population at risk for high public speaking anxiety (PSA). As a result, this analysis tested a one-hour tutoring session designed not only to aid students in maximizing learning outcomes for the first speech of the course, but, subsequently, to enhance markers of student development through reduced PSA and increased self-perceived communication competence (SPCC). …

Spring, Summer, Fall 2019 Graduation Survey Responses, Uno Office Of Instituional Effectiveness

Graduation

Spring, Summer, Fall 2019 Graduation survey responses master file without identifiers.

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Leaf (Learning From And Engaging With Assessment And Feedback) Final Project Report, Ziene Mottiar, Louise Bellew, Sara Boyd, Greg Byrne, Jane Courtney, Cliona Doris, Helen O'Brien Gately, Geraldine Gorham, Leanne Harris, Natalie Hopkin, Anne Hurley, Louise Lynch, Ciaran O'Driscoll, Denise O'Leary, Noel O'Neill, Emma Robinson, Mary Scally, Barry Sheehan, Mairead Stack

Reports

The LEAF (Learning from and Engaging with Assessment and Feedback) project was funded under the Teaching Fellowship in TU Dublin, city campus for 18 months beginning in January 2018. The project team comprised 18 academics from across the TU Dublin - City Campus and there are representatives from all colleges. Also included were two further members who represented the student voice: the Director of Student Affairs and the Students’ Union Education Officer.

This project sought to address a key issue in third level Teaching and Learning, that of assessment and assessment feedback. Assessment strategies have been shown to have a …

The Practice Of Assessment Data Use In Student Affairs: The Need For An Expanded Conceptualization, Mark D. Manderino

Dissertations

Over the past three decades, student affairs assessment, as an organized functional area, has matured and established itself as an essential and expected component within higher education in the United States (Elkins, 2015; Ewell, 2002; Henning & Roberts, 2016). While professionals know that data use is part of the process of assessment (Banta & Blaich, 2010), there has not been sufficient evidence of what use of assessment looks like both in higher education and specifically student affairs, or how best practice strategies encourage assessment data use (Kinzie, Hutchings, Jankowski, 2015). There is a dearth of empirical evidence related to use …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Ita Language Proficiency Testing: Recommended Replacement For The Speak® Test, Anne Marie Stoughton

Graduate Research Theses & Dissertations

Oral language tests have been used since the 1950s to assess the proficiency of spoken language. In the 1980s and 1990s, the need for oral proficiency testing increased as states began to mandate that universities within their jurisdictions test the English proficiency of instructors due to growing concerns over international teaching assistants’ (ITAs) comprehensibility. Many universities turned to the Speaking Proficiency English Assessment Kit® (SPEAK test), a language proficiency test created and distributed by the Educational Testing Service (ETS), as means to test ITA proficiency in English. ETS’s discontinuance of the SPEAK test in 2010 has forced, and is forcing, …

Timely Student Feedback, Ronan Oliver, Evelyn Casey, David O'Connor

Practitioner Research Projects

Students are not only interested in their grades but they are also interested in feedback (Mulliner & Tucker, 2017), as this is an important element of their learning cycle (Gibbons et al., 2018). Together with lecturers they agree that for this to be effective, it must be returned quickly so that it can be acted on within the context of their learning (Denton et al., 2008; Mulliner & Tucker, 2017). However, the delivery of timely and effective feedback can be a burden on lecturers, particularly if they are responsible for large classes and in the early stage of their career. …

A Rubric Guide For New Academics, Pearlean Chadha, Louise Lynch, Barry Nevin, Edmund Nevin, Anushree Priyadarshini

Practitioner Research Projects

Early career academics entering Higher Education face many challenges. The demands of a new work environment – particularly a third-level institute – can lead to struggles for identity and purpose together with uncertainty of how to fit into a new role (Archer, 2008; Houston, Meyer, & Paewai, 2006). The importance of supporting new academics is identified by many authors including Adcroft and Taylor (2013) and Sadler (2012), and is a crucial issue where assessment of student performance is concerned. Assessment is a major driver of student learning, and scholars have extensively documented the importance of constructively aligning assessment types to …

A How-To Guide For Student Generated Video, Janet Gillanders, Kate O'Brien, Sean O'Leary, Ariane Perez-Gavilan, James Sheridan

Practitioner Research Projects

The type of assessment used by the instructor is a major consideration that must be taken into account when designing a third level course. The importance of assessment can be understood if one frames it not only as assessment of learning but also as assessment for learning. In this new framework, in addition to measuring students’ knowledge of the material, assessment can be thought of as a tool used for providing feedback, for defining academic standards, and for directing student learning (Harris, 2005). There is currently a movement calling for a shift away from traditional high-stakes assessment towards alternative assessment …