Scholarship of Teaching and Learning Commons^™

Exploring Neurocognitive Processes That Underlie Reading Performance In Children: A Foundational Study, Ayan Mitra

Theses and Dissertations

With advancement in brain research, neuroscience researchers have collectively informed our understanding of reading-related processes. Despite an extensive body of literature, many educators are not aware of specific neuroimaging findings related to phonological processing and word reading. Therefore, the study builds on this body of research by exploring the connection between the brain and reading scores. Quantitative EEG and standardized academic achievement analyses were performed on 60 school-aged children. Intrahemispheric coherence analysis at rest were conducted across the sample of participants and several coherence networks were extracted and compared to standardized reading achievement scores. Specifically, networks that included Brodmann area …

Covid-19 Modifications To A Service-Learning Project Designed To Prepare Special Education Students To Be Effective Participants In Transdisciplinary Collaborations, Kathy R. Doody, Katrina Fulcher-Rood, Pamela Schuetze

Excelsior: Leadership in Teaching and Learning

This research study examined the impact of COVID-19 on university students’ perceptions about the effectiveness of a community-based service-learning project designed to prepare graduate students in special education and undergraduate students in psychology and speech-language pathology to work in transdisciplinary teams in early childhood settings. Students were placed into transdisciplinary teams and assigned to one of two community-based early childhood programs to administer a universal screening tool that assessed young children in several domains. The project was in its sixth year when the country stood still because of the COVID-19 pandemic. The project was re-envisioned, mid-course, to provide an equitable …

Uptodate Use As A Predictor Of Medical Student Success, Connor Buechler, Kurt Wendland, Jason Booza, Diane Levine

Medical Student Research Symposium

Background

Both practicing physicians and student learners prioritize speed of access and ease of use over most other criteria in choosing how to look up clinical information, with electronic resources far outpacing books for these reasons. While there are many variations of electronic reference materials available, UpToDate is one of, if not the most, frequently referenced clinical knowledge resources. It is professionally written and edited by practicing clinicians with frequent updates as new information or studies become available to inform care, allowing the learner to answer clinical questions rapidly, correctly, and fully. Given its proven popularity, the usefulness of UpToDate …

Assessment As A Learning Opportunity: Feedforward With Multiple Attempts, Emily Faulconer

Publications

High quality feedback is well-known to provide multiple student benefits, especially if students are provided the opportunity to apply the feedback. It reasons, then, that we can support student success on summative assessments by combining multiple attempts with high-quality immediate feedback. This study explores student behaviors, performance, and perspectives regarding this strategy.

A Psychologist’S Perspective For Coordinating Interdisciplinary Courses, Amanda L. Almond

Publications and Research

Developing a student evaluation for interdisciplinary teaching revealed a clearer goal for interdisciplinary course assessment. This chapter summarizes how interdisciplinary course assessment is a cooperative and reflexive process. Using professional judgment and a working group of peers, interdisciplinary courses maintain their integrity through regular reviews. A reflection on experiences with team-teaching, guest lecturing, and learning-communities is also included. Best practices for interdisciplinary course maintenance and concepts of validity are applied to the debate between evaluation and assessment methods. By fostering transparency, accountability, and peer-led critiques, interdisciplinary learning objectives within courses are sustained each semester. Recognizing concerns regarding evaluation, flexible approaches …

Assessment Of Pre-Service Teacher Dispositions, Elizabeth Bradley, Patricia Isaac, Joseph King

Excelsior: Leadership in Teaching and Learning

Measurement of pre-service teacher dispositions is an important part of teacher preparation programs. A strong correlation exists between dispositions of teachers and the quality of their student’s learning. Teachers, in addition to sharing content knowledge, are responsible for demonstrating and sharing core values relating to virtues such as honesty, justice, fairness, care, empathy, integrity, courage, respect, and responsibility, and these values must guide their own conduct and interpersonal relations. As teachers serve pupils who are minors, their conduct and potential to serve effectively and ethically in the profession must be evaluated. However, a thorough faculty-led instrument to assess pre-service teacher …

Assessing Outcomes Of Simulation In Communication Sciences And Disorders, Erin S. Clinard

Teaching and Learning in Communication Sciences & Disorders

Assessment is an ongoing process that is necessary at every stage of designing, implementing, and evaluating simulation-based learning experiences (SBLEs). Designing and aligning a high-quality assessment process provides instructors and researchers with valuable data to understand if students have met the desired simulation learning objectives, where students are in their learning, and opportunities to enhance the SBLE. This reflection discusses the importance of assessing student learning outcomes as well as the effectiveness of all simulation-based learning experiences (SBLEs) in communication sciences and disorders (CSD). While the benefits and effectiveness of simulation have been demonstrated in other health professions, simulation research …

Making Methods Relevant: Undergraduate Research Methods And The Content Analysis Project, Kevin E. Courtright, David A. Mackey

Scholarship of Teaching and Learning, Innovative Pedagogy (2018-2020 archives)

Teachers of undergraduate research methods classes may struggle at times to keep their courses engaging and to have students view the material as relevant to the occupations they will soon enter. This article discusses a content analysis assignment and how it offers a way for students to demonstrate critical thinking and acquire data analysis skills. Through the use of multiple high-impact learning practices, the assignment requires students, individually or in a group, to identify data appropriate for content analysis and then, with faculty guidance, develop research questions, manage the data, conceptualize and operationalize themes, perform content analysis, draw conclusions from …

Yes, You Can Get A Job With That Major! Goal 5 Strategies For Facilitating, Assessing, And Demonstrating Psychology Students’ Professional Development, Kristin M. Vespia, Karen Z. Naufel, Jerry Rudmann, Jaye F. Van Kirk, Deborah Briihl, Jason Young

Publications and Research

The Summit on the National Assessment of Psychology was held on June 2016 to chart a path for assessing student achievement of the goals of the undergraduate psychology major. Our subcommittee was charged with identifying evaluation strategies and tools for students’ professional development, which included applying psychology to various careers; engaging in effective self-regulation, project management, and teamwork; and developing lifelong professional skills. In this article, therefore, we not only review a wide range of assessment tools for facilitating and evaluating professional development in psychology, but we also discuss the larger importance of the learning goal both to students and …

Self-Determination Theory And Faculty Behavior: A Quantitative Study Of Faculty Leaders' Use Of Assessment Evidence, Joseph D. Levy

Dissertations

Despite assessment of student learning being essential work in higher education, a number of institutions have noted faculty could more effectively be using assessment results (Jankowski et al., 2018; Kuh et al., 2015; Metzler & Kurz, 2019; Suskie, 2014). This study applied Self-Determination Theory (SDT) as a theoretical framework to provide context for faculty behavior associated with assessment actions (Fuller et al., 2016; Ryan & Deci, 2000). Mostly quantitative data were collected via electronic survey of faculty program leaders at a single institution, National Louis University (NLU). Results indicated a significant and positive relationship suggesting an increase in meeting the …

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Toward The Development Of A Quick, Reliable Assessment Tool For Reflective Journals, April Garrity, Casey Keck, Janet L. Bradshaw, Keiko Ishikawa

Teaching and Learning in Communication Sciences & Disorders

Reflective practice, including reflective writing, can facilitate enriched learning, especially when implemented as part of a service-learning (SL) experience. Reflection is a central component of service-learning (SL) experiences. Students’ reflective abilities are often measured through reflective journaling; however, assessment of students’ reflective journals is not always efficient and straightforward. The goal of the present study was to establish a simple, reliable, and relatively quick tool for use by busy college instructors seeking to encourage students’ deep learning through reflective writing. A total of 258 reflective journals from 43 graduate students in speech-language pathology were evaluated by three raters using a …

Developing And Using A Rubric To Provide Feedback And Improve Csd Clinical Writing, Laura B. Willis, Lindsey Piazza

Teaching and Learning in Communication Sciences & Disorders

The benefits of rubrics have long been established and their use encouraged in various fields of study. The authors sought to create a rubric specific to the needs in CSD to more clearly share expectations for student clinical writing and more comprehensively assess the quality of their writing. The faculty collaborated with the Office of Academic Assessment to develop a rubric to address these issues. The rubric was developed using VALUE rubrics as guidance, as well as the unique requirements for Communication Sciences and Disorders documentation. This specific rubric may be used to grade and provide feedback to improve the …

Are We At A Watershed Moment For The Quantitative Literacy Movement?: Review Of Shifting Context, Stable Core: Advancing Quantitative Literacy In Higher Education, By Luke Tunstall, Gizem Karaali, And Victor Piercey, Eds., Maura Mast

Numeracy

Luke Tunstall, Gizem Karaali, and Victor Piercey, eds. 2019. Shifting Concepts, Stable Core: Advancing Quantitative Literacy in Higher Education. Math Notes 88. (Mathematics Association of America, MAA Press). Print ISBN 978-0-88385-198-2. Electronic ISBN 978-1-61444-324-7.

The thematic approach of the edited MAA Notes volume Shifting Contexts, Stable Core: Advancing Quantitative Literacy in Higher Education is that the “construct” of quantitative literacy is now fairly stable, but the contexts in which quantitative literacy is taught (and practiced) continue to change. Several chapters give the reader much to consider regarding what constitutes the foundation of this stable core and, relatedly, how quantitative …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …

Sulitest®: A Mixed-Method, Pilot Study Of Assessment Impacts On Undergraduate Sustainability-Related Learning And Motivation, Alicia Mason

Faculty Submissions

A United Nations international collaboration between the Education for Sustainable Development (ESD) and the Principles for Responsible Management Education (PRME) resulted in the creation of Sulitest® (aka Sustainability Literacy Test) an open, online training and assessment tool freely available to higher education institutions globally. This study analyzes the effectiveness of the newly developed Sulitest® to not only measure sustainability literacy of higher education student populations, but also act as a catalyst for boosting affective learning outcomes by: (a) generating interest in sustainability-related issues, (b) improving sustainability-related understandings, and (c) enhancing students’ interests in the subject matter. In order to do …

Improving The Rigor Of Online Education: Exploring Characteristics Of Faculty And Syllabi Within An Online Program Assessment Process, Brad J. Hamel

All NMU Master's Theses

As online course enrollments grow, overall perception of rigor still lags compared to that of traditional face-to-face education. The purpose of this research was to tie faculty and syllabi characteristics to the rigor of online courses. This study explored the relationship between faculty and syllabi characteristics and performance on an online entry-level course design quality assurance assessment (pass, pass with concern, or fail). A decision tree analysis was used to predict the relationship of the independent (faculty and syllabi characteristics) and the dependent (entry-level course design assessment) variables. Findings suggest that faculty rank and writing intensive are key characteristics predictive …

Timely Student Feedback, Ronan Oliver, Evelyn Casey, David O'Connor

Practitioner Research Projects

Students are not only interested in their grades but they are also interested in feedback (Mulliner & Tucker, 2017), as this is an important element of their learning cycle (Gibbons et al., 2018). Together with lecturers they agree that for this to be effective, it must be returned quickly so that it can be acted on within the context of their learning (Denton et al., 2008; Mulliner & Tucker, 2017). However, the delivery of timely and effective feedback can be a burden on lecturers, particularly if they are responsible for large classes and in the early stage of their career. …

A How-To Guide For Student Generated Video, Janet Gillanders, Kate O'Brien, Sean O'Leary, Ariane Perez-Gavilan, James Sheridan

Practitioner Research Projects

The type of assessment used by the instructor is a major consideration that must be taken into account when designing a third level course. The importance of assessment can be understood if one frames it not only as assessment of learning but also as assessment for learning. In this new framework, in addition to measuring students’ knowledge of the material, assessment can be thought of as a tool used for providing feedback, for defining academic standards, and for directing student learning (Harris, 2005). There is currently a movement calling for a shift away from traditional high-stakes assessment towards alternative assessment …

A Rubric Guide For New Academics, Pearlean Chadha, Louise Lynch, Barry Nevin, Edmund Nevin, Anushree Priyadarshini

Practitioner Research Projects

Early career academics entering Higher Education face many challenges. The demands of a new work environment – particularly a third-level institute – can lead to struggles for identity and purpose together with uncertainty of how to fit into a new role (Archer, 2008; Houston, Meyer, & Paewai, 2006). The importance of supporting new academics is identified by many authors including Adcroft and Taylor (2013) and Sadler (2012), and is a crucial issue where assessment of student performance is concerned. Assessment is a major driver of student learning, and scholars have extensively documented the importance of constructively aligning assessment types to …

Leaf (Learning From And Engaging With Assessment And Feedback) Final Project Report, Ziene Mottiar, Louise Bellew, Sara Boyd, Greg Byrne, Jane Courtney, Cliona Doris, Helen O'Brien Gately, Geraldine Gorham, Leanne Harris, Natalie Hopkin, Anne Hurley, Louise Lynch, Ciaran O'Driscoll, Denise O'Leary, Noel O'Neill, Emma Robinson, Mary Scally, Barry Sheehan, Mairead Stack

Reports

The LEAF (Learning from and Engaging with Assessment and Feedback) project was funded under the Teaching Fellowship in TU Dublin, city campus for 18 months beginning in January 2018. The project team comprised 18 academics from across the TU Dublin - City Campus and there are representatives from all colleges. Also included were two further members who represented the student voice: the Director of Student Affairs and the Students’ Union Education Officer.

This project sought to address a key issue in third level Teaching and Learning, that of assessment and assessment feedback. Assessment strategies have been shown to have a …

Learning From Failure: Making The Feedback Loop Work, Natalie Bishop, Pam Dennis, Janet Land, Hannah Allford

Georgia International Conference on Information Literacy

“I spend hours providing feedback, but I have no idea if my students read it” is a common phrase echoed across college campuses. While best practices in teaching pedagogy laud the feedback cycle, many instructors question the impact their feedback has on their students’ writing. As the feedback loop continues to be a trending cog in the machine of formative assessment and authentic education, an essential component of the loop is often overlooked: the conversation.

Presenters will focus on providing easy-to-implement “conversation” opportunities for students to respond to instructor feedback. This reflective practice provides insight into a student’s learning processes, …

Google Forms In Library Instruction: Creating An Active Learning Space And Communicating With Students, Elena Rodriguez

Scholarship of Teaching and Learning, Innovative Pedagogy (2018-2020 archives)

The many programs offered through Google’s G Suite for Education have steadily found their footing across the varied fields of librarianship, including instruction. One such program that has potential in encouraging and developing information literacy skills in undergraduate students is Google Forms. From the observation of a Google Form activity used in four sections of a 100-level History course, utilizing Forms during one-shot instruction can create active learning experiences, be a valuable tool in aiding the continuation of a lesson after a completed one-shot, and can play an important role for the librarian when assessing if learning outcomes have been …

Listening To Our Graduate Students' Feedback: Graduate Student Exit And Alumni Surveys, Alison W. Hong-Novotney

Cal Poly Humboldt theses and projects

Student and alumni surveys have become some of the most widely-used methods of assessment of student learning in higher education. While the majority of literature on student surveys and assessment focuses on undergraduate students, this study looks specifically at why graduate student exit and alumni surveys can be valuable tools within a comprehensive assessment plan. Listening to the feedback of current and former graduate students, and then acting upon that feedback, is crucial for the engagement and success of this unique population of students who bring their particular strengths and needs to their educational experiences. This study examined how master’s …

Assessing Students’ Writing And Public Speaking Self-Efficacy In A Composition And Communication Course, T. Kody Frey, Jessalyn I. Vallade

Information Science Faculty Publications

One avenue for assessing learning involves evaluating self-efficacy, as this psychological beliefis a strong predictor of academic achievement. As such, the purpose of this study was to evaluate writing self-efficacy and public speaking self-efficacy in a composition and communication course. This course is structured to develop both writing and public speaking competencies; the research sought to determine whether students believed they were leaving the course feeling more confident in their capabilities within each respective academic domain. Results (N= 380) from pre- and post-test data suggest that students’ reported writing and public speaking self-efficacy significantly increased over the semester. Additionally, students’ …

Effect Of Experience Facilitating Problem-Based Learning (Pbl) On Physician Assistant Student Outcomes, Susan Hawkins, Anthony Goreczny, Nicole E. Brown

Internet Journal of Allied Health Sciences and Practice

Abstract

Purpose: The impact of prior problem-based learning (PBL) facilitation experience (measured by length of time facilitating) on student learning and student outcomes is unclear. The purpose of this study was to evaluate relationships of facilitator experience in problem-based learning on student outcomes. This study utilized both modified essay questions (MEQ) in the form of patient management assessments and multiple choice question (MCQ) assessments to evaluate different aspects of student acquisition and application of knowledge. Method: This study examined scores from six multiple choice question examinations and six patient management assessments (PMA), one each from six 5-week units …

Student, Instructor, And Observer Agreement Regarding Frequencies Of Scientific Teaching Practices Using The Measurement Instrument For Scientific Teaching-Observable (Misto), Mary F. Durham, Jennifer Knight, Emily K. Bremers, Jameson D. Defreece, Alex R. Paine, Brian A. Couch

School of Biological Sciences: Faculty Publications

Background: The Scientific Teaching (ST) pedagogical framework encompasses many of the best practices recommended in the literature and highlighted in national reports. Understanding the growth and impact of ST requires instruments to accurately measure the extent to which practitioners implement ST in their courses. Researchers have typically relied on students, instructors, or observers to document course teaching practices, but it remains unclear whether and how these perspectives differ from each other. To address this issue, we modified our previously published instrument to generate the Measurement Instrument for Scientific Teaching-Observable (MISTO), which can be completed by students, instructors, and observers, and …

Introduction: History And Conceptual Basis Of Assessment In Higher Education, Peter Ewell, Tammie Cumming

Publications and Research

Assessment and accountability are now inescapable features of the landscape of higher education, and ensuring that these assessments are psychometrically sound has become a high priority for accrediting agencies and therefore also for higher education institutions. Bringing together the higher education assessment literature with the psychometric literature, this book focuses on how to practice sound assessment.

This volume provides comprehensive and detailed descriptions of tools for and approaches to assessing student learning outcomes in higher education. The book is guided by the core purpose of assessment, which is to enable faculty, administrators, and student affairs professionals with the information they …

Enhancing And Evaluating Scientific Argumentation In The Inquiry-Oriented College Chemistry Classroom, Annabel D'Souza

Dissertations, Theses, and Capstone Projects

The research presented in chapters 2, 3, and 4 in this dissertation uses a sociocultural and sociohistorical lens, particularly around power, authority of knowledge and identity formation, to investigate the complexity of engaging in, supporting, and evaluating high-quality argumentation within a college biochemistry inquiry-oriented classroom.

Argumentation skills are essential to college and career (National Research Council, 2010) and for a democratic citizenry. It is central to science teaching and learning (Osborne et al., 2004a) and can deepen content knowledge (Jiménez-Aleixandre et al., 2000; Jiménez-Aleixandre & Pereiro-Munhoz, 2002). When students have opportunities to make claims and support it with evidence and …

Informal Order, Needs Analysis, And The Eap Curriculum, Faisal S. Al-Maamari

The Qualitative Report

The academic curriculum is developed through a systematic process whereby content is created through the alignment of needs to stakeholder or target group. This qualitative research study features a small-scale, English for academic purpose (EAP) needs analysis (NA) of three credit-bearing EAP programs and the corresponding departmental programs conducted at a Language Center at a higher education institution in Oman. Based on interview, observational and documentary data, the analysis showed divergences in academic literacy (writing and reading) between the EAP and content programs. Principally, the findings pointed to the presence and operation of a group of informal orders and the …