Educational Assessment, Evaluation, and Research Commons^™

Improving Student Engagement Despite Lowering Attention Spans In The Classroom, Kaycee Lee

Senior Honors Theses

Attention spans have been decreasing throughout society for many years, partially due to the constant increase of technological advances. The average human attention span of eight seconds is particularly concerning to teachers and others in the classroom. It does not seem that the average attention span is ever going to increase, so teachers must implement intentional methods and strategies within their classroom to keep their students’ attention. Physical activities, technology and hands-on supports, small group instruction, shorter lessons, making intentional mistakes, flexible seating, and differentiated instruction are all strategies supported by research to improve student engagement within the classroom. Every …

Variations In Student Approaches To Problem Solving In Undergraduate Biology Education, Jeremy L. Hsu, Rou-Jia Sung, Su L. Swarat, Alexandra J. Gore, Stephanie Kim, Stanley M. Lo

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Existing research has investigated student problem-solving strategies across science, technology, engineering, and mathematics; however, there is limited work in undergraduate biology education on how various aspects that influence learning combine to generate holistic approaches to problem solving. Through the lens of situated cognition, we consider problem solving as a learning phenomenon that involves the interactions between internal cognition of the learner and the external learning environment. Using phenomenography as a methodology, we investigated undergraduate student approaches to problem solving in biology through interviews. We identified five aspects of problem solving (including knowledge, strategy, intention, metacognition, and mindset) that define three …

M4-Intern Mentorship Project, Christian Freitag, Sahar Elmenini, Kyla Kosidowski

Medical Student Research Symposium

Wayne State University School of Medicine (WSUSOM) in 2018 formed Learning Communities (LCs), that facilitate student engagement, comradery, and mentoring. These programs include medical student-premed, near-peer, and faculty/attending mentorships. There has been an identified gap in mentorship between near-peer and faculty/attending mentorship, and that is near-peer mentors at WSUSOM have yet to complete the residency process to guide other students through it. Moreover, faculty/attending mentors are more removed from residency and may not have relevant advice for students. As resident physicians are recent graduates, they are more likely to provide relevant insight about residency applications, academic challenges, and efficiency than …

Assessment Of Breastfeeding Education In Medical Training, Saranya Madan, Abigail Kuplicki

Medical Student Research Symposium

In 2019, the Academy of Breastfeeding Medicine issued a revised set of educational objectives for medical trainees at various stages of education. In this statement, objectives for medical school were broken down into preclinical and clinical training objectives. In this project, our goal is to assess the degree to which medical training at Wayne State University School of Medicine is addressing these aims.

The assessment of breastfeeding education is accomplished by surveying medical students at various stages of training (M1-M4) and eliciting their level of confidence in and understanding of the topics outlined in the objectives by the Academy of …

A Multi-Year Longitudinal Study Exploring The Impact Of The Covid-19 Pandemic On Students’ Familiarity And Perceptions Of Active Learning, Briana Craig, Jeremy L. Hsu

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

The COVID-19 pandemic caused nearly ubiquitous emergency remote teaching in both secondary and post-secondary education. While there has been a plethora of work examining how instructors adjusted classes to incorporate active learning during emergency remote teaching, there has only been minimal work examining how such emergency remote teaching may have influenced students’ perceptions of active learning. Here, we conduct a longitudinal multi-cohort study at one institution across nine semesters before, during, and after emergency remote teaching due to the pandemic to explore how college students’ familiarity and perceptions of active learning have shifted over time because of the pandemic. Our …

Narrative World Building: Creative Applications For Gamification In Study Abroad, Ashley Lear

Publications

This study examined a cohort of 12 study abroad participants taking a course on video game topography and narrative in Salamanca, Spain, to determine how inhabiting and co-creating narrative worlds as part of the coursework might impact the experiences of the students inside and outside of the classroom as they engaged in mandated and optional cultural engagement activities, such as museum tours and excursions to historical sites. Students completed two gameful learning activities: 1) they co-created their own narrative game world in a group game proposal assignment drawing upon research from storytelling through game environments, and 2) they created independent …

Collaboration In East Africa: A Contextualised Approach To Defining The Construct, Claire Scoular, David Alelah Otieno

Assessment and Reporting

Collaboration has been highlighted internationally as a key skill for learning, working, and living in the twenty-first century. However, to teach it well, enhance its performance, and measure its growth, it is essential to have a clear and consistent definition of the skill. There are a number of frameworks that describe collaboration in a way that is meaningful to learning and growth. Despite some differences across frameworks, it is clear there is a common core set of contributing subskills. This suggests that collaboration is of global interest, and that there are components that transcend national or cultural specificities. Notwithstanding, definitions …

Revised Aba Standard 303: Curricular, Pedagogical, And Substantive Questions, Steven W. Bender

Seattle University Law Review SUpra

ABA accreditation standards now require law schools to provide education and training on racism, bias, and cross-cultural competence. This seemingly straightforward mandate raises numerous questions as schools plan for and implement compliance. Here, I articulate and approach these compliance questions using insights drawn from critical theory—which supplies helpful guidance for responses and ultimately antiracism legal education that is more than minimalist. Armed with critical insights, lawyers are better equipped to contribute to the struggle to eradicate systemic social ills in law and society.

Needs Assessment – National Repository For Nsf Agep Deliverables, Christie Sahley, Megan Sapp-Nelson, Donna Ferullo, Linda Mason, Hanzi Xie

Libraries Faculty and Staff Scholarship and Research

This white paper proposes the establishment of a National Repository for NSF Alliance for Graduate Education and the Professoriate (AGEP) Deliverables to address the critical need for preserving and sharing a wide array of materials generated from the AGEP program. Recognizing the challenges of ephemeral storage solutions and the absence of a unified collection mechanism, the paper underscores the repository's role in promoting justice, equity, diversity, and inclusion (JEDI) research. It emphasizes the importance of accommodating diverse data types, enhancing discoverability, and ensuring long-term access to educational materials, policy documents, and research outcomes. Through a comprehensive approach, the proposed repository …

The Santa Ana Youth Media Project: Ypar And Media Advocacy, Jorge F. Rodriguez

Education Faculty Articles and Research

The Santa Ana Youth Media Project (SAYMP) was born during the summer of 2019 and grew from a need, expressed by youth, for more critical media literacy that could further amplify and focus on narratives that reflect how youth navigate their personal, cultural-social, and economic environments. Our media projects consist of intentional participative research and journalistic designs that document stories using tools such as narrative inquiry, Youth Participatory Action Research (YPAR) and video/media production to visually capture the narratives of youth and community within the city of Santa Ana and its larger Orange County context. Our goal is to develop …

Engaging Students In A Genetics Course-Based Undergraduate Research Experience Utilizing Caenorhabditis Elegans In Hybrid Learning To Explore Human Disease Gene Variants, Natalie Forte, Virginia Veasey, Bethany Christie, Amira Carter, Marli Hanks, Alan Holderfield, Taylor Houston, Anil Challa, Ashley Turner

Research, Publications & Creative Work

Genetic analysis in model systems using bioinformatic approaches provides a rich context for a concrete and conceptual understanding of gene structure and function. With the intent to engage students in research and explore disease biology utilizing the nematode Caenorhabditis elegans model, we developed a semester-long course-based undergraduate research experience (CURE) in a hybrid (online/in-person) learning environment—the gene-editing and evolutionary nematode exploration CURE (GENE-CURE). Using a combination of bioinformatic and molecular genetic tools, students performed structure-function analysis of disease-associated variants of uncertain significance (VUS) in human orthologs. With the aid of a series of workshop-style research sessions, students worked in teams …

Starting The Journey To Excellence With A College Faculty Onboarding Program, Robin Cooper, Judith Slapak-Barski

HCAS Instructional Design and Pedagogy

The journey to engaged, excellent teaching requires support and preparation for those doing the teaching. In this session, we describe a college Faculty Onboarding Program we developed in 2023 to introduce our new Halmos faculty to NSU (Nova Southeastern University) and to Halmos, and to provide them with the resources and information needed to succeed in their new role—driven by the belief that effective onboarding will lead to higher job satisfaction, better job performance, greater organizational commitment, and reduction in stress. Informed by feedback from recently hired faculty, we identified support strategies to help new faculty thrive by proactively removing …

Does Removing Quizzes Impact Student Performance In An Online Course?, John Griffith

Publications

Data for 295 college online introductory statistics students were examined to determine if removing four module (weekly) quizzes impacted student performance on a cumulative exam. In this research, student performance was not significantly impacted by the removal of the quizzes. The difference in the exam mean score earned by the group of students who did not take quizzes was less than 0.8 of a point lower than the exam average for students who took the quizzes prior to the exam. Withdraw rates significantly declined from 5 percent to 1 percent. Results of this study support the idea that course designers …

National Assessment Program: Ict Literacy 2022: Public Report, Tim Friedman, Kate O'Malley, Zachary Watts, Kristy Osborne, Louise Ockwell, Laila Helou

ICT - Digital Literacy

This public report documents the findings of the sixth National Assessment Program ICT Literacy (NAP–ICT Literacy) assessment cycle. In reporting national key performance measures (KPMs) of Australian students’ ICT literacy, the NAP–ICT Literacy assessment provides a way to monitor progress towards the Alice Springs (Mparntwe) Education Goals for Young Australians. Goal 2 of the Alice Springs (Mparntwe) Education Declaration is that “all young Australians become confident and creative individuals, successful lifelong learners, and active and informed members of the community” (Education Council 2019, p. 6). The elaboration of this goal highlights the importance of young Australians’ digital and ICT literacy …

Noticing Instructional Challenges In Artifacts Of Teaching, Tara Barnhart, Elizabeth A. Van Es

Education Faculty Articles and Research

This study investigates challenges of enactment teachers notice when analyzing artifacts of teaching in a professional development focused on supporting the enactment of NGSS-aligned modeling instruction. Five secondary science teachers participated in a semester-long video club. Transcripts of the segments of their meetings in which they analyzed artifacts of practice were coded to characterize what they noticed in videos and student work samples from their own and others’ classrooms of students engaging in sensemaking. Through an inductive and iterative approach, three main linguistic challenges were identified related to the teachers’ noticing of students’ disciplinary thinking: learning how to communicate with …

Expressing Information Needs And Information Literacy Skills Amongst Final Year Undergraduate Students In Northern Nigeria, Zikrat Abdulsalam, Imoisili Ojeime Odigie

Library Philosophy and Practice (e-journal)

Information literacy is the ability of an individual to locate, evaluate, and use information. This study expresses the conscious information needs and information literacy skills amongst final year undergraduate students of three Universities in Nigeria; being the Ahmadu Bello University (ABU), Federal University Lokoja (FUL), and Baze University. A survey research design alongside a questionnaire for the instrument were utilised on a sample size of 307 final year undergraduate students from select faculties within the above-mentioned universities. The findings of the study amongst other show that undergraduate students at the final year level had a conscious knowledge of their information …

The Problem With Accreditation As An Extension Of Privilege And How To Fix It: Primer And A Roadmap For New Professionals, Aaron W. Hughey

Faculty/Staff Personal Papers

The accreditation system for colleges and universities is broken.

It has been broken for quite some time even though those on both sides of the equation refuse to acknowledge what has become increasingly obvious to those of us who work in the academy: Accreditation has evolved into a potent mechanism for perpetuating power structures that have become entrenched in the culture of higher education.

Peeling Away The Taken-For-Grantedness Of Research Subjectivities: Orienting To The Phenomenological, Melissa Freeman, E. Anthony Muhammad

Department of Curriculum, Foundations, & Reading Faculty Publications

Qualitative research is a multidisciplinary field of practice that acknowledges and values the situatedness and subjectivities of the researcher. Therefore, reflexively accounting for one’s subjectivities is a crucial part of a research report. Less discussed is how subjective understandings are historically, culturally, and socially mediated, often challenging researchers’ abilities to orient themselves critically to this self-reflective undertaking. Phenomenology is a philosophical approach investigating how phenomena such as subjectivity are constituted in experience. This makes phenomenology an essential resource for understanding how complex subjective responses manifest differently depending on one’s orientation to the situation. This paper aims to familiarize qualitative research …

French 203: Grammar & Conversation: A Faculty-Led Inquiry Into Reflective & Scholarly Teaching Benchmark Portfolio, Erica Schauer

UNL Faculty Course Portfolios

The following Benchmark Portfolio is the product of a full reassessment of FRENCH 203: CONVERSATION & GRAMMAR, an intermediate-level grammar course that serves as a prerequisite for students pursuing a major or a minor in French at UNL. Previously, French 203 had been a review course that covered the essential grammar structures discussed in 101, 102, 201 and 202 and invited students to practice these structures orally with peers in class. This new iteration of the course, however, seeks to broaden the reach of student comprehension of French as a functional tool of communication by requiring students to understand and …

The Concept Of Alterity: Its Usage And Its Relevance For Critical Qualitative Researchers In The Era Of Trump, E. Anthony Muhammad

Department of Curriculum, Foundations, & Reading Faculty Publications

Alterity is a concept with an extensive yet elusive history. Popularly conceived of as radical difference and Otherness, I identify alterity as the source of much of the virulent forms of racism, sexism, islamophobia, and other dichotomies in society that pit one group against another. Coming out of the tradition of critical qualitative inquiry, I offer a genealogy of the concept of alterity through various contexts and disciplines with a focus on its use in traditional Western philosophy. Within this tradition, the alteric relationship between the Self and the Other was typified by a preeminence bestowed upon the Self and …

Student Behavior Ratings And Response To Tier 1 Reading Intervention: Which Students Do Not Benefit?, Wilhelmina Van Dijk, Christopher Schatschneider, Stephanie Al Otaiba, Sara A. Hart

Special Education and Rehabilitation Counseling Faculty Publications

Core reading instruction and interventions have differential effects based on student characteristics such as cognitive ability and pre-intervention skill level. Evidence for differential effect based on affective characteristics is scant and ambiguous; however, students with problem behavior are more often non-responsive to core reading instruction and intensive reading interventions. In this study, we estimated the range of students' behavior ratings in which a core reading instruction intervention was effective using a data set including 3,024 students in K-3. Data came from seven independent studies evaluating the individualized Student Instruction (ISI) Tier 1 reading intervention and were pooled using integrative data …

Multilingual Zambia - Language Issues In Primary/Secondary Schools Of The Eastern/Southern Provinces, Kenzie Steiner

NUTR/GLST 498b: Global Research Experiences in Nutrition and Health

Introduction: Zambia is a multilingual country that uses 8 different languages for instruction including English and 7 other indigenous languages.

Methods: Survey research conducted between May-June 2022 on 6-7th graders within 9 Zambian schools. Classroom observations made and teachers interviewed.

Results: In Eastern and Southern Provinces, Zambian teachers speak an average of 5 languages while students speak an average of 2. Both teachers and students say English remains the most important language followed by first languages.

Conclusion: Continued research on language-in-education policies and impacts on student performance must be conducted if “One Zambia, One Nation” is meant to promote all …

Policy Analysis Of Girls’ Primary School Completion In Rural Sindh: Root Causes And Policy Recommendations Using Iiep Education Policy Toolbox, Sajid Ali, Aisha Naz Ansari, Mushtaq Ahmed, Zobia Israr Ahmed, Naveed Saleh Siddique, Naveed Ahmed Shaikh, Shazia Solangi, Mujeeb Rehman Khatri, Tauseef Lateef

Institute for Educational Development, Karachi

This report emerged from the policy analysis work produced as part of the course titled ‘Diagnostic tools for improving education policy planning’ by the IIEP-UNESCO with support from KIX. This course enabled us to explore diagnostic tools and their implications, specifically for developing countries, and helped the team unpack diagnostic tools and learn the history of their evolution. We further learned how the education management information system works and how data is essential for policy decisions. Finally, we engaged with real policy analysis using the IIEP Education Policy Toolbox. As a team, we chose to study the issue of girls’ …

知源育利用のガイド, Yoshihiko Ariizumi

Learning, Teaching, & Researching Optimization

知源育を応用するための様々な角度からのヒントを学ぶことができるガイドです。実勢んをしながら、時々このガイドを参照することで、より高いレベルでの実践が可能になるでしょう。

“I Can't Say It”! Doodling To Emancipate Adolescents' Voices In A Transformative Mixed Methods Study Of Covert Bullying In Jamaican High Schools, Ingrid Hunt-Anderson, Peggy Shannon-Baker

Department of Curriculum, Foundations, & Reading Faculty Publications

This article demonstrates the value of doodling as an emancipatory method to enhance mixed methods research studies. We draw from the qualitative phase of an exploratory sequential mixed methods study about covert bullying among high school students in Jamaica. This study was based in the transformative-emancipatory paradigm. The authors illustrate how students' doodles contributed to triangulating, expanding findings from the qualitative phase, and providing an emancipatory space for students’ voices. Lessons learned and recommendations are provided that demonstrate the applicability of doodling within mixed methods studies in educational psychology, developmental psychology, counseling, and applied psychology.

"The Positive Impacts Of A Professional Learning Community Model On Student Achievement In Small Schools", Christy Mariani-Petroze Dr.

Journal of Catholic Education Pre-Prints

This study explores the impact of professional learning communities on student achievement in a small school setting. Aaron Hansen’s book, How to Develop PLCs for Singletons and Small Schools, offered a guide for arranging vertical, grade-level teams with one teacher per grade level at one private, K-8 school. The faculty engaged in high quality, effective professional development using PLC objectives and norms to analyze NWEA MAP data. They adapted instructional practices and implemented formative assessments to influence student growth in math and reading scores. Results indicate that the PLC training that took place between the Fall and Winter MAP testing …

School Improvement Tool, Australian Council For Educational Research (Acer)

School and system improvement

Research shows the powerful impact that school leadership teams can have in improving the quality of teaching and learning. Effective leaders create cultures of high expectations, provide clarity about what teachers are to teach and students are to learn, establish strong professional learning communities, and lead ongoing school-wide efforts to improve teaching practices. The School Improvement Tool describes the practices of highly effective schools and school leaders. The SIT assists schools to review and reflect on their strategies to improve the quality of classroom teaching and learning. It supports school-wide conversations – including with families, school governing bodies, local communities, …

Prepaing Nursing Faculty For Next Generation Nclex: An Interactive Workshop, Rachel Loukota

DNP Research Projects

Abstract

Objective: The National Council of State Boards of Nursing (NCSBN) launched the next- generation NCLEX (NGN) in April 2023. Pre-licensure nursing faculty are unprepared for the change in teaching and evaluating nursing students' clinical judgment skills. Method: This was a quantitative workshop intervention with a pre-post survey. Intervention: Two-hour online and in-person workshops were held between August and October 2022 on how to create unfolding case studies following NCSBN’s clinical judgment measurement model. A template was created for use by participants, with samples to follow along. Results: There was a significant difference

in preparedness and confidence in those who …

Is It Actually Reliable? Examining Statistical Methods For Inter-Rater Reliability Of A Rubric In Graduate Education, Brent J. Goertzen, Kaley Klaus

Leadership Faculty Publications

When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the development of a scoring rubric. Various statistical measures of inter-rater reliability are presented and effectiveness of those measures are discussed. Our findings indicated that inter-rater reliability can be achieved in graduate scoring rubrics, though the strength of reliability varies substantially based on the selected statistical measure. Recommendations for determining validity and measuring …

“Why You Always So Political?”: A Counterstory About Educational-Environmental Racism At A Predominantly White University, Martín Alberto Gonzalez

Chicano/Latino Studies Faculty Publications and Presentations

Using critical race counterstorytelling, I tell a story about the experiences of Mexican/Mexican American/Xicanx (MMAX) undergraduate students at private, historically and predominantly white university in the Northeast. Drawing on in-depth interviews, participant observations, pláticas, document analyses, and literature on race and space and racism in higher education, I argue that the racially hostile campus environment experienced by MMAX students at their respective university manifests itself as a form of educational-environmental racism. Through narrated dialogue, Aurora (a composite character) and I delve into a critical conversation about how educational-environmental racism is experienced by MMAX students through a racialized landscape in the …