Educational Assessment, Evaluation, and Research Commons^™

Digital Solutions For Bridging Language Barriers: Designing And Testing An App For Construction Spanish Safety Communication On Construction Jobsites, Adrian Cappella

All Theses

Language barriers between English-speaking supervisors and Spanish-speaking workers create safety risks on U.S. construction jobsites. Hispanic workers face higher injury and fatality rates, with miscommunication being a major contributing factor. Existing translation tools lack the accuracy, cultural context, and jobsite relevance needed for effective safety communication.

In this study a mobile application with construction-specific safety phrases in English and Spanish was designed and field tested. The research included a literature review, phrase collection and validation with industry experts, application development and design with a computer science collaborator, and usability testing with supervisors and workers. Surveys and field trials measured navigation, …

Language Learner Literature: A Mixed Methods Study, Esmeralda Mora

Dissertations

This dissertation, Language Learner Literature: A Mixed Methods Study, by Esmeralda Mora, Ed.D., of National Louis University, specializing in Curriculum, Advocacy, and Policy, investigated the impact of shifting a Midwest high school world language department from a traditional, grammar-focused model to a proficiency-based approach centered on Language Learner Literature (LLL). Employing a Modified Explanatory Sequential Mixed Methods Design, the study first analyzed longitudinal AAPPL proficiency scores from 1,134 high school students (2020–2025) using T-tests and Multiple Linear Regressions to establish measurable outcomes (the "what"). This quantitative phase demonstrated significant and consistent gains in expressive skills (Writing and Speaking) post-LLL implementation, …

Exploring Student Confidence And Calibration Accuracy In College Algebra: A Mixed-Methods Explanatory Sequential Study, Courtney T. Hill

STEMPS Theses & Dissertations

Calibration, or students’ ability to predict and postdict their performance on an academic task, has important implications for academic performance. It can influence students' decision making processes concerning learning activities, as well as their levels of motivation and self-regulation (Kolovelonis, 2023). The literature on calibration is clear, often indicating that students are not great at these judgements (Lin et. al, 2001). While this phenomenon is well documented, it is not an easy one to explain. Therefore, a two-phase explanatory-sequential mixed method design was used to examine undergraduate students’ calibration judgements on a college algebra exam. To further contribute to the …

Predictive Factors Of Academic Success During Transition To Undergraduate Studies In Stem Programs In Kansas, Elizabeth L. Butler

Electronic Theses and Dissertations

In tThis dissertation the researcher exploreds the correlations between high school GPA, ACT Math, ACT cComposite scores, and first -semester GPA for first-time freshmen at a mid-sized university in the Midwest. This quantitative correlational study uses multiple regression analysis to discover correlations that may exist between these interval variables. Data for this study was collected through a request to the study site’s oOffice of pPlanning and aAnalysiss at the university and was all archival data at a record level for the students. Data had been collected through the admissions process and was stored in Banner and SLATE, both data management …

Art Teams Year 4 Annual (Ad Hoc) Report 2024-2025, Guy Trainin, Kimberley D'Adamo, Hyeonjin Yoon, Azadeh Hassani, Zohreh Tamimdari, Jiabin Lyu, Michael Nti Ababio, Sarah Trainin

Research and Evaluation in Education, Technology, Art, and Design

This report documents the fourth year of the Art TEAMS project, a multi-year professional learning initiative focused on arts-integrated, transdisciplinary teaching practices across Nebraska K-12 schools. During the 2024-2025 academic year, the project advanced work with its second cohort of educators while maintaining engagement with the first cohort to assess the sustainability of implementation. The second cohort brought increased diversity in art forms, including ceramics, digital media, and career and technical education, demonstrating the versatility of arts integration across curricula.

Year Four activities included delivering refined professional development courses grounded in emergent curriculum design, with significant curriculum modifications based on …

Exploring Student And Faculty Perceptions Of Website Credibility, Mark J. Viner Dr., Elizabeth S. Stewart Dr.

Intersections: Critical Issues in Education

This research investigation delves into the multifaceted realm of internet searches and online web pages, aiming to explore thoughts and opinions held by undergraduate students, graduate students, and faculty. Understanding how individuals navigate and interpret information online is crucial as the digital landscape evolves.

The study investigates the factors concerning users' choices in searching for information online and search results' perceived accuracy or validity. Additionally, it delves into users' perceptions of online content, examining their practices, credibility, and the sharing of information online with others.

By collecting and analyzing responses from undergraduate students, graduate students, and faculty, the research identifies …

Research Essay_Eng 110, Justine Matias

Open Educational Resources

This research essay assignment for English 110 (First-Year Composition) provides students with flexible topic options and multimodal format choices while teaching essential academic research skills including source integration, audience awareness, and rhetorical decision-making. Designed with Universal Design for Learning principles, the assignment includes extensive scaffolding and support materials to help multilingual and multicultural first-year students successfully navigate the research writing process.

The Grad's Playbook: Enhancing The Onboarding And New Student Orientation Experience, Debra Rodrigues, Elissa Lipke

Graduate Student Dissertations, Theses, Capstones, and Portfolios

Graduate students often describe the transition into their programs as both exciting and overwhelming. New Student onboarding and orientation play an important role in helping them feel prepared, connected, and supported, yet many universities still approach these processes in a limited way. This study explored how graduate onboarding can better address student needs by drawing on Maslow’s Hierarchy of Needs and Senge’s Five Disciplines of a Learning Organization.

Using a mixed-methods sequential design, the researchers invited 239 newly admitted graduate students to participate, of whom 65 consented and completed a post-orientation survey examining their feelings of preparedness, belonging, and confidence. …

The National Landscape On Wellness Culture And Well-Being Best Practices In Healthcare Systems And Academic Institutions: Results From The Fourth National Summit On Promoting Clinician Well-Being, Megan Amaya, Bernadette Mazurek-Melnyk, Josh Winn, Jeff Messinger

Journal of Wellness

Introduction: The health of our nation’s healthcare workforce continues to decline. A comprehensive, whole-system, evidence-based approach is key to a successful wellness initiative and is the foundation for culture change. Building a culture of wellness leads to better mental health outcomes, healthier lifestyle behaviors, higher levels of engagement and job satisfaction, improved patient satisfaction and employee retention, and a positive return (ROI) and value on investment (VOI).

Methods: The purpose of this cross-sectional, descriptive, anonymous survey was to assess the organizational wellness culture of participants who attended the National Summit on Promoting Well-being and Resilience in Healthcare Professionals. …

More Than A Monolith: Parental College Aspirations, Adolescents’ College Expectations, And Postsecondary Enrollment Among Asian Adolescent Immigrants, Rian R. Djita

Education Reform Faculty and Graduate Students Publications

Studies that are centered around social mobility and educational attainment have shown that educational aspirations and expectations play a critical role in an individual's future success. However, there are only a few analyses that focused on ethnic minorities or immigrants, particularly among Asian populations. These few studies about Asian American families tend to "lump" Asian immigrants as a monolithic ethnic group. This study seeks to bridge this gap by understanding different educational aspirations among immigrant parents from various Asian subgroups concerning their children's postsecondary enrollment in the U.S. Utilizing the High School Longitudinal Study of 2009 (HSLS:09), a nationally representative …

Leveraging Consistency: Evaluating Ai Coders For Qualitative Research, Saríah López-Fierro, Carlos Chiriboga-Calderón, José López-Fierro, Rubén Pacheco-Villamar

Instructional Technology and Learning Sciences Faculty Publications

This study provides insights of using Large Language Models (LLMs) for deductive coding tasks in market research. Deductive coding, which applies predefined codes to text, often demands consistency rather than interpretive nuance. 

We compare five closed-weight LLMs with a group of human coders in tagging instances of “Expansive Framing” across qualitative excerpts, using Fleiss’ Kappa, ANOVA, and Estimated Marginal Means. Results reveal that LLMs exhibit higher consistency and faster processing than humans. These findings suggest that integrating LLMs can improve efficiency, making them an attractive asset for firms managing large datasets.

Development Of Pack-Based Learning Outcome Tests For The Mechanical Engineering Education Study Program Of Teacher Professional Education, Dwi Agus Sudjimat, Darmawan Satyananda

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study aims to develop a learning outcome test instrument based on Pedagogical and Content Knowledge (PACK) for students of the Teacher Professional Education Program (PPG) in the Mechanical Engineering Education Study Program (Pendidikan Teknik Mesin, PTM) at Universitas Negeri Malang. The background of this study is based on the need for an assessment that can measure the integration of content knowledge, pedagogy, and technology in accordance with the demands of the Industry 4.0 era. The test development method follows psychometric procedures, including planning, writing, and validating test items, field testing, analyzing test items, and finalizing the instrument. …

The Impact Of Teachers' Mathematics Qualifications On Student Proficiency, Riaz H. Zaidi

Dissertations

Schools across the United States face persistent challenges in strengthening mathematics and science education. The present study investigates the relationship between mathematics teachers’ qualifications and their students’ performance on standardized assessments, using data from a Midwestern urban school district’s ACT mathematics scores. Findings are discussed within the broader context of Science, Technology, Engineering, and Mathematics (STEM) education and national efforts to enhance competitiveness among industrialized nations. Despite the presence of leading universities and colleges, U.S. students continue to rank near the middle internationally in math and science achievement, according to the Pew Research Center. Contributing factors include disparities in teacher …

Farm Tour Evaluation Tool For Agricultural Awareness, Hannah Eason, Jessica Ryals, Yvette Goodiel, Lauren Butler, John Diaz, Marilyn Swisher

Journal of Extension

Educational farm tours offer learning opportunities that cannot be duplicated in a classroom setting. Developing a consistent farm tour evaluation tool is paramount to quantifying individual Extension farm tours while also providing a common platform to measure outcomes and impacts nationally and over time. An IRB-approved farm tour evaluation tool was developed to capture agricultural awareness and used to evaluate the 2022 National Association of County Agricultural Agents Annual Meeting/Professional Improvement Conference (NACAA AM/PIC) tours. The evaluation tool attempts to quantify farm tour outcomes and impacts and demonstrate the value of agriculture to decision makers, consumers, and community members.

A Rubric For Self-Assessment Of Extension Impact Statements, Gordon B. Jones, Mary L. Halbleib, Leanne S. Giordono

Journal of Extension

Writing effective impact statements is key to documenting outcomes of extension programs, but the process can be a challenge for faculty and administrators. We created a rubric which faculty can use to guide their drafting of statements or for self-assessment of statements. We shared and demonstrated the rubric with Oregon State University Extension Service colleagues and found that it stimulated their thinking on the topic. We encourage Extension units to build on or revise this template to meet their own evaluation and assessment needs.

Teacher Dexiotita And Student Literacy: Building A Literacy Ecosystem In Elementary Schools In East Kupang Sub-District, Kristina E. Noya Nahak, Lanny Isabela Dwisyahri Koroh

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The declining trend of Indonesian students' literacy competence has prompted researchers to examine how teachers' Dexiotita (competence) fosters literacy ecosystems within educational institutions. This inquiry also explores the relationship between students' Dexiotita (competence) literacy and teachers' Dexiotita (competence). A descriptive qualitative method, employing a case study approach, was utilized to examine phenomena in three schools located in the Kupang district of East Kupang sub-district. These schools were selected based on their representation of a diverse sample, with three schools each having a principal, 18 classroom teachers, and 225 students.The data collection process involved interviews, observations, and documentation, with the data …

Why Indigenous Children's And Young Adult Literature Matter

Occasional Paper Series

No abstract provided.

The Healing Power Of Diverse Voices, Brian Lee Young

Occasional Paper Series

No abstract provided.

The Role Of Native And Non-Native Teachers In Selecting Children’S Literature By Native Authors, Trisha Moquino, Katie Kitchens, Laini Szostkowski, Tiffany Jewell, Debbie Reese

Occasional Paper Series

Our contribution to the Occasional Paper Series is driven by the editors request for articles that will provide readers with an opportunity to learn how to use Indigenous Children’s and Young Adult Literature (ICYAL) texts responsibly. In our experience, children encounter far too much anti-Indigeneity in literature, and therefore the classroom.. Before using a book, a teacher must select the book they plan to use in the classroom. If the teacher is seeking to “provide opportunities for students to develop interpersonal relationships between real live kids and those who live only on the page,” (Leitich Smith, 2020) we think it …

Kryptonian Frybread, Byron Graves

Occasional Paper Series

No abstract provided.

“We Sing Too:” Pedagogical Approaches For Listening To Children In Indigenous Picturebooks, Rachel Stubbs, Anja Dressler Araujo, Kari Dressler, Jadyn Fischer-Mcnabb, Aubrey Hanson, Erin Spring

Occasional Paper Series

This article explores how storytelling, particularly through picture books, facilitates learning across boundaries of age, culture, gender, and education. In this article, we emphasize the value of picture books in integrating Indigenous oral traditions into the classroom, highlighting how these texts foster a reciprocal relationship between listener and storyteller. By focusing on the act of listening, our article argues that Indigenous picture books require active participation and decentering of the individual, positioning listeners as part of a larger collective. This article also underscores the importance of viewing children as active, responsible, and agential members of their communities, aligning with Indigenous …

Making Connections To The Local: Exploring The Role Of Indigenous Literature In Early Childhood Education, Lori Huston, Dr. Jan Hare, Ashleigh Janis, Leigh Kweon

Occasional Paper Series

Indigenous children's literature is a vital resource for nurturing cultural understandings and appreciation from an early age for both Indigenous and non-Indigenous children. This paper presents insights gathered from a workshop titled "Nurturing Indigenous Childhoods Through Themed Picture Books: Making Connections to the Local," which emerged as a culmination of our collaborative work on a massive open online course (MOOC) centered on Indigenous pedagogy in early childhood education. We curated a list of Indigenous children's books and engaged in discussions on the significance of Indigenous literature in nurturing cultural identity and literacy learning. In doing so, we aspired to create …

The Legacy Of Language: Indigenous Language In Children’S Fiction, Christine Hartman Derr

Occasional Paper Series

Generally speaking, storytelling is an honored tradition in many Native communities. I use the term generally with a disclaimer. There are currently 574 federally recognized tribal Nations on the land presently known as the United States of America. There are additional Native Nations recognized at the state level and tribal Nations left unrecognized. Each Nation has its own culture, language, traditions, and beliefs. The statements made in this paper could not be universally applicable to all Indigenous communities. There is no monolithic Native perspective that could adequately represent every Native Nation, nor should there be. We celebrate our differences as …

Nurturing Authentic Indigenous Voices In Indigenous Children’S And Young Adult Literature: An Aotearoa New Zealand Case Study, Nicola Daly, Julie Barbour, Darryn Joseph, Te Kani Price, Pania Tahau-Hodges, Kawata Teepa, Nic Vanderschantz, Eboni Waitere, Bryony Walker

Occasional Paper Series

At the heart of decision-making in children’s literature is the publisher who decides whose stories are told and how (Encisco et al, 2010). There is some research concerning inclusivity practices in the children’s literature that we see in libraries, homes and publishing houses (Caple & Tian, 2022; Daly, Vanderschantz, Mitchell & Blair, 2025; Daly, 2021; Stagg Peterson & Robinson, 2020). There is, however, little work examining how the publishing process can contribute to increased diversity in children’s picturebooks, particularly in relation to Indigenous languages and cultures. International research shows that there is limited cultural and linguistic diversity evident in children’s …

An Indigenous Feminist Reading Praxis For Imagining Anti-Colonial Futurities: Honouring The Spirit And Intent Of Katherena Vermette’S Writings, Jennifer Brant, Erenna Morrison, Jasmine Rice, Gayatri Thakor

Occasional Paper Series

We conceptualize Indigenous literatures as integral tools for supporting teachers on their journeys toward truth and reconciliation. As such, we intentionally offer our work as a pedagogical guide for introducing Indigenous Children’s and Young Adult Literatures (ICYAL) in secondary level English courses, asserting that the delivery of such works must be taught in ways that align with anti-racist praxis, acknowledge varied experiences of racism, sexism, and gender-based violences, and promote liberatory thinking. Indeed, while Indigenous literatures are excellent pedagogical tools to engage conversations about social justice and anti-Indigenous racism, they must be paired with key lessons that dismantle harmful, disrespectful …

Introduction: Why Indigenous Children’S And Young Adult Literature Matters, Joaquin Muñoz, Dawn Quigley

Occasional Paper Series

No abstract provided.

The World Doesn’T Look Just One Way, Kim Spencer

Occasional Paper Series

No abstract provided.

Shared Voices: How Pk-16 Leaders Perceive School University Partnership Alignment With Caep Standards, Ann-Marie Hancock

Doctoral Dissertations

This mixed-methods study examined PK–16 leaders’ perspectives regarding the alignment of an educator preparation provider (EPP) with the Council for the Accreditation of Educator Preparation (CAEP) Standards 2 (Clinical Partnerships and Practice) and 5 (Quality Assurance System and Continuous Improvement). Data were collected through a researcher-designed survey and semi-structured interviews with principals, district administrators, and university leaders. Survey results provided descriptive insights into stakeholder perceptions, while interviews offered deeper contextual understanding of the strengths and challenges within school–university partnerships. Findings indicated that leaders valued residency programs and recruitment pipelines as key strengths, highlighting the mutual benefits of sustained clinical partnerships. …

Navigating Undergraduate Research In The Digital Era: A Qualitative Analysis Of Faculty Digital Practices And The Visibility Of Undergraduate Research Opportunities, Danielle Rukezo, Laamiah Mansuri, Southern Mullen, Madison Millen

Undergraduate Scholarly Works

This project examines undergraduate students’ experiences with research and the ways participation in undergraduate research supports academic, professional, and personal development.

Evaluating Student Proficiency In Quantitative Reasoning, Gabriel Chavez, Jennifer Clinkenbeard, Tolga Tezcan, Celine Pinet, Jennifer Duggan, George Beckham, Sumadhur Shakya, Christina Zhang

Numeracy

Quantitative Reasoning (QR) competencies are increasingly vital for academic and professional success across disciplines. This study examines the QR proficiency of over 400 undergraduates through a mixed-methods approach, integrating survey-based self-assessments (n = 469) with direct evaluations of final exams (n = 80). This study took place at a public, primarily undergraduate, four-year state university in Northern California with approximate enrollment of 7,500 students. Although students reported frequent engagement in foundational QR tasks— such as calculation and interpretation—rubric-based scoring revealed inconsistent levels of mastery, particularly on higher-order skills like evaluation and coherence. Regression analyses linked confidence to calculation …