Educational Assessment, Evaluation, and Research Commons^™

Setting Standards For Engineering Writing. Supplementary Information [Data], Hidden For Review

Higher education research

We present an approach to defining minimum standards of written communication for engineering graduates based on the evaluation of writing samples by industry personnel. Communication skills are widely recognised as core graduate capabilities; however, universities often lack explicit, evidence-based standards aligned with industry expectations. This study applies the borderline group method of empirical standard setting to elicit judgement from industry professionals who supervise graduate engineers. Participants evaluated samples of student writing in two common engineering genres, technical report executive summaries and emails, using dichotomous acceptability judgements supported by evaluations of structure, content and expression. We present a validated framework, supported …

An Investigation Into The Impact Of Open Educational Resources (Oer) On Postsecondary Student Outcomes, Amber Mullens

Graduate Studies Theses and Dissertations 2026

Increasing higher education costs are a concern for policymakers and the American public. In 2024-25, undergraduate students paid on average $1,290 for books and supplies (College Board, 2024). These costs have led policymakers and educators to advocate for the use of open educational resources (OER). OER are teaching and learning materials that are in the public domain or licensed under copyright allowing no cost access, reuse, repurpose, adaptation, and redistribution (UNESCO, 2019, p. 5). While research has demonstrated OER use significantly reduces costs for students, less is known about OER's impact on student academic outcomes. Despite significant research on these …

Holistic Review In Graduate Admissions: Admissions Professionals’ Evaluation Of Non-Cognitive Traits, Joshua L. Olson

Graduate Studies Theses and Dissertations 2026

This basic qualitative study examines how graduate admissions professionals conceptualize, operationalize, and interpret holistic review within graduate admissions processes. Guided by Social Cognitive Theory and Expectancy-Value Theory, the study explores how non-cognitive traits such as motivation, resilience, self-efficacy, and professionalism are evaluated alongside traditional academic indicators in admissions decision-making. Using semi-structured interviews with graduate admissions professionals directly involved in admissions decisions, the study identifies how holistic review is defined and implemented across institutional contexts, which non-cognitive traits are most valued, and the tools and procedures used to assess applicant potential beyond academic metrics. Findings suggest that, for participants in this …

The Retrograde Pendulum: Reversing Course On Standards-Based Grading, Jay C. Percell

Faculty Publications - College of Education

This commentary details one large, suburban school district that, after a decade-long commitment to implementing standards-based grading (SBG), reversed course, abandoned the initiative, and returned to traditional grading. This article provides a postmortem of the ambitious reform effort, drawing upon previous research and recent district survey data from teachers and parents. Among the factors leading to the reform's reversal are that, despite a carefully planned, multi-year rollout, the initiative was unable to resolve persistent concerns about implementation inconsistency, student motivation, and the technology reporting platform. Internal pressures were exacerbated by external turmoil, including personnel turnover and the COVID-19 pandemic, and …

Children's Peer Selection In Stem: The Influence Of Gender, Ethnicity, And Disability, Meagan Girard, Kim P. Roberts

Theses and Dissertations (Comprehensive)

The present study examined how children’s peer selection in STEM (science, technology, engineering, and mathematics) may be influenced by gender, ethnicity, and physical disability. Sixty-four children (ages 6-12) from elementary schools in Southwestern Ontario completed three tasks: a simulated peer selection task, an attribution of ability task, and a stereotype belief questionnaire. In the peer selection task, participants were repeatedly asked to select one peer from a set of AI-generated photographs showing children who differed by gender (male, female), ethnicity (White, Black, East Asian), and physical disability status (able-bodied user vs. nondisabled). The Peer Selection Task was based on the …

The Impact Of Student Achievement On Economic Growth: A Pisa-Based Analysis Of Gdp Per Capita, Emma Rose Nasr

Undergraduate Theses and Capstone Projects

This study investigates the extent to which international student achievement, measured through PISA assessments in mathematics, reading, and science, explains cross-country differences in economic development. Using an unbalanced panel data set combining PISA results from 2015, 2018, and 2022 with macroeconomic indicators from the World Development Indicators, I estimate multiple regression models, including pooled OLS, country and time fixed effects, and subsample analyses for developed and developing countries. Results from the pooled model indicate strong positive associations between PISA scores and GDP per capita, consistent with human capital theory. However, these relationships diminish under fixed effects specifications, suggesting that cross-country …

Students' Perceptions Of The Elective Modules: A Multicentre Study From Institutions Of Northwest India, Reshu Gupta, Shrishti Upadhyay, Praveen Singh

Health Professions Education

Purpose: Evaluation of students’ perception of the newly introduced Electives Module by the National Medical Commission, India, within the curriculum of competency-based medical education, effective from admission batch 2019, by gathering their feedback and opinions to assess the effectuation of the program.

Methods: A cross-sectional study was conducted among Phase III Part II MBBS students of admission batches 2019 and 2020 at two medical institutions in Jaipur, a city in Rajasthan, India. The perceptions were evaluated via a questionnaire designed in alignment with the objectives of the elective modules of the National Medical Commission of India and included …

Systematic Review Of Early Childhood And Pre-Primary Education, Anna Dabrowski, Yung Nietschke, Syeda Kashfee Ahmed, Michelle Hsien, Dan Cloney, Tim Friedman

Early Childhood Education

This systematic review synthesises global evidence from academic and grey literature published between 2015 and 2025, examining effective policies and interventions aimed at increasing ECCE participation across diverse country contexts, with a focus on equity dimensions such as gender, disability, socio-economic status and geographic location. The multifaceted nature of increasing ECCE participation is highlighted, exploring institutional, interventionist, preventative, and compensatory policies as per the GEM policy typology, while emphasising equity, quality, and contextual factors. These categories reflect the different levels and areas within which policies operate, noting that in practice, approaches to increase ECCE participation often are combined or overlap.

Examining Teachers’ Data Usage Using The Teacher Data Use Survey, Natasha L. Hawkins

Graduate Studies Theses and Dissertations 2026

The United States spends approximately 2.7 billion dollars on classroom assessments and local exams for K-12 students (SIMBA, 2019).  However, despite this financial investment and the adoption of data-driven frameworks such as Multi-Tiered System of Support, the U.S. Department of Education found that only 55% of teachers used student data to make instructional decisions (U.S. Department of Education, 2007).  This study aims to explore the psychological and organizational factors that influence teachers’ data use when making instructional decisions.

This study used the Teacher Data Use Survey (TDUS) to investigate the extent that teachers’ use of data could be predicted by …

Perspectives Of Rural Educators On The Dependencies And Drawbacks Of Chat Gpt In Nigerian Higher Education Practices, Adedayo Olayinka Theodorio Dr, Francisca Jumoke Theodorio, Olumide Gbenga Olugbodi, Peter Adebowale Samson, Olusegun Olawale Olakotan

Journal of Educational Technology Development and Exchange (JETDE)

ChatGPT remains a valuable tool for transforming teaching strategies and supporting students’ comprehension of subject matter. However, its adoption and research remain uneven within the context of higher education in Nigeria. Specifically, there is limited empirical research that exemplifies real-world experiences regarding the dependencies and drawbacks in rural educational settings. This qualitative single-case study explored this phenomenon at a southwestern institution in Nigeria, involving a purposively selected group of educators. Data were gathered through participatory observation and focus group interviews, which were thematically analysed. The results indicated that the effective use of ChatGPT in rural higher education heavily depends on …

Robust Linking Estimation In Item Response Theory Using Quantile Regression: Applications To The Graded Response And Generalized Partial Credit Models, Ibrahim Almansour

Graduate Studies Theses and Dissertations 2026

This dissertation investigates robust estimation of linking coefficients in Item Response Theory (IRT) using quantile regression and its extensions. Linking procedures are essential for placing item and ability parameters from different test forms onto a common scale, thereby ensuring comparability of examinee scores across administrations. Traditional approaches such as moment methods, characteristic curve methods, and mean-based regression procedures like Ordinary Least Squares (OLS) and Generalized Least Squares (GLS) perform adequately under ideal conditions but tend to lose accuracy when ability distributions deviate from normality or include outliers.

To address these limitations, this research proposes a quantile-based regression framework that estimates …

Academic Integrity In The Age Of Ai: A Student's Guide To Citation And Disclosure, Steve Baule

Essays in Education

The rapid emergence of generative artificial intelligence (AI) has reshaped academic work, creating new opportunities for learning while introducing complex challenges for maintaining academic integrity. This article presents a clear, practical three question framework to help students determine when and how to disclose AI use in their coursework. Grounded in principles of transparency and intellectual honesty, the framework consists of three guiding questions addressing AI‑generated content, meaningful process support, and purely mechanical assistance. Through detailed explanations and real‑world scenarios, the article clarifies distinctions among these categories and outlines appropriate citation and disclosure practices for each. It emphasizes that AI use …

Critical Analysis Of Legal Education: Faculty Perspectives Of Law School's Role In Producing Practice-Ready Graduates, Sophia M. Akel

Graduate Studies Theses and Dissertations 2026

Legal education has long been the subject of harsh, widespread criticism due to concerns about its ability to adequately prepare students for legal practice. Newer attorneys have reported feeling incapable of performing even the most basic functions of their job after graduation from law school (Merritt & Cornett, 2020). Despite this troubling reality, law schools largely continue to function as they always have (Cramton, 1981). To gain insight directly from important figures in legal academia, this study examined law faculty perceptions on legal education’s role in producing practice-ready graduates. A mixed-methods survey design incorporating both quantitative descriptive and qualitative elements …

The Teacher Shortage Crisis: How Workplace Relationships Influence Retention, Attrition, And The Education Labor Market, Jeremy Brooks

University of the Pacific Theses and Dissertations

This study took a closer look at how high school teachers perceive the ongoing teacher shortage, with particular attention to how workplace conditions and the broader school climate impact whether they choose to stay in the profession. Special focus was given to teachers in their first five years, a group especially vulnerable to early attrition. As the conversation around teacher turnover grows louder, this research seeks to better understand what’s driving teachers’ decisions from their own perspectives, not just policy data or administrative assumptions.

The study used a basic qualitative research design, relying on one-on-one, in-depth interviews to gather insights …

Empowering Equity: Latinas In Leadership – Navigating Work-Life Balance In The Post-Pandemic Era, Teresa Excinia

University of the Pacific Theses and Dissertations

This dissertation explored the lived experiences of Latina leaders as they navigated how cultural expectations influenced work–life balance in the post-pandemic era. The COVID-19 pandemic reshaped workplace dynamics, blurring boundaries between professional responsibilities and personal life. For Latinas, these challenges were compounded by cultural expectations that shaped their roles both at home and in the workplace. The purpose of this study was to understand how Latina leaders managed the dual pressures of balancing career demands with cultural and familial obligations. Using Testimonio as the methodological framework, this study captured the voices and narratives of Latina leaders across industries, offering an …

Guidelines For Automatic Grading Of Student Essays Using Large Language Models, Diwakar Yalpi, Sruta Keerti Kasula, Ravi Mukkamala

Computer Science Faculty Publications

Automated essay evaluation using large language models (LLMs) has emerged as a promising approach to support scalable and consistent educational assessment. However, the effectiveness of LLM-based grading varies significantly across evaluation dimensions and is highly influenced by prompt design and model selection. In this study, we evaluate five state-of-the-art LLMs across five rubric-based categories: Relevance to Question, Reasoning and Critical Thinking, Evidence and Examples, Organization, and Clarity and Writing Quality. We systematically investigate the impact of three prompting strategies, including rubric-only prompting, exemplar-based prompting (with and without rubric guidance)(Original and Refined prompt designs) incorporating structured instructions. Additionally, a prompt ablation …

Academic Outcomes Of Associate Degree Transfer Students From Selected Two-Year Campuses To A Public Urban Research University In The Northeast U.S: An Empirical Analysis Using Administrative Unit Record Data, Michelle Bianchi

Electronic Theses & Dissertations (2024 - present)

This study examined academic outcomes for associate degree transfer students at an urban, public research university in the Northeast United States. In particular, this study examined differences in rates of retention, rates of graduation, and cumulative upper-division grade point average (GPA) at graduation between associate degree transfers and direct-entry undergraduates at the same institution, taking into account the two-year college attended. This approach provides a lens into campus effects, considering the profiles of associate degree transfers from identified two-year colleges to search for similarities and differences in academic outcomes for transfers by two-year college attended.

The study relied on student-level …

Negotiating Quality: A Critical Discourse Analysis Of American Higher Education Policy, John A. Foisy

Electronic Theses & Dissertations (2024 - present)

This qualitative study examined how institutional quality is constructed, communicated, and negotiated through the accreditation process in U.S. higher education. Drawing on a multiple case study design, the research analyzed accreditation-related documents from eight institutions undergoing reaffirmation, including self-study reports, peer review team reports, Commission action letters, and institutional responses. The study was guided by three research questions: (a) What institutional signals of quality are evidenced in self-studies? (b) In what ways does the accreditation process represent a negotiation between accreditors and institutions? (c) What implied views of institutional quality emerge from accreditation discourse?

The study employed a multilayered analytical …

Student Support In Civil And Environmental Engineering, Heather Marie Rice

Graduate Theses, Dissertations, and Problem Reports (ETD)

Many student support services target first-year engineering students to help improve their transition from high school to college and to reach first-year retention goals. These opportunities are communicated to students through a variety of ways. The objectives of this work are to evaluate student perspectives of student services support factors in a civil and environmental engineering program and investigate how student support services and opportunities are communicated to students in a civil and environmental engineering program. The media identified for student support service outreach were the fundamentals of engineering program newsletters, academic advising newsletters, Statler eNews newsletters, and the bulletin …

The Impact Of Flight Instructor Feedback On Subsequent Instructor Evaluations Of Student Performance, Ayhan Rozyyev, Jennifer E. Thropp

Journal of Aviation/Aerospace Education & Research

This study examines the impact of feedback tone and feedback order on flight instructors’ evaluations of student performance in an aviation training context. Using a 2×2 mixed factorial design, 40 certified flight instructors reviewed fictitious training records and rated students based on feedback that varied in tone (positive vs. negative) and order (positive-first vs. negative-first). Results showed that positive feedback significantly influenced evaluations across all measured dimensions, while feedback order had no significant effect, challenging assumptions about primacy and recency effects. These findings highlight the role of positive reinforcement in shaping instructor evaluations and suggest that structured training environments can …

Utilising Video Recordings To Assess Student Pilot Performance: An Exploratory Study During A Simulated Training Flight, Bradley Moncion, Shi Cao, Allison Lynch, Suzanne K. Kearns, Elizabeth Irving, Ewa Niechwiej-Szwedo

Journal of Aviation/Aerospace Education & Research

In ab initio flight training, the quality of the feedback a flight instructor provides their student is essential to their success. While other high-performance and safety-critical industries have incorporated the use of video recordings into training and assessments, the aviation industry generally has not. There are some studies addressing the potential benefits of video recordings in training professional pilots, but there is a lack of research at the ab initio level. In this study, five flight instructors assessed the performance of student pilots conducting a simulated training flight using a 4-point marking scale. The flights instructors were then tasked with …

The Impact Of Rti On Ninth Grade Reading Success, James Dailey

Murray State Theses and Dissertations

Graduation rates are an important component of a school’s progress report card, published by the state’s department of education.  Ensuring that students have the resources and supports that they need in order to be successful is paramount to a school’s ability to provide quality educational services for their students.  Research published by the Center for High School Success (2020) indicates that students entering their freshman year of high school are twice as likely to drop out of school for being academically behind compared to their peers. For students to receive the support that they need to help them close their …

Academic Growth From Preact To Act: The Influence Of Socioeconomic Status And Attendance In A Rural Alabama High School, Stacy L. Tinch

Murray State Theses and Dissertations

The purpose of this quantitative correlational study was to examine academic growth from the PreACT to the ACT among students attending a rural public high school in Alabama and to investigate whether socioeconomic status (SES) and attendance were associated with differences in that growth. Guided by Opportunity-to-Learn Theory, the study explored whether students demonstrated academic growth during high school and whether SES, attendance, or the interaction between these variables influenced growth outcomes. Archival student-level data were collected from four graduating cohorts. The final sample consisted of 384 students with complete records for PreACT scores, ACT scores, attendance, and socioeconomic status. …

Teaching Effectiveness On Secondary Mathematics: Evidence From Pisa—Shanghai-China, Ting Shen

Psychological Science Faculty Research & Creative Works

Educational researchers and policymakers around the world have a strong interest in understanding the underlying reasons for the remarkable academic achievement of Chinese students in the Programme for International Student Assessment (PISA). Although teachers have a significant impact on student achievement, empirical evidence on teaching effectiveness in the Chinese education system has been scarce. This study uses the PISA 2012 Shanghai-China data and employs both multilevel models and quantile regression models to investigate effective teaching factors and their differential effects for students at different mathematics achievement levels. The results reveal the importance of cognitive activation and disciplinary climate as consistent, …

Advancing Data Extraction Workflows For Single-Case Design Meta-Analysis Using Large Language Models, Yaosheng Lou

Electronic Theses & Dissertations (2024 - present)

Single-case experimental designs (SCEDs) are a form of longitudinal research that is particularly valuable for studying marginalized and underrepresented populations. Meta-analysis plays an essential role in synthesizing evidence across studies and enhancing the generalizability of findings. However, as interest in SCEDs grows and the evidence base expands, conducting meta-analyses has become increasingly labor-intensive and time-consuming. This dissertation addresses these challenges by examining the applicability of large language models (LLMs) for data extraction and meta-analytic dataset compilation in the context of SCED meta-analysis. Because LLM performance is influenced by model selection, prompt design, and the specific materials being extracted, this dissertation …

Developing A Framework To Enhance Medical Student Well-Being: A Cross-Sectional Study Exploring The Interplay Between Stress, Resilience, And Quality Of Life, Omayma Hamed, Elshaimaa Ahmed, Lamiaa Mohsen, Patricia S. Sexton

Health Professions Education

Purpose: Medical training imposes significant stress on students, often leading to burnout, anxiety, and/or diminished quality of life (QoL). Resilience has been identified as a critical factor in mitigating these challenges. However, there is limited research examining how stress and resilience interact to shape QoL in undergraduate medical students. This study expands upon Lazarus and Folkman’s Transactional Model of Stress and Coping by introducing a synthesized framework that integrates resilience as both a mediator and moderator of stress, advancing the understanding of these relationships.

Methods: A cross-sectional study was conducted among 194 first- and second-year medical students at a private …

How Educational Leaders At A Type C International School In China Understand Educational Leadership, Peter Pagett

Theses: Doctorates and Masters

This study examined how educational leaders at a Type C international school in China understand educational leadership. The extensive knowledge on educational leaders identifies many important facets of this phenomenon, such as the importance of leaders focussing on mission and vision and building relationships. Current understanding also highlights the role of personal identity in influencing a leaders’ work and understandings. However, literature on educational leadership in the context of international schools is scant. Given the challenges specific to international education such as culture shock, transience and isolation there is a need to conduct more research into these types of schools. …

From Deference To Dialogue: How International Gtas From High Power Distance Cultures Adapt To U.S. Classroom Dynamics, Deborah Akua Afi Appiah

Theses and Dissertations

International graduate teaching assistants (GTAs) from high power distance cultures play a significant role in undergraduate education at U.S. universities, yet they face challenges that go well beyond language proficiency. Coming from educational backgrounds where teacher authority is unquestioned and hierarchical, these GTAs must navigate American classrooms that operate on fundamentally different assumptions, where authority is earned rather than assumed, informality is the norm, and students expect to question, negotiate, and be personally known by their instructors. The present study examined how eighteen (18) international GTAs from seven (7) high power distance countries perceived and adapted to these differences while …

Examining Challenges For Sociology Master’S Degree Students At California State University, David Ortuno

University of the Pacific Theses and Dissertations

The purpose of this study is to identify the lived experiences of CSU sociology graduate students pursuing a master’s degree. Seven sociology graduate students from six of the eight (75%) total sociology MA programs throughout the entire CSU system were interviewed. Their responses were designed to analyze the support systems and challenges they face while pursuing a master's degree, as well as to investigate whether their experiences correlate with or fail to correlate with the promises in the CSU mission statement, and to answer the study’s research questions and achieve the purpose of this qualitative study.

Four themes emerged from …

Beyond Assumptions: What Students Really Think About School Wellbeing Programs, Amanda Madden

Research outputs 2022 to 2026

The study examined students’ perceptions of effective components in school-based wellbeing programs, addressing a critical gap where adolescent voices are absent. Data was gathered through a questionnaire, individual interviews, and focus groups conducted with 36 Year 12 students across three independent co-educational schools in Western Australia. Thematic analysis identified seven key components essential for effective wellbeing programming: targeted content providing respite from academic pressures, engaging and relatable presenters, strategic timing, developmental appropriateness, meaningful measurement, genuine teacher engagement, and authentic incorporation of student voice. Students valued practical, non-academic content and expressed scepticisms about teacher-delivered programs. Timing emerged as a previously underexplored …