Educational Assessment, Evaluation, and Research Commons^™

People Orientation And Thing Orientation In Business Majors: Implications For Assessing The Impacts Of Cross-Functional Business Program Curricula, Todd J. Hostager, David A. Christopher, Kristy J. Lauver, Christopher Knowles

International Journal for Business Education

Background/Introduction/Purpose:  Prior research documented significant differences in people orientation and thing orientation (PTO) based on type of major and sex.  This study examines a set of measures for helping business programs to assess whether they are producing graduates equipped to consider both people and things when making decisions, regardless of their major or sex.

Methods/Design:  Students in a strategic management capstone course spent a single 75-minute session responding to a brief new venture pitch by identifying what types of additional information they would need to decide whether to invest in the business.  Three Likert-scaled options gauged the extent to participant …

Workers Authoring Assessment: Play And Power In Early Childhood Education, Phoebe M. Gilpin

Theses and Dissertations

Researchers assert that play-based pedagogy is an effective approach to teaching young children, but there is less consensus on the specific methods of play-based teaching. This mixed-methodology exploratory case study investigated early childhood (EC) educators’ conceptualizations of play-based pedagogy in three phases: Phase 1’s quantitative measure testing found a mismatch between researchers’ conceptualization of play-based pedagogy and EC educators’ (n=183) understandings. In Phase 2, EC educators (n=3) articulated their perspectives about teaching through play and co-authored a new tool, the Teacher-Authored Play and Teaching Scale (TAPTS). Within Phase 3, EC educators (n=60) completed the TAPTS, which I interpreted through a …

Correcting And Connecting Character Formation, Dane C. Joseph

Essays in Education

This essay details some assumptions that the author, through his lived experience working in higher education character formation and assessment, has identified as being potentially problematic to institutional endeavors to form character. These assumptions are framed using theoretical perspectives from within the behavioral and social sciences. A few solutions are offered, with the main one being to reframe formation from passive, single events to an activity navigated responsibly by and with all stakeholders, as well as to assess formation via everyday lived experiences both within and outside the classroom.

Comparative Analysis Of Artificial Intelligence (Ai) Implications For Active Learning And Assessment At Various Curricular Levels Of Stem And Health Sciences In Developed Versus Underprivileged Countries, Vinay Munlapudi, Santanu De

FDLA Journal

Today’s all-pervasive emergence of artificial intelligence (AI) necessitates a comprehensive evaluation of its role in education, especially for occupational disciplines in health sciences and STEM. AI has reshaped student learning and instructors’ navigation of the evolving, post coronavirus infectious disease (COVID-19) global academic landscape. This study aimed at encapsulating evidence-based AI implications for student-centered, active learning and assessment at various curricular levels of science, technology, engineering, mathematics (STEM) and health sciences education in developed versus underprivileged or less developed countries. An extensive, scoping review of 65 recent, scholarly publications was conducted over six months through diverse search engines (PubMed, Google …

Can Ungrading Make Sport Management Education More Practical And Engaging?, Michael A. Odio

The COSMA Journal

In this essay I take on the subject of grades in sport management education. While grades are used as a measure of success across higher education, they are an imperfect measure of achievement and learning and have major limitations in terms of student employability. The ungrading movement brings attention to the ways grades can harm learning by shifting attention away from students’ development, and instructor or peer feedback, and intrinsic motivation, while incentivizing compliance and risk-aversion. These harms directly affect what are arguably some of the most important aspects of sport management education, as when grades are the main incentive, …

Professional Dispositions In Coaching Education: Icf-Credentialed Coaches’ Perspectives On Development And Assessment, Michelle Renee Thompson

Electronic Theses and Dissertations

This qualitative phenomenological study examined how professional dispositions were defined, experienced, and assessed in coaching education within the rapidly expanding field of professional coaching. The problem addressed was the lack of a clear understanding of professional dispositions in coaching and the absence of a systematic dispositional assessment comparable to that in counselor education. The researcher’s purpose was to explore how credentialed professional-level coaches defined and identified professional dispositions for effective coaching engagements and how these dispositions aligned with constructs in other helping professions. The researcher collected data through semistructured videoconference interviews. Purposeful and snowball sampling yielded 16 U.S.-based coaches who …

Tension And Grace: Perceptions Of Assessment And Grading Among Christian Higher Education Faculty And Impact On Job Satisfaction, Jerry L. Pitts, Nary Kitson, Lori Roach, Ashley Tharpe, Sherri Ann Walker, Daniel P. Yerrington

Journal for the Scholarship of Teaching & Learning

This research investigated Christian higher education faculty members perceived job satisfaction regarding assessment and grading. Six participants completed semi-structured interviews, discussion boards, and journal entries with specific questions related to assessment and grading. A phenomenological methodology using rich textual data generated four themes: pedagogical support, job satisfaction, time management, and emotional investment. Results indicated that faculty believed that assessment and grading were an integral part of their job. Job satisfaction was most prevalent when student growth was apparent in assessment and when students appreciated instructor feedback. The study offered five recommendations: 1) clarified assessment and grading expectations for Christian higher …

Developing Clear Guidance For Student Use Of Generative Ai In Academic Programs, Steve Baule

Essays in Education

As generative artificial intelligence becomes increasingly embedded in academic life, institutions need clear, consistent guidance for students and faculty. This paper describes how Winona State University’s College of Education developed complementary AI guidance documents through a collaborative, community-informed process. Following a college-wide symposium and student requests for clearer expectations, faculty leaders drafted documents and gathered feedback from faculty, current students, recent graduates, library faculty, and university committees. The resulting guidance emphasizes transparency, disclosure, privacy, verification of learning, and the distinction between AI as a tool and AI as a source requiring citation. Public dissemination of the documents helped promote consistency, …

Evaluating The Efficacy Of The Nazarene Course Of Study For Developing Lay Leaders In Virginia District Hispanic Ministries: A Competency-Based Assessment, Jeffrey A. Hernandez

Doctoral Dissertations and Projects

Hispanic ministries within the Virginia District of the Church of the Nazarene continue to experience sustained membership growth; however, leadership development has not expanded proportionally, creating emerging capacity gaps. Many Hispanic pastors serve bi-vocationally, limiting capacity to meet increasing congregational demands, and lay leaders are leveraged to meet those needs. Using an assessment tool designed to measure lay leadership competencies, this research project evaluates the effectiveness of a Nazarene Course of Study to function as a leadership development framework for laity within Hispanic church contexts. The study examines the implementation of a pastoral-level ministerial education program among Hispanic laypersons and …

Examining The Glat As A Measure Of Ai Literacy, Hunter R. Castleton

Masters Theses, 2020-current

The current study examined the Generative AI Literacy Assessment Test (GLAT) as a promising test of AI literacy due to its content, which is grounded in relevant AI literacy theory, and its design as a cognitive measure of AI literacy. To examine the GLAT, data were collected from a sample of 543 graduating seniors at James Madison University (JMU) who took the GLAT as part of a longer series of tests. Their responses were first analyzed to assess the test’s item characteristics and internal structure. Following this initial analysis, a final item set was established to ensure that low-quality items …

Exploring The Impact Of Ungrading On Student Engagement And Motivation In A First-Year Composition Class, Mary B. Gruis

Dissertations, Theses, and Projects

This study investigated the association between student engagement, motivation, and self-efficacy in college-level writing-intensive courses using an ungraded approach. Motivated by disillusionment with traditional grading methods and inspired by texts on equitable grading and culturally responsive teaching, the researcher explored how ungrading could foster deeper learning and equitable educational practices. Grounded in Bandura’s (1997) self-efficacy framework, this qualitative case study examined the lived experiences of first-year composition students at a two-year institution. Data collection included student interviews, student reflections, and an instructor interview. The analysis revealed themes aligned with self-efficacy, engagement, and motivation, suggesting that ungrading positively impacted students' perceptions …

Man Vs. Machine: Who Gets Better Mba Grades?, Kirsten Passyn, Mark S. Rosenbaum

Atlantic Marketing Association Proceedings

No abstract provided.

Career And Technical Education Faculty Members' Attitudes Toward Assessment: A Case Study, Cecelia R. Brewer

Doctoral Dissertations and Projects

The purpose of this case study was to understand career and technical education (CTE) faculty members’ attitudes toward assessment at a community college in Kansas. This study explored how faculty members perceived and engaged with outcomes assessment, including their beliefs about its effectiveness, their level of influence in assessment-related decisions, and their sense of being valued within a culture of assessment. The research questions were: 1) What are faculty members’ attitudes toward various assessment methods in career and technical education, including the assessment of both knowledge and skills?, 2) How much do faculty members believe assessment contributes to improving teaching …

The Data Cycle: Assessments & Progress, Shelby R. Willford

SPARK Symposium Presentations

Students in this assessment course engaged in a full Data Cycle process by tutoring a student in the community, designing and implementing assessments, targeted instruction, and progress monitoring to support learning. This presentation provides an overview of the culminating project, highlighting how candidates used data to inform instructional decisions and measure student growth. Through this work, students demonstrate the impact of data-driven teaching on real-world learning outcomes.

Voices Of Agency: Unpacking Student Insights On Nysed Content Standards, Local Curricular Practices, Pedagogy In New York State Schools, And Their Educational Implications, Alprentice Ashanti Talibudeen Mccutchen

Dissertations, Theses, and Capstone Projects

This research sets out to explore the concept of agency in the context of education, including my distinction between passive agency and active agency, and how these distinctions have been taken up by scholars, educators, and policy makers. The core approach is based in an expansive inclusion of various perspectives on agency as a basis for developing a comprehensive framework of active agency as well as its opportunities for educational practices and outcomes. I am arguing that there is a gap—an agency gap—between the passive and active employment of agency. I am also arguing that there is an agency in …

Advanced Qualification Program Assessments In Aviation Higher Education: A Theoretical Framework, Jorge L. D. Albelo Ph.D., Victor M. Fraticelli Rivera Ph.D.

Journal of Aviation Technology and Engineering

This study investigates the integration of an Advanced Qualification Program (AQP)-centered approach into aviation higher education, aiming to refine assessment methods and enhance the educational experience of future aviation professionals. Guided by research questions exploring the strengths, limitations, key characteristics, and potential improvements of AQP-centered assessments, the study reveals a strong consensus among students and faculty. The AQP model, traditionally an alternative to conventional pilot training under 14 CFR Parts 121 and 135, offers a structured, industry-relevant framework emphasizing clear evaluation processes, multilevel knowledge and skill assessments, and high academic performance. Findings indicate that effective AQP assessments balance theoretical knowledge, …

Effects Of Oral Exams On Entry-Level Stem Mathematics Students, Krysten A. Pampel

International Journal of Teaching and Learning in Higher Education

This study investigates the efficacy of oral examinations as an alternative assessment method in college algebra courses, focusing on their impact on student retention of mathematical concepts. Through a comparative analysis of two groups, one undergoing traditional assessment and the other receiving oral examinations, this research explores both quantitative assessment scores and qualitative feedback. While quantitative analysis reveals no significant difference in summative assessment performance between the two groups, qualitative data highlights the benefits of oral examinations, including immediate feedback, enhanced critical thinking, and holistic evaluation of student capabilities. Despite limitations in sample size, the study suggests that oral examinations …

Toward Fairer And More Equitable Numeracy Measurement: Improvements To The Quantitative Reasoning For College Science Assessment, Vonna L. Hemmler, Isaac Rosenthal, Kate Follette, Catherine Sarosi, Erin Galyen, Sanlyn Buxner, Jackson Carter, Samantha Maynard, Sarah Bunnell

Numeracy

Numeracy has become an increasingly important 21st-century skill that, due to the relationship between math and science, is often formally developed at the college level in general education science courses. These courses serve a diverse group of students, many of whom have historically experienced science teaching, curriculum, and assessment on the margins. The well-documented biases of assessments in particular against Individuals of Color (IoC) have inspired us to approach numeracy for social justice in our work from this angle, and in this paper, we detail our efforts to revise our validated numeracy assessment to ensure it more fairly and equitably …

Leadership And Literacy Assessment Systems: A Multi-Case Study Of System Coherence And Assessment Use In Mississippi Elementary Schools, Kristin P. Walters

Theses and Dissertations--Educational Leadership Studies

This qualitative embedded multiple-case study examined how school-level literacy leadership shaped the coherence and use of literacy assessment systems in five Mississippi Elementary Schools. Situated within the context of Mississippi’s recent literacy gains and the policy environment emerging from the Literacy-Based Promotion Act, this study explored how literacy leaders guide assessment systems to support coherence between literacy instruction and assessment practice.

Data were collected through semi-structured interviews with 25 educators across five elementary schools in different districts. Analysis was conducted using descriptive and values coding organized into an analysis matrix that facilitated within-case and cross-case exploration of patterns in distributed …

Development Of The Digital Literacy Scale Based On A Socioformative Approach In University Students, Pedro Luis Arroyo-Pizarro, Renzo Esteban Martinez Laya, Elizabeth Deisy Herrera Bustillos, Esperanza Carmen Quiñones Aldazabal, Ernesto Elias Mamani Tipula, Alex Giovanny Arestigue Navarro, Christian Daniel Palomino Huananchin

Journal of Educational Technology Development and Exchange (JETDE)

Abstract: The objective of this study was to develop and validate a digital literacy scale grounded in the socioformative approach for university students. An instrumental, cross-sectional design was used with a sample of 174 students from Metropolitan Lima. Content validity was established through expert judgment, and construct validity was examined using exploratory factor analysis. The results supported a four-factor structure—Metacognitive-Adaptive ICT domain, Critical digital information management, Multimedia communicative production, and Digital socio-ethical practice—that explained 61% of the variance. Reliability indices were acceptable across dimensions (α=.716–.810; ω=.728–.817). The findings indicate that the scale (EADigit) is a valid and reliable tool for …

The Operationalization Of Student Success: How Institutions And Divisions Of Student Affairs Define And Align Non-Academic Student Success With External Accountability Expectations, Madeline N. Trudeau

Theses and Dissertations--Educational Policy Studies and Evaluation

This qualitative multi-case study investigates how higher education institutions and their divisions of student affairs publicly discuss and define non-academic student success through their strategic planning, within the context of external pressures from state legislatures and accrediting bodies. Grounded in Organizational Learning Theory, Transition Theory, and Theory of Student Involvement and Engagement, this study analyzes the alignment and divergence between external policy expectations and internal institutional and divisional strategic plans.

The findings reveal a fundamental tension; while external stakeholders increasingly demand quantifiable outcomes tied to economic productivity - like post-graduate wages and employability metrics - divisions of student affairs continue …

Coaching Undergraduates, A Conceptual And Practical Guide, Anna Carissa Rozzo

Journal on Empowering Teaching Excellence

Access the online Pressbooks version of this introduction here.

The overall aim of this paper is to provide a holistic orientation to the practice of person-centered coaching while providing tangible methods that faculty and advisors in higher education may be able to integrate into their professional practices. This conceptual paper explores the theoretical and practical intersections of coaching and teaching, presenting a flexible modality to support student-centered learning. The author provides readers with general guidance and templates for goal setting, problem solving, and assessment that practitioners may adapt to their own contexts.

An Accountability Myth: A Critical Analysis On High-Stakes Testing In U.S. Schools, Noelle E. Haskell

Journal of Multicultural Affairs

High-stakes testing has become synonymous with the United States (U.S.) education system. This began in the early 1900’s through the form of intelligence testing which was developed by several U.S. psychologists. Since then, high-stakes testing has taken on many forms. Popular policies such as No Child Left Behind (NCLB), Race to the Top, and the Every Student Succeeds Act (ESSA) have all taken aim at increasing academic achievement and holding schools accountable through high-stakes, standardized tests. Even through its varying forms, high-stakes tests have continued to perpetuate inequalities. Considering this, the current study examines how the rhetoric used in describing …

Can Web-Based International Standardized Tests Be More Inclusive? A Udl Mixed-Methods Study Of Accented Tasks, Abdelbaset Haridy

Language, Literacy, and Sociocultural Studies ETDs

This dissertation explores the critical, yet understudied, issue of using a variety of accents/dialects within standardized listening assessments. The current study argues for a paradigm shift from dominant accent to the use of a variety of accents in foreign language testing and assessment. The shift is guided by the principles of Universal Design for Learning (UDL), World Englishes, and Intercultural Communication Theory. Following a mixed-methods design, the study compares student perceptions (N=202) and experts’ (N=64) opinions across two distinct linguistic contexts: English and Arabic. College student participants rated listening samples across nine parameters, including Fluency, Accuracy, Comprehensibility, Intelligibility, and Approachability. …

Assessing Cognitive Abilities In Students With Hearing Loss And Specific Learning Disabilities, Pooja Gupta, Corinna V. Cole, William H. Blackwell

Journal of Human Services: Training, Research, and Practice

This literature review synthesizes approximately 30 years of research on students from kindergarten through 12th grade with hearing impairments who are suspected of having a specific learning disability (SLD). Assessing SLDs in these students presents significant challenges, particularly when evaluating cognitive abilities using the Cattell-Horn-Carroll (CHC) theory of intelligence. This theory encompasses seven broad cognitive domains that influence academic success in reading, mathematics, and writing, including crystallized intelligence, fluid and sequential reasoning, long-term and short-term memory, visual processing, auditory processing, and processing speed. Since auditory processing is inherently affected in students with hearing impairments, this review excludes it from discussion. …

A Dutch Translation And Multidimensional Structure Of The Adjustment Scales For Early Transition In Schooling, Robert Hamerslag, Ron Oostdam, Ruben Fukkink, Louis Tavecchio, Paul A. Mcdermott, Zoey Kim

Archives of Assessment Psychology

This study introduces and applies the Dutch translation of the Adjustment Scales for Early Transition in Schooling (ASETS), assessed in 323 kindergarten children across 30 regular schools in the Netherlands. Culturally-tailored, context-informed assessments are essential to address childhood adaptation challenges in early schooling. Starting with a professional translation and back-translation of the ASETS by a translation bureau, a panel of kindergarten teachers critically reviewed the translated items. They ensured reliability, contextual accuracy, and addressed nuances in Dutch school terminology, bridging cultural differences between U.S. and Dutch educational settings. The analysis included Exploratory Factor Analysis, revealing three behavioral problem categories: Aggressive/Oppositional, …

Assessing The Assessors: A Study Of Teachers' Assessment Knowledge For Dhh Students, David R. Meek, Ashley N. Greene, Holly V. Metcalf, Erich A. Tucker, Sonia B. Arora

JADARA

This descriptive study examines Teachers of the Deafs’ (TODs) self-reported assessment knowledge, classroom practices, and preparation experiences. Using a survey based on the Pedagogical Content Knowledge (PKC) framework, we collected data from 89 certified TODs across the United States. Results indicate that while TODs understand the importance of assessment, many report inadequate preparation from their teacher training programs and rely primarily on on-the-job learning. Participants expressed concerns about the limited availability of appropriate assessments for Deaf and Hard of Hearing (DHH) students and challenges in adapting existing assessment tools. The findings highlight a need for enhanced assessment training in teacher …

Quarcs Light: Validation Of An Abbreviated Assessment Of Undergraduate Numeracy And Mathematics Affect, Isaac S. Rosenthal, Kate Follette, Vonna L. Hemmler, Catherine Sarosi, Sanlyn Buxner, Erin Galyen, Margaret Shea, Soon-Young Shimizu, Brendan Seto

Numeracy

In this study, we present evidence for the validity of a shortened form of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a validated instrument assessing the numeracy and math-related affect of undergraduate students in general education/introductory science courses. Previously published analyses of QuaRCS data revealed that 1) roughly 30% of students found the assessment boring, leading to lower self-reported effort and 2) affective factors (e.g. numerical self-efficacy) were significant predictors of QuaRCS score. As a result, we reduced the length of the assessment from 25 to 15 quantitative items, and expanded the affective variable selection from three to eight …

"Inspiring Empathy": A Descriptive Review Of A Musical Composition, Garo Saraydarian

Educational Studies Dissertations

This study explored the experiences of college professors using an assessment approach, descriptive review, to assess undergraduate music compositions. College professors, and educators in general, often debate best practices around assessing student work. A literature review showed a debate amongst music educators over approaches to assessing student compositions, with rubrics being especially controversial. Descriptive review uses collective discussion and a series of non-judgmental exercises that aim for participants to become more intimate with a student and their work. As an assessment technique that had been used to look at student artwork, albeit at the elementary grade level, descriptive review has …

Teaching Learning Newsletter Vol 5 Issue 1, Sastra Deemed To Be University

TLC Newsletter

No abstract provided.