Educational Assessment, Evaluation, and Research Commons^™

People Orientation And Thing Orientation In Business Majors: Implications For Assessing The Impacts Of Cross-Functional Business Program Curricula, Todd J. Hostager, David A. Christopher, Kristy J. Lauver, Christopher Knowles

International Journal for Business Education

Background/Introduction/Purpose:  Prior research documented significant differences in people orientation and thing orientation (PTO) based on type of major and sex.  This study examines a set of measures for helping business programs to assess whether they are producing graduates equipped to consider both people and things when making decisions, regardless of their major or sex.

Methods/Design:  Students in a strategic management capstone course spent a single 75-minute session responding to a brief new venture pitch by identifying what types of additional information they would need to decide whether to invest in the business.  Three Likert-scaled options gauged the extent to participant …

Workers Authoring Assessment: Play And Power In Early Childhood Education, Phoebe M. Gilpin

Theses and Dissertations

Researchers assert that play-based pedagogy is an effective approach to teaching young children, but there is less consensus on the specific methods of play-based teaching. This mixed-methodology exploratory case study investigated early childhood (EC) educators’ conceptualizations of play-based pedagogy in three phases: Phase 1’s quantitative measure testing found a mismatch between researchers’ conceptualization of play-based pedagogy and EC educators’ (n=183) understandings. In Phase 2, EC educators (n=3) articulated their perspectives about teaching through play and co-authored a new tool, the Teacher-Authored Play and Teaching Scale (TAPTS). Within Phase 3, EC educators (n=60) completed the TAPTS, which I interpreted through a …

Comparative Analysis Of Artificial Intelligence (Ai) Implications For Active Learning And Assessment At Various Curricular Levels Of Stem And Health Sciences In Developed Versus Underprivileged Countries, Vinay Munlapudi, Santanu De

FDLA Journal

Today’s all-pervasive emergence of artificial intelligence (AI) necessitates a comprehensive evaluation of its role in education, especially for occupational disciplines in health sciences and STEM. AI has reshaped student learning and instructors’ navigation of the evolving, post coronavirus infectious disease (COVID-19) global academic landscape. This study aimed at encapsulating evidence-based AI implications for student-centered, active learning and assessment at various curricular levels of science, technology, engineering, mathematics (STEM) and health sciences education in developed versus underprivileged or less developed countries. An extensive, scoping review of 65 recent, scholarly publications was conducted over six months through diverse search engines (PubMed, Google …

Can Ungrading Make Sport Management Education More Practical And Engaging?, Michael A. Odio

The COSMA Journal

In this essay I take on the subject of grades in sport management education. While grades are used as a measure of success across higher education, they are an imperfect measure of achievement and learning and have major limitations in terms of student employability. The ungrading movement brings attention to the ways grades can harm learning by shifting attention away from students’ development, and instructor or peer feedback, and intrinsic motivation, while incentivizing compliance and risk-aversion. These harms directly affect what are arguably some of the most important aspects of sport management education, as when grades are the main incentive, …

Professional Dispositions In Coaching Education: Icf-Credentialed Coaches’ Perspectives On Development And Assessment, Michelle Renee Thompson

Electronic Theses and Dissertations

This qualitative phenomenological study examined how professional dispositions were defined, experienced, and assessed in coaching education within the rapidly expanding field of professional coaching. The problem addressed was the lack of a clear understanding of professional dispositions in coaching and the absence of a systematic dispositional assessment comparable to that in counselor education. The researcher’s purpose was to explore how credentialed professional-level coaches defined and identified professional dispositions for effective coaching engagements and how these dispositions aligned with constructs in other helping professions. The researcher collected data through semistructured videoconference interviews. Purposeful and snowball sampling yielded 16 U.S.-based coaches who …

Tension And Grace: Perceptions Of Assessment And Grading Among Christian Higher Education Faculty And Impact On Job Satisfaction, Jerry L. Pitts, Nary Kitson, Lori Roach, Ashley Tharpe, Sherri Ann Walker, Daniel P. Yerrington

Journal for the Scholarship of Teaching & Learning

This research investigated Christian higher education faculty members perceived job satisfaction regarding assessment and grading. Six participants completed semi-structured interviews, discussion boards, and journal entries with specific questions related to assessment and grading. A phenomenological methodology using rich textual data generated four themes: pedagogical support, job satisfaction, time management, and emotional investment. Results indicated that faculty believed that assessment and grading were an integral part of their job. Job satisfaction was most prevalent when student growth was apparent in assessment and when students appreciated instructor feedback. The study offered five recommendations: 1) clarified assessment and grading expectations for Christian higher …

Developing Clear Guidance For Student Use Of Generative Ai In Academic Programs, Steve Baule

Essays in Education

As generative artificial intelligence becomes increasingly embedded in academic life, institutions need clear, consistent guidance for students and faculty. This paper describes how Winona State University’s College of Education developed complementary AI guidance documents through a collaborative, community-informed process. Following a college-wide symposium and student requests for clearer expectations, faculty leaders drafted documents and gathered feedback from faculty, current students, recent graduates, library faculty, and university committees. The resulting guidance emphasizes transparency, disclosure, privacy, verification of learning, and the distinction between AI as a tool and AI as a source requiring citation. Public dissemination of the documents helped promote consistency, …

Evaluating The Efficacy Of The Nazarene Course Of Study For Developing Lay Leaders In Virginia District Hispanic Ministries: A Competency-Based Assessment, Jeffrey A. Hernandez

Doctoral Dissertations and Projects

Hispanic ministries within the Virginia District of the Church of the Nazarene continue to experience sustained membership growth; however, leadership development has not expanded proportionally, creating emerging capacity gaps. Many Hispanic pastors serve bi-vocationally, limiting capacity to meet increasing congregational demands, and lay leaders are leveraged to meet those needs. Using an assessment tool designed to measure lay leadership competencies, this research project evaluates the effectiveness of a Nazarene Course of Study to function as a leadership development framework for laity within Hispanic church contexts. The study examines the implementation of a pastoral-level ministerial education program among Hispanic laypersons and …

Examining The Glat As A Measure Of Ai Literacy, Hunter R. Castleton

Masters Theses, 2020-current

The current study examined the Generative AI Literacy Assessment Test (GLAT) as a promising test of AI literacy due to its content, which is grounded in relevant AI literacy theory, and its design as a cognitive measure of AI literacy. To examine the GLAT, data were collected from a sample of 543 graduating seniors at James Madison University (JMU) who took the GLAT as part of a longer series of tests. Their responses were first analyzed to assess the test’s item characteristics and internal structure. Following this initial analysis, a final item set was established to ensure that low-quality items …

Career And Technical Education Faculty Members' Attitudes Toward Assessment: A Case Study, Cecelia R. Brewer

Doctoral Dissertations and Projects

The purpose of this case study was to understand career and technical education (CTE) faculty members’ attitudes toward assessment at a community college in Kansas. This study explored how faculty members perceived and engaged with outcomes assessment, including their beliefs about its effectiveness, their level of influence in assessment-related decisions, and their sense of being valued within a culture of assessment. The research questions were: 1) What are faculty members’ attitudes toward various assessment methods in career and technical education, including the assessment of both knowledge and skills?, 2) How much do faculty members believe assessment contributes to improving teaching …

Advanced Qualification Program Assessments In Aviation Higher Education: A Theoretical Framework, Jorge L. D. Albelo Ph.D., Victor M. Fraticelli Rivera Ph.D.

Journal of Aviation Technology and Engineering

This study investigates the integration of an Advanced Qualification Program (AQP)-centered approach into aviation higher education, aiming to refine assessment methods and enhance the educational experience of future aviation professionals. Guided by research questions exploring the strengths, limitations, key characteristics, and potential improvements of AQP-centered assessments, the study reveals a strong consensus among students and faculty. The AQP model, traditionally an alternative to conventional pilot training under 14 CFR Parts 121 and 135, offers a structured, industry-relevant framework emphasizing clear evaluation processes, multilevel knowledge and skill assessments, and high academic performance. Findings indicate that effective AQP assessments balance theoretical knowledge, …

Effects Of Oral Exams On Entry-Level Stem Mathematics Students, Krysten A. Pampel

International Journal of Teaching and Learning in Higher Education

This study investigates the efficacy of oral examinations as an alternative assessment method in college algebra courses, focusing on their impact on student retention of mathematical concepts. Through a comparative analysis of two groups, one undergoing traditional assessment and the other receiving oral examinations, this research explores both quantitative assessment scores and qualitative feedback. While quantitative analysis reveals no significant difference in summative assessment performance between the two groups, qualitative data highlights the benefits of oral examinations, including immediate feedback, enhanced critical thinking, and holistic evaluation of student capabilities. Despite limitations in sample size, the study suggests that oral examinations …

Leadership And Literacy Assessment Systems: A Multi-Case Study Of System Coherence And Assessment Use In Mississippi Elementary Schools, Kristin P. Walters

Theses and Dissertations--Educational Leadership Studies

This qualitative embedded multiple-case study examined how school-level literacy leadership shaped the coherence and use of literacy assessment systems in five Mississippi Elementary Schools. Situated within the context of Mississippi’s recent literacy gains and the policy environment emerging from the Literacy-Based Promotion Act, this study explored how literacy leaders guide assessment systems to support coherence between literacy instruction and assessment practice.

Data were collected through semi-structured interviews with 25 educators across five elementary schools in different districts. Analysis was conducted using descriptive and values coding organized into an analysis matrix that facilitated within-case and cross-case exploration of patterns in distributed …

Development Of The Digital Literacy Scale Based On A Socioformative Approach In University Students, Pedro Luis Arroyo-Pizarro, Renzo Esteban Martinez Laya, Elizabeth Deisy Herrera Bustillos, Esperanza Carmen Quiñones Aldazabal, Ernesto Elias Mamani Tipula, Alex Giovanny Arestigue Navarro, Christian Daniel Palomino Huananchin

Journal of Educational Technology Development and Exchange (JETDE)

Abstract: The objective of this study was to develop and validate a digital literacy scale grounded in the socioformative approach for university students. An instrumental, cross-sectional design was used with a sample of 174 students from Metropolitan Lima. Content validity was established through expert judgment, and construct validity was examined using exploratory factor analysis. The results supported a four-factor structure—Metacognitive-Adaptive ICT domain, Critical digital information management, Multimedia communicative production, and Digital socio-ethical practice—that explained 61% of the variance. Reliability indices were acceptable across dimensions (α=.716–.810; ω=.728–.817). The findings indicate that the scale (EADigit) is a valid and reliable tool for …

Coaching Undergraduates, A Conceptual And Practical Guide, Anna Carissa Rozzo

Journal on Empowering Teaching Excellence

Access the online Pressbooks version of this introduction here.

The overall aim of this paper is to provide a holistic orientation to the practice of person-centered coaching while providing tangible methods that faculty and advisors in higher education may be able to integrate into their professional practices. This conceptual paper explores the theoretical and practical intersections of coaching and teaching, presenting a flexible modality to support student-centered learning. The author provides readers with general guidance and templates for goal setting, problem solving, and assessment that practitioners may adapt to their own contexts.

Can Web-Based International Standardized Tests Be More Inclusive? A Udl Mixed-Methods Study Of Accented Tasks, Abdelbaset Haridy

Language, Literacy, and Sociocultural Studies ETDs

This dissertation explores the critical, yet understudied, issue of using a variety of accents/dialects within standardized listening assessments. The current study argues for a paradigm shift from dominant accent to the use of a variety of accents in foreign language testing and assessment. The shift is guided by the principles of Universal Design for Learning (UDL), World Englishes, and Intercultural Communication Theory. Following a mixed-methods design, the study compares student perceptions (N=202) and experts’ (N=64) opinions across two distinct linguistic contexts: English and Arabic. College student participants rated listening samples across nine parameters, including Fluency, Accuracy, Comprehensibility, Intelligibility, and Approachability. …

Assessing Cognitive Abilities In Students With Hearing Loss And Specific Learning Disabilities, Pooja Gupta, Corinna V. Cole, William H. Blackwell

Journal of Human Services: Training, Research, and Practice

This literature review synthesizes approximately 30 years of research on students from kindergarten through 12th grade with hearing impairments who are suspected of having a specific learning disability (SLD). Assessing SLDs in these students presents significant challenges, particularly when evaluating cognitive abilities using the Cattell-Horn-Carroll (CHC) theory of intelligence. This theory encompasses seven broad cognitive domains that influence academic success in reading, mathematics, and writing, including crystallized intelligence, fluid and sequential reasoning, long-term and short-term memory, visual processing, auditory processing, and processing speed. Since auditory processing is inherently affected in students with hearing impairments, this review excludes it from discussion. …

Assessing The Assessors: A Study Of Teachers' Assessment Knowledge For Dhh Students, David R. Meek, Ashley N. Greene, Holly V. Metcalf, Erich A. Tucker, Sonia B. Arora

JADARA

This descriptive study examines Teachers of the Deafs’ (TODs) self-reported assessment knowledge, classroom practices, and preparation experiences. Using a survey based on the Pedagogical Content Knowledge (PKC) framework, we collected data from 89 certified TODs across the United States. Results indicate that while TODs understand the importance of assessment, many report inadequate preparation from their teacher training programs and rely primarily on on-the-job learning. Participants expressed concerns about the limited availability of appropriate assessments for Deaf and Hard of Hearing (DHH) students and challenges in adapting existing assessment tools. The findings highlight a need for enhanced assessment training in teacher …

Quarcs Light: Validation Of An Abbreviated Assessment Of Undergraduate Numeracy And Mathematics Affect, Isaac S. Rosenthal, Kate Follette, Vonna L. Hemmler, Catherine Sarosi, Sanlyn Buxner, Erin Galyen, Margaret Shea, Soon-Young Shimizu, Brendan Seto

Numeracy

In this study, we present evidence for the validity of a shortened form of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a validated instrument assessing the numeracy and math-related affect of undergraduate students in general education/introductory science courses. Previously published analyses of QuaRCS data revealed that 1) roughly 30% of students found the assessment boring, leading to lower self-reported effort and 2) affective factors (e.g. numerical self-efficacy) were significant predictors of QuaRCS score. As a result, we reduced the length of the assessment from 25 to 15 quantitative items, and expanded the affective variable selection from three to eight …

"Inspiring Empathy": A Descriptive Review Of A Musical Composition, Garo Saraydarian

Educational Studies Dissertations

This study explored the experiences of college professors using an assessment approach, descriptive review, to assess undergraduate music compositions. College professors, and educators in general, often debate best practices around assessing student work. A literature review showed a debate amongst music educators over approaches to assessing student compositions, with rubrics being especially controversial. Descriptive review uses collective discussion and a series of non-judgmental exercises that aim for participants to become more intimate with a student and their work. As an assessment technique that had been used to look at student artwork, albeit at the elementary grade level, descriptive review has …

Teaching Learning Newsletter Vol 5 Issue 1, Sastra Deemed To Be University

TLC Newsletter

No abstract provided.

Advanced Literacies In The 21st Century: Examining A Narrative-Based Video Game As A Stealth Assessment For Comprehension, Joseph Paul Fiorentini

UNLV Theses, Dissertations, Professional Papers, and Capstones

In our technology-rich 21st Century, the need for valid, reliable, and fair literacy assessments remains pertinent to the field of education. This study defines literacy as advanced literacy where comprehension is considered a holistic product of applying acquired knowledge, skills, or abilities (KSA) to contextualized situations. Conventional assessment methods have traditionally parceled out the construct into its component parts (i.e., vocabulary, phonics, fluency, etc.) as a means of understanding the meaning making process from a traditional literacy perspective. Stealth assessments utilize the Evidence-Centered Design (ECD) framework as a robust method for assessing complex constructs holistically within technology rich environments. Adapting …

2024-2025 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2024-2025 Continuous Improvement report produced by the SWOSU Assessment Center.

2025 Alumni Survey, Southwestern Oklahoma State University

Assessment Center Reports

Alumni Survey reports produced by the SWOSU Assessment Center.

The Key Role Of Feedback In Institutional Readiness For Programmatic Assessment, Michelle Pedlow, David Boud

Research outputs 2022 to 2026

Programmatic assessment for learning represents a shift from fragmented, summative assessment practices to integrated, developmental systems where feedback is central to learning. This paper argues that feedback is foundational to programmatic assessment (PAx) implementation. Using feedback as an analytical lens, it examines institutional readiness for the deep structural and cultural shifts that PAx requires, drawing on a qualitative case study of course coordinators across three disciplines at an Australian university. Five interrelated barriers were identified: fragmented feedback, summative assessment reliance, workload constraints, absence of coordinated feedback pathways, and unconstrained educator autonomy. These reflect structural and cultural misalignments with PAx principles. …

Application Of Fuzzy Logic For Evaluation Of Student Performance, M. Tomovic, C. Tomovic, V. Jovanovic, S. Bawab

Engineering Technology Faculty Publications

The evaluation of student performance is a multifaceted process that traditionally relies on rigid grading systems, often failing to capture the complexity of student abilities and learning dynamics. This paper explores the application of fuzzy logic to enhance the accuracy and adaptability of student performance evaluation. By leveraging fuzzy logic principles, such as membership functions and linguistic variables, we model and assess the various factors influencing student performance—ranging from academic grades to engagement, participation, and personal learning styles. The approach allows for the representation of imprecise, uncertain, and subjective data, offering a more holistic view of a student’s progress. We …

Mapping Learning In Higher Education: The Embedding Content Across Academic Programmes Toolkit, John Pierce, Mary Beades, Andrew Shields

Publications

The growing diversification of teaching roles in higher education and the siloed nature of semesterised programmes can inhibit quality teaching and learning. This paper introduces the Embedding Content Across Academic Programmes Toolkit (ECAAPT), a practical model for mapping and tracking embedded content across modules, semesters, and years within higher education programmes that can ease the administrative burden of curricular mapping and change on academics teaching in the sector. Originally developed with a focus on tracking student academic literacies, this model has also been adapted and shown value in mapping and tracking other content, such as graduate attributes, feedback, assessment strategies, …

The Alchemy Of Assessment And Evaluation, Jessica Kahlow

Mavs Open Press Open Educational Resources - Archive

This comprehensive guide illuminates the art and science of educational assessment, blending ancient alchemical wisdom with modern AI innovations. Part one lays the foundation, exploring essential principles of assessment and evaluation and its pivotal role in shaping learning outcomes. Part two delves into diverse assessment types, from formative assessments driving real-time adjustments to summative evaluations measuring overall achievement. Part three offers expert guidance on crafting effective assessment designs, ensuring authenticity and inclusivity. Part four examines the alchemy of feedback and grading, empowering educators with strategies for constructive engagement and growth. Part five focuses on evaluations, showcasing methods to assess program …

The Value Of Cosma Outcomes: Student Learning Outcomes, Transferable Skills And Taxonomy Levels, Coral Bender, Lindsey Maxwell

The COSMA Journal

Using a content analysis of all published Student Learning Outcomes (SLOs) of Commission on Sport Management Accreditation (COSMA) accredited programs, the current study analyzes SLOs to assess the most frequently used measurable verbs (utilizing a revised version of Blooms’ Taxonomy) and transferable skills (utilizing the definitions provided by AAC&U’s VALUE Outcomes and their corresponding rubrics) emphasized by accredited programs. An analysis of the most common Taxonomy Levels is presented at the aggregate level as well as a comparison between undergraduate and graduate education to provide a case study of SLO measurable verb alignment across accredited sport management programs. Further, content …

Sport Social Hub: Using The Power Of Collaboration To Develop Hands-On Social Media Competencies, Alisa Agozzino, Brendan O'Hallarn, Peyton Stensland, James Strode

The COSMA Journal

This paper introduces Sport Social Hub, a collaborative, multi-institutional social media exchange inspired by the Commission on Public Relations Education's (CPRE) emphasis on key knowledge, skills, and abilities (KSAs) in public relations education. Sport Social Hub engaged students from four universities in topical, sports-themed assignments. These assignments involved creating memes, analyzing historical and contemporary sports photographs, profiling industry professionals with infographics, and developing engagement contests. The paper outlines how Sport Social Hub addresses CPRE's recommended KSAs within social media, collaboration, and creative thinking. Utilizing social media platforms as pedagogical tools, Sport Social Hub aimed to enhance students' social media competencies, …