Educational Assessment, Evaluation, and Research Commons^™

A Qualitative Lens For Exploring Ethical Reasoning: Developing The 8 Key Question Codebook, Yelisey Shapovalov

Dissertations, 2020-current

The Ethical Reasoning in Action program leveraged program assessment data to further promote student learning based on their effective educational framework for ethical reasoning: The Eight Key Question (8KQ) strategy. A cross-disciplinary team of five core researchers launched the first constructivist qualitative inquiry into students’ ethical reasoning process. The purpose was to comparatively describe essays of Low and High performing students. The basic qualitative design evolved over 19 months to create the 8KQ Codebook through an emergent, iterative, and conceptually sensitizing process. The 8KQ Codebook synthesized structural coding with a mix of theory-driven and data-driven codes across six research questions: …

Learning Stories As Assessment For Liberation, Helen Frazier

Occasional Paper Series

This paper illustrates the transformative power of learning stories as an alternative approach to in early childhood assessment. The author uses examples from her own classroom to demonstrate the use of formative assessment to foster attachment, pluralism and creativity.

Data Driven Instruction In Teaching Poetry Analysis To Advanced Placement Literature And Composition Seniors, Andrea Reyes

Theses/Capstones/Creative Projects

The goal of the poetry unit was to enhance students’ written ability by analyzing a variety of poetic literature to answer advanced placements practice prompts. I used the following research-based instructional strategies: homework and practice, nonlinguistic representations, and cooperative learning. I used the following research-based assessment strategies: essay writing, Quizizz, exit ticket, and topic, evidence, and analysis responses. The standards that the unit addressed are: LA.12.RP.2 Analyze the development and interaction of literary elements such as characterization, setting, and plot, and how they contribute to the meaning of the work as a whole, LA.12.V.2 Interpret an author’s use of figurative, …

The Inclusion Of Classroom-Related Dispositions In Teacher Evaluations, David K. Griffin

Excelsior: Leadership in Teaching and Learning

This paper examines various approaches to evaluating the classroom teacher and discusses the inclusion of dispositions in the evaluation process. A random sample of 150 teachers were asked to complete an online survey focusing on the inclusion of dispositions in their formal evaluations. They were asked to report what specific dispositions were evaluated, and if the specific dispositions were operationally defined. A summary of their responses to the survey items is discussed.

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Application Of A Risk Assessment Framework To Evaluate Organizational Capacity In Extension, Lendel K. Narine, Andree' Walker Bravo

Journal of Human Sciences and Extension

This brief report outlines a risk assessment conducted at Utah State University (USU) Extension in 2023. The report provides a discussion on the need, value, and use of risk assessments. It also presents an adaptable methodological framework for conducting risk assessments in Extension and an overview of the risk assessment results. Results show the highest risk to USU Extension is related to recruitment and retention of employees, while other noteworthy risks include internal conflicts and low employee morale. The results of the risk assessment will be used to inform strategic planning in Extension. We recommend periodic risk assessments to ensure …

The Impact Of Student Behavior And Motivation On Intercultural Competence, Marki Alexander

Dissertations

Intercultural competence has become an important trait for university graduates to possess, but an investigation into the influence of multiple factors on the achievement of intercultural competence has not been undertaken. This research examines the influence of academic and social behaviors, motivation, and student demographics on the attainment of intercultural competence through a mixed methods study. Undergraduate students taking a course focused on human diversity responded to intercultural situational judgement tests and the Expanded Cultural Intelligence Scale. The qualitative findings show a need to refine previous understandings of the development of intercultural competence. Some support for the influence of motivation …

Osces’ Impact On Occupational Therapy Student Learning: Insights From Second- And Third-Year Focus Groups, Craig R. St. Jean, Karin Werther, Mary R. Roberts

The Open Journal of Occupational Therapy

Background: Objective Structured Clinical Examinations (OSCEs) are widely used in health programs to assess clinical skills. We present results of a qualitative study investigating occupational therapy students’ perceptions of OSCEs’ impact on their learning and readiness for clinical practice.

Method: Six second and six third year students in the University of Alberta’s Master of Science in Occupational Therapy program were interviewed in separate focus groups. Independent reviewers applied thematic analysis to the focus group transcripts to identify, analyze, and report themes in the data.

Results: Five themes were constructed from the data: from learning to action, transition …

An Exploration Of Teacher Perception And Practices Of Using Assessment Data To Improve Achievement Of Equity Student Groups, Laurie Mazelin

Theses, Dissertations and Capstones

While utilizing assessment data has been a pervasive practice in educational reform for decades, and teachers are expected to use assessment data to improve instruction, little is known about how the practice of requiring teachers to review test data affects their perception of effectiveness in addressing the learning gaps of student groups. This qualitative phenomenological research study used open-ended, semi-structured interviews to help better understand how the expectations of teachers analyzing and integrating assessment data translates into teacher instructional practice and self-efficacy. This study aimed to explore the shared experience of teachers required to participate in collaborative planning centered on …

Teachers’ Assessment Practices In An Inclusive Refugee Setting: An Exploration Of How It Influences The Learning Of Learners With Disabilities., Julius Odongo Mireri

Master of Education

Assessments play a pivotal role in determining learning outcomes and educational experiences for refugee learners with disabilities (RLWD). However, their circumstances present unique challenges to traditional assessment practices. This study explored how teachers' assessment approaches influence learning for RLWD enrolled in an inclusive refugee school in Kakuma Kenya. The objectives were to examine how assessments are adapted to meet diverse learner needs, investigate how the refugee context shapes assessment practices, determine how assessments influence learning, and identify challenges faced in assessment. A qualitative case study design was employed. Data collection methods included individual interviews with 8 teachers and the head …

The Song Of Life: Listening To Self, Others, Nature, And God (The Divine), E. James Baesler

Communication & Theatre Arts Faculty Publications

“Listening to the SONG of Life” is a pedagogical framework that conceptualizes listening as a multi-sensory experience in four contexts: Self, Others, Nature, and God/Goddess (the Divine). L-SONG (Listening-SONG) is an instrument developed to measure student learning in four contexts during a listening course.

2023-2024 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

2024 Nsse, Southwestern Oklahoma State University

Assessment Center Reports

National Survey of Student Engagement (NSSE) reports produced by the SWOSU Assessment Center.

2023-2024 Service Learning Report, Southwestern Oklahoma State University

Assessment Center Reports

In 2004, Southwestern Oklahoma State University (SWOSU) joined the Campus Compact coalition, a partnership of over 1,000 colleges and universities committed to the public purposes of higher education. SWOSU shares the ideals of Campus Compact, building democracy through civic education and community service (Campus Compact, n.d.)

2023-2024 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2023-2024 Continuous Improvement report produced by the SWOSU Assessment Center.

Exploring Teachers’ Feedback Practices And Its Influence On Students’ Learning In Competency-Based Curriculum: A Case Of A Selected Secondary School In Central Division, Arua City., Anziku Sunday Oyeeson

Master of Education

This study explored teachers’ feedback practices and its influence on student learning in Competency-Based Curriculum (CBC) in a selected lower secondary school in Central Division, Arua City. The study aimed at exploring how teachers’ feedback impacts on students’ competency development and its related challenges in CBC. The study used a qualitative research approach to engage two school administrators, three lower secondary class teachers and five students through interviews, lesson observations, focus group discussion and document analysis. The data was transcribed using Ms Word, coded using colors and themes derived through thematic analysis. The findings revealed that in addition to written …

Deep Change Theory: Implications For Educational Development Leaders, Caitlin Martin, Elizabeth Wardle

Publications

While chapters 1 and 2 explore the promise of theoretical frameworks for making conceptual change that leads to innovative action around teaching and learning in higher education, they also point out the challenges to this kind of work as teams of faculty strive to lead change in their programs and departments after completing the program. To summarize our claims thus far: one of the goals for the HCWE Faculty Writing Fellows Program is to empower faculty who participate to return to their departments to make programmatic changes—changes they identify as central to their work and values and program culture. The …

An Slp Graduate Student’S Analysis Of Language In Children With Speech Sound Disorders, Madeline Janney, Donna Thomas

Journal of Interprofessional Practice and Collaboration

Purpose

Students in allied health professional (AHP) programs are instructed in evidenced-based evaluation practices and participate in interprofessional education and practice in order to identify disorders (e.g., speech, language, gross motor, fine motor) and provide effective treatment. The purpose of this paper is to present a small-scale research study of one graduate student in an AHP program that trains speech-language pathologists.

Method

A graduate student used retrospective methodology to examine the language skills of nine children with speech sound disorders (SSD) to determine if language impairment (LI) co-existed. The student learned and used a method of language sample analysis known …

The Effect Of Fifty Percent Minimum Grades On Student Achievement, James M. Mariani

Doctoral Dissertations and Projects

This causal-comparative quantitative research study aims to determine whether mandating a 50% minimum grade significantly increases student achievement. The setting for this study was one suburban Pennsylvanian high school of approximately 1,250 students. The educational process involves three integrated components: curriculum, instruction, and assessment. Evaluating methods in which schools assign grades is an inherent part of every school assessment system. The Treedale School District and Pennsylvania Department of Education collected data, which the researcher analyzed by performing multiple Mann-Whitney U tests between pre-policy 0%-100% and post policy 50%-100% grade scale groups. The independent variable is grading scale and the dependent …

The Language Of 21st Century Skills: Next Directions For Closing The Skills Gap Between Employers And Postsecondary Graduates, Gabe A. Orona, Ou Lydia Liu, Richard Arum

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The onus of preparing skilled employees for the modern workforce is largely placed on institutions of higher education. However, recent surveys consistently show a skills gap between what employers’ desire and what graduates possess. This review engages this discussion in the context of measuring and assessing 21^st century skills. We begin by succinctly reviewing literature pertaining to the skills gap, including what types of skills are commonly referenced, before moving to examine literature indicating the relations between current 21st century skills and job-related outcomes. Finally, we conclude with recommendations for higher education researchers examining skill development. Our recommendations cover …

Utilization Of Summative Assessment In Physical Therapy Education To Establish Foundations Of Clinical Science Knowledge, Katherine Grevelding, Ken Kosior

Internet Journal of Allied Health Sciences and Practice

Abstract

Purpose: Doctor of Physical Therapy [DPT] students’ ability to apply, integrate, and synthesize foundations of clinical science knowledge is vital to success in clinical practice. The aim of this case study was to explore summative examination quantification of foundational clinical science knowledge as a benchmark toward competence-based education in the first year of a DPT program. Methods: First year DPT students from a private New England University took the Physical Therapy Foundations of Clinical Science [PT-FCS] exam at the end of the second semester following completion of foundational clinical sciences coursework. The PT-FCS exam is a multiple-choice exam comprised …

Educator Cultural Proficiency Insight Tool: As We Know Better, We Can Do Better!, Queinnise Miller

Tapestry: Journal of Research in Education

All across the U.S. student populations are evolving to reflect the increase in diversity. These students are culturally, linguistically, and economically diverse in nature (CLED). Apart from the health field, cultural competence has not been widely assessed in the education field. A purposeful sample of 362 K-12 teachers, who served 50% or more of CLED students, were administered the Educator Cultural Proficiency Insight Tool (ECPIT). The purpose of this research was two-fold: (a) develop and validate the ECPIT and (b) examine the demographic differences regarding levels of cultural proficiency of current educators. Findings indicated that the ECPIT was a valid …

Improving Second Language Learning Through Performance-Based Assessment Practices, Maria Granados

Dissertations

From the time of the No Child Left Behind Act (2001) to the present day, standardized testing has become the benchmark measure for student assessment and school accountability in the United States. Multilingual learners are a vulnerable population with more testing and accountability requirements than mainstream students. Not only are they required to learn a second language, but they are also assessed within the same standardized testing paradigms as their peers - native speakers of the English language. This study aimed to examine and evaluate the benefits of instructional practices and assessments that provide multilingual students and teachers prompt and …

Assessment Of Community College Shared Governance: The Relationship Between Shared Governance And Institutional Performance, Shalee Hodgson

Doctorate in Education

Community colleges rely on shared governance to connect the people closest to institutional work, administrators, faculty, and staff, with the decisions that shape it. However, the relationship between shared governance and institutional performance remains underexamined, and the role of staff in particular has received limited scholarly attention. This qualitative case study examined employee perceptions of shared governance and institutional performance at one community college in the northwestern United States, exploring how shared governance supported institutional effectiveness and how the college sustained its assessment through committee operations and the strategic planning process. Data were collected through document review and semi-structured interviews …

Development And Initial Validation Of The Mindful Self-Regulated Learning Scale (M-Srls), Sarah Wolff

UNLV Theses, Dissertations, Professional Papers, and Capstones

Modern mindfulness is a catch-all term. Just exactly what it looks like within the context of education and how it is taught vastly varies. As such, program fidelity and integrity is questioned. Here a definition of mindful self-regulated learning is proposed and the Mindful Self-Regulated Learning Scale (m-SRLS) is developed. This includes item generation and development, systematic testing of item performance, scale dimensionality, convergent and divergent validity, measurement invariance across groups and subgroups, and scale reliability over a series of five pilot studies and five primary studies using independent samples. The resulting m-SRLS is a context specific measurement tool that …

Centering Equity In Assessment: Theories, Models And Practices, Anne E. Lundquist

Measures of Success Series

Assessment data can be a valuable tool to explore inequities on campus and move to remedy them. But assessment itself is not apolitical or objective and the approaches we use and the mindfulness with which we conduct assessment can advance equity in higher education or perpetuate inequities and cause harm. This session will highlight the critical role of cultivating individual awareness as assessors; discuss the context and scholarly history of equity-centered and equity-minded assessment; share frameworks for considering various approaches to centering equity in assessment; and provide some examples of practice and resources. Participants will have an opportunity to reflect …

Infographic: Basic Literacy Skills And The Gap Between Male And Female Students, Jo Earp

Teacher infographics

NAPLAN’s National Minimum Standard is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. Ahead of the 2023 tests, we compare the percentage of male and female students in year 9 achieving at or above the standard in Literacy, over time.

Infographic: Basic Skills And The Gap Between Indigenous And Non-Indigenous Students, Jo Earp

Teacher infographics

In the National Assessment Program — Literacy and Numeracy (NAPLAN) tests, the national minimum standard (NMS) is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. This infographic looks at the performance of Indigenous and non-Indigenous students in Year 9, over time.

Securing The Right Skills: A Longitudinal Assessment Of College Students’ Writing And Public Speaking Self-Efficacy, T. Kody Frey, Jessalyn I. Vallade

Basic Communication Course Annual

This research investigated the developmental patterns of students’ writing and public-speaking self-efficacy throughout their experience in the basic communication course (BCC). Questions were posed regarding (a) whether students grew in their reported writing and public speaking self-efficacy over two semesters, (b) whether growth differed based on biological sex, and (c) whether affinity and apprehension (as sources of performance self-efficacy) played a role in student growth. Two multilevel models revealed significant differences in students’ initial status and rate of growth for each outcome. Specifically, sex, affinity, and apprehension influenced students’ starting positions in the course, while only apprehension had a significant …

Conceptualizing Lifelong Learning For K-12 Education, Betsy Ng

Journal of Research Initiatives

In this era of rapid evolution, education in the twenty-first century must strive to develop students to be lifelong learners. Students should possess goals and life-ready competencies for continuous learning during formal, non-formal, and informal education. Within a globalizing world, lifelong learning skills enable students to manage difficulties and challenges. Lifelong learning for K-12 education may shape our students’ values and behavior, as well as build resilience in the face of challenges ahead. To date, educational research related to lifelong learning across varied contexts of K-12 education is still in its infancy. The present paper contributes to the conceptualization of …