Educational Assessment, Evaluation, and Research Commons^™

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Application Of A Risk Assessment Framework To Evaluate Organizational Capacity In Extension, Lendel K. Narine, Andree' Walker Bravo

Journal of Human Sciences and Extension

This brief report outlines a risk assessment conducted at Utah State University (USU) Extension in 2023. The report provides a discussion on the need, value, and use of risk assessments. It also presents an adaptable methodological framework for conducting risk assessments in Extension and an overview of the risk assessment results. Results show the highest risk to USU Extension is related to recruitment and retention of employees, while other noteworthy risks include internal conflicts and low employee morale. The results of the risk assessment will be used to inform strategic planning in Extension. We recommend periodic risk assessments to ensure …

The Impact Of Student Behavior And Motivation On Intercultural Competence, Marki Alexander

Dissertations

Intercultural competence has become an important trait for university graduates to possess, but an investigation into the influence of multiple factors on the achievement of intercultural competence has not been undertaken. This research examines the influence of academic and social behaviors, motivation, and student demographics on the attainment of intercultural competence through a mixed methods study. Undergraduate students taking a course focused on human diversity responded to intercultural situational judgement tests and the Expanded Cultural Intelligence Scale. The qualitative findings show a need to refine previous understandings of the development of intercultural competence. Some support for the influence of motivation …

Osces’ Impact On Occupational Therapy Student Learning: Insights From Second- And Third-Year Focus Groups, Craig R. St. Jean, Karin Werther, Mary R. Roberts

The Open Journal of Occupational Therapy

Background: Objective Structured Clinical Examinations (OSCEs) are widely used in health programs to assess clinical skills. We present results of a qualitative study investigating occupational therapy students’ perceptions of OSCEs’ impact on their learning and readiness for clinical practice.

Method: Six second and six third year students in the University of Alberta’s Master of Science in Occupational Therapy program were interviewed in separate focus groups. Independent reviewers applied thematic analysis to the focus group transcripts to identify, analyze, and report themes in the data.

Results: Five themes were constructed from the data: from learning to action, transition …

An Exploration Of Teacher Perception And Practices Of Using Assessment Data To Improve Achievement Of Equity Student Groups, Laurie Mazelin

Theses, Dissertations and Capstones

While utilizing assessment data has been a pervasive practice in educational reform for decades, and teachers are expected to use assessment data to improve instruction, little is known about how the practice of requiring teachers to review test data affects their perception of effectiveness in addressing the learning gaps of student groups. This qualitative phenomenological research study used open-ended, semi-structured interviews to help better understand how the expectations of teachers analyzing and integrating assessment data translates into teacher instructional practice and self-efficacy. This study aimed to explore the shared experience of teachers required to participate in collaborative planning centered on …

Teachers’ Assessment Practices In An Inclusive Refugee Setting: An Exploration Of How It Influences The Learning Of Learners With Disabilities., Julius Odongo Mireri

Master of Education

Assessments play a pivotal role in determining learning outcomes and educational experiences for refugee learners with disabilities (RLWD). However, their circumstances present unique challenges to traditional assessment practices. This study explored how teachers' assessment approaches influence learning for RLWD enrolled in an inclusive refugee school in Kakuma Kenya. The objectives were to examine how assessments are adapted to meet diverse learner needs, investigate how the refugee context shapes assessment practices, determine how assessments influence learning, and identify challenges faced in assessment. A qualitative case study design was employed. Data collection methods included individual interviews with 8 teachers and the head …

The Song Of Life: Listening To Self, Others, Nature, And God (The Divine), E. James Baesler

Communication & Theatre Arts Faculty Publications

“Listening to the SONG of Life” is a pedagogical framework that conceptualizes listening as a multi-sensory experience in four contexts: Self, Others, Nature, and God/Goddess (the Divine). L-SONG (Listening-SONG) is an instrument developed to measure student learning in four contexts during a listening course.

2023-2024 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

2024 Nsse, Southwestern Oklahoma State University

Assessment Center Reports

National Survey of Student Engagement (NSSE) reports produced by the SWOSU Assessment Center.

2023-2024 Service Learning Report, Southwestern Oklahoma State University

Assessment Center Reports

In 2004, Southwestern Oklahoma State University (SWOSU) joined the Campus Compact coalition, a partnership of over 1,000 colleges and universities committed to the public purposes of higher education. SWOSU shares the ideals of Campus Compact, building democracy through civic education and community service (Campus Compact, n.d.)

2023-2024 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2023-2024 Continuous Improvement report produced by the SWOSU Assessment Center.

Exploring Teachers’ Feedback Practices And Its Influence On Students’ Learning In Competency-Based Curriculum: A Case Of A Selected Secondary School In Central Division, Arua City., Anziku Sunday Oyeeson

Master of Education

This study explored teachers’ feedback practices and its influence on student learning in Competency-Based Curriculum (CBC) in a selected lower secondary school in Central Division, Arua City. The study aimed at exploring how teachers’ feedback impacts on students’ competency development and its related challenges in CBC. The study used a qualitative research approach to engage two school administrators, three lower secondary class teachers and five students through interviews, lesson observations, focus group discussion and document analysis. The data was transcribed using Ms Word, coded using colors and themes derived through thematic analysis. The findings revealed that in addition to written …

Deep Change Theory: Implications For Educational Development Leaders, Caitlin Martin, Elizabeth Wardle

Publications

While chapters 1 and 2 explore the promise of theoretical frameworks for making conceptual change that leads to innovative action around teaching and learning in higher education, they also point out the challenges to this kind of work as teams of faculty strive to lead change in their programs and departments after completing the program. To summarize our claims thus far: one of the goals for the HCWE Faculty Writing Fellows Program is to empower faculty who participate to return to their departments to make programmatic changes—changes they identify as central to their work and values and program culture. The …

An Slp Graduate Student’S Analysis Of Language In Children With Speech Sound Disorders, Madeline Janney, Donna Thomas

Journal of Interprofessional Practice and Collaboration

Purpose

Students in allied health professional (AHP) programs are instructed in evidenced-based evaluation practices and participate in interprofessional education and practice in order to identify disorders (e.g., speech, language, gross motor, fine motor) and provide effective treatment. The purpose of this paper is to present a small-scale research study of one graduate student in an AHP program that trains speech-language pathologists.

Method

A graduate student used retrospective methodology to examine the language skills of nine children with speech sound disorders (SSD) to determine if language impairment (LI) co-existed. The student learned and used a method of language sample analysis known …

The Effect Of Fifty Percent Minimum Grades On Student Achievement, James M. Mariani

Doctoral Dissertations and Projects

This causal-comparative quantitative research study aims to determine whether mandating a 50% minimum grade significantly increases student achievement. The setting for this study was one suburban Pennsylvanian high school of approximately 1,250 students. The educational process involves three integrated components: curriculum, instruction, and assessment. Evaluating methods in which schools assign grades is an inherent part of every school assessment system. The Treedale School District and Pennsylvania Department of Education collected data, which the researcher analyzed by performing multiple Mann-Whitney U tests between pre-policy 0%-100% and post policy 50%-100% grade scale groups. The independent variable is grading scale and the dependent …

The Language Of 21st Century Skills: Next Directions For Closing The Skills Gap Between Employers And Postsecondary Graduates, Gabe A. Orona, Ou Lydia Liu, Richard Arum

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The onus of preparing skilled employees for the modern workforce is largely placed on institutions of higher education. However, recent surveys consistently show a skills gap between what employers’ desire and what graduates possess. This review engages this discussion in the context of measuring and assessing 21^st century skills. We begin by succinctly reviewing literature pertaining to the skills gap, including what types of skills are commonly referenced, before moving to examine literature indicating the relations between current 21st century skills and job-related outcomes. Finally, we conclude with recommendations for higher education researchers examining skill development. Our recommendations cover …

Utilization Of Summative Assessment In Physical Therapy Education To Establish Foundations Of Clinical Science Knowledge, Katherine Grevelding, Ken Kosior

Internet Journal of Allied Health Sciences and Practice

Abstract

Purpose: Doctor of Physical Therapy [DPT] students’ ability to apply, integrate, and synthesize foundations of clinical science knowledge is vital to success in clinical practice. The aim of this case study was to explore summative examination quantification of foundational clinical science knowledge as a benchmark toward competence-based education in the first year of a DPT program. Methods: First year DPT students from a private New England University took the Physical Therapy Foundations of Clinical Science [PT-FCS] exam at the end of the second semester following completion of foundational clinical sciences coursework. The PT-FCS exam is a multiple-choice exam comprised …

Educator Cultural Proficiency Insight Tool: As We Know Better, We Can Do Better!, Queinnise Miller

Tapestry: Journal of Research in Education

All across the U.S. student populations are evolving to reflect the increase in diversity. These students are culturally, linguistically, and economically diverse in nature (CLED). Apart from the health field, cultural competence has not been widely assessed in the education field. A purposeful sample of 362 K-12 teachers, who served 50% or more of CLED students, were administered the Educator Cultural Proficiency Insight Tool (ECPIT). The purpose of this research was two-fold: (a) develop and validate the ECPIT and (b) examine the demographic differences regarding levels of cultural proficiency of current educators. Findings indicated that the ECPIT was a valid …

Improving Second Language Learning Through Performance-Based Assessment Practices, Maria Granados

Dissertations

From the time of the No Child Left Behind Act (2001) to the present day, standardized testing has become the benchmark measure for student assessment and school accountability in the United States. Multilingual learners are a vulnerable population with more testing and accountability requirements than mainstream students. Not only are they required to learn a second language, but they are also assessed within the same standardized testing paradigms as their peers - native speakers of the English language. This study aimed to examine and evaluate the benefits of instructional practices and assessments that provide multilingual students and teachers prompt and …

Development And Initial Validation Of The Mindful Self-Regulated Learning Scale (M-Srls), Sarah Wolff

UNLV Theses, Dissertations, Professional Papers, and Capstones

Modern mindfulness is a catch-all term. Just exactly what it looks like within the context of education and how it is taught vastly varies. As such, program fidelity and integrity is questioned. Here a definition of mindful self-regulated learning is proposed and the Mindful Self-Regulated Learning Scale (m-SRLS) is developed. This includes item generation and development, systematic testing of item performance, scale dimensionality, convergent and divergent validity, measurement invariance across groups and subgroups, and scale reliability over a series of five pilot studies and five primary studies using independent samples. The resulting m-SRLS is a context specific measurement tool that …

Centering Equity In Assessment: Theories, Models And Practices, Anne E. Lundquist

Measures of Success Series

Assessment data can be a valuable tool to explore inequities on campus and move to remedy them. But assessment itself is not apolitical or objective and the approaches we use and the mindfulness with which we conduct assessment can advance equity in higher education or perpetuate inequities and cause harm. This session will highlight the critical role of cultivating individual awareness as assessors; discuss the context and scholarly history of equity-centered and equity-minded assessment; share frameworks for considering various approaches to centering equity in assessment; and provide some examples of practice and resources. Participants will have an opportunity to reflect …

Infographic: Basic Literacy Skills And The Gap Between Male And Female Students, Jo Earp

Teacher infographics

NAPLAN’s National Minimum Standard is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. Ahead of the 2023 tests, we compare the percentage of male and female students in year 9 achieving at or above the standard in Literacy, over time.

Infographic: Basic Skills And The Gap Between Indigenous And Non-Indigenous Students, Jo Earp

Teacher infographics

In the National Assessment Program — Literacy and Numeracy (NAPLAN) tests, the national minimum standard (NMS) is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. This infographic looks at the performance of Indigenous and non-Indigenous students in Year 9, over time.

Securing The Right Skills: A Longitudinal Assessment Of College Students’ Writing And Public Speaking Self-Efficacy, T. Kody Frey, Jessalyn I. Vallade

Basic Communication Course Annual

This research investigated the developmental patterns of students’ writing and public-speaking self-efficacy throughout their experience in the basic communication course (BCC). Questions were posed regarding (a) whether students grew in their reported writing and public speaking self-efficacy over two semesters, (b) whether growth differed based on biological sex, and (c) whether affinity and apprehension (as sources of performance self-efficacy) played a role in student growth. Two multilevel models revealed significant differences in students’ initial status and rate of growth for each outcome. Specifically, sex, affinity, and apprehension influenced students’ starting positions in the course, while only apprehension had a significant …

Conceptualizing Lifelong Learning For K-12 Education, Betsy Ng

Journal of Research Initiatives

In this era of rapid evolution, education in the twenty-first century must strive to develop students to be lifelong learners. Students should possess goals and life-ready competencies for continuous learning during formal, non-formal, and informal education. Within a globalizing world, lifelong learning skills enable students to manage difficulties and challenges. Lifelong learning for K-12 education may shape our students’ values and behavior, as well as build resilience in the face of challenges ahead. To date, educational research related to lifelong learning across varied contexts of K-12 education is still in its infancy. The present paper contributes to the conceptualization of …

Onward In Higher Education: Business Faculty Perspectives On Authentic Assessment, Farah L. Kashef, Matt Townsley

Journal of Research Initiatives

This mixed-method study explored business faculty’s perspectives on drawbacks and benefits associated with authentic assessment at 10 R1 Midwestern universities. In search of solutions, faculty were also asked to provide recommendations in implementing authentic assessment. Quantitative and qualitative findings suggest most business faculty are in favor of assessment strategies that promote higher order thinking and real-world practices. However, ongoing faculty professional development opportunities and reconsidering the assessment culture of higher education are needed to make this important shift towards authentic assessment.

A 5-Week Personalized Training Workshop To Assess And Evaluate Faculty Members Teaching Online, Felix O. Quayson, Christopher Zirkle

Journal of Research Initiatives

The authors developed the Skills of Inquiry (SoI) model accompanied by a logic model to assess and evaluate faculty members teaching online. The Skills of Inquiry is based on faculty members’ abilities to understand the online environments, skills development pertaining to online teaching, and acquisition of specific online skills. The Skills of Inquiry model was used to personalize a 5-week workshop training and development module specifically for faculty members teaching online. The training workshop is effective in training faculty members to acquire specific online teaching skills through customized and individualized professional development learning. The training is a self-paced asynchronous online …

Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker

Numeracy

The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …

Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner

Numeracy

Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students’ reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 …

2022-2023 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.