Education Commons^™

Comparing Online And Traditional Assessment Practices In Middle School Mathematics, Maxwell Krueger, Kathy Enger

Dissertations, Theses, and Projects

As a result of the COVID-19 pandemic, teachers across the world have been forced to explore different modalities of assessment, many of them virtual. Now that many of the most restricting policies for schools due to pandemic have been lifted, the use of these virtual assessments remain. Due to the recent nature of their use though means that not many studies have looked into the implications of these assessments on students let alone middle school students. This study aims to help fill in some of the gaps in this research. In this study, students will take one of two assessments …

The Inclusion Of Classroom-Related Dispositions In Teacher Evaluations, David K. Griffin

Excelsior: Leadership in Teaching and Learning

This paper examines various approaches to evaluating the classroom teacher and discusses the inclusion of dispositions in the evaluation process. A random sample of 150 teachers were asked to complete an online survey focusing on the inclusion of dispositions in their formal evaluations. They were asked to report what specific dispositions were evaluated, and if the specific dispositions were operationally defined. A summary of their responses to the survey items is discussed.

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Osces’ Impact On Occupational Therapy Student Learning: Insights From Second- And Third-Year Focus Groups, Craig R. St. Jean, Karin Werther, Mary R. Roberts

The Open Journal of Occupational Therapy

Background: Objective Structured Clinical Examinations (OSCEs) are widely used in health programs to assess clinical skills. We present results of a qualitative study investigating occupational therapy students’ perceptions of OSCEs’ impact on their learning and readiness for clinical practice.

Method: Six second and six third year students in the University of Alberta’s Master of Science in Occupational Therapy program were interviewed in separate focus groups. Independent reviewers applied thematic analysis to the focus group transcripts to identify, analyze, and report themes in the data.

Results: Five themes were constructed from the data: from learning to action, transition …

Hitting For Average: Educational Assessment, Unidimensionality, And The Connection To Baseball Hitting Statistics, Alex Romagnoli

Educational Considerations

The traditional points system and subsequent Grade Point Average (GPA) in education perpetuates an evaluation of academic performance which reflects arbitrary weighting of assignments and/or assessments. As such, GPAs which are calculated using a traditional points system are not unidimensional in their design. The baseball batting and slugging percentage, which serves as established metrics for performance evaluations among baseball players, better reflects unidimensionality. In essence, this paper puts forth an analysis and discussion which posits that baseball batting average and slugging percentage can serve as an example for how unidimensionality can become more prevalent in educational assessments, especially as it …

Deep Change Theory: Implications For Educational Development Leaders, Caitlin Martin, Elizabeth Wardle

Publications

While chapters 1 and 2 explore the promise of theoretical frameworks for making conceptual change that leads to innovative action around teaching and learning in higher education, they also point out the challenges to this kind of work as teams of faculty strive to lead change in their programs and departments after completing the program. To summarize our claims thus far: one of the goals for the HCWE Faculty Writing Fellows Program is to empower faculty who participate to return to their departments to make programmatic changes—changes they identify as central to their work and values and program culture. The …

An Slp Graduate Student’S Analysis Of Language In Children With Speech Sound Disorders, Madeline Janney, Donna Thomas

Journal of Interprofessional Practice and Collaboration

Purpose

Students in allied health professional (AHP) programs are instructed in evidenced-based evaluation practices and participate in interprofessional education and practice in order to identify disorders (e.g., speech, language, gross motor, fine motor) and provide effective treatment. The purpose of this paper is to present a small-scale research study of one graduate student in an AHP program that trains speech-language pathologists.

Method

A graduate student used retrospective methodology to examine the language skills of nine children with speech sound disorders (SSD) to determine if language impairment (LI) co-existed. The student learned and used a method of language sample analysis known …

Considerations When Developing An Indigenous Early Learning And Child Care Outcomes Framework Within Canada: A Collaboration Between A White Settler And Ojibway/Oneida Knowledge Keeper, Bronwyn Johns

Electronic Thesis and Dissertation Repository

This research contributes to the scholarship on evaluation and assessment within early learning and child care (ELCC) environments. The research was carried out in collaboration with the leaders of an Indigenous ELCC centre, an Ojibway/Oneida Knowledge Keeper, co-supervisors with the Faculty of Education at Western University, and funding partners Mitacs and a municipal funder. The collaboration took place within Southwestern Ontario, Canada. The dissertation is a diffractive analysis that involved reading texts multiple times, focusing on differences that matter while not ignoring relevant similarities. The methodology was also informed by the Ojibway/Oneida Knowledge Keeper who collaborated with the researcher by …

The Effect Of Fifty Percent Minimum Grades On Student Achievement, James M. Mariani

Doctoral Dissertations and Projects

This causal-comparative quantitative research study aims to determine whether mandating a 50% minimum grade significantly increases student achievement. The setting for this study was one suburban Pennsylvanian high school of approximately 1,250 students. The educational process involves three integrated components: curriculum, instruction, and assessment. Evaluating methods in which schools assign grades is an inherent part of every school assessment system. The Treedale School District and Pennsylvania Department of Education collected data, which the researcher analyzed by performing multiple Mann-Whitney U tests between pre-policy 0%-100% and post policy 50%-100% grade scale groups. The independent variable is grading scale and the dependent …

The Language Of 21st Century Skills: Next Directions For Closing The Skills Gap Between Employers And Postsecondary Graduates, Gabe A. Orona, Ou Lydia Liu, Richard Arum

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The onus of preparing skilled employees for the modern workforce is largely placed on institutions of higher education. However, recent surveys consistently show a skills gap between what employers’ desire and what graduates possess. This review engages this discussion in the context of measuring and assessing 21^st century skills. We begin by succinctly reviewing literature pertaining to the skills gap, including what types of skills are commonly referenced, before moving to examine literature indicating the relations between current 21st century skills and job-related outcomes. Finally, we conclude with recommendations for higher education researchers examining skill development. Our recommendations cover …

Utilization Of Summative Assessment In Physical Therapy Education To Establish Foundations Of Clinical Science Knowledge, Katherine Grevelding, Ken Kosior

Internet Journal of Allied Health Sciences and Practice

Abstract

Purpose: Doctor of Physical Therapy [DPT] students’ ability to apply, integrate, and synthesize foundations of clinical science knowledge is vital to success in clinical practice. The aim of this case study was to explore summative examination quantification of foundational clinical science knowledge as a benchmark toward competence-based education in the first year of a DPT program. Methods: First year DPT students from a private New England University took the Physical Therapy Foundations of Clinical Science [PT-FCS] exam at the end of the second semester following completion of foundational clinical sciences coursework. The PT-FCS exam is a multiple-choice exam comprised …

Educator Cultural Proficiency Insight Tool: As We Know Better, We Can Do Better!, Queinnise Miller

Tapestry: Journal of Diversity, Equity, Inclusion, and Belonging in Education

All across the U.S. student populations are evolving to reflect the increase in diversity. These students are culturally, linguistically, and economically diverse in nature (CLED). Apart from the health field, cultural competence has not been widely assessed in the education field. A purposeful sample of 362 K-12 teachers, who served 50% or more of CLED students, were administered the Educator Cultural Proficiency Insight Tool (ECPIT). The purpose of this research was two-fold: (a) develop and validate the ECPIT and (b) examine the demographic differences regarding levels of cultural proficiency of current educators. Findings indicated that the ECPIT was a valid …

Improving Second Language Learning Through Performance-Based Assessment Practices, Maria Granados

Dissertations

From the time of the No Child Left Behind Act (2001) to the present day, standardized testing has become the benchmark measure for student assessment and school accountability in the United States. Multilingual learners are a vulnerable population with more testing and accountability requirements than mainstream students. Not only are they required to learn a second language, but they are also assessed within the same standardized testing paradigms as their peers - native speakers of the English language. This study aimed to examine and evaluate the benefits of instructional practices and assessments that provide multilingual students and teachers prompt and …

Development And Initial Validation Of The Mindful Self-Regulated Learning Scale (M-Srls), Sarah Wolff

UNLV Theses, Dissertations, Professional Papers, and Capstones

Modern mindfulness is a catch-all term. Just exactly what it looks like within the context of education and how it is taught vastly varies. As such, program fidelity and integrity is questioned. Here a definition of mindful self-regulated learning is proposed and the Mindful Self-Regulated Learning Scale (m-SRLS) is developed. This includes item generation and development, systematic testing of item performance, scale dimensionality, convergent and divergent validity, measurement invariance across groups and subgroups, and scale reliability over a series of five pilot studies and five primary studies using independent samples. The resulting m-SRLS is a context specific measurement tool that …

Ungrading: Why Rating Students Undermines Learning (And What To Do Instead), Lori M. Costello

Journal of Applied Communications

Book review of Ungrading: Why Rating Students Undermines Learning (and What to Do Instead), edited by Susan D. Blum with a foreword by Alfie Kohn

Centering Equity In Assessment: Theories, Models And Practices, Anne E. Lundquist

Measures of Success Series

Assessment data can be a valuable tool to explore inequities on campus and move to remedy them. But assessment itself is not apolitical or objective and the approaches we use and the mindfulness with which we conduct assessment can advance equity in higher education or perpetuate inequities and cause harm. This session will highlight the critical role of cultivating individual awareness as assessors; discuss the context and scholarly history of equity-centered and equity-minded assessment; share frameworks for considering various approaches to centering equity in assessment; and provide some examples of practice and resources. Participants will have an opportunity to reflect …

Infographic: Basic Literacy Skills And The Gap Between Male And Female Students, Jo Earp

Teacher infographics

NAPLAN’s National Minimum Standard is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. Ahead of the 2023 tests, we compare the percentage of male and female students in year 9 achieving at or above the standard in Literacy, over time.

Program Assessment – Implementing A Cycle Of Continuous Improvement, Terri Gaeddert

Academic Chairpersons Conference Proceedings

Presenter and participants will discuss challenges of assessment processes and best practices available to assessment coordinators, department chairs, and administrators to support a culture of assessment for continuous improvement. The presenter will share how adjusting the timeline of assessment reporting provided for increased data collection and more meaningful discussion and reflection on data trends.

Infographic: Basic Skills And The Gap Between Indigenous And Non-Indigenous Students, Jo Earp

Teacher infographics

In the National Assessment Program — Literacy and Numeracy (NAPLAN) tests, the national minimum standard (NMS) is the ‘agreed minimum acceptable standard of knowledge and skills without which a student will have difficulty making sufficient progress at school’. This infographic looks at the performance of Indigenous and non-Indigenous students in Year 9, over time.

Securing The Right Skills: A Longitudinal Assessment Of College Students’ Writing And Public Speaking Self-Efficacy, T. Kody Frey, Jessalyn I. Vallade

Basic Communication Course Annual

This research investigated the developmental patterns of students’ writing and public-speaking self-efficacy throughout their experience in the basic communication course (BCC). Questions were posed regarding (a) whether students grew in their reported writing and public speaking self-efficacy over two semesters, (b) whether growth differed based on biological sex, and (c) whether affinity and apprehension (as sources of performance self-efficacy) played a role in student growth. Two multilevel models revealed significant differences in students’ initial status and rate of growth for each outcome. Specifically, sex, affinity, and apprehension influenced students’ starting positions in the course, while only apprehension had a significant …

Conceptualizing Lifelong Learning For K-12 Education, Betsy Ng

Journal of Research Initiatives

In this era of rapid evolution, education in the twenty-first century must strive to develop students to be lifelong learners. Students should possess goals and life-ready competencies for continuous learning during formal, non-formal, and informal education. Within a globalizing world, lifelong learning skills enable students to manage difficulties and challenges. Lifelong learning for K-12 education may shape our students’ values and behavior, as well as build resilience in the face of challenges ahead. To date, educational research related to lifelong learning across varied contexts of K-12 education is still in its infancy. The present paper contributes to the conceptualization of …

Onward In Higher Education: Business Faculty Perspectives On Authentic Assessment, Farah L. Kashef, Matt Townsley

Journal of Research Initiatives

This mixed-method study explored business faculty’s perspectives on drawbacks and benefits associated with authentic assessment at 10 R1 Midwestern universities. In search of solutions, faculty were also asked to provide recommendations in implementing authentic assessment. Quantitative and qualitative findings suggest most business faculty are in favor of assessment strategies that promote higher order thinking and real-world practices. However, ongoing faculty professional development opportunities and reconsidering the assessment culture of higher education are needed to make this important shift towards authentic assessment.

A 5-Week Personalized Training Workshop To Assess And Evaluate Faculty Members Teaching Online, Felix O. Quayson, Christopher Zirkle

Journal of Research Initiatives

The authors developed the Skills of Inquiry (SoI) model accompanied by a logic model to assess and evaluate faculty members teaching online. The Skills of Inquiry is based on faculty members’ abilities to understand the online environments, skills development pertaining to online teaching, and acquisition of specific online skills. The Skills of Inquiry model was used to personalize a 5-week workshop training and development module specifically for faculty members teaching online. The training workshop is effective in training faculty members to acquire specific online teaching skills through customized and individualized professional development learning. The training is a self-paced asynchronous online …

Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker

Numeracy

The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …

Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner

Numeracy

Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students’ reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 …

Experiential Learning Projects As Assessment In Initial Teacher Education, Renee Crawford, Louise E. Jenkins, Lydia Wan

Australian Journal of Teacher Education

In a rapidly changing global environment, Initial Teacher Educators (ITE) have a responsibility to role-model contemporary teaching approaches, which develop graduates who think creatively and flexibly in educational workplaces. An important aspect of this work is supporting pre-service teachers (PSTs) to understand how to design assessments which facilitate a deep understanding of student learning. This learning can be achieved through the implementation of assessments which model contemporary practices and enrich student learning in ITE courses. This paper discusses new ways to consider the purpose of assessment by focusing on Experiential Learning (EL) as a form of assessment in ITE. This …

Evaluating The Assessment Of Resident Assistant Training, Diego Ulloa

Masters Theses

This poster provides the findings from a qualitative study of four housing professionals responsible for Resident Assistant (RA) training at four institutions in the Great Lake Association of College and University Housing Officers (GLACUHO) professional association that includes the states of Illinois, Indiana, Michigan, and Ohio. This study looked at how those four institutions assessed, evaluated, and improved the centralized training provided to RAs by the department. Key findings include the importance of the use of learning outcomes for training sessions, developing, and maintaining strong relationships with key campus partners, and the issues around prioritizing session topics and departmental needs …

2022-2023 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

Score Equating Between Aeps-2 And Aeps-3 For 0-3 Year Olds, Yuyan Xia

Theses and Dissertations--Education Sciences

Over the past two decades, the emphasis on educational equity in early childhood education (ECE) and early childhood special education (ECSE) has highlighted the importance of assessment through policies and regulations. Ensuring accurate assessment scores is a fundamental aspect of this trend. The release of the Assessment, Evaluation, and Programming System for Infants and Children, Third Edition (AEPS-3) in December 2021 led to a shift from the Second Edition (AEPS-2) in child development scoring. In order to harmonize the previous and updated assessment versions for children aged 0-3 across six developmental domains, a common item non-equivalent design, featuring fixed parameter …

Social Studies And History Curriculum Assessment In Colleges Of Education In Ghana: Reflective Practices Of Teacher Educators, Bernice Oteng, Ronald Osei Mensah, Pearl Adiza Babah, Enock Swanzy-Impraim

Research outputs 2022 to 2026

Assessment is a crucial and essential component of successful instruction and learning. As a result, teachers must examine their actions in the classroom through a process of reflective practices (self-observation and self-evaluation) and think about why they do it and if it works. This essay examines the reflective practices of Ghanaian teacher educators regarding the evaluation of social studies and history curricula. It made use of the sequential explanatory mixed method as a methodology drawn from questionnaires, interviews and document reviews. The findings disclosed that teacher educators in Ghana’s colleges of education have low efficacy and poor reflective practices when …