Education Commons^™

The Inclusion Of Classroom-Related Dispositions In Teacher Evaluations, David K. Griffin

Excelsior: Leadership in Teaching and Learning

This paper examines various approaches to evaluating the classroom teacher and discusses the inclusion of dispositions in the evaluation process. A random sample of 150 teachers were asked to complete an online survey focusing on the inclusion of dispositions in their formal evaluations. They were asked to report what specific dispositions were evaluated, and if the specific dispositions were operationally defined. A summary of their responses to the survey items is discussed.

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Osces’ Impact On Occupational Therapy Student Learning: Insights From Second- And Third-Year Focus Groups, Craig R. St. Jean, Karin Werther, Mary R. Roberts

The Open Journal of Occupational Therapy

Background: Objective Structured Clinical Examinations (OSCEs) are widely used in health programs to assess clinical skills. We present results of a qualitative study investigating occupational therapy students’ perceptions of OSCEs’ impact on their learning and readiness for clinical practice.

Method: Six second and six third year students in the University of Alberta’s Master of Science in Occupational Therapy program were interviewed in separate focus groups. Independent reviewers applied thematic analysis to the focus group transcripts to identify, analyze, and report themes in the data.

Results: Five themes were constructed from the data: from learning to action, transition …

Hitting For Average: Educational Assessment, Unidimensionality, And The Connection To Baseball Hitting Statistics, Alex Romagnoli

Educational Considerations

The traditional points system and subsequent Grade Point Average (GPA) in education perpetuates an evaluation of academic performance which reflects arbitrary weighting of assignments and/or assessments. As such, GPAs which are calculated using a traditional points system are not unidimensional in their design. The baseball batting and slugging percentage, which serves as established metrics for performance evaluations among baseball players, better reflects unidimensionality. In essence, this paper puts forth an analysis and discussion which posits that baseball batting average and slugging percentage can serve as an example for how unidimensionality can become more prevalent in educational assessments, especially as it …

An Slp Graduate Student’S Analysis Of Language In Children With Speech Sound Disorders, Madeline Janney, Donna Thomas

Journal of Interprofessional Practice and Collaboration

Purpose

Students in allied health professional (AHP) programs are instructed in evidenced-based evaluation practices and participate in interprofessional education and practice in order to identify disorders (e.g., speech, language, gross motor, fine motor) and provide effective treatment. The purpose of this paper is to present a small-scale research study of one graduate student in an AHP program that trains speech-language pathologists.

Method

A graduate student used retrospective methodology to examine the language skills of nine children with speech sound disorders (SSD) to determine if language impairment (LI) co-existed. The student learned and used a method of language sample analysis known …

The Language Of 21st Century Skills: Next Directions For Closing The Skills Gap Between Employers And Postsecondary Graduates, Gabe A. Orona, Ou Lydia Liu, Richard Arum

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

The onus of preparing skilled employees for the modern workforce is largely placed on institutions of higher education. However, recent surveys consistently show a skills gap between what employers’ desire and what graduates possess. This review engages this discussion in the context of measuring and assessing 21^st century skills. We begin by succinctly reviewing literature pertaining to the skills gap, including what types of skills are commonly referenced, before moving to examine literature indicating the relations between current 21st century skills and job-related outcomes. Finally, we conclude with recommendations for higher education researchers examining skill development. Our recommendations cover …

Utilization Of Summative Assessment In Physical Therapy Education To Establish Foundations Of Clinical Science Knowledge, Katherine Grevelding, Ken Kosior

Internet Journal of Allied Health Sciences and Practice

Abstract

Purpose: Doctor of Physical Therapy [DPT] students’ ability to apply, integrate, and synthesize foundations of clinical science knowledge is vital to success in clinical practice. The aim of this case study was to explore summative examination quantification of foundational clinical science knowledge as a benchmark toward competence-based education in the first year of a DPT program. Methods: First year DPT students from a private New England University took the Physical Therapy Foundations of Clinical Science [PT-FCS] exam at the end of the second semester following completion of foundational clinical sciences coursework. The PT-FCS exam is a multiple-choice exam comprised …

Educator Cultural Proficiency Insight Tool: As We Know Better, We Can Do Better!, Queinnise Miller

Tapestry: Journal of Diversity, Equity, Inclusion, and Belonging in Education

All across the U.S. student populations are evolving to reflect the increase in diversity. These students are culturally, linguistically, and economically diverse in nature (CLED). Apart from the health field, cultural competence has not been widely assessed in the education field. A purposeful sample of 362 K-12 teachers, who served 50% or more of CLED students, were administered the Educator Cultural Proficiency Insight Tool (ECPIT). The purpose of this research was two-fold: (a) develop and validate the ECPIT and (b) examine the demographic differences regarding levels of cultural proficiency of current educators. Findings indicated that the ECPIT was a valid …

Ungrading: Why Rating Students Undermines Learning (And What To Do Instead), Lori M. Costello

Journal of Applied Communications

Book review of Ungrading: Why Rating Students Undermines Learning (and What to Do Instead), edited by Susan D. Blum with a foreword by Alfie Kohn

Securing The Right Skills: A Longitudinal Assessment Of College Students’ Writing And Public Speaking Self-Efficacy, T. Kody Frey, Jessalyn I. Vallade

Basic Communication Course Annual

This research investigated the developmental patterns of students’ writing and public-speaking self-efficacy throughout their experience in the basic communication course (BCC). Questions were posed regarding (a) whether students grew in their reported writing and public speaking self-efficacy over two semesters, (b) whether growth differed based on biological sex, and (c) whether affinity and apprehension (as sources of performance self-efficacy) played a role in student growth. Two multilevel models revealed significant differences in students’ initial status and rate of growth for each outcome. Specifically, sex, affinity, and apprehension influenced students’ starting positions in the course, while only apprehension had a significant …

Conceptualizing Lifelong Learning For K-12 Education, Betsy Ng

Journal of Research Initiatives

In this era of rapid evolution, education in the twenty-first century must strive to develop students to be lifelong learners. Students should possess goals and life-ready competencies for continuous learning during formal, non-formal, and informal education. Within a globalizing world, lifelong learning skills enable students to manage difficulties and challenges. Lifelong learning for K-12 education may shape our students’ values and behavior, as well as build resilience in the face of challenges ahead. To date, educational research related to lifelong learning across varied contexts of K-12 education is still in its infancy. The present paper contributes to the conceptualization of …

Onward In Higher Education: Business Faculty Perspectives On Authentic Assessment, Farah L. Kashef, Matt Townsley

Journal of Research Initiatives

This mixed-method study explored business faculty’s perspectives on drawbacks and benefits associated with authentic assessment at 10 R1 Midwestern universities. In search of solutions, faculty were also asked to provide recommendations in implementing authentic assessment. Quantitative and qualitative findings suggest most business faculty are in favor of assessment strategies that promote higher order thinking and real-world practices. However, ongoing faculty professional development opportunities and reconsidering the assessment culture of higher education are needed to make this important shift towards authentic assessment.

A 5-Week Personalized Training Workshop To Assess And Evaluate Faculty Members Teaching Online, Felix O. Quayson, Christopher Zirkle

Journal of Research Initiatives

The authors developed the Skills of Inquiry (SoI) model accompanied by a logic model to assess and evaluate faculty members teaching online. The Skills of Inquiry is based on faculty members’ abilities to understand the online environments, skills development pertaining to online teaching, and acquisition of specific online skills. The Skills of Inquiry model was used to personalize a 5-week workshop training and development module specifically for faculty members teaching online. The training workshop is effective in training faculty members to acquire specific online teaching skills through customized and individualized professional development learning. The training is a self-paced asynchronous online …

Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker

Numeracy

The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …

Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner

Numeracy

Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students’ reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 …

Experiential Learning Projects As Assessment In Initial Teacher Education, Renee Crawford, Louise E. Jenkins, Lydia Wan

Australian Journal of Teacher Education

In a rapidly changing global environment, Initial Teacher Educators (ITE) have a responsibility to role-model contemporary teaching approaches, which develop graduates who think creatively and flexibly in educational workplaces. An important aspect of this work is supporting pre-service teachers (PSTs) to understand how to design assessments which facilitate a deep understanding of student learning. This learning can be achieved through the implementation of assessments which model contemporary practices and enrich student learning in ITE courses. This paper discusses new ways to consider the purpose of assessment by focusing on Experiential Learning (EL) as a form of assessment in ITE. This …

Assessment Fairness In Freedom Of Learning In Open And Distance Education, Suci Nurhayati, Puryati Puryati

REID (Research and Evaluation in Education)

This research aims to analyze or obtain a comprehensive overview of fairness in independent campus programs in open and distance education by looking at the conformity of the concept of assessment fairness themes in the practice of assessment on the program. This research was conducted using a qualitative research design, and the data obtained were analyzed descriptively. Data collection was carried out by conducting in-depth interviews with seven sources with competencies related to independent campus programs and their policies at the Universitas Terbuka as organizers of open and distance education systems, using interview guides and documentation studies. Data were transcribed …

Examinees’ Affective Preference For Online Speaking Assessment: Synchronous Vs Asynchronous, Yuxiao Du, Fangzheng Zhang

Chinese Language Teaching Methodology and Technology

With technological advancement and the COVID pandemic, online speaking assessment is increasingly used in language teaching. Two modes are developed: online synchronous testing (direct human-to-human interview) and online asynchronous testing (semi-direct human-to-machine interview). Ample literature has explored how each of the two online modes differs from traditional face-to-face speaking assessments. However, few studies have investigated the differences between the two modes, especially in terms of examinees’ affective preferences. This study, therefore, compares the extent to which each mode is accepted and favored by test takers and explores why such an affective preference emerges. The participants are 46 college students enrolled …

Book Review: Going Gradeless, Grades 6–12: Shifting The Focus To Student Learning, Ana De Jesús, Alesia Mickle Moldavan

Excelsior: Leadership in Teaching and Learning

This book review of Going Gradeless, Grades 6–12: Shifting the Focus to Student Learning by E. Burns and D. Frangiosa (2021) provides an alternative pedagogical method to assessment that uses a “gradeless” approach to learning for purposes of removing the stress and negative impacts of traditional grading practices while maintaining accountability with equity in mind. In this review, we describe the foundational underpinnings that frame the book and summarize some of the observed benefits as well as challenges faced by the authors who implemented this approach. We provide an overview of the chapters situated in four major takeaways guiding this …

Living, Learning, Serving: Outcomes Of Combining A Living-Learning Program With Service-Learning Courses, Allen Brizee, Kate Figiel-Miller, Marianna Carlucci

Jesuit Higher Education: A Journal

Abstract

This article discusses a two-year IRB-approved programmatic case study that measured the outcomes of merging a living-learning program (LLP) with service-learning. The study compared student survey data from four different pedagogical models, one of which was the hybrid LLP-service-learning model where service-learning students also participated in the LLP. We also interviewed instructors who used the LLP with their service-learning pedagogy. We used a one-way ANOVA and a non-parametric test to code and analyze the survey data. We used grounded theory to code and analyze interview data. Survey data revealed that the LLP-service-learning hybrid model scored the lowest of the …

My First Time Ungrading: Approach Used And Reflections, Heather Leslie

Feminist Pedagogy

A few months ago, I began devouring information about ungrading with a fervent appetite. I started with the book Ungrading: Why Rating Students Undermines Learning (and What To Do Instead) edited by Susan Blum and listened to just about every podcast where she was interviewed about this topic. I then read other books she recommended like Wad-Ja-Get: The Grading Game in American Education by Howard Kirschenbaum and Punished By Rewards: The Trouble with Gold Stars, Incentive Plans, A’s, and Praise by Alfie Kohn. Recently, I have become much more dialed into the ungrading movement by reading articles from Teachers Going …

Building Librarians’ Research Skills Through Experiential Learning, Raeda K. Anderson, Katherine Fisher, Emily Williams, George Usmanov

Georgia Library Quarterly

Experiential learning programs are an effective method to teach data-focused research skills and statistical analysis. We examine the effects of a participatory research training program developed and executed by a data librarian and administered to library employees at a large academic library. The program aimed to improve research skills and increase research productivity. This study employs a survey within a concurrent mixed methods methodological framework to examine the outcomes of the training program. Our findings show that the program served as a low-cost, short-term, effective method of teaching data collection and quantitative analysis that increased participants’ knowledge of the research …

Assessing Teacher Candidates’ Pedagogical Judgement: An Analysis Of Clinically-Based Instructional Assignments, Sonia Janis, Mardi Schmeichel, Joseph Mcanulty, Chantelle Grace, Kaitlin Wegrzyn

Journal of Educational Supervision

Research on clinically-based teacher education indicates that facilitating clinical experiences for teacher candidates improves their preparation for the profession. While we have answered the call to implement rich clinical experiences in our teacher education program, we have found that we also needed to design new, robust strategies to assess what the candidates are taking away from their clinical experiences. This paper describes our use of Horn and Campbell’s (2015) notion of “pedagogical judgment” to analyze the work of social studies teacher candidates in clinical placements. We describe a rubric developed to evaluate candidates’ pedagogical judgment and offer insights into the …

Using Formative Assessment To Build Coherence Between Educational Policy And Classroom Practice: A Case Study Using Inquiry In Science, Connie Cirkony, John Daniel Kenny

Australian Journal of Teacher Education

In this paper we argue that the complexity of education systems can lead to a lack of coherence in the implementation of policy. More effective educational change requires policy-makers and researchers to pay more attention to supporting teachers in classrooms. As an example, we consider decades of research attempts in STEM education to implement learning through inquiry and note there has been little change in teaching practices in classrooms. Using formative assessment in science education as a case study, we developed a rubric for teachers that embeds key aspects of the desired pedagogy. We argue this builds teachers’ confidence to …

Assessment And Feedback Practices In The Efl Classroom, Ida Ayu Made Sri Widiastuti

REID (Research and Evaluation in Education)

The present study explored the implementation of Language classroom assessment and feedback within the English as a Foreign Language (EFL) classroom. This research was conducted using a qualitative research design, and the obtained data were analyzed descriptively. Data were collected by conducting direct classroom observation using observation checklists and in-depth interviews with the three professional English instructors using an observation guide. The data were transcribed and coded according to their categories. The findings of the study indicated that the students learning progress were assessed through a short question-answer and completion test. Verbal feedback was merely provided by the teachers, and …

Developing Assessment Instruments Of Debate Practice In Indonesian Language Learning, Septiana Farida, Farida Agus Setiawati

REID (Research and Evaluation in Education)

This study aims to develop an instrument for assessing debate practice in Indonesian Class X senior high school (Sekolah Menengah Atas or SMA/Madrasah Aliyah or MA) learning. The theoretical construct of the instrument was found after reviewing several theories, including speaking skills that apply to debate practice, especially those based on the Australian Debating Federation. The non-test instrument development procedure used is the Mardapi model, which includes non-cognitive. Ten material experts reviewed the draft instrument (two lecturers and eight Indonesian Language Teachers Class X in the SMA/MA in Yogyakarta Special Region) then it was calculated using the Aiken …

Teachers’ Beliefs And Practices Regarding Assessment In English As A Foreign Language Classrooms In Vietnam, Xuan Van Ha, Nam Giang Tran, Ngoc Hai Tran

The Qualitative Report

Task-based language teaching (TBLT) has generated worldwide popularity as a curriculum innovation, and extensive research has investigated various aspects of the approach. However, little is known about the implementation of classroom assessment in TBLT curricula. This study investigated high school English as a foreign language teachers’ beliefs and practices regarding assessment in a curriculum innovation context in Vietnam. Data comprised in-depth interviews with six teachers, as well as testing documents. The findings revealed a strong impact of the high-stakes exams on teachers’ testing beliefs in that they focused explicitly on linguistic items in the assessed content and forms of assessment. …

Students’ And Faculty Members’ Perceptions And Experiences Of Classroom Assessment: A Case Study Of A Public University In Afghanistan, Sayed Ahmad Javid Mussawy, Gretchen Rossman, Sayed Abdul Qahar Haqiqat

Higher Learning Research Communications

Objective: The primary goal of the study was to examine students’ perceptions of classroom assessment at a public university in Afghanistan. Exploring current assessment practices focused on student and faculty members lived experiences was a secondary goal. The study also sought to collect evidence on whether or not the new assessment policy was effective in student achievement.

Method: Authors used an explanatory sequential mixed-methods design to conduct the study. Initially, we applied the Students Perceptions of Assessment Questionnaire (SPAQ), translated into Dari/Farsi and validated, to collect data from a random sample of 400 students from three colleges: Agriculture, Education, and …

Leading Leaders In Rethinking Grading: A Case Study Of Implementation Of Standards-Based Grading In Educational Leadership, Erin E. Lehmann

Journal of Research Initiatives

The purpose of this paper is to share the process of how one university instructor worked toward a shift to standards-based grading (SBG) in a graduate Educational Leadership program. Educational leadership programs use standards to guide coursework and instruction in an accountability era, but grading practices remain as subjective as they were 50 years ago. Educators of future leaders must address this need. In addition, instructors need to effectively communicate essential learning to students to understand their learning progression clearly; standards-based grading is designed to do this. The author shares best practices in grading as well as the challenges of …

Rubrics That Systematically Identify Areas For Improvement, Judy R. Wilkerson, W. Steve Lang

University of South Florida (USF) M3 Publishing

Commonly used analytic and holistic formats for rubrics have significant limitations in their potential to yield meaningful feedback to students. This inhibits students’ potential to improve their work. Consistent with the recommendation of the Gordon Commission for the Future of Assessment in Education that the focus of assessment shift from accountability to improvement, this research presents one easily-implemented step toward that goal. An alternative rubric format that is designed to provide meaningful feedback to students in order to trigger necessary learning and improvement is illustrated, and feedback from students on its utility is documented. The alternative rubric format, which focuses …