Education Commons^™

Assessment Fairness In Freedom Of Learning In Open And Distance Education, Suci Nurhayati, Puryati Puryati

REID (Research and Evaluation in Education)

This research aims to analyze or obtain a comprehensive overview of fairness in independent campus programs in open and distance education by looking at the conformity of the concept of assessment fairness themes in the practice of assessment on the program. This research was conducted using a qualitative research design, and the data obtained were analyzed descriptively. Data collection was carried out by conducting in-depth interviews with seven sources with competencies related to independent campus programs and their policies at the Universitas Terbuka as organizers of open and distance education systems, using interview guides and documentation studies. Data were transcribed …

The Use Of Single-Subject Research Design For Assessment, Evaluation, And Research In Higher Education, Jordan C. Spencer

Theses and Dissertations

While enrolling in a college for a degree is still considered to be more of the expectation than the rule in households across the United States it is facing public criticism regarding its overall cost versus long-term benefits. This has prompted researchers to reevaluate practices in higher education to determine ways in which post-secondary institutions can improve their overall outcomes. In part, research indicates that this should include revisions to assessment, evaluation, and research (AER) practices. Currently, higher education faces many challenges associated with rigorous AER practices, which include an institutional focus on accountability measures, organizational challenges, and difficulties in …

Review Of The Australian Core Skills Framework And Digital Literacy Skills Framework And Relevant Assessment Tools. Final Report, Louise Wignall, Anita Roberts, Jana Scomazzon

Transition and Post-School Education and Training

This is the final report of a project commissioned in 2020 by the then Department of Education, Skills and Employment to review the Australian Core Skills Framework (ACSF) and Digital Literacy Skills Framework (DLSF) and tools available to support assessment using these frameworks. The review explored the development and history of the ACSF and DLSF, their use and application in the Australian context and examined features of selected international adult skills frameworks and curriculum. Through this desktop research and range of consultation activities with stakeholders, the Australian Council for Educational Research (ACER) has investigated current use of the ACSF and …

Developing Rubrics Using The New Oru Outcomes, Kim Boyd, Trevor Ellis, Leighanne Locke, Terry Shannon, Rachael Valentz

Professional Development Resources

The development and examples of key program assessments (KPAs) are shared. Dr. Boyd opens the presentation. Dr. Shannon (B.S. Sports Management) begins by providing an overview of aligning program and ORU outcomes. Prof. Locke (B.S. Mathematics) walks through how current assignments were chosen to be used as key program assessments and then how the rubrics were revised to improve alignment. Dr. Valentz (B.S. Nursing) discusses how to improve the foundational alignment between program outcomes and the criterion (rubric row headings) used to measure them. She shares how criterion can be contextualized in different assignments and demonstrates in Brightspace, by D2L, …

Avatars & Choice: Fostering Student Agency, Engagement, And Equity In Assessment, Sandra M. Sweeney

Doctoral Dissertations

Provision of item choice and use of digital avatars in reading assessment contexts may play a critical role in fostering student agency, engagement, and equity in assessment. Using a mixed methods approach, this study was conducted over four phases within an equity framework. Phase I consisted of a survey, during Phase II an iOS software application and reading test was developed, Phase III was an experimental study, and during phase IV post-experiment interviews were conducted. Research questions for this study (1) explored student interests and experiences related to assessments and technology use, (2) investigated the effect of item choice and …

Examinees’ Affective Preference For Online Speaking Assessment: Synchronous Vs Asynchronous, Yuxiao Du, Fangzheng Zhang

Chinese Language Teaching Methodology and Technology

With technological advancement and the COVID pandemic, online speaking assessment is increasingly used in language teaching. Two modes are developed: online synchronous testing (direct human-to-human interview) and online asynchronous testing (semi-direct human-to-machine interview). Ample literature has explored how each of the two online modes differs from traditional face-to-face speaking assessments. However, few studies have investigated the differences between the two modes, especially in terms of examinees’ affective preferences. This study, therefore, compares the extent to which each mode is accepted and favored by test takers and explores why such an affective preference emerges. The participants are 46 college students enrolled …

Book Review: Going Gradeless, Grades 6–12: Shifting The Focus To Student Learning, Ana De Jesús, Alesia Mickle Moldavan

Excelsior: Leadership in Teaching and Learning

This book review of Going Gradeless, Grades 6–12: Shifting the Focus to Student Learning by E. Burns and D. Frangiosa (2021) provides an alternative pedagogical method to assessment that uses a “gradeless” approach to learning for purposes of removing the stress and negative impacts of traditional grading practices while maintaining accountability with equity in mind. In this review, we describe the foundational underpinnings that frame the book and summarize some of the observed benefits as well as challenges faced by the authors who implemented this approach. We provide an overview of the chapters situated in four major takeaways guiding this …

It’S All About To Change: Implications Of Reforming Grading & Assessment Within A Public School District, Divonna M. Stebick, Megan L. Pilarcik, Daniel W. Hartman

Education Faculty Publications

Calls to reform grading systems and other assessment practices have been growing for several decades. There is consensus among many educators that grading and assessment practices that have been traditionally accepted as good practice are at best ineffective and at worst have a negative impact on raising achievement. Consequently, there is no single solution or methodology for grading that has emerged as the best practice. A variety of contemporary grading approaches have gained widespread popularity in recent years, typically being referred to as standards-based grading, standards-referenced grading, proficiency-based grading, or competency-based learning. A challenge, however, is that different school districts …

High Quality, Equity, And Assessment: An Analysis Of Variables Impacting English Learner Standardized Science Test Performance And Implications For Construct Validity, Maria Del Carmen Salazar, Joanna K. Bruno, Melissa P. Schneider

Curriculum and Instruction: Faculty Scholarship

In the United States, assessment is seen as a lever that can facilitate high-quality education. This study on English learners, students whose native language is not English, was based on data from eighth-grade English learners’ performance on science general and content-specific (physical, life, and earth science) standardized exams and an English language proficiency exam. The researchers utilized regression analysis to examine factors (i.e., socioeconomic status, home language, English language proficiency, and receptive and productive elements of language) that are predictive of English learner performance in general and content-specific science standardized assessments to identify implications for construct validity of high-stakes science …

Living, Learning, Serving: Outcomes Of Combining A Living-Learning Program With Service-Learning Courses, Allen Brizee, Kate Figiel-Miller, Marianna Carlucci

Jesuit Higher Education: A Journal

Abstract

This article discusses a two-year IRB-approved programmatic case study that measured the outcomes of merging a living-learning program (LLP) with service-learning. The study compared student survey data from four different pedagogical models, one of which was the hybrid LLP-service-learning model where service-learning students also participated in the LLP. We also interviewed instructors who used the LLP with their service-learning pedagogy. We used a one-way ANOVA and a non-parametric test to code and analyze the survey data. We used grounded theory to code and analyze interview data. Survey data revealed that the LLP-service-learning hybrid model scored the lowest of the …

Equitable Assessment For Elementary Dual-Language Learners, Joliette Mandel

Dissertations, Theses, and Capstone Projects

This thesis points out the contradictions between the goals of standardized testing and the goals of dual-language elementary education. I argue that dual-language elementary schools in the New York City Department of Education would be better served by a performance assessment model to measure student and school accountability for several reasons. Performance assessment is more equitable for students who are marginalized by their race, language, or class. Many students who attend dual-language schools in the NYCDOE fall into all these categories. I will discuss in depth why standardized testing is failing students, particularly those in dual-language elementary programs. Next, I …

Taking Time: Part-Time Students And Student Learning Outcomes Assessment, Sarah K. H. Macdonald

Dissertations, 2020-current

For decades, higher education institutions have undertaken comprehensive and systematic efforts to explore, document, and improve the assessment of student learning outcomes, as well as improving learning itself. However, many of these assessment practices have been designed for full-time traditional students, even as the number of non-traditional students enrolled in higher education continues to grow. One group of these non-traditional students remains particularly invisible on their campuses, in their classrooms, and in assessment practices: part-time students.

Part-time students, defined by the U.S. Department of Education’s Integrated Postsecondary Education Data System (IPEDS), are students who are not full-time (USDOE, n.d.). This …

Drafting An Assessment Plan For Your Instruction Program: Sustainably Assessing Information Literacy In An Undergraduate Stem Course, Kevin Moore, Clinton K. Baugess

All Musselman Library Staff Works

Assessing student learning across a library instruction program can be infeasible without being strategic, intentional, and realistic. Librarians at a small college will share how they developed a sustainable, 3-year assessment plan for the ACRL Framework and targeted a 100-level biology course-one of the two high-enrollment STEM courses that receive library instruction on their campus each year. The presenters will share their assessment plan, flipped instruction model, workflow-management strategies, and lessons learned for collaborating with STEM faculty to assess information literacy.

Exploring Associations Between Self-Concept, Ideal Self, And Assessment Practices Of High School Science Teachers, Jeffrey Celebre

Seton Hall University Dissertations and Theses (ETDs)

Despite being faced with major barriers to overcome, local school districts and teachers must work to align their instructional practices in science and their assessment practices to the Next Generation Science Standards (NGSS) and the New Jersey Student Learning Standards for Science (NJSLS-Science). As described in the literature, a three-dimensional approach to assessment design is one of the qualities considered the model for a true and authentic measurement of student aptitude in science. As teachers work to understand NGSS alignment and their ability to meet alignment standards as an assessor while designing and implementing NGSS-aligned assessments, they will undoubtedly encounter …

My First Time Ungrading: Approach Used And Reflections, Heather Leslie

Feminist Pedagogy

A few months ago, I began devouring information about ungrading with a fervent appetite. I started with the book Ungrading: Why Rating Students Undermines Learning (and What To Do Instead) edited by Susan Blum and listened to just about every podcast where she was interviewed about this topic. I then read other books she recommended like Wad-Ja-Get: The Grading Game in American Education by Howard Kirschenbaum and Punished By Rewards: The Trouble with Gold Stars, Incentive Plans, A’s, and Praise by Alfie Kohn. Recently, I have become much more dialed into the ungrading movement by reading articles from Teachers Going …

Open-Ended Problems: How Much Time Is Enough Time?, Kaitlyn Solymosi

Honors Projects

The purpose of this action research is to observe and analyze students’ responses to open-ended questions, examine student engagement in assessment, and to gauge a reasonable timetable of how long students are predicted to work through them. A great amount of research has been conducted regarding the benefits and impact of open-ended problems in K-12 classrooms, but very little research has focused on the proper amount of time that should be allotted for them. This action research aims to establish a general rule for determining the proper amount of time allotted for open-ended problems. Implications for mathematics teachers will be …

Learning Analytics For The Formative Assessment Of New Media Skills, Negar Shabihi

Electronic Thesis and Dissertation Repository

Recent theories of education have shifted learning environments towards student-centred education. Also, the advancement of technology and the need for skilled individuals in different areas have led to the introduction of new media skills. Along with new pedagogies and content, these changes require new forms of assessment. However, assessment as the core of learning has not been modified as much as other educational aspects. Hence, much attention is required to develop assessment methods based on current educational requirements. To address this gap, we have implemented two data-driven systematic literature reviews to recognize the existing state of the field in the …

Diseño De Una Prueba De Clasificación De Español No Estandarizada, David Sánchez-Jiménez

Publications and Research

Resumen

El presente estudio propone una nueva prueba de clasificación en línea específicamente creada para los estudiantes de español de New York City College of Technology (NYCCT), una institución caracterizada por la elevada diversidad de su comunidad educativa. En 2017 el Departamento de Humanidades decidió crear su propia prueba de clasificación de lenguas. En el caso del idioma español, esta se creó y se pilotó en 2018 con una muestra de 144 alumnos distribuidos en 3 niveles: inicial, intermedio y avanzado alto. Los resultados de esta práctica mostraron datos relevantes que permitieron identificar factores inesperados en el análisis, como la …

Building Librarians’ Research Skills Through Experiential Learning, Raeda K. Anderson, Katherine Fisher, Emily Williams, George Usmanov

Georgia Library Quarterly

Experiential learning programs are an effective method to teach data-focused research skills and statistical analysis. We examine the effects of a participatory research training program developed and executed by a data librarian and administered to library employees at a large academic library. The program aimed to improve research skills and increase research productivity. This study employs a survey within a concurrent mixed methods methodological framework to examine the outcomes of the training program. Our findings show that the program served as a low-cost, short-term, effective method of teaching data collection and quantitative analysis that increased participants’ knowledge of the research …

Assessing Teacher Candidates’ Pedagogical Judgement: An Analysis Of Clinically-Based Instructional Assignments, Sonia Janis, Mardi Schmeichel, Joseph Mcanulty, Chantelle Grace, Kaitlin Wegrzyn

Journal of Educational Supervision

Research on clinically-based teacher education indicates that facilitating clinical experiences for teacher candidates improves their preparation for the profession. While we have answered the call to implement rich clinical experiences in our teacher education program, we have found that we also needed to design new, robust strategies to assess what the candidates are taking away from their clinical experiences. This paper describes our use of Horn and Campbell’s (2015) notion of “pedagogical judgment” to analyze the work of social studies teacher candidates in clinical placements. We describe a rubric developed to evaluate candidates’ pedagogical judgment and offer insights into the …

Looking Behind Virtual Lenses: Field Experience, Modeling, Coaching, Partnerships, Supervision, And Feedback, Tamara Lynn, Shantel Farnan, Jessica A. Rueter, Adam Moore

Education Faculty Publications

Small special education programs (SSEPs) are composed of limited faculty tasked with educating interns dispersed across large geographical areas (Reid, 1994). These needs underscore a call for more flexible educational program options. Moreover, Kebritchi et al. (2017) found professors in higher education institutions sought a variety of instructional methods to critically respond to barriers experienced by SEPPs. The purpose of this article is to highlight virtual methods utilized by SSEPs for field experiences, modeling, coaching, feedback, supervision, and partnerships to leverage faculty expertise effectively and efficiently, to expand recruitment in programs, and to support teacher retention efforts. Using the Council …

Leadership In Physical Therapist Education: Instructional Strategies And Assessment Methods Used Among U.S. Capte Accredited Programs, Gretchen R. Prather

Theses, Dissertations and Capstones

The physical therapy profession has recently placed greater significance on leadership education and research at all levels of professional development. Excellence and innovation in physical therapy practice must address leadership development beginning in professional education. This call for reform has been adopted broadly, including from an accreditation standpoint. The challenge now becomes to determine the most effective ways for preparing student physical therapists to lead in today’s fluid healthcare environment. This study examined leadership content among U.S. CAPTE accredited physical therapist education programs and, specifically, the instructional strategies and assessment methods frequently used to develop emerging leaders. An online survey …

Reconfigurable Modules For Automatic Creating Robotic Courses, Ana Djuric, Vukica Jovanovic

Engineering Technology Faculty Publications

The main objective of this paper is to describe a teaching tool that can be used for automated creation of different problems that can be used for assessing student knowledge while teaching industrial robotics courses. These materials can be used for instructors who need to create customized questions and answers for different student homework. Wayne State University, Detroit, MI offer different industrial robotics and courses related to fundamental robotic theory: kinematics, dynamics, and control. Old Dominion University, Norfolk, VA offers the course in Introduction to Industrial Robotics. Both programs are Mechanical Engineering Technology under the Engineering Technology departments / division. …

A Weighted Individual Performance-Based Assessment For Middle School Orchestral Strings: Establishing Validity And Reliability, Kevin Ward

Doctor of Education Dissertations

The study established the validity and reliability of a weighted individual performance-based assessment tool within the utility scope of middle school orchestral strings. The following research questions guided this study:

1. What specific string-playing behaviors and corresponding criteria validate a weighted individual performance-based assessment tool for middle school orchestral strings?

2. What are the psychometric properties of the weighted individual performance-based assessment tool in authentic situations?

For Research Question 1, the expert panel and I were able to 100% mutually agree on 10 string-playing behaviors: tempo, rhythm, tone, pitch, intonation, technique, bowing, dynamics, phrasing, and posture that created the DISAT. …

Relationship Between Student Hope And Academic Achievement, Deanna S. Fosness

All Graduate Theses, Dissertations, and Other Capstone Projects

Educational research is ubiquitous; however, agreement on best practices is not. Although parents, teachers, students, and communities have a vested interest in students' success, varying practices of what is taught, how it is taught, and to whom it is taught are still debated.

This study expands upon work done by Dr. Scott Wurdinger and Dr. Ron Newell in which their research shows that student hope and NWEA math and reading scores appear to be correlated. To expand upon those results, demographic information was used to see if a difference exists amongst dichotomized groups. The results indicate that the difference in …

Using Formative Assessment To Build Coherence Between Educational Policy And Classroom Practice: A Case Study Using Inquiry In Science, Connie Cirkony, John Daniel Kenny

Australian Journal of Teacher Education

In this paper we argue that the complexity of education systems can lead to a lack of coherence in the implementation of policy. More effective educational change requires policy-makers and researchers to pay more attention to supporting teachers in classrooms. As an example, we consider decades of research attempts in STEM education to implement learning through inquiry and note there has been little change in teaching practices in classrooms. Using formative assessment in science education as a case study, we developed a rubric for teachers that embeds key aspects of the desired pedagogy. We argue this builds teachers’ confidence to …