Educational Assessment, Evaluation, and Research Commons^™

Looking Behind Virtual Lenses: Field Experience, Modeling, Coaching, Partnerships, Supervision, And Feedback, Tamara Lynn, Shantel Farnan, Jessica A. Rueter, Adam Moore

Education Faculty Publications

Small special education programs (SSEPs) are composed of limited faculty tasked with educating interns dispersed across large geographical areas (Reid, 1994). These needs underscore a call for more flexible educational program options. Moreover, Kebritchi et al. (2017) found professors in higher education institutions sought a variety of instructional methods to critically respond to barriers experienced by SEPPs. The purpose of this article is to highlight virtual methods utilized by SSEPs for field experiences, modeling, coaching, feedback, supervision, and partnerships to leverage faculty expertise effectively and efficiently, to expand recruitment in programs, and to support teacher retention efforts. Using the Council …

2022 Alumni Survey, Southwestern Oklahoma State University

Assessment Center Reports

Alumni Survey reports produced by the SWOSU Assessment Center.

2021-2022 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2021-2022 Continuous Improvement report produced by the SWOSU Assessment Center.

Using Formative Assessment To Build Coherence Between Educational Policy And Classroom Practice: A Case Study Using Inquiry In Science, Connie Cirkony, John Daniel Kenny

Australian Journal of Teacher Education

In this paper we argue that the complexity of education systems can lead to a lack of coherence in the implementation of policy. More effective educational change requires policy-makers and researchers to pay more attention to supporting teachers in classrooms. As an example, we consider decades of research attempts in STEM education to implement learning through inquiry and note there has been little change in teaching practices in classrooms. Using formative assessment in science education as a case study, we developed a rubric for teachers that embeds key aspects of the desired pedagogy. We argue this builds teachers’ confidence to …

Relationship Between Student Hope And Academic Achievement, Deanna S. Fosness

All Graduate Theses, Dissertations, and Other Capstone Projects

Educational research is ubiquitous; however, agreement on best practices is not. Although parents, teachers, students, and communities have a vested interest in students' success, varying practices of what is taught, how it is taught, and to whom it is taught are still debated.

This study expands upon work done by Dr. Scott Wurdinger and Dr. Ron Newell in which their research shows that student hope and NWEA math and reading scores appear to be correlated. To expand upon those results, demographic information was used to see if a difference exists amongst dichotomized groups. The results indicate that the difference in …

Reconfigurable Modules For Automatic Creating Robotic Courses, Ana Djuric, Vukica Jovanovic

Engineering Technology Faculty Publications

The main objective of this paper is to describe a teaching tool that can be used for automated creation of different problems that can be used for assessing student knowledge while teaching industrial robotics courses. These materials can be used for instructors who need to create customized questions and answers for different student homework. Wayne State University, Detroit, MI offer different industrial robotics and courses related to fundamental robotic theory: kinematics, dynamics, and control. Old Dominion University, Norfolk, VA offers the course in Introduction to Industrial Robotics. Both programs are Mechanical Engineering Technology under the Engineering Technology departments / division. …

Developing Assessment Instruments Of Debate Practice In Indonesian Language Learning, Septiana Farida, Farida Agus Setiawati

REID (Research and Evaluation in Education)

This study aims to develop an instrument for assessing debate practice in Indonesian Class X senior high school (Sekolah Menengah Atas or SMA/Madrasah Aliyah or MA) learning. The theoretical construct of the instrument was found after reviewing several theories, including speaking skills that apply to debate practice, especially those based on the Australian Debating Federation. The non-test instrument development procedure used is the Mardapi model, which includes non-cognitive. Ten material experts reviewed the draft instrument (two lecturers and eight Indonesian Language Teachers Class X in the SMA/MA in Yogyakarta Special Region) then it was calculated using the Aiken …

Use Of The Music Syllabus From The National Standards Curriculum Nsc, At The Lower Secondary Level, In Kingston And St. Andrew, Jamaica, Ornisea Williams Hird

Masters Theses

The Jamaican music education landscape has had a positive shift in the demand for music teachers who are educated to become classroom music teachers. Despite the growing need for trained music teachers to be placed in many high schools in Jamaica and the implementation of two curricula, there has been minimal study that assess how music teachers use the music syllabus from the National Standards Curriculum (NSC) in teaching and learning. The study joins a set of vibrant discussions on the development of music education in Jamaica and examines the use of the NSC at the lower secondary level (grades …

Teachers’ Beliefs And Practices Regarding Assessment In English As A Foreign Language Classrooms In Vietnam, Xuan Van Ha, Nam Giang Tran, Ngoc Hai Tran

The Qualitative Report

Task-based language teaching (TBLT) has generated worldwide popularity as a curriculum innovation, and extensive research has investigated various aspects of the approach. However, little is known about the implementation of classroom assessment in TBLT curricula. This study investigated high school English as a foreign language teachers’ beliefs and practices regarding assessment in a curriculum innovation context in Vietnam. Data comprised in-depth interviews with six teachers, as well as testing documents. The findings revealed a strong impact of the high-stakes exams on teachers’ testing beliefs in that they focused explicitly on linguistic items in the assessed content and forms of assessment. …

Students’ And Faculty Members’ Perceptions And Experiences Of Classroom Assessment: A Case Study Of A Public University In Afghanistan, Sayed Ahmad Javid Mussawy, Gretchen Rossman, Sayed Abdul Qahar Haqiqat

Higher Learning Research Communications

Objective: The primary goal of the study was to examine students’ perceptions of classroom assessment at a public university in Afghanistan. Exploring current assessment practices focused on student and faculty members lived experiences was a secondary goal. The study also sought to collect evidence on whether or not the new assessment policy was effective in student achievement.

Method: Authors used an explanatory sequential mixed-methods design to conduct the study. Initially, we applied the Students Perceptions of Assessment Questionnaire (SPAQ), translated into Dari/Farsi and validated, to collect data from a random sample of 400 students from three colleges: Agriculture, Education, and …

Improving Outcomes Assessment Through Silo Integration, Jeffrey Scott Harmon

Theses and Dissertations

The purpose of this action research study was to leverage the experiences and perceptions of academic administrators at Mountain State University to disrupt the negative aspects of silo-based decision-making within closing the loop assessment practices. Siloed operations naturally begin to operate in contradiction to one another and often to the detriment of the organization. Focusing specifically on siloed operations across academic schools at Mountain State University, this study reveals issues of inefficiency and redundancy, and develops intervention strategies in an effort to improve closing the loop assessment efforts. These strategies include structural changes leading to a more integrated assessment model …

Leading Leaders In Rethinking Grading: A Case Study Of Implementation Of Standards-Based Grading In Educational Leadership, Erin E. Lehmann

Journal of Research Initiatives

The purpose of this paper is to share the process of how one university instructor worked toward a shift to standards-based grading (SBG) in a graduate Educational Leadership program. Educational leadership programs use standards to guide coursework and instruction in an accountability era, but grading practices remain as subjective as they were 50 years ago. Educators of future leaders must address this need. In addition, instructors need to effectively communicate essential learning to students to understand their learning progression clearly; standards-based grading is designed to do this. The author shares best practices in grading as well as the challenges of …

Ungrading, Supporting Our Students Through A Pedagogy Of Care, Shaun Ferns, Robert Hickey, Helen Williams

Articles

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Grades became more widely established in the twentieth century becoming ubiquitous across most educational institutions. There is increasing evidence to suggest that grades are not effective tools for promoting or measuring learning. One alternative approach for promoting and measuring learning is "Ungrading," in which no letter grades or marks are given to students. Instead, they are replaced with formative feedback provided through strategies such as individual feedback, peer review and self-assessment. An Ungrading approach promises increased learner motivation, a reduction in stress, and …

A Study Of Elementary Teachers' Data Driven Decision-Making Practices And School Performance, Julianne K. Kotcho

Seton Hall University Dissertations and Theses (ETDs)

The notion of using data to inform educational decisions is not novel; in fact, teachers and school leaders have used data in various forms and for a variety of reasons for decades. However, challenges remain with the timely availability of data, accessibility to the data, and teachers’ understanding of how these data can be transformed into action that impacts instructional decisions. Without appropriate professional development, support, and leadership, teachers may struggle to use data to make sound decisions and take action in their classrooms.

This quantitative correlation study examined elementary school teachers’ levels of readiness regarding data-driven decision-making (DDDM) practices …

Ungrading Uncovered: How Going Gradeless Can Support Learner Diversity In Higher Education, Shaun Ferns, Robert Hickey, Helen Williams

Other resources

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Traditional grades, the awarding of numeric values to student work, date back to the 1600s where Harvard used exit grades to measure and categorize students (Smallwood, 1935). Grades became more widely established in the education sector at the beginning of the twentieth century to deal with increased numbers of students and as a means of communication between educational institutions and third parties, a form of universal measurement. Although becoming ubiquitous across most educational spectrums in the second half of the twentieth century, there …

Undoing The Traditions Of Grading And Reporting, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

One silver lining from the ongoing public health crisis might be the lasting impact of two modified approaches to grading and reporting of the past year.

Closing The Loop: Development Of A Dashboard For Quality Improvement Of Business Education Programs, Alicia Iriberri, Donald N. Stengel

International Journal for Business Education

Business schools continuously improve their processes and program assessment activities, but fall short in achieving faculty's awareness of process steps and disseminating results to inform and trigger continuous improvement actions. The assessment process of the Craig School of Business at California State University, Fresno had worked well. It evaluated student learning of core competencies of its Business Administration degree programs. The assessment process had a sound set of program goals and student learning outcomes and metrics. Learning outcomes were measured semiannually, and reports were written annually. Assessment results consistently surpassed benchmarks. Still, the assessment process did not effectively disseminate results …

Building And Maintaining Sanctuary Spaces Through Face To Face Writing Assessment, Jeffrey Austin, Ann Burke, Ellen Foley, Gretchen Rumohr

Teaching/Writing: The Journal of Writing Teacher Education

Seasoned secondary and college instructors discuss successful face-to-face assessment, especially in virtual settings. F2F assessment frees educators to co-create equitable literacy learning experiences with students, encourages agency, demystifies the grading process, develops the classroom community, and brings meaningful inquiry about writers’ own skills and practices, ultimately disrupting inequities and inequalities of traditional grading and creating “sanctuary spaces” for all writers.

Pace Yourself: Impact Of Covid-19 On Patient-Centered Care Experience, Kristen Wilhite, Mikael D. Jones, Clark D. Kebodeaux

Pharmacy Practice and Science Faculty Publications

(1) Background: The outbreak of the novel coronavirus, COVID-19, forced colleges of pharmacy to implement new online learning methodologies to ensure that students could complete required courses. This transition was especially acute for laboratory simulation courses that require students to practice professional skills. This study aims to compare student assessment performance within a simulation-based laboratory course for students who completed the module prior to and after the online transition. (2) Methods: This study was a retrospective cohort comparison of student outcome performance with two distinct content delivery methods. Students were organized into two tracks at the beginning of the semester …

Stem For Everyone: A Mixed Methods Approach To The Conception And Implementation Of An Evaluation Process For Stem Education Programs For Students With Disabilities, Amy Jane Griffiths, John Brady, Nicholas Riley, James Alsip, Vanessa Trine, Lauren Gomez

Education Faculty Articles and Research

Some students with autism spectrum disorder and other learning differences may have superior visual acuity, increased attentional focus, and logical thinking abilities, lending to an affinity for science, technology, engineering, and mathematics (STEM) fields. At the same time, economists report that, the United States will experience a 28.2% increase in STEM-related jobs between 2014 and 2024. Although students with disabilities (SWD) can help to fill those positions, 85% of SWD graduates are either underemployed or unemployed as they enter young adulthood. Thus, there is a need to develop, evaluate, and report outcomes of STEM preparation programs specifically tailored to SWD. …

Perspectives On Professional Development On Common Core Standards For English Language Arts, Martin W. Jones

Walden Dissertations and Doctoral Studies

Middle school teachers at a rural site in a western state have faced problems in implementing Common Core State Standards (CCSS) for English Language Arts (ELA), as well as in resolving achievement gaps in ELA between regular education students, special education (SPED) students, English language learners (ELL), and at-risk students. The purpose of this case study was to obtain teachers’ and school leaders’ perspectives on how CCSS for ELA can be used to enhance learning for all populations of students using the Universal Design for Learning (UDL) principles. The CCSS for ELA and UDL comprised the frameworks employed in this …

Towards The Development Of A Framework For The Inclusion Of Peer Assessment In Irish Medical Science Undergraduate Education, Mary Mcgrath

Doctoral

Assessment of learning is integral to all programmes in Higher Education (HE). While one purpose of assessment is to confirm achievement of standards, another is to support student learning. When educational programmes adopt an assessment strategy that is inclusive of ‘assessment for learning’ the role of assessment supporting learning can be expanded and sustained more effectively. Peer Assessment (PA) is an example of an assessment approach that can support and enrich student learning. The advantages and benefits of PA are strongly established in the published literature.

This research study aimed to investigate and develop a framework for the inclusion of …

Community College Full-Time Faculty Members’ Perceptions Of Course Grading, April C. Zawlocki

Graduate Research Theses & Dissertations

This study examined community college full-time faculty members’ perceptions of grading and reporting student learning via course grades using a mixed methods approach. The research questions that guided this study asked about the differences that exist in community college full-time faculty members’ perceptions of grading by different academic subdivision, by having or not having a degree in education, and by gender. Additionally, the study examined how perceptions of the purpose of grades differ among faculty members. The study also sought to find out which criteria were used to determine course grades and what experiences faculty members attribute to learning how …

Data And Assessment Management In Collegiate Recreation, Jeana Carow

Graduate Theses and Dissertations

Collegiate recreation programs and centers typically provide traditional programming space in addition to a range of physical activity spaces and resources, as a valuable part of the student experience. The external pressures of identifying and communicating departmental value and impact on the campus community has resulted in collegiate recreation departments’ use of data to communicate the effectiveness and impact of their work. The purpose of the study was to identify the data collection and assessment management practices of collegiate recreation departments, particularly focusing on the organization of data and assessment strategies as well as data collection, storage, reporting, analyzing, and …

A Psychologist’S Perspective For Coordinating Interdisciplinary Courses, Amanda L. Almond

Publications and Research

Developing a student evaluation for interdisciplinary teaching revealed a clearer goal for interdisciplinary course assessment. This chapter summarizes how interdisciplinary course assessment is a cooperative and reflexive process. Using professional judgment and a working group of peers, interdisciplinary courses maintain their integrity through regular reviews. A reflection on experiences with team-teaching, guest lecturing, and learning-communities is also included. Best practices for interdisciplinary course maintenance and concepts of validity are applied to the debate between evaluation and assessment methods. By fostering transparency, accountability, and peer-led critiques, interdisciplinary learning objectives within courses are sustained each semester. Recognizing concerns regarding evaluation, flexible approaches …

The Role Of Test Making In Learning Process, Dilbar Xasanova, Hugh Cartwright Cheonan Assistant Professor

The Light of Islam

Almost always with the word "test" a question comes to mind with four or fve possible answers. Students usually think of multiple-choice questions (MCQs) when they are told to get tested. Testing means testing students' knowledge using different types of question forms. The proposed article examines the academic performance test, which was developed by the administration of the Uzbekistan English Teachers Association (UZTEA) for Year 2 students of lyceums and colleges. The purpose of this study is to discuss test constructs and propose a more reliable version of them if the reason for the unsatisfactory results depends on the evaluation …

Estimating School-Level Achievement In Belize, Betty Jean Usher-Tate

College of Education and Human Sciences: Dissertations, Theses, and Student Research

This dissertation consists of five chapters: introduction, literature review, methodology, results, and discussion with final thoughts. The research design of this dissertation study attended to structures, cultures, and characteristics associated with, and specific to, the Belize education system. The processes for data collection and types of analyses were appropriate, yielded meaningful results, and served as a segue for national application. The Belize Educator Survey was developed to capture the educators’ voices and illuminate their relationship to educational achievement in Belize. The Belize Educator Survey was piloted and revised with direct input from educators and experts who work in the Belize …

Training Design Enhancement Through Training Evaluation: Effects On Training Transfer, Elham Arabi

UNLV Theses, Dissertations, Professional Papers, and Capstones

With recurring changes in the society, in terms of economy and technology, companies need to ensure that their human capital is aligned with these transformations in order to sustain in a competitive industry. To date, organizations view training as a requirement to increase their employees’ efficiencies and productivity, and reduce their attrition rates. Despite investment in employee training, research shows a lack of transfer of learning to job and as a result minimal return on investment. This issue is due to many barriers, but can be addressed by learning professionals. Poor learning design and training evaluation practices have been identified …

Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall

Numeracy

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …

Self-Determination Theory And Faculty Behavior: A Quantitative Study Of Faculty Leaders' Use Of Assessment Evidence, Joseph D. Levy

Dissertations

Despite assessment of student learning being essential work in higher education, a number of institutions have noted faculty could more effectively be using assessment results (Jankowski et al., 2018; Kuh et al., 2015; Metzler & Kurz, 2019; Suskie, 2014). This study applied Self-Determination Theory (SDT) as a theoretical framework to provide context for faculty behavior associated with assessment actions (Fuller et al., 2016; Ryan & Deci, 2000). Mostly quantitative data were collected via electronic survey of faculty program leaders at a single institution, National Louis University (NLU). Results indicated a significant and positive relationship suggesting an increase in meeting the …