Educational Assessment, Evaluation, and Research Commons^™

Saudi Arabian Science Teachers And Formative Assessment In The Gender Segregated Male School System, Khalid Abdullah Kariri

Dissertations

Formative assessment is a key pedagogical tool that allows teachers to make instructional assessments in real time for the improvement of student learning. It gives students the opportunity to provide evidence of their learning thus giving teachers assurances that their hard work is not in vain. Formative assessment is commonly practiced in Western schools, while most Saudi science classroom teachers rely on end-of-unit summative assessment. A review of the literature reveals that very little research has been done related to Saudi teachers’ use of formative assessment in science classrooms. The goal of this dissertation was to address this absence of …

Dominican Nursing Students’ Self-Reported Mastery Of International Nursing Competencies, Wady Ramirez

Dissertations

The Dominican health care system has many challenges to meet the legal and the population’s health care expectations (La Hoz, 2018; United States Agency for International Development, 2013). The purpose of this study was to evaluate how well Dominican nursing students, who have completed their internship but not yet defended their final career project, assessed themselves against a set of international nursing competencies. In addition, the purpose was to explore any differences in their self-assessments based on whether these students completed their internship at public health care centers or not. Finally, the goal was to determine to what extent do …

Supporting Examination Reform In Nepal, Mee Young Han

Teacher India

ACER is helping to ensure that school assessment in Nepal focuses on testing higher-order thinking skills.

Alignment Or Detachment: College Educators’ Perceptions Of Experiential Learning Pedagogy, Wayne D. Finseth

All Graduate Theses, Dissertations, and Other Capstone Projects

The main purpose of this study was to investigate how college educators’ perceptions of experiential learning influence the design, implementation, and assessment of their courses. A second purpose of this study was to examine the way’s college educators use experiential learning in their classes. A final purpose of this study was to evaluate the relationship between a college educators’ prior experience with experiential learning and how they utilize that prior experiences to design, instruct, and assess their courses. A descriptive research design was used in this study. A randomized and anonymous survey containing 29 items was emailed out through Qualtrics …

Assessing Teacher Pedagogical Knowledge: The Video Assessment Of Teacher Knowledge (Vatk), Peter D. Wiens, Jori S. Beck, Christina J. Lunsmann

Teaching & Learning Faculty Publications

This study examines the creation and implementation of a video-based assessment of teacher knowledge of effective teaching called the Video Assessment of Teacher Knowledge (VATK). The VATK was developed with the intention of creating an easily administered, standardised assessment that can potentially provide information on teacher candidate knowledge of teaching at important points during their training programmes and into the teaching field. The theoretical framework upon which the VATK was developed and the process for item creation are described. Classical test theory and item response theory analysis were conducted to determine the measure’s potential for use in future studies. Analyses …

Occupational Therapy Students’ Perceptions Of Osce: A Qualitative Descriptive Analysis, Nancy E. Krusen, M. Nicole Martino

Journal of Occupational Therapy Education

Objective Structured Clinical Examinations (OSCE) are commonly used across health professions educational programs to evaluate student clinical competencies. OSCE are multiple, brief stations representing common practice scenarios. The purpose of the study was to evaluate student perceptions of OSCE. The researchers implemented 17 OSCE stations with 40 second year occupational therapy students to assess clinical competencies prior to fieldwork. Applying a qualitative descriptive methodologic approach, researchers analyzed station rating data, Qualtrics survey Likert-type items, and Qualtrics survey open-ended responses. Number of station rating responses varied widely, due to perceived time press. Station rating responses confirmed the more robust 80% response …

The Assessment Of Faith And Learning, Beth Green, Albert Cheng, David Smith

Education Reform Faculty and Graduate Students Publications

The Practicing Faith Survey (PFS) is a new assessment tool designed to measure the extent to which schoolchildren connect their faith to learning. This paper reviews the landscape of educational assessment and argues that assessment remains a critical element in the design of Christian teaching and learning. It suggests that unease around the concept of educational measurement leads to limited attempts to assess faith formation in the context of learning. The paper discusses PFS as a way to reframe the design process consistent with distinctively Christian practices of teaching and learning.

The Development And Validation Of The Practicing Faith Survey, Albert Cheng, Beth Green, David Smith

Education Reform Faculty and Graduate Students Publications

The Practicing Faith Survey (PFS) is a new assessment tool designed to measure the extent to which schoolchildren connect their faith to learning. PFS measures student engagement with five domains of Christian practice in connection with learning: intellectual, relational, introspective, benevolence, and formational practices. We describe the item-development process and then present evidence for the validity and reliability of the PFS based on a sample of 1,300 fifth- through twelfth-grade students who participated in a pilot of the instrument.

How Schools Create Healthy Testing Cultures And How Principals Use Standardized Test Data To Become Leaders Of Learning, Holly A. Gurule

Teacher Education, Educational Leadership & Policy ETDs

Standardized tests are not new to the field of education. The problem with them seems to lie in the ways these tests are now being used as criteria for various high-stakes decisions such as teachers’ evaluations, school grades, school sanctions, and even graduation from high school with a diploma. With so many different uses for standardized tests, it is easy to see how our perception of them has become skewed.

This bounded case study of a small elementary school in a large urban district centered on shifting the focus away from looking at standardized tests as a negative, as mere …

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media …

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …

A Closer Look At Toefl Speaking Assessment Test: A Guide To Teaching Toefl Ibt Speaking, Glen Ryan Alejandro

Master's Projects and Capstones

The lack of reliable speaking learning materials has been a problem of some non-native English speakers who are preparing for the TOEFL iBT Test (Test of English as a Foreign Language Internet-Based Test) and who are struggling most with the speaking section of said standardized test. Consequently, the lack of these reliable resources has been the main concern of TOEFL iBT speaking instructors whose main goal is to help meet the needs of these struggling students. As a result, many non-native English speakers who are preparing for the speaking section of the TOEFL iBT Test are not able to meet …

Sulitest®: A Mixed-Method, Pilot Study Of Assessment Impacts On Undergraduate Sustainability-Related Learning And Motivation, Alicia Mason

Faculty Submissions

A United Nations international collaboration between the Education for Sustainable Development (ESD) and the Principles for Responsible Management Education (PRME) resulted in the creation of Sulitest® (aka Sustainability Literacy Test) an open, online training and assessment tool freely available to higher education institutions globally. This study analyzes the effectiveness of the newly developed Sulitest® to not only measure sustainability literacy of higher education student populations, but also act as a catalyst for boosting affective learning outcomes by: (a) generating interest in sustainability-related issues, (b) improving sustainability-related understandings, and (c) enhancing students’ interests in the subject matter. In order to do …

Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley

Journal of Research Initiatives

The purpose of this paper is to provide a model for educational leadership faculty who aspire to walk the talk of effective feedback by embedding standards-based grading (SBG) in their courses. Rather than focusing on learning, points are the currency of K-12 classrooms across the country. Over 100 years of grading research suggests typical grading practices are subjective at best. Some schools are responding by implementing SBG, yet few articles describe how higher education embeds this philosophy in educator preparation coursework. In this essay, the author documents how to design assessments, align rubrics, and provide feedback to aspiring school leaders …

Improving The Rigor Of Online Education: Exploring Characteristics Of Faculty And Syllabi Within An Online Program Assessment Process, Brad J. Hamel

All NMU Master's Theses

As online course enrollments grow, overall perception of rigor still lags compared to that of traditional face-to-face education. The purpose of this research was to tie faculty and syllabi characteristics to the rigor of online courses. This study explored the relationship between faculty and syllabi characteristics and performance on an online entry-level course design quality assurance assessment (pass, pass with concern, or fail). A decision tree analysis was used to predict the relationship of the independent (faculty and syllabi characteristics) and the dependent (entry-level course design assessment) variables. Findings suggest that faculty rank and writing intensive are key characteristics predictive …

Setting The Foundation For Democratization: Assessing The Quality Of A Political Science Program In Egypt, Yasmin Khodary

Political Science

Purpose – The purpose of this paper is to investigate the quality of a political science program in an Egyptian private university through assessing three particular dimensions: knowledge of political science core facts and theories; reading comprehension skills; and critical thinking (CT).

Design/methodology/approach – A case study research approach was used. The study relies also on a quantitative methodology. Quantitative data were collected from students in the second and fourth years of political science to assess their knowledge of core political science facts and theories, reading comprehension and CT through the online California Critical Thinking Skills Test.

Findings – Unlike …

An Explorative Case-Study Of The Use Of Peerwise To Foster Student Centred, And Peer Supported, Learning In A First-Year Business Module, Anna Dynan, Barry J. Ryan

Irish Business Journal

Peer based learning is not a new concept in business studies in higher education; however, the integration of technology enabled and asynchronous peer learning has limited reported use and even less evidence based evaluation. In this explorative case study, the online tool PeerWise was used to scaffold and support an asynchronous peer-learning environment for a group of 212 first year business studies students. Students were required to create, answer and rate multiple choice questions on topics aligned to their curriculum within the peer constructed PeerWise question database. While there was no statistically significant correlation between PeerWise engagement and final module …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Advising Assessment Practices Of Advising Professionals At An Accredited United Kingdom Urban Career-Focused Higher Education Institution: A Replicated Quantitative, Descriptive Analysis, Catherine E. Mahrt-Washington

Dissertations

The Problem

As the world has flattened, the globalization and quality education movement surrounding higher education worldwide has led to the accountability of all stakeholders regarding student success in and beyond the classroom. Student mobility continues to impact tertiary enrollments as families and students consider the proliferated traditional and non-traditional enrollment alternatives along with prospective lower tertiary debt options. Although assessment, an accountability tool, in co-curricular areas such as advising has been overlooked by leaders, advising is not impervious to accountability consequences. The problem is that assessment of advising, if performed, is oftentimes implemented informally, without a well-defined framework or …

Perceptions Of Assessment In Norwegian Occupational Therapy Students, Tore Bonsaksen, Astrid Gramstad, Gry Mørk, Susanne G. Johnson

Journal of Occupational Therapy Education

In addition to securing minimum standards of learning among students, assessment is increasingly used as a tool to improve students’ learning. Assessment quality is measured as part of the Course Experience Questionnaire; however, the original ‘appropriate assessment’ scale has demonstrated ambiguous psychometric properties. The current study aimed to gain knowledge about occupational therapy students’ perceptions of assessment, and this was achieved by examining the factor structure and internal consistency of the six items on the ‘appropriate assessment’ scale. Students from six Norwegian universities (n = 187, response rate 61.3 %) completed the scale and reported demographic information. The factor …

Validating Bloom's Revised Taxonomy As A Rubric For Assessing Middle School Students' Levels Of Thinking, Siri Torrence Deforest Reynolds

Walden Dissertations and Doctoral Studies

Educators in a rural charter middle school in the United States were challenged with the reliable assessment of student thinking skills even though the development of higher order thinking was an espoused goal for the school. The purpose of this study was to validate a new rubric based on Bloom’s Revised Taxonomy (BRT) to reliably assess student levels of thinking as reflected in the students’ written work. A quantitative, nonexperimental design was used. The focus of the research questions was on the BRT rubric’s reliability and validity. Interrater reliability was assessed using Krippendorff’s alpha. Validity was explored by assessing the …

Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart

Numeracy

In a previous article, we described our college’s new core curriculum, which included a Quantitative Literacy (QL) component for the first time. We explained how we defined QL in the college catalog, and how we used that definition to choose courses to satisfy the new requirement. We then discussed our early efforts at assessing the effectiveness of the QL program and described our plans for the future. Here we report on our progress towards those goals, including working with faculty from other departments and with our institutional research office to develop a more sophisticated assessment plan, as well as creating …

Design Of An Osce To Assess Clinical Competence Of Occupational Therapy Students, Nancy E. Krusen, Debra Rollins

Journal of Occupational Therapy Education

Objective structured clinical examinations (OSCEs) are a series of controlled, timed stations in which students demonstrate clinical skills. OSCEs are commonly used within health professions education to demonstrate competence, prepare for clinical education, and conduct program evaluation. The body of literature addressing the use of OSCEs in occupational therapy (OT) is growing; however, there are no available guidelines for developing an OSCE specific to the profession. The purpose of this paper is to describe the design of an OSCE for OT students prior to fieldwork placement. Twelve OT practitioners participated in a modified-Delphi method to generate possible OSCE scenarios. The …

Mapping Of Physics Problem-Solving Skills Of Senior High School Students Using Physpross-Cat, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Revnika Faizah

REID (Research and Evaluation in Education)

Evaluation using computerized adaptive tests (CAT) is an alternative to paper-based tests (PBT). This study was aimed at mapping physics problem-solving skills using PhysProSS-CAT on the basis of the item response theory (IRT). The study was conducted inSleman Regency, Yogyakarta, involving 156 students of Grade XI of senior high school. Sampling was done using stratified random sampling technique. The results of the study show that the PhysProSS-CAT is able to accurately measure physics problem-solving skills. Students' competences in physics problem solving can be mapped as 6% of the very high category, 4% of the high category, 36% of the medium …

Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg

Journal of Pre-College Engineering Education Research (J-PEER)

Reasoning about mechanism is central to disciplined inquiry in science and engineering and should thus be one of the foundations of a science, technology, engineering, and mathematics education. In addition, mechanistic reasoning is one of the core competencies listed in the Next Generation Science Standards (NGSS) Engineering Concepts and Practices (NGSS Lead States, 2013). Mechanistic explanations focus on the processes that underlie cause–effect relationships and consider how the activities of system components affect one another.

While some assessment work has been accomplished in engineering education, to date mechanistic reasoning is an area where limited assessment development has been accomplished for …

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment; and …

The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing

Boise State University Theses and Dissertations

The quantitative study presented here evaluates the effects of formative and summative assessment on student’s connectedness, satisfaction, learning and academic performance within a university three-credit 400 level online healthcare course. Literature exploring the role that formative assessment plays within an online environment is currently lacking. Additionally, understanding how assessment practices can help support the goals of online healthcare education is vitally important given the rise in popularity of this delivery format.

This study investigated student outcomes in the form of connectedness, satisfaction, learning and academic performance. Four cohorts of students were included in this study. Two cohorts were provided with …

Faculty Development Initiatives: A Prerequisite For Capacity Building And Enhanced Productivity In A Medical Institution, Rehana Rehman, Hassan Mehmood, Syeda Fatima, Irfanullah Baig, Zohaib Rana, Mohammad Iqbal

Department of Biological & Biomedical Sciences

Objective: To determine the contribution of teaching, learning and assessment forum's initiatives on professional development of faculty and staff.
Methods: This retrospective study was conducted at the Department of Biological and Biomedical Sciences, Aga Khan University, Karachi, from July to December 2016, and comprised teaching, learning and assessment activities carried out from 2012 to 2015. The responses acquired from feedback evaluation were recorded at the end of activity on a Likert-type scale ranging from 1-5. Positive responses were presented for each variable with respective activity type across the study years. The association of the effectiveness of teaching, learning …