Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Journal

Educational Assessment, Evaluation, and Research

Assessment

Institution
Publication Year
Publication

Articles 1 - 30 of 55

Full-Text Articles in Education

Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley Apr 2019

Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley

Journal of Research Initiatives

The purpose of this paper is to provide a model for educational leadership faculty who aspire to walk the talk of effective feedback by embedding standards-based grading (SBG) in their courses. Rather than focusing on learning, points are the currency of K-12 classrooms across the country. Over 100 years of grading research suggests typical grading practices are subjective at best. Some schools are responding by implementing SBG, yet few articles describe how higher education embeds this philosophy in educator preparation coursework. In this essay, the author documents how to design assessments, align rubrics, and provide feedback to aspiring school leaders ...


Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart Jan 2019

Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart

Numeracy

In a previous article, we described our college’s new core curriculum, which included a Quantitative Literacy (QL) component for the first time. We explained how we defined QL in the college catalog, and how we used that definition to choose courses to satisfy the new requirement. We then discussed our early efforts at assessing the effectiveness of the QL program and described our plans for the future. Here we report on our progress towards those goals, including working with faculty from other departments and with our institutional research office to develop a more sophisticated assessment plan, as well as ...


Design Of An Osce To Assess Clinical Competence Of Occupational Therapy Students, Nancy E. Krusen, Debra Rollins Jan 2019

Design Of An Osce To Assess Clinical Competence Of Occupational Therapy Students, Nancy E. Krusen, Debra Rollins

Journal of Occupational Therapy Education

Objective structured clinical examinations (OSCEs) are a series of controlled, timed stations in which students demonstrate clinical skills. OSCEs are commonly used within health professions education to demonstrate competence, prepare for clinical education, and conduct program evaluation. The body of literature addressing the use of OSCEs in occupational therapy (OT) is growing; however, there are no available guidelines for developing an OSCE specific to the profession. The purpose of this paper is to describe the design of an OSCE for OT students prior to fieldwork placement. Twelve OT practitioners participated in a modified-Delphi method to generate possible OSCE scenarios. The ...


Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg Dec 2018

Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg

Journal of Pre-College Engineering Education Research (J-PEER)

Reasoning about mechanism is central to disciplined inquiry in science and engineering and should thus be one of the foundations of a science, technology, engineering, and mathematics education. In addition, mechanistic reasoning is one of the core competencies listed in the Next Generation Science Standards (NGSS) Engineering Concepts and Practices (NGSS Lead States, 2013). Mechanistic explanations focus on the processes that underlie cause–effect relationships and consider how the activities of system components affect one another.

While some assessment work has been accomplished in engineering education, to date mechanistic reasoning is an area where limited assessment development has been accomplished ...


An Analysis Of Learning Outcomes In A Freshman Seminar Learning Community That Utilizes Peer Mentoring At A Community College, George J. Hill, Paula L. Risolo Ed. D Dec 2018

An Analysis Of Learning Outcomes In A Freshman Seminar Learning Community That Utilizes Peer Mentoring At A Community College, George J. Hill, Paula L. Risolo Ed. D

Learning Communities Research and Practice

While there has been research on the effects of utilizing Peer Mentors within Learning Communities with regards to retention data, little research has been done to show the effects that Peer Mentoring has on learning outcomes within a Learning Community. Using anecdotal evidence from peer mentors working within a Learning Community at an urban community college, we describe the effects that individual mentors have had on individual first-semester students. For a preliminary quantitative analysis, a pre post survey was given to two groups of Learning Community students, one group which had peer mentors attached to their Learning Communities (PMLC), and ...


Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva Nov 2018

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment ...


Navigating The Tensions Of Innovative Assessment And Pedagogy In Higher Education, Jennifer Lock, Beaumie Kim, Kim Koh, Gabrielle Wilcox Apr 2018

Navigating The Tensions Of Innovative Assessment And Pedagogy In Higher Education, Jennifer Lock, Beaumie Kim, Kim Koh, Gabrielle Wilcox

The Canadian Journal for the Scholarship of Teaching and Learning

Innovative practice in a classroom adds challenges and tensions to programs and institutional structures in higher education. With the recent emphasis on curricula reform, there is a great focus on assessment and pedagogical practices to support student learning. To illustrate the tensions arising from these efforts, we present four pedagogical and assessment innovation approaches using both Shulman’s (2005) Signature Pedagogies and Tatar’s (2007) Design Tensions frameworks. The four approaches include problem-based learning, game-based learning, case-based learning, and technology-enhanced learning. A narrative for each approach examines and addresses tensions using Shulman’s (2005) surface, deep and implicit structures. We ...


Using The Quantitative Literacy And Reasoning Assessment (Qlra) For Early Detection Of Students In Need Of Academic Support In Introductory Courses In A Quantitative Discipline: A Case Study, Nathan D. Grawe, Kristin O'Connell Jan 2018

Using The Quantitative Literacy And Reasoning Assessment (Qlra) For Early Detection Of Students In Need Of Academic Support In Introductory Courses In A Quantitative Discipline: A Case Study, Nathan D. Grawe, Kristin O'Connell

Numeracy

As the number of young people attending college has increased, the diversity of college students’ educational backgrounds has also risen. Some students enter introductory courses with math anxiety or gaps in their quantitative training that impede their ability to master or even grasp relevant disciplinary content. Too often professors learn of these anxieties and gaps only during the post mortem of the first midterm. By that time, a good portion of a student’s grade is determined and successful recovery may be impossible. During the 2016-17 academic year, the Department of Economics at Carleton College ran a pilot project using ...


Saudi Science Teachers' Assessment Practices In Alzelfy Educational Administration According To Their Perceptions, Saeed Mohammad Alshamrani Aug 2017

Saudi Science Teachers' Assessment Practices In Alzelfy Educational Administration According To Their Perceptions, Saeed Mohammad Alshamrani

International Journal for Research in Education

This paper aimed to identify science teachers' assessment practices according to their perceptions through identifying the assessment goals, activities, criteria, and the nature of assessment reports (types and data). It used the descriptive method; the population was all science teacher in Alzelfy educational administration in Saudi Arabia (106 teachers); however, the response rate was (38%) of the population. A questionnaire with four dimensions was developed; these dimensions are: the goals (two items), activities (20 items), criteria (six items), and the nature of reports (11 items). The results indicated that the teachers thought that they practiced the assessment highly to achieve ...


Preliminary Evaluation Of The Psychometric Quality Of HeightenTm Quantitative Literacy, Katrina C. Roohr, Hyesun Lee, Jun Xu, Ou Lydia Liu, Zhen Wang Jul 2017

Preliminary Evaluation Of The Psychometric Quality Of HeightenTm Quantitative Literacy, Katrina C. Roohr, Hyesun Lee, Jun Xu, Ou Lydia Liu, Zhen Wang

Numeracy

Quantitative literacy has been identified as an important student learning outcome (SLO) by both the higher education and workforce communities. This paper aims to provide preliminary evidence of the psychometric quality of the pilot forms for HEIghten quantitative literacy, a next-generation SLO assessment for students in higher education. We evaluated the psychometric quality of the test items (e.g., item analyses), individual- and group-level reliability, the relationship with student performance and related variables (e.g., grade point average) as well as student perceptions, and differences across college-related and demographic subgroups. Our study used data from a pilot test administered to ...


Informal Order, Needs Analysis, And The Eap Curriculum, Faisal S. Al-Maamari Jun 2017

Informal Order, Needs Analysis, And The Eap Curriculum, Faisal S. Al-Maamari

The Qualitative Report

The academic curriculum is developed through a systematic process whereby content is created through the alignment of needs to stakeholder or target group. This qualitative research study features a small-scale, English for academic purpose (EAP) needs analysis (NA) of three credit-bearing EAP programs and the corresponding departmental programs conducted at a Language Center at a higher education institution in Oman. Based on interview, observational and documentary data, the analysis showed divergences in academic literacy (writing and reading) between the EAP and content programs. Principally, the findings pointed to the presence and operation of a group of informal orders and the ...


The Consequential Validity Of The M-Step And Third-Grade Retention, Michelle L. Sprouse May 2017

The Consequential Validity Of The M-Step And Third-Grade Retention, Michelle L. Sprouse

Language Arts Journal of Michigan

This paper applies Slomp, Corrigan, and Sugimoto’s (2014) consequential validity framework to the third-grade Michigan Student Test of Educational Progress (M-STEP) in English language arts (ELA). Slomp et al.’s (2014) consequential validity framework provides for a holistic examination of the validity of the assessment and its consequences. Using this framework, this paper considers the construct of reading developed in the adopted standards, assessment design, sample assessment items, disaggregated performance data, and the assessment consequences. The number and magnitude of validity concerns raised in all aspects of the framework call into question the consequential validity of the assessment.


Teaching, Learning, And Assessment: Insights Into Students’ Motivation To Learn, Simon R. Walters, Pedro Silva, Jennifer Nikolai Apr 2017

Teaching, Learning, And Assessment: Insights Into Students’ Motivation To Learn, Simon R. Walters, Pedro Silva, Jennifer Nikolai

The Qualitative Report

This study draws upon the perspectives of sport and recreation undergraduate students in New Zealand who were involved in the design of their own assessments, and discusses the implication of the teaching and learning environment on this process. In a previous study, student criticism had emerged of current teaching strategies and assessment methods at their institution. The purpose of this current study was to directly address some of these concerns and for lecturers and students to work collaboratively to develop a more learner-centred teaching and learning environment. Students from a second-year sociology of sport paper were invited to design their ...


Hbcus: Accreditation, Governance And Survival Challenges In An Ever-Increasing Competition For Funding And Students, Jerry Crawford Ii Mar 2017

Hbcus: Accreditation, Governance And Survival Challenges In An Ever-Increasing Competition For Funding And Students, Jerry Crawford Ii

Journal of Research Initiatives

Historically Black Colleges and Universities (HBCUs) are facing challenges to their continued existence on several fronts. One is fiscally, as federal funding for education has been cut and the responsibility for paying for higher education has been levied on students and parents. Another challenge is the amount of endowment dollars available to them and lastly, there are questions today as to if HBCUs are still needed in a society that has allowed African-Americans to enroll in Predominantly White Institutions (PWIs). Both of these challenges are contingent on the most critical issue – accreditation. The loss of accreditation of units and entire ...


The Doctoral Comprehensive Examination In Counselor Education: Faculty Members’ Perception Of Its Purposes, Katie Kostohryz Dec 2016

The Doctoral Comprehensive Examination In Counselor Education: Faculty Members’ Perception Of Its Purposes, Katie Kostohryz

The Journal of Counselor Preparation and Supervision

This research focused on faculty members’ perceptions of the comprehensive examination in counselor education doctoral programs. A between-within repeated measure analysis of variance was computed to evaluate significant differences in perceptions of faculty toward five stated purposes of the comprehensive examination related to their current format of the comprehensive examination. Findings showed significant differences in perceptions within the five stated purposes of the comprehensive examination. There was no significant mean difference between faculty’s perceptions of the stated purposes and the current format of the comprehensive examination; however, a significant interaction was found between the format and purposes of the ...


International Developments (No.6) 2016 Jun 2016

International Developments (No.6) 2016

International Developments

In this issue of International Developments we look at the purposeful collection of educational data through progressive achievement testing to enable teachers to establish where students are in their long-term learning, diagnose individual strengths and weaknesses, identify the best next steps for action, decide on appropriate evidence-based interventions, monitor the progress students make over time, and evaluate the effectiveness of their own teaching decisions and approaches. We also explore how a new primary years assessment is helping teachers, curriculum designers and policymakers to better measure the learning achievement of students in South East Asia; investigate the impact of a professional ...


Long Term Benefits For Women In A Science, Technology, Engineering, And Mathematics Living-Learning Community, Jennifer L. Maltby, Christopher Brooks, Marjorie Horton, Helen Morgan May 2016

Long Term Benefits For Women In A Science, Technology, Engineering, And Mathematics Living-Learning Community, Jennifer L. Maltby, Christopher Brooks, Marjorie Horton, Helen Morgan

Learning Communities Research and Practice

Science, technology, engineering and math (STEM) degrees provide opportunities for economic mobility. Yet women, underrepresented minority (URM), and first-generation college students remain disproportionately underrepresented in STEM fields. This study examined the effectiveness of a living-learning community (LLC) for URM and first-generation first-year women interested in STEM. The authors utilized a matched sample post-hoc analysis to examine undergraduate and graduate degree attainment in science related fields for women who participated in the Women in Science Residence Program (WISERP) LLC compared to matched controls. The control group was matched on twelve characteristics that are associated with retention in STEM. First-generation college students ...


A Review Of: The Test: Why Our Schools Are Obsessed With Standardized Testing—But You Don’T Have To Be, Lasisi Ajayi May 2016

A Review Of: The Test: Why Our Schools Are Obsessed With Standardized Testing—But You Don’T Have To Be, Lasisi Ajayi

Wisdom in Education

This is a review of Anya Kamenetz's book, "The Test: Why our schools are obsessed with standardized testing—but you don’t have to be"


Impacts Of Neoliberal Managerial Practices On Faculty Engagement In Student Learning Assessment, Christopher Urban Apr 2016

Impacts Of Neoliberal Managerial Practices On Faculty Engagement In Student Learning Assessment, Christopher Urban

Prairie Journal of Educational Research

Faculty perceptions of student learning assessment were examined in the context of neoliberal trends in higher education in this exploratory survey study. For this preliminary study, a small department consisting of sixteen faculty members was surveyed. Responding faculty rated themselves as highly engaged in assessment, and rated course uses of assessment as more important than institutional uses of assessment. Faculty perceived administrators as placing more importance on institutional uses over course uses, though the gap between administrators and faculty was less in course uses than in institutional uses. Faculty ratings of neoliberal manifestations at their institution varied considerably, with a ...


Judging Airline Pilots’ Performance With And Without An Assessment Model: A Comparison Study Of The Scoring Of Raters From Two Different Airlines, David Weber Jan 2016

Judging Airline Pilots’ Performance With And Without An Assessment Model: A Comparison Study Of The Scoring Of Raters From Two Different Airlines, David Weber

Journal of Aviation/Aerospace Education & Research

Various models have been suggested to assess the performance of airline pilots. However, the influence of a model on assessors’ scoring remains largely unexplored. The aim of the present study was to contrast the assessments of raters from two airlines, who assessed performance in pairs of the same airline and rank by using or not using an assessment model. The results showed differences between the assessors of the two airlines in terms of their scoring. Implications were drawn in regards to the usage of a model and its influence on pilot performance assessment.


The Washback Of The Toefl Ibt In Vietnam, Melissa Barnes Jan 2016

The Washback Of The Toefl Ibt In Vietnam, Melissa Barnes

Australian Journal of Teacher Education

Washback, or the influence of testing on teaching and learning, has received considerable attention in language testing research over the past twenty years. It is widely argued that testing, particularly high-stakes testing, exerts a powerful influence, whether intended or unintended, positive or negative, on both teachers and learners. This article investigates the washback effects of a high-stakes English language proficiency test, the Test of English as a Foreign Language Internet-Based Test (TOEFL iBT), in Vietnam. Vietnam, a developing country whose educational philosophies differ from those underpinning the TOEFL iBT, provided a unique context to explore the test's washback. In ...


Developing School Heads As Instructional Leaders In School–Based Assessment: Challenges And Next Steps, Govinda Ishwar Lingam, Narsamma Lingam Jan 2016

Developing School Heads As Instructional Leaders In School–Based Assessment: Challenges And Next Steps, Govinda Ishwar Lingam, Narsamma Lingam

Australian Journal of Teacher Education

The aim of this paper is to present the findings of a study on school-based assessment in a Pacific nation – namely, the Solomon Islands. A questionnaire was designed consisting of both open-ended and closed-type questions to elicit the views of school heads on the challenges they faced in school-based assessment. The findings indicated that they faced difficulties in effectively carrying out school-based assessment due to the limited knowledge and skills they possessed. They highlighted that the initial teacher training programme did not include much on assessment and this adversely impacted their work as instructional leaders on assessment for learning and ...


Experiential Learning And The Basic Communication Course: A New Path To Assessing Forensic Learning Outcomes, Ben Walker Dec 2015

Experiential Learning And The Basic Communication Course: A New Path To Assessing Forensic Learning Outcomes, Ben Walker

Speaker & Gavel

Scholars have often touted the educational benefits of forensics (e.g.: Bartanen, 1998; Beasley, 1979; Brownlee, 1979; Ehninger, 1952; Gartell, 1973; Jensen, 2008; McBath, 1975; Millsap, 1998; Schroeder & Schroeder, 1995; Stenger, 1999; Yaremchuk, 1979). Critics, most notably Burnett, Brand, and Meister (2003), have argued forensics is only a competitive game with the idea of education used as a crutch to uphold the activity in the eyes of schools. While attempting to counter critics, many forensic educators have scrambled to find proof of student learning. Besides theoretical approaches to potential learning methods (e.g., Dreibelbis & Gullifor, 1992; Friedley, 1992; Sellnow, Littlefield, & Sellnow, 1992; Swanson, 1992; Zeuschner, 1992 ...


Surveying Assessment In Experiential Learning: A Single Campus Study, Thomas Yates, Jay Wilson, Kendra Purton Dec 2015

Surveying Assessment In Experiential Learning: A Single Campus Study, Thomas Yates, Jay Wilson, Kendra Purton

The Canadian Journal for the Scholarship of Teaching and Learning

The purpose of this study was to determine the methods of experiential assessment in use at a Canadian university and the extent to which they are used. Exploring experiential assessment will allow identification of commonly used methods and facilitate the development of best practices of assessment in the context of experiential learning (EL) at an institutional level. The origins of EL are found in the work of Dewey (1938), later modified by Kolb and Fry (1975). Experiential methods include: experiential education, service learning problem-based learning and others such as action learning, enquiry-based learning, and case studies. Faculty currently involved in ...


A Systematic Assessment Of ‘None Of The Above’ On Multiple Choice Tests In A First Year Psychology Classroom, Matthew V. Pachai, David Dibattista, Joseph A. Kim Dec 2015

A Systematic Assessment Of ‘None Of The Above’ On Multiple Choice Tests In A First Year Psychology Classroom, Matthew V. Pachai, David Dibattista, Joseph A. Kim

The Canadian Journal for the Scholarship of Teaching and Learning

Multiple choice writing guidelines are decidedly split on the use of ‘none of the above’ (NOTA), with some authors discouraging and others advocating its use. Moreover, empirical studies of NOTA have produced mixed results. Generally, these studies have utilized NOTA as either the correct response or a distractor and assessed its effect on difficulty and discrimination. In these studies, NOTA commonly yields increased difficulty when it is used as the correct response, and no change in discrimination regardless of usage. However, when NOTA is implemented as a distractor, rarely is consideration given to the distractor that could have been written ...


Identifying Teaching Effectiveness: Using Student Skill Surveys, Speech Evaluations, And Quiz Scores To Inform Instruction, Sally A. Blomstrom Nov 2015

Identifying Teaching Effectiveness: Using Student Skill Surveys, Speech Evaluations, And Quiz Scores To Inform Instruction, Sally A. Blomstrom

Communication and Theater Association of Minnesota Journal

This paper suggests an instrument for measuring students’ self perceptions of improvement in public speaking skills, i.e., a skill survey, and a method to inform and improve instruction by looking at results from that survey in combination with instructor evaluation forms for persuasive speeches, quiz scores, and an information literacy measure. Data were collected from students enrolled in a public speaking course at Embry-Riddle Aeronautical University. Background on the survey development and the method is provided along with results and discussion.


Assessing The Public Speaking Course, Roberta Freeman Nov 2015

Assessing The Public Speaking Course, Roberta Freeman

Communication and Theater Association of Minnesota Journal

College and high school speech communication instructors know full well how tedious and timeconsuming assessment can be; however, this instructor has found a way to make assessment a more efficient and meaningful tool identifying strengths and weaknesses within the public speaking curriculum. After five years of extensive research, several drafts of rubrics and artifacts, the process has been streamlined and successful in that the data compiled reflects the strengths and challenges of this instructor’s students. This article is intended to provide public speaking instructors the opportunity to replicate part of the Minnesota State Community & Technical College (M State) speech ...


Plans For Embedding Icts Into Teaching And Learning Through A Large-Scale Secondary Education Reform In The Country Of Georgia, Jayson W. Richardson, Gregory Sales, Sonja Sentočnik Jul 2015

Plans For Embedding Icts Into Teaching And Learning Through A Large-Scale Secondary Education Reform In The Country Of Georgia, Jayson W. Richardson, Gregory Sales, Sonja Sentočnik

FIRE: Forum for International Research in Education

Integrating ICTs into international development projects is common. However, focusing on how ICTs support leading, teaching, and learning is often overlooked. This article describes a team’s approach to technology integration into the design of a large-scale, five year, teacher and leader professional development project in the country of Georgia. The main goal of this project was to improve student outcomes via changing core pedagogical practices such as formative assessment, higher order thinking, and student-centered learning. In this article, we describe the background of the project, detail the country and sector context, the project team composition, the technological approach used ...


The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe Jul 2015

The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe

Numeracy

The Levels of Conceptual Understanding in Statistics (LOCUS) project (NSF DRL-111868) has created assessments that measure conceptual (rather than procedural) understanding of statistics as outlined in GAISE Framework (Franklin et al., 2007, Guidelines for Assessment and Instruction in Statistics Education, American Statistical Association). Here we provide a brief overview of the LOCUS project and present results from multiple-choice items on the pilot administration of the assessments with data collected from over 3400 students in grades 6-12 across six states. These results help illustrate students’ understanding of statistical topics prior to the implementation of the Common Core State Standards. Using the ...


The Quantitative Reasoning For College Science (Quarcs) Assessment, 1: Development And Validation, Katherine B. Follette, Donald W. Mccarthy, Erin Dokter, Sanlyn Buxner, Edward Prather Jul 2015

The Quantitative Reasoning For College Science (Quarcs) Assessment, 1: Development And Validation, Katherine B. Follette, Donald W. Mccarthy, Erin Dokter, Sanlyn Buxner, Edward Prather

Numeracy

Science is an inherently quantitative endeavor, and general education science courses are taken by a majority of college students. As such, they are a powerful venue for advancing students’ skills and attitudes toward mathematics. This article reports on the development and validation of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a numeracy assessment instrument designed for college-level general education science students. It has been administered to more than four thousand students over eight semesters of refinement. We show that the QuaRCS is able to distinguish varying levels of quantitative literacy and present performance statistics for both individual items and ...