Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

Assessment

Institution
Publication Year
Publication
Publication Type
File Type

Articles 1 - 30 of 689

Full-Text Articles in Education

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond Aug 2019

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media ...


Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge Aug 2019

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment ...


Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson Aug 2019

Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson

Publications of the Buros Center Professional Staff

The article discusses salient factors that influence the current context within which homeschooling occurs. Individual states have applied various approaches to establish regulations that both preserve the rights of homeschooling parents and fulfill the state’s obligation to ensure that its residents receive the education to which they are constitutionally entitled. Case and ethnographic studies or research involving small and selected samples often appear in outlets associated with homeschool advocacy groups or in outlets that are not mainstream. The paucity of empirical evidence derived from methodologically strong research paradigms has led to little certainty about many aspects of homeschooling including ...


Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz Jul 2019

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each ...


What's In Our Assessment Utility Belt, A. Carey Huddlestun Jun 2019

What's In Our Assessment Utility Belt, A. Carey Huddlestun

A. Carey Huddlestun

This presentation will present practical assessment resources used by instruction librarians. It will feature assessment resources we use most often; ones we keep in our assessment 'utility belts.' This 25 minute presentation will broadly cover how these resources are used in real world instructional settings. Types of resources presented will include books, websites, and community resources. We will provide time for discussion and for attendees to share their preferred assessment resources.


Comparison Of National Assessment Of Educational Progress (Naep) Reports And State Physical Education Mandates, Erick Alfonso May 2019

Comparison Of National Assessment Of Educational Progress (Naep) Reports And State Physical Education Mandates, Erick Alfonso

Seton Hall University Dissertations and Theses (ETDs)

There have been several studies that analyzed the relationship between physical education and academic achievement at a local level, but a longitudinal analysis across the United States has not been done. An understanding of the relationship between physical education policies across the United States and academic achievement at the state level may provide insight into best practices to ensure that comprehensive physical education policies are adopted in all states. Using data from the Society of Health and Physical Educators and The National Assessment of Educational Progress, I investigated the relationship between physical education policies and academic achievement. Minor relationships with ...


A Closer Look At Toefl Speaking Assessment Test: A Guide To Teaching Toefl Ibt Speaking, Glen Ryan Alejandro May 2019

A Closer Look At Toefl Speaking Assessment Test: A Guide To Teaching Toefl Ibt Speaking, Glen Ryan Alejandro

Master's Projects and Capstones

The lack of reliable speaking learning materials has been a problem of some non-native English speakers who are preparing for the TOEFL iBT Test (Test of English as a Foreign Language Internet-Based Test) and who are struggling most with the speaking section of said standardized test. Consequently, the lack of these reliable resources has been the main concern of TOEFL iBT speaking instructors whose main goal is to help meet the needs of these struggling students. As a result, many non-native English speakers who are preparing for the speaking section of the TOEFL iBT Test are not able to meet ...


Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley May 2019

Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley

Matt Townsley

The purpose of this paper is to provide a model for educational leadership faculty who aspire to walk the talk of effective feedback by embedding standards-based grading (SBG) in their courses. Rather than focusing on learning, points are the currency of K-12 classrooms across the country. Over 100 years of grading research suggests typical grading practices are subjective at best. Some schools are responding by implementing SBG, yet few articles describe how higher education embeds this philosophy in educator preparation coursework. In this essay, the author documents how to design assessments, align rubrics, and provide feedback to aspiring school leaders ...


What To Do With All This Data? Using Competency Assessment For Advising, Rachel A. Guimond, Hillary Cole Apr 2019

What To Do With All This Data? Using Competency Assessment For Advising, Rachel A. Guimond, Hillary Cole

Scholar Week 2016 - present

While assessment serves a critical role in providing direction for program development, student outcome data can also foster individual growth. This presentation will explore the existing research on different advising models and the ONU Social Work Program’s system for using assessment for accreditation to advise students toward professional growth.


Improving The Rigor Of Online Education: Exploring Characteristics Of Faculty And Syllabi Within An Online Program Assessment Process, Brad J. Hamel Apr 2019

Improving The Rigor Of Online Education: Exploring Characteristics Of Faculty And Syllabi Within An Online Program Assessment Process, Brad J. Hamel

All NMU Master's Theses

As online course enrollments grow, overall perception of rigor still lags compared to that of traditional face-to-face education. The purpose of this research was to tie faculty and syllabi characteristics to the rigor of online courses. This study explored the relationship between faculty and syllabi characteristics and performance on an online entry-level course design quality assurance assessment (pass, pass with concern, or fail). A decision tree analysis was used to predict the relationship of the independent (faculty and syllabi characteristics) and the dependent (entry-level course design assessment) variables. Findings suggest that faculty rank and writing intensive are key characteristics predictive ...


Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley Apr 2019

Walking The Talk: Embedding Standards-Based Grading In An Educational Leadership Course, Matt Townsley

Journal of Research Initiatives

The purpose of this paper is to provide a model for educational leadership faculty who aspire to walk the talk of effective feedback by embedding standards-based grading (SBG) in their courses. Rather than focusing on learning, points are the currency of K-12 classrooms across the country. Over 100 years of grading research suggests typical grading practices are subjective at best. Some schools are responding by implementing SBG, yet few articles describe how higher education embeds this philosophy in educator preparation coursework. In this essay, the author documents how to design assessments, align rubrics, and provide feedback to aspiring school leaders ...


The Double-Edged Sword Of Standardized Testing, Barbara Meyer, Christine Paxson Mar 2019

The Double-Edged Sword Of Standardized Testing, Barbara Meyer, Christine Paxson

Faculty Publications - College of Education

Assessment in Pk-12 schools has always been a challenge. Measurement and comparison of students, schools, school districts and states provides accountability for all stakeholders in education. Standardized testing has become the norm, but it is overused. The Partnership for Assessment of Readiness for College and Careers is one test adopted on a large scale to measure whether students are prepared for college and career. Parents are one of the stakeholders who had had concerns about another standardized test, but they also recognize the need. A survey was conducted of parents whose children took PARCC to learn their expectations of the ...


Piloting Pbl For Senior Military Leaders, Megan J. Hennessey Ph.D., Celestino Perez Jan 2019

Piloting Pbl For Senior Military Leaders, Megan J. Hennessey Ph.D., Celestino Perez

SoTL Commons Conference

The U.S. Army War College is an accredited professional military education institution that develops strategic leaders and skilled problem solvers in order to achieve national security objectives. During the 2018-2019 academic year, faculty piloted a problem-based learning (PBL) design in the Introduction to Strategic Studies course to explore how executive-level students: (1) translate knowledge of strategy into performance and (2) how engagement in PBL influenced students’ sense of belonging in the seminar environment using Walton and Cohen’s (2007) Sense of Belonging instrument.


Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock Jan 2019

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of ...


Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock Jan 2019

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Faculty Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of ...


Perceptions Of Assessment In Norwegian Occupational Therapy Students, Tore Bonsaksen, Astrid Gramstad, Gry Mørk, Susanne G. Johnson Jan 2019

Perceptions Of Assessment In Norwegian Occupational Therapy Students, Tore Bonsaksen, Astrid Gramstad, Gry Mørk, Susanne G. Johnson

Journal of Occupational Therapy Education

In addition to securing minimum standards of learning among students, assessment is increasingly used as a tool to improve students’ learning. Assessment quality is measured as part of the Course Experience Questionnaire; however, the original ‘appropriate assessment’ scale has demonstrated ambiguous psychometric properties. The current study aimed to gain knowledge about occupational therapy students’ perceptions of assessment, and this was achieved by examining the factor structure and internal consistency of the six items on the ‘appropriate assessment’ scale. Students from six Norwegian universities (n = 187, response rate 61.3 %) completed the scale and reported demographic information. The factor structure of ...


Design Of An Osce To Assess Clinical Competence Of Occupational Therapy Students, Nancy E. Krusen, Debra Rollins Jan 2019

Design Of An Osce To Assess Clinical Competence Of Occupational Therapy Students, Nancy E. Krusen, Debra Rollins

Journal of Occupational Therapy Education

Objective structured clinical examinations (OSCEs) are a series of controlled, timed stations in which students demonstrate clinical skills. OSCEs are commonly used within health professions education to demonstrate competence, prepare for clinical education, and conduct program evaluation. The body of literature addressing the use of OSCEs in occupational therapy (OT) is growing; however, there are no available guidelines for developing an OSCE specific to the profession. The purpose of this paper is to describe the design of an OSCE for OT students prior to fieldwork placement. Twelve OT practitioners participated in a modified-Delphi method to generate possible OSCE scenarios. The ...


Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart Jan 2019

Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart

Numeracy

In a previous article, we described our college’s new core curriculum, which included a Quantitative Literacy (QL) component for the first time. We explained how we defined QL in the college catalog, and how we used that definition to choose courses to satisfy the new requirement. We then discussed our early efforts at assessing the effectiveness of the QL program and described our plans for the future. Here we report on our progress towards those goals, including working with faculty from other departments and with our institutional research office to develop a more sophisticated assessment plan, as well as ...


Validating Bloom's Revised Taxonomy As A Rubric For Assessing Middle School Students' Levels Of Thinking, Siri Torrence Deforest Reynolds Jan 2019

Validating Bloom's Revised Taxonomy As A Rubric For Assessing Middle School Students' Levels Of Thinking, Siri Torrence Deforest Reynolds

Walden Dissertations and Doctoral Studies

Educators in a rural charter middle school in the United States were challenged with the reliable assessment of student thinking skills even though the development of higher order thinking was an espoused goal for the school. The purpose of this study was to validate a new rubric based on Bloom’s Revised Taxonomy (BRT) to reliably assess student levels of thinking as reflected in the students’ written work. A quantitative, nonexperimental design was used. The focus of the research questions was on the BRT rubric’s reliability and validity. Interrater reliability was assessed using Krippendorff’s alpha. Validity was explored ...


Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg Dec 2018

Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg

Journal of Pre-College Engineering Education Research (J-PEER)

Reasoning about mechanism is central to disciplined inquiry in science and engineering and should thus be one of the foundations of a science, technology, engineering, and mathematics education. In addition, mechanistic reasoning is one of the core competencies listed in the Next Generation Science Standards (NGSS) Engineering Concepts and Practices (NGSS Lead States, 2013). Mechanistic explanations focus on the processes that underlie cause–effect relationships and consider how the activities of system components affect one another.

While some assessment work has been accomplished in engineering education, to date mechanistic reasoning is an area where limited assessment development has been accomplished ...


An Analysis Of Learning Outcomes In A Freshman Seminar Learning Community That Utilizes Peer Mentoring At A Community College, George J. Hill, Paula L. Risolo Ed. D Dec 2018

An Analysis Of Learning Outcomes In A Freshman Seminar Learning Community That Utilizes Peer Mentoring At A Community College, George J. Hill, Paula L. Risolo Ed. D

Learning Communities Research and Practice

While there has been research on the effects of utilizing Peer Mentors within Learning Communities with regards to retention data, little research has been done to show the effects that Peer Mentoring has on learning outcomes within a Learning Community. Using anecdotal evidence from peer mentors working within a Learning Community at an urban community college, we describe the effects that individual mentors have had on individual first-semester students. For a preliminary quantitative analysis, a pre post survey was given to two groups of Learning Community students, one group which had peer mentors attached to their Learning Communities (PMLC), and ...


Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva Nov 2018

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment ...


The Gaise College Report: The American Statistical Association Meets Sound Pedagogy In Central Virginia, Beverly Wood Nov 2018

The Gaise College Report: The American Statistical Association Meets Sound Pedagogy In Central Virginia, Beverly Wood

Beverly Wood

Research in undergraduate statistics education often centers on the introductory course required for a large percentage of college students. While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses in various academic departments to provide explicit evidence for this assumption. The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The ...


Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood Nov 2018

Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood

Beverly Wood

In 2005 the American Statistical Association (ASA) endorsed the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report. This report has had a profound impact on the teaching of introductory statistics in two- and four-year institutions, and the six recommendations put forward in the report have stood the test of time. Much has happened within the statistics education community and beyond in the intervening 10 years, making it critical to re-evaluate and update this important report. For readers who are unfamiliar with the original GAISE College Report or who are new to the statistics education community, the full ...


Teaching To Assess: An Evaluation Of Assessment Education For Secondary Teacher Candidates, Daniel M. Frederking Aug 2018

Teaching To Assess: An Evaluation Of Assessment Education For Secondary Teacher Candidates, Daniel M. Frederking

Theses and Dissertations

This study examined the assessment instruction of a four-year undergraduate secondary education program and its alignment to the teaching standards and the summative teacher licensure assessment. Document analyses were conducted on the program’s syllabi as well as the assessment portions of the InTASC standards and the handbook of the edTPA. Results highlighted several areas of misalignment in the areas of categorical concurrence, depth of knowledge, and range of knowledge. Also of note, preservice teachers in different secondary subject areas are receiving different amounts of assessment instruction. Additionally, local edTPA data was examined to highlight areas of strength and weakness ...


The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing Aug 2018

The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing

Boise State University Theses and Dissertations

The quantitative study presented here evaluates the effects of formative and summative assessment on student’s connectedness, satisfaction, learning and academic performance within a university three-credit 400 level online healthcare course. Literature exploring the role that formative assessment plays within an online environment is currently lacking. Additionally, understanding how assessment practices can help support the goals of online healthcare education is vitally important given the rise in popularity of this delivery format.

This study investigated student outcomes in the form of connectedness, satisfaction, learning and academic performance. Four cohorts of students were included in this study. Two cohorts were provided ...


Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik Jul 2018

Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik

Eric A. Kowalik

Learning management systems (LMS) are widely used in education. They offer the potential for assessing student learning, but the reality of using them for this is problematic. This case study chronicles efforts by librarians at Marquette University to use LMS data to assess students’ information literacy knowledge in Marquette’s first-year English program.


Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Sara Kuhn

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"The seven-level Researcher Skill Development framework extends the RSD's original 5 levels of student autonomy to include the degree of autonomy required for a successful research career. It therefore addresses not only students, but also early, middle and late career researchers. This involves the extension of the same facets of inquiry that appear in the original RSD framework to include two higher levels: 6 and 7." -- https://www.adelaide.edu.au/rsd/framework/rsd7/

For more information, see ...


Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Sara Kuhn

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"Research Skill Development (RSD) is about making explicit and coherent in regular university coursework the incremental attainment of research skills in a specific discipline. In the RSD, there are six facets of the research process, identified from the literature and modified according to Bloom’s taxonomy and our experiences of using the framework in the disciplines. The meaning of ‘research’ in this context is: students actively finding information new to themselves. Underlying this notion is the ‘degree of knowness ...


Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Open Educational Resources

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"The seven-level Researcher Skill Development framework extends the RSD's original 5 levels of student autonomy to include the degree of autonomy required for a successful research career. It therefore addresses not only students, but also early, middle and late career researchers. This involves the extension of the same facets of inquiry that appear in the original RSD framework to include two higher levels: 6 and 7." -- https://www.adelaide.edu.au/rsd/framework/rsd7/

For more information, see ...