Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

PDF

2018

Educational Assessment, Evaluation, and Research

Assessment

Institution
Publication
Publication Type

Articles 1 - 30 of 44

Full-Text Articles in Education

Mapping Of Physics Problem-Solving Skills Of Senior High School Students Using Physpross-Cat, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Revnika Faizah Dec 2018

Mapping Of Physics Problem-Solving Skills Of Senior High School Students Using Physpross-Cat, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Revnika Faizah

REID (Research and Evaluation in Education)

Evaluation using computerized adaptive tests (CAT) is an alternative to paper-based tests (PBT). This study was aimed at mapping physics problem-solving skills using PhysProSS-CAT on the basis of the item response theory (IRT). The study was conducted inSleman Regency, Yogyakarta, involving 156 students of Grade XI of senior high school. Sampling was done using stratified random sampling technique. The results of the study show that the PhysProSS-CAT is able to accurately measure physics problem-solving skills. Students' competences in physics problem solving can be mapped as 6% of the very high category, 4% of the high category, 36% of the medium …


Assessment Of The Social Attitude Of Primary School Students, Ari Setiawan, Siti Partini Suardiman Dec 2018

Assessment Of The Social Attitude Of Primary School Students, Ari Setiawan, Siti Partini Suardiman

REID (Research and Evaluation in Education)

The implementation of Curriculum 2013 at primary school level brings about its own problems to teachers. A serious problem emerges in the assessment, especially the assessment of core competence for the social attitude aspect. This problem arises because social attitude has many dimensions and requires judgments in diverse forms. In addition, the assessment of social attitude is focused on the affective sphere. The objective of this research is to assess the social attitude of grade IV and/or V students of primary school using three integrated instrument models: self-assessment (SA), peer assessment (PA), and observational assessment (OA). This research employed qualitative …


Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg Dec 2018

Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg

Journal of Pre-College Engineering Education Research (J-PEER)

Reasoning about mechanism is central to disciplined inquiry in science and engineering and should thus be one of the foundations of a science, technology, engineering, and mathematics education. In addition, mechanistic reasoning is one of the core competencies listed in the Next Generation Science Standards (NGSS) Engineering Concepts and Practices (NGSS Lead States, 2013). Mechanistic explanations focus on the processes that underlie cause–effect relationships and consider how the activities of system components affect one another.

While some assessment work has been accomplished in engineering education, to date mechanistic reasoning is an area where limited assessment development has been accomplished for …


Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva Nov 2018

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment; and …


The Gaise College Report: The American Statistical Association Meets Sound Pedagogy In Central Virginia, Beverly Wood Nov 2018

The Gaise College Report: The American Statistical Association Meets Sound Pedagogy In Central Virginia, Beverly Wood

Beverly Wood

Research in undergraduate statistics education often centers on the introductory course required for a large percentage of college students. While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses in various academic departments to provide explicit evidence for this assumption. The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The College …


Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood Nov 2018

Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood

Beverly Wood

In 2005 the American Statistical Association (ASA) endorsed the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report. This report has had a profound impact on the teaching of introductory statistics in two- and four-year institutions, and the six recommendations put forward in the report have stood the test of time. Much has happened within the statistics education community and beyond in the intervening 10 years, making it critical to re-evaluate and update this important report. For readers who are unfamiliar with the original GAISE College Report or who are new to the statistics education community, the full …


A Different Way To Provide Feedback Of Student Learning, Dr. Deborah Bracke Oct 2018

A Different Way To Provide Feedback Of Student Learning, Dr. Deborah Bracke

Education: Faculty Scholarship & Creative Works

This article provides an alternative to traditional letter grading.


What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston Sep 2018

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

Veronica Wells

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …


Teaching To Assess: An Evaluation Of Assessment Education For Secondary Teacher Candidates, Daniel M. Frederking Aug 2018

Teaching To Assess: An Evaluation Of Assessment Education For Secondary Teacher Candidates, Daniel M. Frederking

Theses and Dissertations

This study examined the assessment instruction of a four-year undergraduate secondary education program and its alignment to the teaching standards and the summative teacher licensure assessment. Document analyses were conducted on the program’s syllabi as well as the assessment portions of the InTASC standards and the handbook of the edTPA. Results highlighted several areas of misalignment in the areas of categorical concurrence, depth of knowledge, and range of knowledge. Also of note, preservice teachers in different secondary subject areas are receiving different amounts of assessment instruction. Additionally, local edTPA data was examined to highlight areas of strength and weakness. Students …


The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing Aug 2018

The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing

Boise State University Theses and Dissertations

The quantitative study presented here evaluates the effects of formative and summative assessment on student’s connectedness, satisfaction, learning and academic performance within a university three-credit 400 level online healthcare course. Literature exploring the role that formative assessment plays within an online environment is currently lacking. Additionally, understanding how assessment practices can help support the goals of online healthcare education is vitally important given the rise in popularity of this delivery format.

This study investigated student outcomes in the form of connectedness, satisfaction, learning and academic performance. Four cohorts of students were included in this study. Two cohorts were provided with …


Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik Jul 2018

Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik

Eric A. Kowalik

Learning management systems (LMS) are widely used in education. They offer the potential for assessing student learning, but the reality of using them for this is problematic. This case study chronicles efforts by librarians at Marquette University to use LMS data to assess students’ information literacy knowledge in Marquette’s first-year English program.


Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Sara Kuhn

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"The seven-level Researcher Skill Development framework extends the RSD's original 5 levels of student autonomy to include the degree of autonomy required for a successful research career. It therefore addresses not only students, but also early, middle and late career researchers. This involves the extension of the same facets of inquiry that appear in the original RSD framework to include two higher levels: 6 and 7." -- https://www.adelaide.edu.au/rsd/framework/rsd7/

For more information, see: Willison, J., & O’Regan, K. (2007). Commonly known, commonly not known, …


Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Sara Kuhn

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"Research Skill Development (RSD) is about making explicit and coherent in regular university coursework the incremental attainment of research skills in a specific discipline. In the RSD, there are six facets of the research process, identified from the literature and modified according to Bloom’s taxonomy and our experiences of using the framework in the disciplines. The meaning of ‘research’ in this context is: students actively finding information new to themselves. Underlying this notion is the ‘degree of knowness’ of knowledge: whether research involves …


Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Open Educational Resources

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"The seven-level Researcher Skill Development framework extends the RSD's original 5 levels of student autonomy to include the degree of autonomy required for a successful research career. It therefore addresses not only students, but also early, middle and late career researchers. This involves the extension of the same facets of inquiry that appear in the original RSD framework to include two higher levels: 6 and 7." -- https://www.adelaide.edu.au/rsd/framework/rsd7/

For more information, see: Willison, J., & O’Regan, K. (2007). Commonly known, commonly not known, …


Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn Jul 2018

Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Open Educational Resources

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"Research Skill Development (RSD) is about making explicit and coherent in regular university coursework the incremental attainment of research skills in a specific discipline. In the RSD, there are six facets of the research process, identified from the literature and modified according to Bloom’s taxonomy and our experiences of using the framework in the disciplines. The meaning of ‘research’ in this context is: students actively finding information new to themselves. Underlying this notion is the ‘degree of knowness’ of knowledge: whether research involves …


Faculty Development Initiatives: A Prerequisite For Capacity Building And Enhanced Productivity In A Medical Institution, Rehana Rehman, Hassan Mehmood, Syeda Fatima, Irfanullah Baig, Zohaib Rana, Mohammad Iqbal Jun 2018

Faculty Development Initiatives: A Prerequisite For Capacity Building And Enhanced Productivity In A Medical Institution, Rehana Rehman, Hassan Mehmood, Syeda Fatima, Irfanullah Baig, Zohaib Rana, Mohammad Iqbal

Department of Biological & Biomedical Sciences

Objective: To determine the contribution of teaching, learning and assessment forum's initiatives on professional development of faculty and staff.
Methods: This retrospective study was conducted at the Department of Biological and Biomedical Sciences, Aga Khan University, Karachi, from July to December 2016, and comprised teaching, learning and assessment activities carried out from 2012 to 2015. The responses acquired from feedback evaluation were recorded at the end of activity on a Likert-type scale ranging from 1-5. Positive responses were presented for each variable with respective activity type across the study years. The association of the effectiveness of teaching, learning …


Multiple–True–False Questions Reveal The Limits Of The Multiple–Choice Format For Detecting Students With Incomplete Understandings, Brian Couch, Joanna K. Hubbard, Chad Brassil Jun 2018

Multiple–True–False Questions Reveal The Limits Of The Multiple–Choice Format For Detecting Students With Incomplete Understandings, Brian Couch, Joanna K. Hubbard, Chad Brassil

School of Biological Sciences: Faculty Publications

By having students select one answer among several plausible options, multiple–choice (MC) questions capture a student’s preferred answer but provide little information regarding a student’s thinking on the remaining options. We conducted a crossover design experiment in which similar groups of introductory biology students were assigned verbatim questions in the MC format or multiple–true–false (MTF) format, which requires students to separately evaluate each option as either true or false. Our data reveal that nearly half of the students who select the correct MC answer likely hold incorrect understandings of the other options and that the selection rates for individual MC …


Breaking The Language Barrier: Equitable Assessment In General Chemistry, Eshani Lee May 2018

Breaking The Language Barrier: Equitable Assessment In General Chemistry, Eshani Lee

UNLV Theses, Dissertations, Professional Papers, and Capstones

Because language provides the framework through which knowledge is constructed, it is crucial to consider the ways in which students with limited English proficiencies are able to express their understanding. English language learners (ELLs) make up a significant portion of the student body in the education system and represent many ethnic and racial minorities in STEM (Science, Technology, Engineering & Mathematics) fields (Burke & Mattis, 2007). Despite the national push to build a more diversified, STEM-ready workforce, there is little research that considers the way ELLs are assessed in STEM courses at the postsecondary level. Literature reports that science tests …


Motivational Decline And Recovery In Higher Education Stem Courses, Anna M. Young, Paul J. Wendel, Joan M. Esson, Kathryn M. Plank Apr 2018

Motivational Decline And Recovery In Higher Education Stem Courses, Anna M. Young, Paul J. Wendel, Joan M. Esson, Kathryn M. Plank

Education Faculty Scholarship & Creative Works

Decline in student motivation is a concern for STEM education, especially for underrepresented groups in the sciences. Using the Science Motivation Questionnaire II, 41 foundational STEM courses were surveyed at the beginning and end of each semester in an academic year at a small primarily undergraduate university. Significant pre- to post-semester declines were observed in each of five measured motivational factors (Intrinsic motivation, Career motivation, Self determination, Self-efficacy, and Grade motivation), with effect sizes ranging from 0.21 to 0.41. However, in the second semester pre-survey, four motivational factors rebounded, including three returning to initial levels, suggesting that the observed motivational …


The Validity Of Validity In Debra P.: Judicial And Psychometric Perspectives On Test Consequences, Charles Olney, Brent Duckor Apr 2018

The Validity Of Validity In Debra P.: Judicial And Psychometric Perspectives On Test Consequences, Charles Olney, Brent Duckor

Faculty Publications

We explore the uses and functions of ‘validity’ as a boundary marker between legal theory and psychometrics. Standardized testing regimes rely on experts to articulate the limits of validity. When challenged in courts, these limits become the subject of contestation, requiring practitioners to litigate the validity of validity. This process generates significant discontinuities, resulting from different conceptual relationships to the idea of validity. Through a qualitative textual analysis of specific case law and a quantitative examination of Lexis-Nexis database archives, we trace how legal reasoning elides new developments in psychometric research that would broaden and enrich judicial treatments while showing …


Aligning To Extend Resource Capacities And Enhance Students' Acquisition Of Social And Cultural Capital, Michelle Maloney, Allison Dumas Apr 2018

Aligning To Extend Resource Capacities And Enhance Students' Acquisition Of Social And Cultural Capital, Michelle Maloney, Allison Dumas

Pacific's Annual Assessment Conference

No abstract provided.


Getting To Square One: Managing Cognitive Load, Eleanor Wittrup Apr 2018

Getting To Square One: Managing Cognitive Load, Eleanor Wittrup

Pacific's Annual Assessment Conference

No abstract provided.


Integrated Leadership And Critical Thinking Assessment Study, Tarianne Goteli Cotton, Sandra Mahoney Apr 2018

Integrated Leadership And Critical Thinking Assessment Study, Tarianne Goteli Cotton, Sandra Mahoney

Pacific's Annual Assessment Conference

No abstract provided.


A Longitudinal Study Of Pacific Students' Alcohol And Other Drug Use: Using Data To Inform Prevention And Intervention Strategies, Heather Dunn Carlton Apr 2018

A Longitudinal Study Of Pacific Students' Alcohol And Other Drug Use: Using Data To Inform Prevention And Intervention Strategies, Heather Dunn Carlton

Pacific's Annual Assessment Conference

No abstract provided.


Tiger Pathways Creating A Cohort Experience To Support First Year Students, Anne Eastlick, Jesus Margarito Apr 2018

Tiger Pathways Creating A Cohort Experience To Support First Year Students, Anne Eastlick, Jesus Margarito

Pacific's Annual Assessment Conference

No abstract provided.


What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston Apr 2018

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

Pacific's Annual Assessment Conference

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …


What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston Apr 2018

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

University Libraries Librarian and Staff Presentations

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …


Trends In Assessment: Implications And Opportunities For Department Chairs, Stephen P. Hundley Mar 2018

Trends In Assessment: Implications And Opportunities For Department Chairs, Stephen P. Hundley

Academic Chairpersons Conference Proceedings

Learn about trends in assessment from the executive editor of Assessment Update and chair of the national-level Assessment Institute. Attention will be paid to the role of the chair in creating a culture of assessment, supporting student success, and in using assessment results to inform department planning and improvement efforts.


1. Why Use Norm Referenced Standardized Tests To Answer: Did I Teach? Did They Learn?, John Hobe Mar 2018

1. Why Use Norm Referenced Standardized Tests To Answer: Did I Teach? Did They Learn?, John Hobe

National Youth Advocacy and Resilience Conference

  1. : If it is state law that students must attend school or be home schooled until they are a certain age, then must the state protect them while at public schools? The answer seems self-evident. Indeed, the United States Constitution’s 14th Amendment guarantees equal protection under the laws to its citizens. But do school practices unintentionally violate this protection?


Is Setting Higher Standards The Answer?, Geoff N. Masters Ao Mar 2018

Is Setting Higher Standards The Answer?, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Raising the expected performance standard in each year of school and holding all teachers and students accountable for achieving these higher standards may not be the most effective way to improve levels of performance in Australian schools.