Science and Mathematics Education Commons^™

The Redesigned Sat Calls For A Conceptual Approach, Jeff Mccalla

Colorado Mathematics Teacher

Be intentional about including conceptual questions on every assessment that students take.

Probing For Bias: Comparing Populations Using Item Response Curves, Paul J. Walter, Edward Nuhfer, Crisel Suarez

Numeracy

We introduce an approach for making a quantitative comparison of the item response curves (IRCs) of any two populations on a multiple-choice test instrument. In this study, we employ simulated and actual data. We apply our approach to a dataset of 12,187 participants on the 25-item Science Literacy Concept Inventory (SLCI), which includes ample demographic data of the participants. Prior comparisons of the IRCs of different populations addressed only two populations and were made by visual inspection. Our approach allows for quickly comparing the IRCs for many pairs of populations to identify those items where substantial differences exist. For each …

Science Teachers’ Infusion Of Peer Assessment In Primary School, Usha Nair Tangaraju

Student Works (2020-2029)

Infusing peer assessment strategies into science lessons have the potential to enhance learner autonomy. Learner autonomy is an important attribute as an educational outcome. Nevertheless, research indicates that teachers do not infuse peer assessment strategies that teachers perceive as challenges. Thus, this study examines how primary science teachers infuse peer assessment strategies and to investigate the challenges these teachers face when infusing these strategies. The exploratory qualitative research design was utilized. The sample of this study were three primary school science teachers. These teachers were chosen because of their willingness to participate in the study. Data collection techniques employed were …

Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall

Numeracy

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …

The Effects Of Teacher Professional Development And Self-Efficacy On Classroom Uses Of Information And Computer Technologies, Elif N. Gokbel

Electronic Theses and Dissertations

The uses of new technologies during mathematics instruction are essential for maintaining opportunities for students to gain better understanding of the content and become digital learners in the information age. Although scholars found technology integration is helpful in improving students’ mathematics achievement, the role of teachers’ preparedness for technology integration remains critical.

Technology professional development and self-efficacy are two major factors impacting teachers’ successful integration of instructional technologies. The purpose of this study was to provide a more in-depth look into (i) mathematics teachers technology uses during direct instruction, dialogic instruction, and assessment; (ii) the relationship between various types of …

Multiple True-False Questions Reveal More Thoroughly The Complexity Of Student Thinking Than Multiple-Choice Questions: A Bayesian Item Response Model Comparison, Chad Brassil, Brian A. Couch

School of Biological Sciences: Faculty Publications

Background: Within undergraduate science courses, instructors often assess student thinking using closed-ended question formats, such as multiple-choice (MC) and multiple-true-false (MTF), where students provide answers with respect to predetermined response options. While MC and MTF questions both consist of a question stem followed by a series of options, MC questions require students to select just one answer, whereas MTF questions enable students to evaluate each option as either true or false. We employed an experimental design in which identical questions were posed to students in either format and used Bayesian item response modeling to understand how responses in each …

Assessment Instrument For Practicum Skills In Trimyristin Separation For Undergraduate Students, Naseer Ahmed, Senam Senam, Antuni Wiyarsi

Jurnal Inovasi Pendidikan IPA

Assessment of practicum plays an essential role in gaining knowledge and skill. Because practical work is an essential component of science courses, there were need to develop new instruments to examine practicum skill. To gain the purpose, Research and Development method used, Borg and Gall's model was adopted in this research. Observation sheets were used to obtain data. The qualitative data analysis technique was used to make coding. The data were described using descriptive statistics. It was used to determine the ability of students to practice in general, purposive sampling technique used for data collection. Products of practical's skills assessment …

Grading For Growth: Using Sliding Scale Rubrics To Motivate Struggling Learners, Dina Mahmood, Hugo Jacobo

Interdisciplinary Journal of Problem-Based Learning

In an effort to adopt more equitable and humanizing grading practices, this teacher inquiry explores how educators attempted to improve students’ views of learning and assessments by utilizing rubrics on a sliding scale. Using the sliding scale rubric approach to grading provided an opportunity for students and educators to rethink how learning is evaluated. The authors found that the logistics of using sliding scale rubrics as a grading tool does need to be refined and further evaluated; however, the belief that a student can receive a grade based on her or his individual starting point did have some positive implications …

Gaining Access To The Language Of Science: A Research Partnership For Disciplined, Discursive Ways To Select And Assess Vocabulary Knowledge, H. Emily Hayden, Anupma Singh, Michelle Eades Baird

Reading Horizons: A Journal of Literacy and Language Arts

To equalize access to science learning across genders and demographic groups, access to the disciplinary language of science is one place to start. The language of science is highly challenging and specialized, and difficulties acquiring this language contribute to disparities in science achievement across diverse student groups. This study used a pre-post design to analyze effectiveness of a brief classroom science vocabulary assessment designed to assess receptive and productive vocabulary knowledge across multiple sections of one 7^th grade science teacher’s class. Vocabulary was selected and analysis conducted by an interdisciplinary research partnership including the science teacher, a literacy specialist, …

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …

Mastery-Based Testing In Undergraduate Mathematics, J.B. Collins, Amanda Harsy, Jarod Hart, Katie Anne Haymaker, Alyssa Marie Hoofnagle, Mike Janssen, Jessica Stewart Kelly, Austin Tyler Mohr, Jessica O'Shaughnessy

Faculty Work Comprehensive List

Mastery-based testing is an assessment scheme that challenges students to provide complete solutions to problems derived from clear course concepts. Students are allowed multiple attempts to demonstrate mastery, which helps create a classroom environment where students value persistence toward thorough understanding. In this paper, we describe in detail the benefits and implementation of mastery-based testing in college mathematics courses. We also summarize student response data that show positive reactions to this testing method.

Concept Inventories As A Resource For Teaching Evolution, Robert E. Furrow, Jeremy L. Hsu

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Understanding evolution is critical to learning biology, but few college instructors take advantage of the body of peer-reviewed literature that can inform evolution teaching and assessment. Here we summarize the peer-reviewed papers on tools to assess student learning of evolutionary concepts. These published concept inventories provide a resource for instructors to design courses, gauge student preparation, identify key misconceptions in their student population, and measure the impact of a lesson, course, or broader curriculum on student learning. Because these inventories vary in their format, target audience, and degree of validation, we outline and explain these features. In addition to summarizing …

Effects Of Professional Learning Communities On Instructional Revisions In Secondary Mathematics Classrooms, John Kenneth Bond

Theses, Dissertations and Capstones

This non-experimental, descriptive study examined the effect(s), if any, that professional learning communities have had on the professional practices of secondary (grades 9-12) mathematics teachers in Boone, Clay, Putnam, and Kanawha counties in West Virginia. Also investigated were the potential differences in instructional-practice change(s) based on selected demographic variables: sex, degree level, the grade level taught, the total years of teaching experience, the total number of years in their current position, the specific math subject taught, the total number of years of PLC participation, and the composition (e.g., departmental, cross-curricular, or both) of participants’ PLC. Data were collected from a …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg

Journal of Pre-College Engineering Education Research (J-PEER)

Reasoning about mechanism is central to disciplined inquiry in science and engineering and should thus be one of the foundations of a science, technology, engineering, and mathematics education. In addition, mechanistic reasoning is one of the core competencies listed in the Next Generation Science Standards (NGSS) Engineering Concepts and Practices (NGSS Lead States, 2013). Mechanistic explanations focus on the processes that underlie cause–effect relationships and consider how the activities of system components affect one another.

While some assessment work has been accomplished in engineering education, to date mechanistic reasoning is an area where limited assessment development has been accomplished for …

Multiple True–False Questions Reveal The Limits Of The Multiple-Choice Format For Detecting Students With Incomplete Understandings, Brian A. Couch, Joanna K. Hubbard, Chad E. Brassil

School of Biological Sciences: Faculty Publications

By having students select one answer among several plausible options, multiple-choice (MC) questions capture a student’s preferred answer but provide little information regarding a student’s thinking on the remaining options. We conducted a crossover design experiment in which similar groups of introductory biology students were assigned verbatim questions in the MC format or multiple true–false (MTF) format, which requires students to separately evaluate each option as either true or false. Our data reveal that nearly half of the students who select the correct MC answer likely hold incorrect understandings of the other options and that the selection rates for individual …

Motivational Decline And Recovery In Higher Education Stem Courses, Anna M. Young, Paul J. Wendel, Joan M. Esson, Kathryn M. Plank

Education Faculty Scholarship & Creative Works

Decline in student motivation is a concern for STEM education, especially for underrepresented groups in the sciences. Using the Science Motivation Questionnaire II, 41 foundational STEM courses were surveyed at the beginning and end of each semester in an academic year at a small primarily undergraduate university. Significant pre- to post-semester declines were observed in each of five measured motivational factors (Intrinsic motivation, Career motivation, Self determination, Self-efficacy, and Grade motivation), with effect sizes ranging from 0.21 to 0.41. However, in the second semester pre-survey, four motivational factors rebounded, including three returning to initial levels, suggesting that the observed motivational …

Changes In Teacher Thinking And Action In Response To The Next Generation Science Standards, Angela R. Bowden

Theses and Dissertations

This study examined the role of K-12 science teachers’ understandings and perceptions of the Next Generation Science Standards, implementation of the new standards in the classroom, and potential barriers to implementation as reform stakeholders had envisioned. Grounded in the relevant literature and working from the Teacher-Centered System Reform framework, this study employed a quantitative approach to data collection. The TCSR Model framed this study by linking teachers’ demographic and professional profile, teaching experience, professional development, district-level, school-level, and classroom-level contexts and illuminates the dynamic effect the factors have on teachers’ thinking and their practice. The study recognizes teachers’ knowledge and …

The Iterative Development And Use Of An Online Problem-Based Learning Module For Preservice And Inservice Teachers, Peter Rillero, Laurie Camposeco

Interdisciplinary Journal of Problem-Based Learning

Teachers’ problem-based learning knowledge, abilities, and attitudes are important factors in successful K–12 PBL implementations. This article describes the development and use of a free, online module entitled Design a Problem-Based Learning Experience. The module production, aligned with theories of andragogy, was a partnership between the recipients of a grant using PBL to enhance English language learner education and the Sanford Inspire Program. A multistage evaluation design was used in the iterative process of module creation. Starting with an initial white paper, the module’s conceptualization, development, pilot testing, and refinement are described, along with the current use statistics. The URL …

Student, Instructor, And Observer Agreement Regarding Frequencies Of Scientific Teaching Practices Using The Measurement Instrument For Scientific Teaching-Observable (Misto), Mary F. Durham, Jennifer Knight, Emily K. Bremers, Jameson D. Defreece, Alex R. Paine, Brian A. Couch

School of Biological Sciences: Faculty Publications

Background: The Scientific Teaching (ST) pedagogical framework encompasses many of the best practices recommended in the literature and highlighted in national reports. Understanding the growth and impact of ST requires instruments to accurately measure the extent to which practitioners implement ST in their courses. Researchers have typically relied on students, instructors, or observers to document course teaching practices, but it remains unclear whether and how these perspectives differ from each other. To address this issue, we modified our previously published instrument to generate the Measurement Instrument for Scientific Teaching-Observable (MISTO), which can be completed by students, instructors, and observers, and …

Assessment Literacy In A Mathematics Classroom, Virginia M. Doran

All Student Theses and Dissertations

The purpose of this study was to determine the effects of using assessment literacy in a math classroom. This was accomplished by analyzing the test results of students in two different high school Geometry B classes. Both classes were taught the same curriculum, with the same textbook and tests, and by the same teacher. However, assessment literacy techniques were only implemented in one of the two classes. Both classes completed a pre and post-test. The researcher compared the growth of both classes. Results of the study showed that incorporating assessment literacy techniques such as student friendly learning targets, reflection, self-assessment, …

Enhancing And Evaluating Scientific Argumentation In The Inquiry-Oriented College Chemistry Classroom, Annabel D'Souza

Dissertations, Theses, and Capstone Projects

The research presented in chapters 2, 3, and 4 in this dissertation uses a sociocultural and sociohistorical lens, particularly around power, authority of knowledge and identity formation, to investigate the complexity of engaging in, supporting, and evaluating high-quality argumentation within a college biochemistry inquiry-oriented classroom.

Argumentation skills are essential to college and career (National Research Council, 2010) and for a democratic citizenry. It is central to science teaching and learning (Osborne et al., 2004a) and can deepen content knowledge (Jiménez-Aleixandre et al., 2000; Jiménez-Aleixandre & Pereiro-Munhoz, 2002). When students have opportunities to make claims and support it with evidence and …

Design And Assessment Of Deep And Active Learning In Science, Technology, Engineering, And Mathematics (Stem) Education, Juhong Christie Liu Ph.D., Elizabeth Johnson Ph.D., Jin Joy Mao Ph.D.

Libraries

This presentation draws academic significance from a focused literature review and initial data for learning design in Science, Technology, Engineering, and Mathematics (STEM) education. The presenters will discuss strategies of fostering deep, active learning, alignment with assessment, and development of assessment instruments and methods. The presenters will share the design and development of an assessment kit to measure learning outcomes that matter in the 21st century STEM education. Through shared evidence and interactive reflection, the audience will take away up-to-date design strategies for deep and active learning as well as assessment in STEM education. The project is sponsored by National …

Using Concept Maps To Monitor Knowledge Structure Changes In A Science Classroom, Leah J. Cook

Dissertations

The aim of this research is to determine what differences may exist in students’ structural knowledge while using a variety of concept mapping assessments. A concept map can be used as an assessment which connects concepts in a knowledge domain. A single assessment may not be powerful enough to establish how students’ new knowledge relates to prior knowledge. More research is needed to establish how various aspects of the concept mapping task influence the output of map creation by students. Using multiple concept maps and pre-instruction and postinstruction VNOS instruments during a 16-week semester, this study was designed to investigate …

Using Educative Assessment In A Science Classroom, Jordan Truitt

Honors Projects

The focus of this study is to consider educative assessment in the science classroom and its effectiveness in assessing student-centered learning. By using educative assessment to measure learning, student work can be evaluated by rubric in addition to a traditional summative assessment. In comparing the student learning measured using the rubric results and traditional results, there was no statistical difference between the two assessments. However, the educative assessment provided greater insight into higher levels of learning. Conversational data also showed evidence of skills-based learning in the field of science. Further research into the applications for ‘at-risk’ students is required.

Real Data Is Messy... And Manageable, Beverly Wood, Carl Clark

Publications

Using real data in an introductory statistics course is a delicate balance between reality and manageability. The internet is awash with data that is useful for students to answer questions of interest to them but it is not always formatted as neatly as textbook data. The ASA's recently endorsed GAISE College Report 2016 points to the plausibility of considering multivariable thinking even if only at a rudimentary level. With both messy and multivariable data in mind, we present some activities/projects and sources for data to give introductory students the opportunity to engage with real data.

The Quantitative Reasoning For College Science (Quarcs) Assessment 2: Demographic, Academic And Attitudinal Variables As Predictors Of Quantitative Ability, Katherine Follette, Sanlyn Buxner, Erin Dokter, Donald Mccarthy, Beau Vezino, Laci Brock, Edward Prather

Numeracy

In this article, we explore the ability of demographic and attitudinal variables to predict student scores on the Quantitative Reasoning for College Science (QuaRCS) Assessment. Variables measured by the assessment include: students' academic choices and plans, attitudes and perceptions regarding mathematics, self-reported effort level, and basic demographics such as age, race/ethnicity, gender and disability status. As in previously published numeracy studies, we find significant score deviations according to gender, race/ethnicity, and disability status; however, the effect size of these correlations pale in comparison to the effect size of affective/attitudinal variables on QuaRCS score. A large number of variables with …

Inquiry-Based Learning: Assessing Students' Science Inquiry Skills, Abha Bhagat

Teacher India

Inquiry-based approaches to teaching yield substantial benefits to students, but assessment of students' science inquiry skills indicate more emphasis is needed on the development of inquiry-based teaching and learning in the classroom.