Science and Mathematics Education Commons^™

High Quality, Equity, And Assessment: An Analysis Of Variables Impacting English Learner Standardized Science Test Performance And Implications For Construct Validity, Maria Del Carmen Salazar, Joanna K. Bruno, Melissa P. Schneider

Curriculum and Instruction: Faculty Scholarship

In the United States, assessment is seen as a lever that can facilitate high-quality education. This study on English learners, students whose native language is not English, was based on data from eighth-grade English learners’ performance on science general and content-specific (physical, life, and earth science) standardized exams and an English language proficiency exam. The researchers utilized regression analysis to examine factors (i.e., socioeconomic status, home language, English language proficiency, and receptive and productive elements of language) that are predictive of English learner performance in general and content-specific science standardized assessments to identify implications for construct validity of high-stakes science …

Cross-Disciplinary Learning Index: A Quantitative Measure Of Cross-Disciplinary Learning About Energy, Todd Haskell, Emily Borda, Andrew Boudreaux

Physics & Astronomy

The structure of many science programs at the college level assumes that students are able to draw on and integrate ideas from multiple disciplinary contexts. However, most assessment tools focus on learning in the context of a single discipline. We describe the development and validation of an instrument to measure how well students are able to combine energy ideas from different disciplines into a coherent understanding of a phenomenon. The final version of the instrument consists of a pair of multiple-choice online assessments, along with a metric calculated from the assessment scores: the cross disciplinary learning index (CDLI). The items …

Physics Inventory Of Quantitative Literacy: A Tool For Assessing Mathematical Reasoning In Introductory Physics, Suzanne W. Brahmia, Alexis Olsho, Trevor I. Smith, Andrew Boudreaux, Philip Eaton, Charlotte Zimmerman

Physics & Astronomy

One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring Quantitative Literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike …

Defining Understanding: Perspectives From Biology Instructors & Biology Education Researchers, Jeremy L. Hsu, Stanley M. Lo, Brian K. Sato

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Promoting student understanding of biological concepts is a key part of biology education, and the ability to “understand” a concept forms one of the six categories of the oft-used Bloom’s Taxonomy. Despite this, there remains no consensus as to what it means to understand a concept. While several formal definitions have been offered, we investigated how biology instructors and biology education researchers define the term and how they perceived the skill sets needed for a student to understand a concept in the context of assessments. We found that there was no agreement on the definition of understanding, and that responses …

Modeling Through Model-Eliciting Activities: An Analysis Of Models, Elements, And Strategies In High School. The Cases Of Students With Different Level Of Achievement, Jair J. Aguilar

Teaching and Learning Faculty Publications and Presentations

A mathematical client-driven task known as Model-Eliciting Activities was implemented with students of different levels of achievement (i.e., low, average, and high) at the high-school level. The study strived to prove that Model-Eliciting Activities can be solved by students at any achievement level and be used as an assessment tool. Students collaborated in teams of three to develop solutions that met the client’s needs. The model-solutions were compared and contrasted among several dimensions and achievement levels, considering the quality of the final product-solution based on the Quality Assessment Guide, the intermedia product composed of the type of models created, the …

Stem For Everyone: A Mixed Methods Approach To The Conception And Implementation Of An Evaluation Process For Stem Education Programs For Students With Disabilities, Amy Jane Griffiths, John Brady, Nicholas Riley, James Alsip, Vanessa Trine, Lauren Gomez

Education Faculty Articles and Research

Some students with autism spectrum disorder and other learning differences may have superior visual acuity, increased attentional focus, and logical thinking abilities, lending to an affinity for science, technology, engineering, and mathematics (STEM) fields. At the same time, economists report that, the United States will experience a 28.2% increase in STEM-related jobs between 2014 and 2024. Although students with disabilities (SWD) can help to fill those positions, 85% of SWD graduates are either underemployed or unemployed as they enter young adulthood. Thus, there is a need to develop, evaluate, and report outcomes of STEM preparation programs specifically tailored to SWD. …

Preschool Mathematics Performance And Executive Function: Rural-Urban Comparisons Across Time, Jacob A. Esplin, Ann M. Berghout Austin, Belinda Blevins-Knabe, Brionne G. Neilson, Robert F. Corwyn

Faculty Publications

This longitudinal study examined the relationship between executive function (EF) and mathematics with rural and urban preschool children. A panel of direct and indirect EF measures were used to compare how well individual measures, as well as analytic approaches, predicted both numeracy and geometry skill. One hundred eighteen children, ages 39 to 68 months, were given EF and mathematics assessments twice, approximately six months apart, concurrent to their teachers completing an indirect assessment of EF for each child. Results suggest: (1) the child’s age determines if a panel of direct EF measures is a better predictor of numeracy and geometry …

Designing Performance Tasks In Mathematics Using Technological Tools, Ma. Louise Antonette N. De Las Peñas, Debbie Marie Versoza, Maria Alva Q. Aberin, Agnes Garciano, Jumela F. Sarmiento, Mark Anthony C. Tolentino

Mathematics Faculty Publications

In the Philippines, the performance task is one of the major summative assessments in the K to 12 curriculum. This paper discusses how performance tasks may utilize mathematical apps within the context of blended learning. Guidelines on designing performance tasks; as well as the GRASPS framework; are discussed. Performance tasks that cut across various grade levels and strands of mathematics are presented. These involve divisibility (Numbers); integer and polynomial operations (Algebra); triangle centers (Geometry); and statistics (Statistics). The performance tasks described in this paper can provide an initial idea for the design of other summative assessments and contribute to the …

Designing Research-Based Instructional Materials That Leverage Dual-Process Theories Of Reasoning: Insights From Testing One Specific, Theory-Driven Intervention, Mila Kryjevskaia, Mackenzie R. Stetzer, Beth A. Lindsey, Alistair Mcinerny, Paula R. L. Heron, Andrew Boudreaux

Physics & Astronomy

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis …

Assessment As A Learning Opportunity: Feedforward With Multiple Attempts, Emily Faulconer

Publications

High quality feedback is well-known to provide multiple student benefits, especially if students are provided the opportunity to apply the feedback. It reasons, then, that we can support student success on summative assessments by combining multiple attempts with high-quality immediate feedback. This study explores student behaviors, performance, and perspectives regarding this strategy.

Mastery-Based Testing In Undergraduate Mathematics, J.B. Collins, Amanda Harsy, Jarod Hart, Katie Anne Haymaker, Alyssa Marie Hoofnagle, Mike Janssen, Jessica Stewart Kelly, Austin Tyler Mohr, Jessica O'Shaughnessy

Faculty Work Comprehensive List

Mastery-based testing is an assessment scheme that challenges students to provide complete solutions to problems derived from clear course concepts. Students are allowed multiple attempts to demonstrate mastery, which helps create a classroom environment where students value persistence toward thorough understanding. In this paper, we describe in detail the benefits and implementation of mastery-based testing in college mathematics courses. We also summarize student response data that show positive reactions to this testing method.

Concept Inventories As A Resource For Teaching Evolution, Robert E. Furrow, Jeremy L. Hsu

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Understanding evolution is critical to learning biology, but few college instructors take advantage of the body of peer-reviewed literature that can inform evolution teaching and assessment. Here we summarize the peer-reviewed papers on tools to assess student learning of evolutionary concepts. These published concept inventories provide a resource for instructors to design courses, gauge student preparation, identify key misconceptions in their student population, and measure the impact of a lesson, course, or broader curriculum on student learning. Because these inventories vary in their format, target audience, and degree of validation, we outline and explain these features. In addition to summarizing …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Motivational Decline And Recovery In Higher Education Stem Courses, Anna M. Young, Paul J. Wendel, Joan M. Esson, Kathryn M. Plank

Education Faculty Scholarship & Creative Works

Decline in student motivation is a concern for STEM education, especially for underrepresented groups in the sciences. Using the Science Motivation Questionnaire II, 41 foundational STEM courses were surveyed at the beginning and end of each semester in an academic year at a small primarily undergraduate university. Significant pre- to post-semester declines were observed in each of five measured motivational factors (Intrinsic motivation, Career motivation, Self determination, Self-efficacy, and Grade motivation), with effect sizes ranging from 0.21 to 0.41. However, in the second semester pre-survey, four motivational factors rebounded, including three returning to initial levels, suggesting that the observed motivational …

Design And Assessment Of Deep And Active Learning In Science, Technology, Engineering, And Mathematics (Stem) Education, Juhong Christie Liu Ph.D., Elizabeth Johnson Ph.D., Jin Joy Mao Ph.D.

Libraries

This presentation draws academic significance from a focused literature review and initial data for learning design in Science, Technology, Engineering, and Mathematics (STEM) education. The presenters will discuss strategies of fostering deep, active learning, alignment with assessment, and development of assessment instruments and methods. The presenters will share the design and development of an assessment kit to measure learning outcomes that matter in the 21st century STEM education. Through shared evidence and interactive reflection, the audience will take away up-to-date design strategies for deep and active learning as well as assessment in STEM education. The project is sponsored by National …

Real Data Is Messy... And Manageable, Beverly Wood, Carl Clark

Publications

Using real data in an introductory statistics course is a delicate balance between reality and manageability. The internet is awash with data that is useful for students to answer questions of interest to them but it is not always formatted as neatly as textbook data. The ASA's recently endorsed GAISE College Report 2016 points to the plausibility of considering multivariable thinking even if only at a rudimentary level. With both messy and multivariable data in mind, we present some activities/projects and sources for data to give introductory students the opportunity to engage with real data.

Inquiry-Based Learning: Assessing Students' Science Inquiry Skills, Abha Bhagat

Teacher India

Inquiry-based approaches to teaching yield substantial benefits to students, but assessment of students' science inquiry skills indicate more emphasis is needed on the development of inquiry-based teaching and learning in the classroom.

Gaiseing Into The New Guidelines, Robert Carver, Megan Mocko, Jeffrey Witmer, Beverly Wood

Publications

The first GAISE College Report came out in 2005. Over the past ten years our discipline has changed in many ways, including but not limited to what type of data is easily available, the technology that we use, as well as how we teach students. In this presentation we will briefly start with how the new GAISE 2016 guidelines and goals have changed, including the two new emphases of statistical thinking: giving students experience with multivariable thinking and with the investigative process. So how do you start to implement these new ideas? In this presentation, we will demonstrate an activity …

Multivariate Thinking In An Intro Stats Course – Is It Possible?, Beverly Wood

Publications

Many of our students have an intuitive sense that there is more to the story than univariate or bivariate data can tell us. We can acknowledge and encourage that habit of digging deeper by demonstrating some ways to look at additional variables. Simpson’s paradox and side-by-side scatter plots are ways to provide a glimpse of more complex analysis that are accessible to students in an introductory course with or without strong quantitative skills.

Academic Intervention: Acceleration And Remediation, Barbara Franklin

Doctoral Dissertations and Projects

Eighth grade math students must pass a standards based test to be promoted to the next grade. Students who were at risk of failing the state’s annual test faced impending retention. The purpose of this quasi-experimental study was to see if an intensive nine-week (55 min per day) remedial Math Connection (MC) class for 67 suburban, eighth grade students identified as at risk of failing, could significantly increase the scores; concurrently, at this Title I school, they were compared with 122 eighth grade students who were not identified as at risk of failing. The dependent variable was measured using the …

Building Exemplary Teaching Practices: Following The Paths Of New Science Teachers, Elizabeth B. Lewis, Ana Rivero, Aaron A. Musson, Jia Lu, Lyrica Lucas

Department of Teaching, Learning, and Teacher Education: Posters and Presentations

There are few comprehensive studies of beginning science teachers that describe enacted teaching practices in terms of inquiry-based instruction, classroom discourse, assessment, and curricular choices, and explore how these factors interact with teaching self-efficacy. We conducted a 3-year, longitudinal study of four cohorts of master’s level science teacher education program graduates. We coded and analyzed 319 science lessons of new teachers from student teaching to third year post-program to describe teachers’ enacted practices and gathered annual teaching self-efficacy reports to examine teachers’ beliefs. Our analysis resulted in key findings relevant to future programmatic improvements. First, when we reviewed specific inquiry-based …

Assessing Student Comprehension In Introductory Biology: A Comparison Of Free-Response And Multiple-True/False Exam Formats, Macy A. Potts, Brian Couch, Joanna K. Hubbard

UCARE Research Products

Question format is an important consideration when designing instruments to gauge student comprehension. In many lecture-style courses, instructors must decide how to effectively test a large group of students. Two common types of question formats used for introductory biology exams are free-response (FR) and multiple-true/false (MTF). FR questions include a question prompt which students respond to with essay-style answers. Conversely, MTF questions include an opening question stem with accompanying statements to be marked as either true or false. The goal of this study was to determine the advantages and disadvantages of FR and MTF question formats for assessing student comprehension …

Binning For Equity And Access: Formative Assessment–Focused Teacher Professional Development For Middle School Mathematics Classrooms, Brent Duckor, Carrie Holmberg, Joanne Becker

Faculty Publications

While research has shown for over a decade that teachers who engage in formative assessment (FA) practices may have the most powerful impact on student learning (Black & Wiliam, 1998; Hattie, 2012) less is known about the development of teachers’ knowledge and use of formative assessment as they plan, enact, and reflect on their practice. Our qualitative case study focuses on how in-service middle school math teachers take up the specific moves (Author, 2014a) associated with formative assessment practice as they plan, enact, and reflect on their practices as part of a FA-focused professional development cycle of inquiry. The study …

Multiple Problem-Solving Strategies Provide Insight Into Students’ Understanding Of Open-Ended Linear Programming Problems, Marla A. Sole

Publications and Research

Open-ended questions that can be solved using different strategies help students learn and integrate content, and provide teachers with greater insights into students’ unique capabilities and levels of understanding. This article provides a problem that was modified to allow for multiple approaches. Students tended to employ high-powered, complex, familiar solution strategies rather than simpler, more intuitive strategies, which suggests that students might need more experience working with informal solution methods. During the semester, by incorporating open-ended questions, I gained valuable feedback, was able to better model real-world problems, challenge students with different abilities, and strengthen students’ problem solving skills.

Children, Mathematics, And Videotape: Using Multimodal Analysis To Bring Bodies Into Early Childhood Assessment Interviews, Amy Noelle Parks, Mardi Schmeichel

Department of Teaching, Learning, and Teacher Education: Faculty Publications

Despite the increased use of video for data collection, most research using assessment interviews in early childhood education relies solely upon the analysis of linguistic data, ignoring children’s bodies. This trend is particularly troubling in studies of marginalized children because transcripts limited to language can make it difficult to analyze embodied power relations between majority researchers and minority children. This article responds to this problem by outlining a theoretical position on power and bodies, describing multimodal analysis strategies, and using these strategies to analyze the subject positions available during a mathematical assessment interview for three African American preschool child-participants and …

Mapcores 2013-2014 Assessment Report, Kristen Nairn, Pamela L. Bacon, Jim Crumley, Yu Zhang

MapCores Faculty Publications

This is a report showing the assessment results for the MapCores (MAthematics, Physics, COmputer science REsearch Scholars) program at the College of Saint Benedict. Started in 2009, MapCores is a cohort-based program designed to increase women's interest and achievement in mathematics, physics, computer science and engineering. The report was submitted for the National Science Foundation grant number 0965705.

A Course-Based Research Experience: How Benefits Change With Increased Investment In Instructional Time, Christopher D. Shaffer, Consuelo J. Alvarez, April E. Bednarski, David Dunbar, Anya L. Goodman, Catherine Reinke, Anne G. Rosenwald, Michael J. Wolyniak, Cheryl Bailey, Daron Barnard, Christopher Bazinet, Dale L. Beach, James E.J. Bedard, Satish Bhalla, John Braverman, Martin Burg, Vidya Chandrasekaran, Hui-Min Chung, Kari Clase, Randall J. Dejong, Justin R. Diangelo, Chunguang Du, Todd T. Eckdahl, Heather Eisler, Julia A. Emerson, Amy Frary, Donald Frohlich, Yuying Gosser, Shubha Govind, Adam Haberman, Amy T. Hark, Charles Hauser, Arlene Hoogewerf, Laura L.M. Hoopes, Carina E. Howell, Diana Johnson, Christopher J. Jones, Lisa Kadlec, Marian Kaehler, S. Catherine Silver Key, Adam Kleinschmit, Nighat P. Kokan, Olga Kopp, Gary Kuleck, Judith Leatherman, Jane Lopilato, Christy Mackinnon, Juan Carlos Martinez-Cruzado, Gerard Mcneil, Stephanie Mel, Hemlata Mistry, Alexis Nagengast, Paul Overvoorde, Don W. Paetkau, Susan Parrish, Celeste N. Peterson, Mary Preuss, Laura K. Reed, Dennis Revie, Srebrenka Robic, Jennifer Roecklein-Canfield, Michael R. Rubin, Kenneth Saville, Stephanie Schroeder, Karim Sharif, Mary Shaw, Gary Skuse, Christopher D. Smith, Mary A. Smith, Sheryl T. Smith, Eric Spana, Mary Spratt, Aparna Sreenivasan, Joyce Stamm, Paul Szauter, Jeffrey S. Thompson, Matthew Wawersik, James Youngblom, Leming Zhou, Elaine R. Mardis, Jeremy Buhler, Wilson Leung, David Lopatto, Sarah C.R. Elgin

Faculty Publications

There is widespread agreement that science, technology, engineering, and mathematics programs should provide undergraduates with research experience. Practical issues and limited resources, however, make this a challenge. We have developed a bioinformatics project that provides a course-based research experience for students at a diverse group of schools and offers the opportunity to tailor this experience to local curriculum and institution-specific student needs. We assessed both attitude and knowledge gains, looking for insights into how students respond given this wide range of curricular and institutional variables. While different approaches all appear to result in learning gains, we find that a significant …

Comparability Of Online And Paper/Pencil Mathematics Performance Measures, John L. Moon

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The purpose of this study was to investigate the relationship between student mathematics performance of 4^th, 8^th, and 11^th grade students in Nebraska and the mode of test administration, online and paper-pencil. Schools were allowed to select the mode of test administration for their school with some exceptions for students needing accommodations. This resulted in four test groups, namely students taking the online tests in schools selecting paper or online assessments along with students taking the paper-pencil tests in schools selecting paper or online assessments. Since the students in the study were clustered within schools, …

Gaise In Discipline-Specific Courses, Beverly Wood

Publications

While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses designed for students in a specific major, providing explicit evidence for this assumption.

The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The College Report’s Goals for Students and Recommendations for Teaching are used as a framework for a qualitative study …