Science and Mathematics Education Commons^™

Instructional Decision Making In A Gateway Quantitative Reasoning Course, Deependra Budhathoki, Gregory D. Foley, Stephen Shadik

Numeracy

Many educators and professional organizations recommend Quantitative Reasoning as the best entry-level postsecondary mathematics course for non-STEM majors. However, novice and veteran instructors who have no prior experience in teaching a QR course often express their ignorance of the content to choose for this course, the instruction to offer students, and the assessments to measure student learning. We conducted a case study to investigate the initial implementation of an entry-level university quantitative reasoning course during fall semester, 2018. The participants were the course instructor and students. We examined the instructor’s motives and actions and the students’ responses to the course. …

Threshold Concepts In Quantitative Reasoning, Judith Canner, Jennifer E. Clinkenbeard

Numeracy

The idea of “threshold concepts” has been used to identify discipline-based concepts that are critical to that academic area. Threshold concepts are often difficult for students to assimilate in a meaningful way but, once done, can be powerful for the learner. In general, threshold concepts are 1) transformative to learner thinking; 2) bounded by the discipline; 3) integrative with other concepts; and 4) irreversible once understood (Meyer and Land 2003). This paper presents five threshold concepts in quantitative reasoning (QR) developed by transdisciplinary faculty workgroups that may be applicable for non-mathematics disciplines as well. They are as follows: 1) QR …

Assessment As A Learning Opportunity: Feedforward With Multiple Attempts, Emily Faulconer

Publications

High quality feedback is well-known to provide multiple student benefits, especially if students are provided the opportunity to apply the feedback. It reasons, then, that we can support student success on summative assessments by combining multiple attempts with high-quality immediate feedback. This study explores student behaviors, performance, and perspectives regarding this strategy.

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …

Mastery-Based Testing In Undergraduate Mathematics, J.B. Collins, Amanda Harsy, Jarod Hart, Katie Anne Haymaker, Alyssa Marie Hoofnagle, Mike Janssen, Jessica Stewart Kelly, Austin Tyler Mohr, Jessica O'Shaughnessy

Faculty Work Comprehensive List

Mastery-based testing is an assessment scheme that challenges students to provide complete solutions to problems derived from clear course concepts. Students are allowed multiple attempts to demonstrate mastery, which helps create a classroom environment where students value persistence toward thorough understanding. In this paper, we describe in detail the benefits and implementation of mastery-based testing in college mathematics courses. We also summarize student response data that show positive reactions to this testing method.

Concept Inventories As A Resource For Teaching Evolution, Robert E. Furrow, Jeremy L. Hsu

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Understanding evolution is critical to learning biology, but few college instructors take advantage of the body of peer-reviewed literature that can inform evolution teaching and assessment. Here we summarize the peer-reviewed papers on tools to assess student learning of evolutionary concepts. These published concept inventories provide a resource for instructors to design courses, gauge student preparation, identify key misconceptions in their student population, and measure the impact of a lesson, course, or broader curriculum on student learning. Because these inventories vary in their format, target audience, and degree of validation, we outline and explain these features. In addition to summarizing …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Enhancing And Evaluating Scientific Argumentation In The Inquiry-Oriented College Chemistry Classroom, Annabel D'Souza

Dissertations, Theses, and Capstone Projects

The research presented in chapters 2, 3, and 4 in this dissertation uses a sociocultural and sociohistorical lens, particularly around power, authority of knowledge and identity formation, to investigate the complexity of engaging in, supporting, and evaluating high-quality argumentation within a college biochemistry inquiry-oriented classroom.

Argumentation skills are essential to college and career (National Research Council, 2010) and for a democratic citizenry. It is central to science teaching and learning (Osborne et al., 2004a) and can deepen content knowledge (Jiménez-Aleixandre et al., 2000; Jiménez-Aleixandre & Pereiro-Munhoz, 2002). When students have opportunities to make claims and support it with evidence and …

Real Data Is Messy... And Manageable, Beverly Wood, Carl Clark

Publications

Using real data in an introductory statistics course is a delicate balance between reality and manageability. The internet is awash with data that is useful for students to answer questions of interest to them but it is not always formatted as neatly as textbook data. The ASA's recently endorsed GAISE College Report 2016 points to the plausibility of considering multivariable thinking even if only at a rudimentary level. With both messy and multivariable data in mind, we present some activities/projects and sources for data to give introductory students the opportunity to engage with real data.

The Quantitative Reasoning For College Science (Quarcs) Assessment 2: Demographic, Academic And Attitudinal Variables As Predictors Of Quantitative Ability, Katherine Follette, Sanlyn Buxner, Erin Dokter, Donald Mccarthy, Beau Vezino, Laci Brock, Edward Prather

Numeracy

In this article, we explore the ability of demographic and attitudinal variables to predict student scores on the Quantitative Reasoning for College Science (QuaRCS) Assessment. Variables measured by the assessment include: students' academic choices and plans, attitudes and perceptions regarding mathematics, self-reported effort level, and basic demographics such as age, race/ethnicity, gender and disability status. As in previously published numeracy studies, we find significant score deviations according to gender, race/ethnicity, and disability status; however, the effect size of these correlations pale in comparison to the effect size of affective/attitudinal variables on QuaRCS score. A large number of variables with …

Gaiseing Into The New Guidelines, Robert Carver, Megan Mocko, Jeffrey Witmer, Beverly Wood

Publications

The first GAISE College Report came out in 2005. Over the past ten years our discipline has changed in many ways, including but not limited to what type of data is easily available, the technology that we use, as well as how we teach students. In this presentation we will briefly start with how the new GAISE 2016 guidelines and goals have changed, including the two new emphases of statistical thinking: giving students experience with multivariable thinking and with the investigative process. So how do you start to implement these new ideas? In this presentation, we will demonstrate an activity …

Multivariate Thinking In An Intro Stats Course – Is It Possible?, Beverly Wood

Publications

Many of our students have an intuitive sense that there is more to the story than univariate or bivariate data can tell us. We can acknowledge and encourage that habit of digging deeper by demonstrating some ways to look at additional variables. Simpson’s paradox and side-by-side scatter plots are ways to provide a glimpse of more complex analysis that are accessible to students in an introductory course with or without strong quantitative skills.

A Course-Based Research Experience: How Benefits Change With Increased Investment In Instructional Time, Christopher D. Shaffer, Consuelo J. Alvarez, April E. Bednarski, David Dunbar, Anya L. Goodman, Catherine Reinke, Anne G. Rosenwald, Michael J. Wolyniak, Cheryl Bailey, Daron Barnard, Christopher Bazinet, Dale L. Beach, James E.J. Bedard, Satish Bhalla, John Braverman, Martin Burg, Vidya Chandrasekaran, Hui-Min Chung, Kari Clase, Randall J. Dejong, Justin R. Diangelo, Chunguang Du, Todd T. Eckdahl, Heather Eisler, Julia A. Emerson, Amy Frary, Donald Frohlich, Yuying Gosser, Shubha Govind, Adam Haberman, Amy T. Hark, Charles Hauser, Arlene Hoogewerf, Laura L.M. Hoopes, Carina E. Howell, Diana Johnson, Christopher J. Jones, Lisa Kadlec, Marian Kaehler, S. Catherine Silver Key, Adam Kleinschmit, Nighat P. Kokan, Olga Kopp, Gary Kuleck, Judith Leatherman, Jane Lopilato, Christy Mackinnon, Juan Carlos Martinez-Cruzado, Gerard Mcneil, Stephanie Mel, Hemlata Mistry, Alexis Nagengast, Paul Overvoorde, Don W. Paetkau, Susan Parrish, Celeste N. Peterson, Mary Preuss, Laura K. Reed, Dennis Revie, Srebrenka Robic, Jennifer Roecklein-Canfield, Michael R. Rubin, Kenneth Saville, Stephanie Schroeder, Karim Sharif, Mary Shaw, Gary Skuse, Christopher D. Smith, Mary A. Smith, Sheryl T. Smith, Eric Spana, Mary Spratt, Aparna Sreenivasan, Joyce Stamm, Paul Szauter, Jeffrey S. Thompson, Matthew Wawersik, James Youngblom, Leming Zhou, Elaine R. Mardis, Jeremy Buhler, Wilson Leung, David Lopatto, Sarah C.R. Elgin

Faculty Publications

There is widespread agreement that science, technology, engineering, and mathematics programs should provide undergraduates with research experience. Practical issues and limited resources, however, make this a challenge. We have developed a bioinformatics project that provides a course-based research experience for students at a diverse group of schools and offers the opportunity to tailor this experience to local curriculum and institution-specific student needs. We assessed both attitude and knowledge gains, looking for insights into how students respond given this wide range of curricular and institutional variables. While different approaches all appear to result in learning gains, we find that a significant …

Educational Outcomes From The Openorbiter Small Spacecraft Development Program, Jeremy Straub

Jeremy Straub

The OpenOrbiter program [1] is developing a low-cost framework for the creation of space-craft by researchers and educators worldwide [8]. In addition to the technical objectives, ed-ucational assessment [2, 3] has also been a key focus. Students working on development of the spacecraft [4] were asked what types of benefits they sought from their participation [5]. The assessment of the attainment of these benefits is ongoing, in conjunction with continued development in pursuit of the crea-tion of a set of designs that can be used to build a spacecraft with a cost of under $5,000 [13] .

Gaise In Discipline-Specific Courses, Beverly Wood

Publications

While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses designed for students in a specific major, providing explicit evidence for this assumption.

The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The College Report’s Goals for Students and Recommendations for Teaching are used as a framework for a qualitative study …

The Future Of Natural Selection Knowledge Measurement: A Reply To Anderson Et Al. (2010), Ross Nehm, Irvin Sam Schonfeld

Publications and Research

The development of rich, reliable, and robust measures of the composition, structure, and stability of student thinking about core scientific ideas (such as natural selection) remains a complex challenge facing science educators. In their recent article (Nehm & Schonfeld 2008), the authors explored the strengths, weaknesses, and insights provided by a detailed exploration of three commonly used measures of student thinking about natural selection in a large sample of underrepresented minority students. One of their core findings was that all of the tools they studied--including the CINS--have strengths and weaknesses that must be carefully taken into consideration by those …

Analysis Of Factors Influencing West Virginia Secondary Biology And Science Teacher Attrition Rates, Seth Perry

Theses, Dissertations and Capstones

The high rate of attrition for beginning teachers has been blamed on many factors. Nationally these include low pay, urban versus rural school settings, age, with younger teachers leaving sooner, and other variables making a complex problem with no clear component responsible for the loss of teachers. This study examined the self reported variables that contribute to high school teachers in West Virginia leaving their profession. An electronic survey instrument was distributed to current secondary teachers across the state. Teachers were asked to respond to questions related to professional satisfaction, perceived value from students and parents, administrative support, content versus …

Measuring Knowledge Of Natural Selection: A Comparison Of The C.I.N.S., An Open-Response Instrument, And An Oral Interview, Ross Nehm, Irvin Sam Schonfeld

Publications and Research

Growing recognition of the central importance of fostering an in-depth understanding of natural selection has, surprisingly, failed to stimulate work on the development and rigorous evaluation of instruments that measure knowledge of it. We used three different methodological tools, the Conceptual Inventory of Natural Selection (CINS), a modified version of Bishop and Anderson's (Bishop and Anderson [1990] Journal of Research in Science Teaching 27: 415-427) open-response test that we call the Open Response Instrument (ORI), and an oral interview derived from both instruments, to measure biology majors' understanding of and alternative conceptions about natural selection. We explored how these instruments …

Community Service-Learning In Statistics: Course Design And Assessment, Debra L. Hydorn

Mathematics

Service-learning projects are a useful method for students to learn both the practice and value of statistical methods. Effective service learning, however, depends on several factors and can be implemented according to a variety of models. In this article, different models for incorporating service-learning in statistics courses are presented along with example statistics courses. Principles for good service-learning practice will also be presented as a means for assessing the quality of a service-learning course component.