Science and Mathematics Education Commons^™

Cross-Disciplinary Learning Index: A Quantitative Measure Of Cross-Disciplinary Learning About Energy, Todd Haskell, Emily Borda, Andrew Boudreaux

Physics & Astronomy

The structure of many science programs at the college level assumes that students are able to draw on and integrate ideas from multiple disciplinary contexts. However, most assessment tools focus on learning in the context of a single discipline. We describe the development and validation of an instrument to measure how well students are able to combine energy ideas from different disciplines into a coherent understanding of a phenomenon. The final version of the instrument consists of a pair of multiple-choice online assessments, along with a metric calculated from the assessment scores: the cross disciplinary learning index (CDLI). The items …

Physics Inventory Of Quantitative Literacy: A Tool For Assessing Mathematical Reasoning In Introductory Physics, Suzanne W. Brahmia, Alexis Olsho, Trevor I. Smith, Andrew Boudreaux, Philip Eaton, Charlotte Zimmerman

Physics & Astronomy

One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring Quantitative Literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike …

Designing Performance Tasks In Mathematics Using Technological Tools, Ma. Louise Antonette N. De Las Peñas, Debbie Marie Versoza, Maria Alva Q. Aberin, Agnes Garciano, Jumela F. Sarmiento, Mark Anthony C. Tolentino

Mathematics Faculty Publications

In the Philippines, the performance task is one of the major summative assessments in the K to 12 curriculum. This paper discusses how performance tasks may utilize mathematical apps within the context of blended learning. Guidelines on designing performance tasks; as well as the GRASPS framework; are discussed. Performance tasks that cut across various grade levels and strands of mathematics are presented. These involve divisibility (Numbers); integer and polynomial operations (Algebra); triangle centers (Geometry); and statistics (Statistics). The performance tasks described in this paper can provide an initial idea for the design of other summative assessments and contribute to the …

Designing Research-Based Instructional Materials That Leverage Dual-Process Theories Of Reasoning: Insights From Testing One Specific, Theory-Driven Intervention, Mila Kryjevskaia, Mackenzie R. Stetzer, Beth A. Lindsey, Alistair Mcinerny, Paula R. L. Heron, Andrew Boudreaux

Physics & Astronomy

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis …

Real Data Is Messy... And Manageable, Beverly Wood, Carl Clark

Publications

Using real data in an introductory statistics course is a delicate balance between reality and manageability. The internet is awash with data that is useful for students to answer questions of interest to them but it is not always formatted as neatly as textbook data. The ASA's recently endorsed GAISE College Report 2016 points to the plausibility of considering multivariable thinking even if only at a rudimentary level. With both messy and multivariable data in mind, we present some activities/projects and sources for data to give introductory students the opportunity to engage with real data.

Development And Testing Of An Assessment To Measure Spatial Thinking About Enhanced Greenhouse Effect, Heather Jean Skaza

UNLV Theses, Dissertations, Professional Papers, and Capstones

Americans, in general, do not behave in environmentally sustainable ways. We drive cars and fly in planes that emit planet-warming carbon. We purchase food in nearly indestructible packaging that is not recycled or repurposed. We do not consider the environmental impact of the “stuff” stuffed into our grocery and department stores, most of which is made of materials that had to be dug out of the ground, leaving rivers and skies full of pollution in its place. Citizens have a responsibility to understand complex global and local environmental problems. A person’s ability to think about the way that an environmental …

Gaiseing Into The New Guidelines, Robert Carver, Megan Mocko, Jeffrey Witmer, Beverly Wood

Publications

The first GAISE College Report came out in 2005. Over the past ten years our discipline has changed in many ways, including but not limited to what type of data is easily available, the technology that we use, as well as how we teach students. In this presentation we will briefly start with how the new GAISE 2016 guidelines and goals have changed, including the two new emphases of statistical thinking: giving students experience with multivariable thinking and with the investigative process. So how do you start to implement these new ideas? In this presentation, we will demonstrate an activity …

Multivariate Thinking In An Intro Stats Course – Is It Possible?, Beverly Wood

Publications

Many of our students have an intuitive sense that there is more to the story than univariate or bivariate data can tell us. We can acknowledge and encourage that habit of digging deeper by demonstrating some ways to look at additional variables. Simpson’s paradox and side-by-side scatter plots are ways to provide a glimpse of more complex analysis that are accessible to students in an introductory course with or without strong quantitative skills.

Multiple Problem-Solving Strategies Provide Insight Into Students’ Understanding Of Open-Ended Linear Programming Problems, Marla A. Sole

Publications and Research

Open-ended questions that can be solved using different strategies help students learn and integrate content, and provide teachers with greater insights into students’ unique capabilities and levels of understanding. This article provides a problem that was modified to allow for multiple approaches. Students tended to employ high-powered, complex, familiar solution strategies rather than simpler, more intuitive strategies, which suggests that students might need more experience working with informal solution methods. During the semester, by incorporating open-ended questions, I gained valuable feedback, was able to better model real-world problems, challenge students with different abilities, and strengthen students’ problem solving skills.

The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe

Numeracy

The Levels of Conceptual Understanding in Statistics (LOCUS) project (NSF DRL-111868) has created assessments that measure conceptual (rather than procedural) understanding of statistics as outlined in GAISE Framework (Franklin et al., 2007, Guidelines for Assessment and Instruction in Statistics Education, American Statistical Association). Here we provide a brief overview of the LOCUS project and present results from multiple-choice items on the pilot administration of the assessments with data collected from over 3400 students in grades 6-12 across six states. These results help illustrate students’ understanding of statistical topics prior to the implementation of the Common Core State Standards. Using the …

Motivation For Achievement And Attitudes Toward Mathematics Instruction In A Required Calculus Course At The Norwegian University Of Science And Technology, Donna Sundre, Carol Barry, Vidar Gynnild, Erin Tangen Ostgard

Donna L. Sundre

This study from the Norwegian University of Science and Technology (NTNU) examines students’ learning goals and attitudes toward mathematics in a first-year calculus course in undergraduate engineering education. Achievement motivation research using the Achievement Goal Questionnaire (AGQ) is advanced from current literature with two additions: (1) a course specific context using introductory college calculus students, and (2) participation of Norwegian students. Pre- and posttest measures of attitudes indicate that students do change learning goals over time, unfortunately opposite to the instructors’ aspirations. A significant increase in “Mastery Avoidance” and “Work Avoidance” was accompanied with a drop in “Mastery Approach” and …

An Investigation Of The Dayton Regional Stem School Public-Private Partnerships, Kimberly S. Poole

CCE Theses and Dissertations

This dissertation study documents in-depth the exploration of the Public Private Partnerships (PPPs) between the Dayton Regional STEM School (DRSS) and their industry partners as well as the establishment of a framework for evaluating and assessing PPPs. The public-private partnership agreements were studied in order to answer the over-arching research question: How is an effective public-private partnership established, assessed, and evaluated in education? A descriptive case study methodology was used to study DRSS' public-private partnership agreements to determine if goals and objectives were established and whether or not the partnerships met those goals and objectives. This case study also included …

Mapcores 2013-2014 Assessment Report, Kristen Nairn, Pamela L. Bacon, Jim Crumley, Yu Zhang

MapCores Faculty Publications

This is a report showing the assessment results for the MapCores (MAthematics, Physics, COmputer science REsearch Scholars) program at the College of Saint Benedict. Started in 2009, MapCores is a cohort-based program designed to increase women's interest and achievement in mathematics, physics, computer science and engineering. The report was submitted for the National Science Foundation grant number 0965705.

Mapcores 2012-2013 Assessment Report, Kristen Nairn, Pamela L. Bacon, Jim Crumley, Lynn Ziegler

MapCores Faculty Publications

This is a report showing the assessment results for the MapCores (MAthematics, Physics, COmputer science REsearch Scholars) program at the College of Saint Benedict. Started in 2009, MapCores is a cohort-based program designed to increase women's interest and achievement in mathematics, physics, computer science and engineering. The report was submitted for the National Science Foundation grant number 0965705.

The Measure And Instruction Of Scale In Introductory Chemistry, Karrie Linn Gerlach

Theses and Dissertations

As a student, it is fundamental to comprehend how small an atom or molecule is in order to truly understand how the world works. The American Association for the Advancement of Science (AAAS) has determined that scale is a critical theme that pervades through all areas of science and is critical to a deep understanding. This project determined that students, which are more proficient with scale and moving between the macroscopic and particle worlds, were better performers in chemistry classes. Interviews were used to determine what the students understood and what common misconceptions were present. These lead to the development …

The Mathematics Portfolio: An Alternative Tool To Evaluate Students’ Progress, Marla A. Sole

Publications and Research

This article describes the need for more thorough and varied forms of assessment to evaluate students’ level of understanding in mathematics. Portfolios are one type of assessment tool that, when added to a teacher’s repertoire can improve students’ comprehension and retention and enable students to monitor their own progress and to take more responsibility for their own learning. Portfolio assignments can also help students and teachers to detect and remedy weaknesses and misunderstandings and can increase students’ self-confidence in mathematics. This article discusses what a portfolio is, gives an example of a unit portfolio used in an undergraduate Finite Mathematics …

Parts Of The Whole: Learn More, Learn Better, Dorothy Wallace

Numeracy

Building on previous columns in Numeracy, this column analyzes various teaching techniques in terms of their ability to build cognitive schema, extend existing schema, reinforce learning, move mean understanding of a group of students, and reduce variance in understanding of a group. We offer a pedagogical cycle as an example of how to address multiple learning goals using common teaching methods.

Motivation For Achievement And Attitudes Toward Mathematics Instruction In A Required Calculus Course At The Norwegian University Of Science And Technology, Donna Sundre, Carol Barry, Vidar Gynnild, Erin Tangen Ostgard

Numeracy

This study from the Norwegian University of Science and Technology (NTNU) examines students’ learning goals and attitudes toward mathematics in a first-year calculus course in undergraduate engineering education. Achievement motivation research using the Achievement Goal Questionnaire (AGQ) is advanced from current literature with two additions: (1) a course specific context using introductory college calculus students, and (2) participation of Norwegian students.

Pre- and posttest measures of attitudes indicate that students do change learning goals over time, unfortunately opposite to the instructors’ aspirations. A significant increase in “Mastery Avoidance” and “Work Avoidance” was accompanied with a drop in “Mastery Approach” and …

Numeracy, Financial Literacy, And Financial Decision-Making, Annamaria Lusardi

Numeracy

Financial decisions, be they related to asset building or debt management, require the capacity to do calculations, including some complex ones. But how numerate are individuals, in particular when it comes to calculations related to financial decisions? Studies and surveys implemented in both the United States and in other countries that are described in this paper show the level of numeracy among the population to be very low. Moreover, lack of numeracy is not only widespread but is particularly severe among some demographic groups, such as women, the elderly, and those with low educational attainment. This has potential consequences for …

Parts Of The Whole: An Algebra Lesson, Dorothy Wallace

Numeracy

This column draws on research of Eon Harper to demonstrate how an understanding of his proposed stages of algebra acquisition would inform a systemic overhaul of algebra education. Harper's stages also explain why students may pass a series of algebra courses yet still be unable to make sense of calculus, as well as offering insight on what aspects of algebra support quantitative literacy.

Quantitative Reasoning In The Contemporary World, 3: Assessing Student Learning, Stuart Boersma, Caren Diefenderfer, Shannon W. Dingman, Bernard L. Madison

Numeracy

In this third paper in a series describing the Quantitative Reasoning in the Contemporary World course, the authors provide an adaptation of the Association of American Colleges and Universities quantitative literacy VALUE rubric. Describing achievement levels in six core competencies (interpretation, representation, calculation, analysis/synthesis, and communication), the resulting Quantitative Literacy Assessment Rubric (QLAR) is applicable to grading student work and has exhibited a high degree of reliability in two separate scoring tests (97% and 88% respectively). The distribution of the six core competencies across the 24 case studies in the authors’ quantitative reasoning casebook shows that interpretation, calculation, and analysis/synthesis …

Quantitative Literacy At Michigan State University, 2: Connection To Financial Literacy, Dennis Gilliland, Vince Melfi, Alla Sikorskii, Edward Corcoran, Eleanor Melfi

Numeracy

The lack of capability of making financial decisions has been recently described for the adult United States population. A concerted effort to increase awareness of this crisis, to improve education in quantitative and financial literacy, and to simplify financial decision-making processes is critical to the solution. This paper describes a study that was undertaken to explore the relationship between quantitative literacy and financial literacy for entering college freshmen. In summer 2010, incoming freshmen to Michigan State University were assessed. Well-tested financial literacy items and validated quantitative literacy assessment instruments were administered to 531 subjects. Logistic regression models were used to …

Quantitative Literacy At Michigan State University, 1: Development And Initial Evaluation Of The Assessment, Alla Sikorskii, Vince Melfi, Dennis Gilliland, Jennifer Kaplan, Suzie Ahn

Numeracy

Development, psychometric testing, and the results of the administration of a quantitative literacy (QL) assessment to undergraduate students are described. Three forms were developed covering a wide range of skills, contexts, and quantitative information presentation formats. Following item generation and revision based on preliminary testing and cognitive interviewing, a total of 3,701 consented undergraduate students at Michigan State University completed one of the three forms. Two of the forms contained 14 multiple-choice items, and one form contained 17 multiple-choice items. All forms were completed by students in less than 30 minutes. Evidence of validity and reliability were obtained for the …

Development Of An Assessment Of Quantitative Literacy For Miami University, Rose Marie Ward, Monica C. Schneider, James D. Kiper

Numeracy

Quantitative Literacy is a competence as important as general literacy; yet, while writing requirements are seemingly ubiquitous across the college curriculum, quantitative literacy requirements are not. The current project provides preliminary evidence of the reliability and validity of a quantitative literacy measure suitable for delivery online. A sample of 188 undergraduate students from Miami University, a midsize university in the midwestern U.S., participated in the current study. Scores on the measure, were inversely related to statistical/mathematical anxiety measures, directly related to subjective assessment of numeracy, and did not differ across gender or year in school. The resulting measure provides a …

Communicating Quantitative Literacy: An Examination Of Open-Ended Assessment Items In Timss, Nals, Ials, And Pisa, Karl W. Kosko, Jesse L. M. Wilkins

Numeracy

Quantitative Literacy (QL) has been described as the skill set an individual uses when interacting with the world in a quantitative manner. A necessary component of this interaction is communication. To this end, assessments of QL have included open-ended items as a means of including communicative aspects of QL. The present study sought to examine whether such open-ended items typically measured aspects of quantitative communication, as compared to mathematical communication, or mathematical skills. We focused on public-released items and rubrics from four of the most widely referenced assessments: the Third International Mathematics and Science Study (TIMSS-95): the National Adult Literacy …

Calculus, Biology And Medicine: A Case Study In Quantitative Literacy For Science Students, Kim Rheinlander, Dorothy Wallace

Numeracy

This paper describes a course designed to enhance the numeracy of biology and pre-medical students. The course introduces students with the background of one semester of calculus to systems of nonlinear ordinary differential equations as they appear in the mathematical biology literature. Evaluation of the course showed increased enjoyment and confidence in doing mathematics, and an increased appreciation of the utility of mathematics to science. Students who complete this course are better able to read the research literature in mathematical biology and carry out research problems of their own.

Personal And Professional Numeracy: A Unit For Pre-Service Teachers At The University Of Tasmania, Jane M. Watson

Numeracy

This paper addresses issues associated with the development of a unit preparing pre-service teachers to be quantitatively literate in three respects. These issues surround (i) the need to be aware of numeracy demands across the curriculum, (ii) the need to model numerate behavior in all interactions of teachers, and (iii) the need to be able to interpret and use system data provided from local and national testing programs. The context for the unit described is Australia, where a national testing program for literacy and numeracy requires teachers to analyze extensive data on their students, a national curriculum requires teachers of …

Spreadsheets Across The Curriculum, 2: Assessing Our Success With Students At Eckerd College, Laura Reiser Wetzel

Numeracy

The Spreadsheets Across the Curriculum (SSAC) library consists of activities to reinforce or teach quantitative literacy or mathematical concepts and skills in context. Each SSAC “module” consists of a PowerPoint presentation with embedded Excel spreadsheets. Each student works through a presentation, thinks about the in-context problem, figures out how to solve it mathematically, and builds spreadsheets to calculate and examine answers.

To assess the effectiveness of SSAC modules, I surveyed Eckerd College undergraduates in two separate studies. Two undergraduate research assistants and I generated pre- and post-tests for 10 SSAC modules. We hired 21 undergraduates who conducted 62 individual module …

Establishing Open-Ended Assessments: Investigating The Validity Of Creative Exercises, Scott E. Lewis, Janet L. Shaw, Kathryn A. Freeman

Faculty and Research Publications

Open-ended assessments, defined as assessments with a large set of possible correct answers, by nature lend themselves to concerns regarding accurate and consistent grading. This article describes one particular open-ended assessment, named Creative Exercises (CE), designed for promoting students' interconnection of concepts in a college general chemistry setting. The article presents evidence concerning several aspects of validity, including the extent scores represent chemistry knowledge and the extent scoring is consistent across three graders. The evidence is also presented in the context of what is known about concept maps, a commonly employed open-ended assessment in chemistry. Implications for the administration of …

Mathematics In The Age Of Technology: There Is A Place For Technology In The Mathematics Classroom, Helen Crompton

Teaching & Learning Faculty Publications

In today’s world of ubiquitous computing there are a number of technologies available to K-12 educators for teaching and learning mathematics. However, Koehler and Mishra (2008) have described how teaching and learning with such technologies presents a “wicked problem,” as it can involve a number of variables, independent of each other and contextually bound, that need to be brought together. This article highlights the advantages technology offers for mathematics education and looks at some of the reasons behind the poor uptake, such as teacher beliefs and lack of training. A number of solutions are offered to address these issues, including …