Science and Mathematics Education Commons^™

Parts Of The Whole: Learn More, Learn Better, Dorothy Wallace

Numeracy

Building on previous columns in Numeracy, this column analyzes various teaching techniques in terms of their ability to build cognitive schema, extend existing schema, reinforce learning, move mean understanding of a group of students, and reduce variance in understanding of a group. We offer a pedagogical cycle as an example of how to address multiple learning goals using common teaching methods.

Motivation For Achievement And Attitudes Toward Mathematics Instruction In A Required Calculus Course At The Norwegian University Of Science And Technology, Donna Sundre, Carol Barry, Vidar Gynnild, Erin Tangen Ostgard

Numeracy

This study from the Norwegian University of Science and Technology (NTNU) examines students’ learning goals and attitudes toward mathematics in a first-year calculus course in undergraduate engineering education. Achievement motivation research using the Achievement Goal Questionnaire (AGQ) is advanced from current literature with two additions: (1) a course specific context using introductory college calculus students, and (2) participation of Norwegian students.

Pre- and posttest measures of attitudes indicate that students do change learning goals over time, unfortunately opposite to the instructors’ aspirations. A significant increase in “Mastery Avoidance” and “Work Avoidance” was accompanied with a drop in “Mastery Approach” and …

Numeracy, Financial Literacy, And Financial Decision-Making, Annamaria Lusardi

Numeracy

Financial decisions, be they related to asset building or debt management, require the capacity to do calculations, including some complex ones. But how numerate are individuals, in particular when it comes to calculations related to financial decisions? Studies and surveys implemented in both the United States and in other countries that are described in this paper show the level of numeracy among the population to be very low. Moreover, lack of numeracy is not only widespread but is particularly severe among some demographic groups, such as women, the elderly, and those with low educational attainment. This has potential consequences for …

Parts Of The Whole: An Algebra Lesson, Dorothy Wallace

Numeracy

This column draws on research of Eon Harper to demonstrate how an understanding of his proposed stages of algebra acquisition would inform a systemic overhaul of algebra education. Harper's stages also explain why students may pass a series of algebra courses yet still be unable to make sense of calculus, as well as offering insight on what aspects of algebra support quantitative literacy.

Quantitative Reasoning In The Contemporary World, 3: Assessing Student Learning, Stuart Boersma, Caren Diefenderfer, Shannon W. Dingman, Bernard L. Madison

Numeracy

In this third paper in a series describing the Quantitative Reasoning in the Contemporary World course, the authors provide an adaptation of the Association of American Colleges and Universities quantitative literacy VALUE rubric. Describing achievement levels in six core competencies (interpretation, representation, calculation, analysis/synthesis, and communication), the resulting Quantitative Literacy Assessment Rubric (QLAR) is applicable to grading student work and has exhibited a high degree of reliability in two separate scoring tests (97% and 88% respectively). The distribution of the six core competencies across the 24 case studies in the authors’ quantitative reasoning casebook shows that interpretation, calculation, and analysis/synthesis …

Quantitative Literacy At Michigan State University, 2: Connection To Financial Literacy, Dennis Gilliland, Vince Melfi, Alla Sikorskii, Edward Corcoran, Eleanor Melfi

Numeracy

The lack of capability of making financial decisions has been recently described for the adult United States population. A concerted effort to increase awareness of this crisis, to improve education in quantitative and financial literacy, and to simplify financial decision-making processes is critical to the solution. This paper describes a study that was undertaken to explore the relationship between quantitative literacy and financial literacy for entering college freshmen. In summer 2010, incoming freshmen to Michigan State University were assessed. Well-tested financial literacy items and validated quantitative literacy assessment instruments were administered to 531 subjects. Logistic regression models were used to …

Quantitative Literacy At Michigan State University, 1: Development And Initial Evaluation Of The Assessment, Alla Sikorskii, Vince Melfi, Dennis Gilliland, Jennifer Kaplan, Suzie Ahn

Numeracy

Development, psychometric testing, and the results of the administration of a quantitative literacy (QL) assessment to undergraduate students are described. Three forms were developed covering a wide range of skills, contexts, and quantitative information presentation formats. Following item generation and revision based on preliminary testing and cognitive interviewing, a total of 3,701 consented undergraduate students at Michigan State University completed one of the three forms. Two of the forms contained 14 multiple-choice items, and one form contained 17 multiple-choice items. All forms were completed by students in less than 30 minutes. Evidence of validity and reliability were obtained for the …

Development Of An Assessment Of Quantitative Literacy For Miami University, Rose Marie Ward, Monica C. Schneider, James D. Kiper

Numeracy

Quantitative Literacy is a competence as important as general literacy; yet, while writing requirements are seemingly ubiquitous across the college curriculum, quantitative literacy requirements are not. The current project provides preliminary evidence of the reliability and validity of a quantitative literacy measure suitable for delivery online. A sample of 188 undergraduate students from Miami University, a midsize university in the midwestern U.S., participated in the current study. Scores on the measure, were inversely related to statistical/mathematical anxiety measures, directly related to subjective assessment of numeracy, and did not differ across gender or year in school. The resulting measure provides a …

Communicating Quantitative Literacy: An Examination Of Open-Ended Assessment Items In Timss, Nals, Ials, And Pisa, Karl W. Kosko, Jesse L. M. Wilkins

Numeracy

Quantitative Literacy (QL) has been described as the skill set an individual uses when interacting with the world in a quantitative manner. A necessary component of this interaction is communication. To this end, assessments of QL have included open-ended items as a means of including communicative aspects of QL. The present study sought to examine whether such open-ended items typically measured aspects of quantitative communication, as compared to mathematical communication, or mathematical skills. We focused on public-released items and rubrics from four of the most widely referenced assessments: the Third International Mathematics and Science Study (TIMSS-95): the National Adult Literacy …

Measurement Of Life Skill Acquisition Of The Idaho First Lego® League State Tournament Participants Ages 9-14, Kristina Lee Luckey

Boise State University Theses and Dissertations

Youth development programs provide opportunities for children to learn and apply the life skills they are likely to utilize later in life. Therefore, it is critical that steps are taken to evaluate their effectiveness. The direct purpose of this study was to measure life skill outcomes of participants ages 9-14 of the Idaho FIRST LEGO® League program state tournament participants. This mixed method pre-experimental design study incorporated quantitative measurements using a paired samples test and qualitative measures utilizing a single-category design focus group methodology for triangulation purposes. This study contributes to the literature by providing empirical evidence of the formation …

Year-Round Calendars At The High School Level, Matthew Nohner

Mathematics Graduate Theses

The purpose of this paper is to explore the effects of a year round calendar on math scores at the high school level. Students forget facts, especially math facts, over long extended breaks. Year round calendars aim to address this dilemma by minimizing long breaks from learning. The results of year round calendars have been mixed. Some schools have reported both academic and monetary gains after switching from a traditional calendar, while other schools have seen modest gains in student learning. All studies cited in this paper report that at-risk and low socioeconomic students benefit academically from a year round …

Personal And Professional Numeracy: A Unit For Pre-Service Teachers At The University Of Tasmania, Jane M. Watson

Numeracy

This paper addresses issues associated with the development of a unit preparing pre-service teachers to be quantitatively literate in three respects. These issues surround (i) the need to be aware of numeracy demands across the curriculum, (ii) the need to model numerate behavior in all interactions of teachers, and (iii) the need to be able to interpret and use system data provided from local and national testing programs. The context for the unit described is Australia, where a national testing program for literacy and numeracy requires teachers to analyze extensive data on their students, a national curriculum requires teachers of …

Establishing Open-Ended Assessments: Investigating The Validity Of Creative Exercises, Scott E. Lewis, Janet L. Shaw, Kathryn A. Freeman

Faculty Articles

Open-ended assessments, defined as assessments with a large set of possible correct answers, by nature lend themselves to concerns regarding accurate and consistent grading. This article describes one particular open-ended assessment, named Creative Exercises (CE), designed for promoting students' interconnection of concepts in a college general chemistry setting. The article presents evidence concerning several aspects of validity, including the extent scores represent chemistry knowledge and the extent scoring is consistent across three graders. The evidence is also presented in the context of what is known about concept maps, a commonly employed open-ended assessment in chemistry. Implications for the administration of …

Calculus, Biology And Medicine: A Case Study In Quantitative Literacy For Science Students, Kim Rheinlander, Dorothy Wallace

Numeracy

This paper describes a course designed to enhance the numeracy of biology and pre-medical students. The course introduces students with the background of one semester of calculus to systems of nonlinear ordinary differential equations as they appear in the mathematical biology literature. Evaluation of the course showed increased enjoyment and confidence in doing mathematics, and an increased appreciation of the utility of mathematics to science. Students who complete this course are better able to read the research literature in mathematical biology and carry out research problems of their own.

Spreadsheets Across The Curriculum, 2: Assessing Our Success With Students At Eckerd College, Laura Reiser Wetzel

Numeracy

The Spreadsheets Across the Curriculum (SSAC) library consists of activities to reinforce or teach quantitative literacy or mathematical concepts and skills in context. Each SSAC “module” consists of a PowerPoint presentation with embedded Excel spreadsheets. Each student works through a presentation, thinks about the in-context problem, figures out how to solve it mathematically, and builds spreadsheets to calculate and examine answers.

To assess the effectiveness of SSAC modules, I surveyed Eckerd College undergraduates in two separate studies. Two undergraduate research assistants and I generated pre- and post-tests for 10 SSAC modules. We hired 21 undergraduates who conducted 62 individual module …

Mathematics In The Age Of Technology: There Is A Place For Technology In The Mathematics Classroom, Helen Crompton

Teaching & Learning Faculty Publications

In today’s world of ubiquitous computing there are a number of technologies available to K-12 educators for teaching and learning mathematics. However, Koehler and Mishra (2008) have described how teaching and learning with such technologies presents a “wicked problem,” as it can involve a number of variables, independent of each other and contextually bound, that need to be brought together. This article highlights the advantages technology offers for mathematics education and looks at some of the reasons behind the poor uptake, such as teacher beliefs and lack of training. A number of solutions are offered to address these issues, including …

Parts Of The Whole: Thinking About Variance: Standards, Targets, Tracking, And Other Thoughts, Dorothy Wallace

Numeracy

Variation is a natural result of any process, including education. Understanding how variation propagates and increases is necessary for designing educational interventions that work for the intended population. We show how common strategies such as setting standards and tracking can accidentally produce unintended and undesirable results due to the way variation moves through a system.

Quantitative Reasoning In The Contemporary World, 2: Focus Questions For The Numeracy Community, Bernard L. Madison, Shannon W. Dingman

Numeracy

Numerous questions about student learning of quantitative reasoning arose as we developed, taught and assessed the Quantitative Reasoning in the Contemporary World course described in the companion paper in this issue of Numeracy. In this paper, we present some of those questions and describe the context in which they arose. They fall into eight general problem areas: learning that is context-bound and does not easily transfer (i.e., situated learning); the need for a productive disposition regarding mathematics; the connection between QL and mathematical proficiency; the persistence of students, despite our efforts, for using the wrong base for percents; the inconsistent …

Quantitative Reasoning In The Contemporary World, 1: The Course And Its Challenges:, Shannon W. Dingman, Bernard L. Madison

Numeracy

The authors describe successes and challenges in developing a QL-friendly course at the University of Arkansas. This work is part of a three-year NSF project Quantitative Reasoning in the Contemporary World (QRCW) that supported the expansion of the course. The course, MATH 2183, began experimentally in Fall 2004 as a section of finite mathematics known informally as “News Math” for 26 students from arts and humanities disciplines. Over the past six years, the course has evolved and now MATH 2183 is approved to satisfy the College of Arts and Sciences mathematics requirement for the Bachelor of Arts degree. In 2009-2010, …

Quantitative Literacy: Does It Work? Evaluation Of Student Outcomes At Colby-Sawyer College, Benjamin Steele, Semra Kilic-Bahi

Numeracy

Colby-Sawyer College has adopted a mission for quantitative literacy (QL) to give students the “necessary skills to understand and use quantitative information in their personal and professional lives.” We have implemented an across-the-curriculum approach to develop these skills. As part of this QL program, we administer two assessment tests, one in basic mathematical skills and one that applies those skills, plus an attitude survey to both freshmen and seniors. Three years of data show that seniors score about 10 percentage points higher than freshmen on these tests. However, seniors still scored below 55 percent on both tests, and many cannot …

Advancing Assessment Of Quantitative And Scientific Reasoning, Donna L. Sundre, Amy D. Thelk

Numeracy

Advancing Assessment of Quantitative and Scientific Reasoning is a four-year NSF Project (DUE-0618599) in part designed to evaluate the generalizability of quantitative (QR) and scientific reasoning (SR) assessment instruments created at James Madison University to four other four-year institutions with very distinct missions and student demographics. This article describes the methods, results, and findings we obtained in our studies. More specifically, we describe how to conduct content-alignment exercises in which faculty members map each item from a prospective test to the student learning objectives taught at the institution. Our results indicated that 92-100% of the QR and SR items were …

Pairing Educational Robotics With Geospatial Technologies In Informal Learning Environments, Bradley S. Barker, Neal Grandgenett, Gwen Nugent, Viacheslav I. Adamchuk

Teacher Education Faculty Publications

Educational robotics, when paired with geospatial technologies and taught in an informal educational environment, can be an innovative strategy to teach youth about science, technology, engineering, and mathematic (STEM) concepts. However, little is known about the true effects on conceptual knowledge and associated attitudes. Therefore, this study was conducted to examine the shortterm effects of a series of five-day summer robotics/geospatial camps held in Nebraska. The study was conducted at six diverse locations and consisted of a five-day 4-H camp experience. The study examined the experiences of 147 youth between the ages of 10 and 15. A pretestposttest quasi-experimental design …

Assessing The Effect Of Simulation Models On Systems Learning In An Introductory Environmental Science Course, Heather J. Skaza

UNLV Theses, Dissertations, Professional Papers, and Capstones

While there is plenty of anecdotal evidence within the systems dynamics community supporting the use of systems simulations in the classroom to improve student understanding, there is little published, controlled, experimental research. This paper describes the results of a paired experiment testing the effect of using system dynamics simulations to increase systems understanding in an introductory environmental science course. We believed that the students using the systems simulations would demonstrate a greater systemic understanding of environmental issues than those who did not.

We conducted an experiment during the fall semester of 2009, with 304 students enrolled in four sections of …

The Future Of Natural Selection Knowledge Measurement: A Reply To Anderson Et Al. (2010), Ross Nehm, Irvin Sam Schonfeld

Publications and Research

The development of rich, reliable, and robust measures of the composition, structure, and stability of student thinking about core scientific ideas (such as natural selection) remains a complex challenge facing science educators. In their recent article (Nehm & Schonfeld 2008), the authors explored the strengths, weaknesses, and insights provided by a detailed exploration of three commonly used measures of student thinking about natural selection in a large sample of underrepresented minority students. One of their core findings was that all of the tools they studied--including the CINS--have strengths and weaknesses that must be carefully taken into consideration by those …

Parts Of The Whole: Observing The State Of The System, Dorothy Wallace

Numeracy

This column draws on the approach of statistician J. Edwards Deming to analyze sources and consequences of variation in an education system. Educational systems are not immune from the effects of poor statistical control, which makes it difficult for teachers to teach effectively and for managers such as principals to improve on school performance. It is also argued that the need for statistical control in these areas is in tension, if not outright conflict, with our goals for educating students.

A Rubric For Assessing Quantitative Reasoning In Written Arguments, Nathan D. Grawe, Neil S. Lutsky, Christopher J. Tassava

Numeracy

This paper introduces a rubric for assessing QR in student papers and analyzes the inter-rater reliability of the instrument based on a reading session involving 11 participants. Despite the disciplinary diversity of the group (which included a faculty member from the arts and literature, two staff members, and representatives from five natural and social science departments), the rubric produced reliable measures of QR use and proficiency in a sample of student papers. Readers agreed on the relevance and extent of QR in 75.0 and 81.9 percent of cases respectively (corresponding to Cohen’s κ= 0.611 and 0.693). A four-category measure of …

Review Of Calculation Vs. Context: Quantitative Literacy And Its Implications For Teacher Education By Bernard L. Madison And Lynn Arthur Steen (Editors), Maura B. Mast

Numeracy

Madison, Bernard L. and Steen, Lynn Arthur (Eds.). Calculation vs. Context: Quantitative Literacy and Its Implications for Teacher Education. (Washington, DC: Mathematical Association of America, 2009). 197 pp. Softcover. ISBN 978-0-88385-908-7. Available free on the MAA website at http://www.maa.org/ql/calcvscontext.html

The papers in Calculation vs. Context discuss the role of quantitative literacy in the K-12 curriculum and in teacher education. The papers present a varied set of perspectives and address three themes: the changing environment of education in American society; the challenges, and the necessity, of preparing teachers to teach quantitative literacy and of including quantitative literacy in the K-12 education; …

Quantitative Literacy Assessments: An Introduction To Testing Tests, Dorothy Wallace, Kim Rheinlander, Steven Woloshin, Lisa Schwartz

Numeracy

This paper describes how professional evaluators construct assessment instruments that work properly to measure the right thing. Constructing an assessment tool begins with getting feedback from relevant experts on the content of questions. The tool is developed and refined through comparison with existing instruments, focus groups and cognitive interviews. The final instrument is formally tested for content validity, usability, reliability and construct validity through a variety of statistical measures. This process of construction is illustrated by two examples relevant to quantitative literacy: the Medical Data Interpretation Test and the Math Attitudes Survey.

Assessing Quantitative Reasoning, Corrine H. Taylor

Numeracy

No abstract provided.

Quantitative Literacy On The Web Of Science, 2 – Mining The Health Numeracy Literature For Assessment Items, H L. Vacher, Todd Chavez

Numeracy

A topic search of the Web of Science (WoS) database using the term “numeracy” produced a bibliography of 293 articles, reviews and editorial commentaries (Oct 2008). The citation graph of the bibliography clearly identifies five benchmark papers (1995-2001), four of which developed numeracy assessment instruments. Starting with the 80 papers that cite these benchmarks, we identified a set of 25 papers (1995-2008) in which the medical research community reports the development and/or application of health-numeracy assessments. In all we found 10 assessment instruments from which we have compiled a total of 48 assessment items. There are both general and context-specific …