Physical Sciences and Mathematics Commons^™

Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker

Numeracy

The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …

Analyzing The Retention Of Knowledge Among General Chemistry Students, James T. Kingsepp

USF Tampa Graduate Theses and Dissertations

General chemistry is a survey course meant to form a foundation for students’ to build upon as they progress into chemistry sub-disciplines. The effectiveness of this foundation rests heavily on students’ abilities to retain or relearn concepts from the course. This study seeks to investigate the utility of a measure of general chemistry students’ knowledge retention across the time period of one semester. This approach was enacted in five different courses of either first or second semester general chemistry. The results showed that one-quarter to one-half of students exhibited a high rate of retention across the semester. A smaller group, …

Are We At A Watershed Moment For The Quantitative Literacy Movement?: Review Of Shifting Context, Stable Core: Advancing Quantitative Literacy In Higher Education, By Luke Tunstall, Gizem Karaali, And Victor Piercey, Eds., Maura Mast

Numeracy

Luke Tunstall, Gizem Karaali, and Victor Piercey, eds. 2019. Shifting Concepts, Stable Core: Advancing Quantitative Literacy in Higher Education. Math Notes 88. (Mathematics Association of America, MAA Press). Print ISBN 978-0-88385-198-2. Electronic ISBN 978-1-61444-324-7.

The thematic approach of the edited MAA Notes volume Shifting Contexts, Stable Core: Advancing Quantitative Literacy in Higher Education is that the “construct” of quantitative literacy is now fairly stable, but the contexts in which quantitative literacy is taught (and practiced) continue to change. Several chapters give the reader much to consider regarding what constitutes the foundation of this stable core and, relatedly, how quantitative …

Paired Measures Of Competence And Confidence Illuminate Impacts Of Privilege On College Students, Rachel M. Watson, Edward Nuhfer, Kali Nicholas Moon, Steven Fleisher, Paul Walter, Karl Wirth, Christopher Cogan, Ami Wangeline, Eric Gaze

Numeracy

We seek to understand how the experiences of groups that differ in gender, ethnicity, and sexual orientation produce college-level educational performances that differ from the experiences of the dominant majority group. We employ two datasets: a National Database of 24,701 participants and a Paired-Measures Database with 3,323 participants. Both datasets provide demographic information, socioeconomic conditions of status as first-generation student, English as a first language, and interest in majoring in science, and competency scores on understanding science as a way of knowing obtained from the Science Literacy Concept Inventory. The Paired-Measures Database includes additional self-assessed competence ratings that enabled quantifying …

Fire And Flood Expand The Floodplain Shifting Habitat Mosaic Concept, W. J. Kleindl, Mark C. Rains, L. A. Marshall, F. R. Hauer

School of Geosciences Faculty and Staff Publications

The floodplain shifting habitat mosaic concept suggests that habitat patch dynamics are influenced by hydrologic disturbances driven by flood pulses of sufficient power to initiate incipient motion of the substratum and maintain cut-and-fill alluviation of the channel and banks. However, floodplain habitat mosaics are subject to other important landscape-scale disturbance regimes. In the Rocky Mountains of the USA and Canada, fire also affects floodplain habitat patch composition. The floodplain exists at the intersection of disturbance regimes that shape the riverscape and those that shape the landscape. We extended the shifting habitat mosaic concept by examining the effects of multiple disturbance …

The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe

Numeracy

The Levels of Conceptual Understanding in Statistics (LOCUS) project (NSF DRL-111868) has created assessments that measure conceptual (rather than procedural) understanding of statistics as outlined in GAISE Framework (Franklin et al., 2007, Guidelines for Assessment and Instruction in Statistics Education, American Statistical Association). Here we provide a brief overview of the LOCUS project and present results from multiple-choice items on the pilot administration of the assessments with data collected from over 3400 students in grades 6-12 across six states. These results help illustrate students’ understanding of statistical topics prior to the implementation of the Common Core State Standards. Using the …

Characterization Of Waste Anesthetic Gas Exposures To Veterinary Workers In The Tampa Bay Area, Kyle Vogel

USF Tampa Graduate Theses and Dissertations

Veterinarians routinely conduct surgical operations on animals while veterinary technicians administer anesthetic gas to sedate the animal prior to an operation. One commonly used anesthetic agent in veterinary clinics is isoflurane. Veterinary workers have the potential to be exposed to this gas during surgical operations. The Occupational Safety and Health Administration (OSHA) does not have a specific Permissible Exposure Limit (PEL) for isoflurane, however The National Institutes for Health (NIH) does advise that workers should not be exposed to isoflurane in concentrations exceeding 2 parts per million (ppm) for an 8 hour Time Weighted Average (TWA).

Animal clinics vary in …

Measuring Habits Of Mind: Toward A Prompt-Less Instrument For Assessing Quantitative Literacy, Stuart Boersma, Dominic Klyve

Numeracy

In this study, we offer a new “prompt-less” instrument for measuring students’ habits of mind in the field of quantitative literacy. The instrument consists of a series of questions about a newspaper article the students read. The questions do not explicitly solicit quantitative information; students’ habit of mind is assessed by their use of quantitative reasoning even when it is not asked for. Students’ answers were graded according to a modified version of the Quantitative Literacy Assessment Rubric (QLAR) published in this journal (vol. 4, issue 2). We applied the instrument and rubric to assess pre- and post-intervention habits of …

Using A Media-Article Approach To Quantitative Reasoning As An Honors Course: An Exploratory Study, Stuart Boersma, Dominic Klyve

Numeracy

In this study, we investigate student performance on a basic skills assessment of percentages and ratios in two cohorts of students: the general (non-STEM) student body (cohort G) and (non-STEM) honors students (cohort H). Both cohorts used a media-article approach to the study of quantitative reasoning. A pre- and a post-intervention assessment were administered with a two-week intervention period consisting of critical analyses of the use of percentages and ratios in media articles. Using non-parametric techniques, no statistically significant improvement was measured in cohort G while cohort H students showed statistically significant improvement on several items.

Parts Of The Whole: Learn More, Learn Better, Dorothy Wallace

Numeracy

Building on previous columns in Numeracy, this column analyzes various teaching techniques in terms of their ability to build cognitive schema, extend existing schema, reinforce learning, move mean understanding of a group of students, and reduce variance in understanding of a group. We offer a pedagogical cycle as an example of how to address multiple learning goals using common teaching methods.

Motivation For Achievement And Attitudes Toward Mathematics Instruction In A Required Calculus Course At The Norwegian University Of Science And Technology, Donna Sundre, Carol Barry, Vidar Gynnild, Erin Tangen Ostgard

Numeracy

This study from the Norwegian University of Science and Technology (NTNU) examines students’ learning goals and attitudes toward mathematics in a first-year calculus course in undergraduate engineering education. Achievement motivation research using the Achievement Goal Questionnaire (AGQ) is advanced from current literature with two additions: (1) a course specific context using introductory college calculus students, and (2) participation of Norwegian students.

Pre- and posttest measures of attitudes indicate that students do change learning goals over time, unfortunately opposite to the instructors’ aspirations. A significant increase in “Mastery Avoidance” and “Work Avoidance” was accompanied with a drop in “Mastery Approach” and …

Numeracy, Financial Literacy, And Financial Decision-Making, Annamaria Lusardi

Numeracy

Financial decisions, be they related to asset building or debt management, require the capacity to do calculations, including some complex ones. But how numerate are individuals, in particular when it comes to calculations related to financial decisions? Studies and surveys implemented in both the United States and in other countries that are described in this paper show the level of numeracy among the population to be very low. Moreover, lack of numeracy is not only widespread but is particularly severe among some demographic groups, such as women, the elderly, and those with low educational attainment. This has potential consequences for …

Parts Of The Whole: An Algebra Lesson, Dorothy Wallace

Numeracy

This column draws on research of Eon Harper to demonstrate how an understanding of his proposed stages of algebra acquisition would inform a systemic overhaul of algebra education. Harper's stages also explain why students may pass a series of algebra courses yet still be unable to make sense of calculus, as well as offering insight on what aspects of algebra support quantitative literacy.

Quantitative Reasoning In The Contemporary World, 3: Assessing Student Learning, Stuart Boersma, Caren Diefenderfer, Shannon W. Dingman, Bernard L. Madison

Numeracy

In this third paper in a series describing the Quantitative Reasoning in the Contemporary World course, the authors provide an adaptation of the Association of American Colleges and Universities quantitative literacy VALUE rubric. Describing achievement levels in six core competencies (interpretation, representation, calculation, analysis/synthesis, and communication), the resulting Quantitative Literacy Assessment Rubric (QLAR) is applicable to grading student work and has exhibited a high degree of reliability in two separate scoring tests (97% and 88% respectively). The distribution of the six core competencies across the 24 case studies in the authors’ quantitative reasoning casebook shows that interpretation, calculation, and analysis/synthesis …

Quantitative Literacy At Michigan State University, 2: Connection To Financial Literacy, Dennis Gilliland, Vince Melfi, Alla Sikorskii, Edward Corcoran, Eleanor Melfi

Numeracy

The lack of capability of making financial decisions has been recently described for the adult United States population. A concerted effort to increase awareness of this crisis, to improve education in quantitative and financial literacy, and to simplify financial decision-making processes is critical to the solution. This paper describes a study that was undertaken to explore the relationship between quantitative literacy and financial literacy for entering college freshmen. In summer 2010, incoming freshmen to Michigan State University were assessed. Well-tested financial literacy items and validated quantitative literacy assessment instruments were administered to 531 subjects. Logistic regression models were used to …

Quantitative Literacy At Michigan State University, 1: Development And Initial Evaluation Of The Assessment, Alla Sikorskii, Vince Melfi, Dennis Gilliland, Jennifer Kaplan, Suzie Ahn

Numeracy

Development, psychometric testing, and the results of the administration of a quantitative literacy (QL) assessment to undergraduate students are described. Three forms were developed covering a wide range of skills, contexts, and quantitative information presentation formats. Following item generation and revision based on preliminary testing and cognitive interviewing, a total of 3,701 consented undergraduate students at Michigan State University completed one of the three forms. Two of the forms contained 14 multiple-choice items, and one form contained 17 multiple-choice items. All forms were completed by students in less than 30 minutes. Evidence of validity and reliability were obtained for the …

Development Of An Assessment Of Quantitative Literacy For Miami University, Rose Marie Ward, Monica C. Schneider, James D. Kiper

Numeracy

Quantitative Literacy is a competence as important as general literacy; yet, while writing requirements are seemingly ubiquitous across the college curriculum, quantitative literacy requirements are not. The current project provides preliminary evidence of the reliability and validity of a quantitative literacy measure suitable for delivery online. A sample of 188 undergraduate students from Miami University, a midsize university in the midwestern U.S., participated in the current study. Scores on the measure, were inversely related to statistical/mathematical anxiety measures, directly related to subjective assessment of numeracy, and did not differ across gender or year in school. The resulting measure provides a …

Communicating Quantitative Literacy: An Examination Of Open-Ended Assessment Items In Timss, Nals, Ials, And Pisa, Karl W. Kosko, Jesse L. M. Wilkins

Numeracy

Quantitative Literacy (QL) has been described as the skill set an individual uses when interacting with the world in a quantitative manner. A necessary component of this interaction is communication. To this end, assessments of QL have included open-ended items as a means of including communicative aspects of QL. The present study sought to examine whether such open-ended items typically measured aspects of quantitative communication, as compared to mathematical communication, or mathematical skills. We focused on public-released items and rubrics from four of the most widely referenced assessments: the Third International Mathematics and Science Study (TIMSS-95): the National Adult Literacy …

Calculus, Biology And Medicine: A Case Study In Quantitative Literacy For Science Students, Kim Rheinlander, Dorothy Wallace

Numeracy

This paper describes a course designed to enhance the numeracy of biology and pre-medical students. The course introduces students with the background of one semester of calculus to systems of nonlinear ordinary differential equations as they appear in the mathematical biology literature. Evaluation of the course showed increased enjoyment and confidence in doing mathematics, and an increased appreciation of the utility of mathematics to science. Students who complete this course are better able to read the research literature in mathematical biology and carry out research problems of their own.

Personal And Professional Numeracy: A Unit For Pre-Service Teachers At The University Of Tasmania, Jane M. Watson

Numeracy

This paper addresses issues associated with the development of a unit preparing pre-service teachers to be quantitatively literate in three respects. These issues surround (i) the need to be aware of numeracy demands across the curriculum, (ii) the need to model numerate behavior in all interactions of teachers, and (iii) the need to be able to interpret and use system data provided from local and national testing programs. The context for the unit described is Australia, where a national testing program for literacy and numeracy requires teachers to analyze extensive data on their students, a national curriculum requires teachers of …

Spreadsheets Across The Curriculum, 2: Assessing Our Success With Students At Eckerd College, Laura Reiser Wetzel

Numeracy

The Spreadsheets Across the Curriculum (SSAC) library consists of activities to reinforce or teach quantitative literacy or mathematical concepts and skills in context. Each SSAC “module” consists of a PowerPoint presentation with embedded Excel spreadsheets. Each student works through a presentation, thinks about the in-context problem, figures out how to solve it mathematically, and builds spreadsheets to calculate and examine answers.

To assess the effectiveness of SSAC modules, I surveyed Eckerd College undergraduates in two separate studies. Two undergraduate research assistants and I generated pre- and post-tests for 10 SSAC modules. We hired 21 undergraduates who conducted 62 individual module …

The Role Of Rater Motivation In Personnel Selection Validation Studies, Dan Ispas

USF Tampa Graduate Theses and Dissertations

Personnel selection validation studies are routinely conducted in contemporary organizations for selecting and placing employees. Although numerous studies have been conducted with the goal of identifying new predictors, less research was focused on the criterion side. In the current paper, across three studies and five samples, I examined the role played by rater motivation in validation studies. I proposed that rater motivation would impact criterion-related validity of various predictors, the reliability, and the variance of performance ratings. In Study 1, these hypotheses were tested in two samples with varied operationalizations of predictors and of rater motivation. In Study 2, I …

Parts Of The Whole: Thinking About Variance: Standards, Targets, Tracking, And Other Thoughts, Dorothy Wallace

Numeracy

Variation is a natural result of any process, including education. Understanding how variation propagates and increases is necessary for designing educational interventions that work for the intended population. We show how common strategies such as setting standards and tracking can accidentally produce unintended and undesirable results due to the way variation moves through a system.

Quantitative Reasoning In The Contemporary World, 2: Focus Questions For The Numeracy Community, Bernard L. Madison, Shannon W. Dingman

Numeracy

Numerous questions about student learning of quantitative reasoning arose as we developed, taught and assessed the Quantitative Reasoning in the Contemporary World course described in the companion paper in this issue of Numeracy. In this paper, we present some of those questions and describe the context in which they arose. They fall into eight general problem areas: learning that is context-bound and does not easily transfer (i.e., situated learning); the need for a productive disposition regarding mathematics; the connection between QL and mathematical proficiency; the persistence of students, despite our efforts, for using the wrong base for percents; the inconsistent …

Quantitative Reasoning In The Contemporary World, 1: The Course And Its Challenges:, Shannon W. Dingman, Bernard L. Madison

Numeracy

The authors describe successes and challenges in developing a QL-friendly course at the University of Arkansas. This work is part of a three-year NSF project Quantitative Reasoning in the Contemporary World (QRCW) that supported the expansion of the course. The course, MATH 2183, began experimentally in Fall 2004 as a section of finite mathematics known informally as “News Math” for 26 students from arts and humanities disciplines. Over the past six years, the course has evolved and now MATH 2183 is approved to satisfy the College of Arts and Sciences mathematics requirement for the Bachelor of Arts degree. In 2009-2010, …

Quantitative Literacy: Does It Work? Evaluation Of Student Outcomes At Colby-Sawyer College, Benjamin Steele, Semra Kilic-Bahi

Numeracy

Colby-Sawyer College has adopted a mission for quantitative literacy (QL) to give students the “necessary skills to understand and use quantitative information in their personal and professional lives.” We have implemented an across-the-curriculum approach to develop these skills. As part of this QL program, we administer two assessment tests, one in basic mathematical skills and one that applies those skills, plus an attitude survey to both freshmen and seniors. Three years of data show that seniors score about 10 percentage points higher than freshmen on these tests. However, seniors still scored below 55 percent on both tests, and many cannot …

Advancing Assessment Of Quantitative And Scientific Reasoning, Donna L. Sundre, Amy D. Thelk

Numeracy

Advancing Assessment of Quantitative and Scientific Reasoning is a four-year NSF Project (DUE-0618599) in part designed to evaluate the generalizability of quantitative (QR) and scientific reasoning (SR) assessment instruments created at James Madison University to four other four-year institutions with very distinct missions and student demographics. This article describes the methods, results, and findings we obtained in our studies. More specifically, we describe how to conduct content-alignment exercises in which faculty members map each item from a prospective test to the student learning objectives taught at the institution. Our results indicated that 92-100% of the QR and SR items were …

Parts Of The Whole: Observing The State Of The System, Dorothy Wallace

Numeracy

This column draws on the approach of statistician J. Edwards Deming to analyze sources and consequences of variation in an education system. Educational systems are not immune from the effects of poor statistical control, which makes it difficult for teachers to teach effectively and for managers such as principals to improve on school performance. It is also argued that the need for statistical control in these areas is in tension, if not outright conflict, with our goals for educating students.

A Rubric For Assessing Quantitative Reasoning In Written Arguments, Nathan D. Grawe, Neil S. Lutsky, Christopher J. Tassava

Numeracy

This paper introduces a rubric for assessing QR in student papers and analyzes the inter-rater reliability of the instrument based on a reading session involving 11 participants. Despite the disciplinary diversity of the group (which included a faculty member from the arts and literature, two staff members, and representatives from five natural and social science departments), the rubric produced reliable measures of QR use and proficiency in a sample of student papers. Readers agreed on the relevance and extent of QR in 75.0 and 81.9 percent of cases respectively (corresponding to Cohen’s κ= 0.611 and 0.693). A four-category measure of …

Review Of Calculation Vs. Context: Quantitative Literacy And Its Implications For Teacher Education By Bernard L. Madison And Lynn Arthur Steen (Editors), Maura B. Mast

Numeracy

Madison, Bernard L. and Steen, Lynn Arthur (Eds.). Calculation vs. Context: Quantitative Literacy and Its Implications for Teacher Education. (Washington, DC: Mathematical Association of America, 2009). 197 pp. Softcover. ISBN 978-0-88385-908-7. Available free on the MAA website at http://www.maa.org/ql/calcvscontext.html

The papers in Calculation vs. Context discuss the role of quantitative literacy in the K-12 curriculum and in teacher education. The papers present a varied set of perspectives and address three themes: the changing environment of education in American society; the challenges, and the necessity, of preparing teachers to teach quantitative literacy and of including quantitative literacy in the K-12 education; …