Science and Mathematics Education Commons^™

Instructional Decision Making In A Gateway Quantitative Reasoning Course, Deependra Budhathoki, Gregory D. Foley, Stephen Shadik

Numeracy

Many educators and professional organizations recommend Quantitative Reasoning as the best entry-level postsecondary mathematics course for non-STEM majors. However, novice and veteran instructors who have no prior experience in teaching a QR course often express their ignorance of the content to choose for this course, the instruction to offer students, and the assessments to measure student learning. We conducted a case study to investigate the initial implementation of an entry-level university quantitative reasoning course during fall semester, 2018. The participants were the course instructor and students. We examined the instructor’s motives and actions and the students’ responses to the course. …

Threshold Concepts In Quantitative Reasoning, Judith Canner, Jennifer E. Clinkenbeard

Numeracy

The idea of “threshold concepts” has been used to identify discipline-based concepts that are critical to that academic area. Threshold concepts are often difficult for students to assimilate in a meaningful way but, once done, can be powerful for the learner. In general, threshold concepts are 1) transformative to learner thinking; 2) bounded by the discipline; 3) integrative with other concepts; and 4) irreversible once understood (Meyer and Land 2003). This paper presents five threshold concepts in quantitative reasoning (QR) developed by transdisciplinary faculty workgroups that may be applicable for non-mathematics disciplines as well. They are as follows: 1) QR …

Development And Initial Validation Of The Mindful Self-Regulated Learning Scale (M-Srls), Sarah Wolff

UNLV Theses, Dissertations, Professional Papers, and Capstones

Modern mindfulness is a catch-all term. Just exactly what it looks like within the context of education and how it is taught vastly varies. As such, program fidelity and integrity is questioned. Here a definition of mindful self-regulated learning is proposed and the Mindful Self-Regulated Learning Scale (m-SRLS) is developed. This includes item generation and development, systematic testing of item performance, scale dimensionality, convergent and divergent validity, measurement invariance across groups and subgroups, and scale reliability over a series of five pilot studies and five primary studies using independent samples. The resulting m-SRLS is a context specific measurement tool that …

High Quality, Equity, And Assessment: An Analysis Of Variables Impacting English Learner Standardized Science Test Performance And Implications For Construct Validity, Maria Del Carmen Salazar, Joanna K. Bruno, Melissa P. Schneider

Curriculum and Instruction: Faculty Scholarship

In the United States, assessment is seen as a lever that can facilitate high-quality education. This study on English learners, students whose native language is not English, was based on data from eighth-grade English learners’ performance on science general and content-specific (physical, life, and earth science) standardized exams and an English language proficiency exam. The researchers utilized regression analysis to examine factors (i.e., socioeconomic status, home language, English language proficiency, and receptive and productive elements of language) that are predictive of English learner performance in general and content-specific science standardized assessments to identify implications for construct validity of high-stakes science …

Exploring Associations Between Self-Concept, Ideal Self, And Assessment Practices Of High School Science Teachers, Jeffrey Celebre

Seton Hall University Dissertations and Theses (ETDs)

Despite being faced with major barriers to overcome, local school districts and teachers must work to align their instructional practices in science and their assessment practices to the Next Generation Science Standards (NGSS) and the New Jersey Student Learning Standards for Science (NJSLS-Science). As described in the literature, a three-dimensional approach to assessment design is one of the qualities considered the model for a true and authentic measurement of student aptitude in science. As teachers work to understand NGSS alignment and their ability to meet alignment standards as an assessor while designing and implementing NGSS-aligned assessments, they will undoubtedly encounter …

Open-Ended Problems: How Much Time Is Enough Time?, Kaitlyn Solymosi

Honors Projects

The purpose of this action research is to observe and analyze students’ responses to open-ended questions, examine student engagement in assessment, and to gauge a reasonable timetable of how long students are predicted to work through them. A great amount of research has been conducted regarding the benefits and impact of open-ended problems in K-12 classrooms, but very little research has focused on the proper amount of time that should be allotted for them. This action research aims to establish a general rule for determining the proper amount of time allotted for open-ended problems. Implications for mathematics teachers will be …

Cross-Disciplinary Learning Index: A Quantitative Measure Of Cross-Disciplinary Learning About Energy, Todd Haskell, Emily Borda, Andrew Boudreaux

Physics & Astronomy

The structure of many science programs at the college level assumes that students are able to draw on and integrate ideas from multiple disciplinary contexts. However, most assessment tools focus on learning in the context of a single discipline. We describe the development and validation of an instrument to measure how well students are able to combine energy ideas from different disciplines into a coherent understanding of a phenomenon. The final version of the instrument consists of a pair of multiple-choice online assessments, along with a metric calculated from the assessment scores: the cross disciplinary learning index (CDLI). The items …

Using Formative Assessment To Build Coherence Between Educational Policy And Classroom Practice: A Case Study Using Inquiry In Science, Connie Cirkony, John Daniel Kenny

Australian Journal of Teacher Education

In this paper we argue that the complexity of education systems can lead to a lack of coherence in the implementation of policy. More effective educational change requires policy-makers and researchers to pay more attention to supporting teachers in classrooms. As an example, we consider decades of research attempts in STEM education to implement learning through inquiry and note there has been little change in teaching practices in classrooms. Using formative assessment in science education as a case study, we developed a rubric for teachers that embeds key aspects of the desired pedagogy. We argue this builds teachers’ confidence to …

Physics Inventory Of Quantitative Literacy: A Tool For Assessing Mathematical Reasoning In Introductory Physics, Suzanne W. Brahmia, Alexis Olsho, Trevor I. Smith, Andrew Boudreaux, Philip Eaton, Charlotte Zimmerman

Physics & Astronomy

One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring Quantitative Literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike …

Defining Understanding: Perspectives From Biology Instructors & Biology Education Researchers, Jeremy L. Hsu, Stanley M. Lo, Brian K. Sato

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Promoting student understanding of biological concepts is a key part of biology education, and the ability to “understand” a concept forms one of the six categories of the oft-used Bloom’s Taxonomy. Despite this, there remains no consensus as to what it means to understand a concept. While several formal definitions have been offered, we investigated how biology instructors and biology education researchers define the term and how they perceived the skill sets needed for a student to understand a concept in the context of assessments. We found that there was no agreement on the definition of understanding, and that responses …

Modeling Through Model-Eliciting Activities: An Analysis Of Models, Elements, And Strategies In High School. The Cases Of Students With Different Level Of Achievement, Jair J. Aguilar

Teaching and Learning Faculty Publications and Presentations

A mathematical client-driven task known as Model-Eliciting Activities was implemented with students of different levels of achievement (i.e., low, average, and high) at the high-school level. The study strived to prove that Model-Eliciting Activities can be solved by students at any achievement level and be used as an assessment tool. Students collaborated in teams of three to develop solutions that met the client’s needs. The model-solutions were compared and contrasted among several dimensions and achievement levels, considering the quality of the final product-solution based on the Quality Assessment Guide, the intermedia product composed of the type of models created, the …

Stem For Everyone: A Mixed Methods Approach To The Conception And Implementation Of An Evaluation Process For Stem Education Programs For Students With Disabilities, Amy Jane Griffiths, John Brady, Nicholas Riley, James Alsip, Vanessa Trine, Lauren Gomez

Education Faculty Articles and Research

Some students with autism spectrum disorder and other learning differences may have superior visual acuity, increased attentional focus, and logical thinking abilities, lending to an affinity for science, technology, engineering, and mathematics (STEM) fields. At the same time, economists report that, the United States will experience a 28.2% increase in STEM-related jobs between 2014 and 2024. Although students with disabilities (SWD) can help to fill those positions, 85% of SWD graduates are either underemployed or unemployed as they enter young adulthood. Thus, there is a need to develop, evaluate, and report outcomes of STEM preparation programs specifically tailored to SWD. …

Designing Performance Tasks In Mathematics Using Technological Tools, Ma. Louise Antonette N. De Las Peñas, Debbie Marie Versoza, Maria Alva Q. Aberin, Agnes Garciano, Jumela F. Sarmiento, Mark Anthony C. Tolentino

Mathematics Faculty Publications

In the Philippines, the performance task is one of the major summative assessments in the K to 12 curriculum. This paper discusses how performance tasks may utilize mathematical apps within the context of blended learning. Guidelines on designing performance tasks; as well as the GRASPS framework; are discussed. Performance tasks that cut across various grade levels and strands of mathematics are presented. These involve divisibility (Numbers); integer and polynomial operations (Algebra); triangle centers (Geometry); and statistics (Statistics). The performance tasks described in this paper can provide an initial idea for the design of other summative assessments and contribute to the …

Overcoming Challenges In Assessing Mathematical Reasoning, Sandra Herbert

Australian Journal of Teacher Education

Despite mathematical reasoning being necessary for in-depth understanding of mathematical concepts, many teacher experience difficulty in assessing it. Data were collected from 34 primary teachers at 4 Victorian government schools at two post- lesson reflective sessions following lessons with a focus on reasoning. These sessions facilitated teachers’ collaborative efforts to assess their students’ reasoning from students’ work samples. The data included transcripts of all the reflective sessions; written work samples; and associated completed rubrics. Analysis of these data enabled identification of seven challenges teachers experienced in assessing reasoning: Limited guidance provided by curriculum documents; Teachers’ knowledge of reasoning; Teacher noticing …

Preschool Mathematics Performance And Executive Function: Rural-Urban Comparisons Across Time, Jacob A. Esplin, Ann M. Berghout Austin, Belinda Blevins-Knabe, Brionne G. Neilson, Robert F. Corwyn

Faculty Publications

This longitudinal study examined the relationship between executive function (EF) and mathematics with rural and urban preschool children. A panel of direct and indirect EF measures were used to compare how well individual measures, as well as analytic approaches, predicted both numeracy and geometry skill. One hundred eighteen children, ages 39 to 68 months, were given EF and mathematics assessments twice, approximately six months apart, concurrent to their teachers completing an indirect assessment of EF for each child. Results suggest: (1) the child’s age determines if a panel of direct EF measures is a better predictor of numeracy and geometry …

Designing Research-Based Instructional Materials That Leverage Dual-Process Theories Of Reasoning: Insights From Testing One Specific, Theory-Driven Intervention, Mila Kryjevskaia, Mackenzie R. Stetzer, Beth A. Lindsey, Alistair Mcinerny, Paula R. L. Heron, Andrew Boudreaux

Physics & Astronomy

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis …

Assessment As A Learning Opportunity: Feedforward With Multiple Attempts, Emily Faulconer

Publications

High quality feedback is well-known to provide multiple student benefits, especially if students are provided the opportunity to apply the feedback. It reasons, then, that we can support student success on summative assessments by combining multiple attempts with high-quality immediate feedback. This study explores student behaviors, performance, and perspectives regarding this strategy.

President's Message, Joanie Funderburk

Colorado Mathematics Teacher

Assessment refers to more than just high-stakes tests. Teachers assess students every time they ask a question, have students share work on the board, review a homework assignment, or solicit student questions during a lesson.

The Seesaw App: Providing Differentiated Assessment Opportunities, Tessa Ziser

Colorado Mathematics Teacher

I discovered the Seesaw app, which allows students to create drawings, videos, and pictures that become part of an online portfolio. Although it is not THE answer to assessment, it has become one of my (and my students’) favorites.

The Redesigned Sat Calls For A Conceptual Approach, Jeff Mccalla

Colorado Mathematics Teacher

Be intentional about including conceptual questions on every assessment that students take.

Probing For Bias: Comparing Populations Using Item Response Curves, Paul J. Walter, Edward Nuhfer, Crisel Suarez

Numeracy

We introduce an approach for making a quantitative comparison of the item response curves (IRCs) of any two populations on a multiple-choice test instrument. In this study, we employ simulated and actual data. We apply our approach to a dataset of 12,187 participants on the 25-item Science Literacy Concept Inventory (SLCI), which includes ample demographic data of the participants. Prior comparisons of the IRCs of different populations addressed only two populations and were made by visual inspection. Our approach allows for quickly comparing the IRCs for many pairs of populations to identify those items where substantial differences exist. For each …

Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall

Numeracy

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …

The Effects Of Teacher Professional Development And Self-Efficacy On Classroom Uses Of Information And Computer Technologies, Elif N. Gokbel

Electronic Theses and Dissertations

The uses of new technologies during mathematics instruction are essential for maintaining opportunities for students to gain better understanding of the content and become digital learners in the information age. Although scholars found technology integration is helpful in improving students’ mathematics achievement, the role of teachers’ preparedness for technology integration remains critical.

Technology professional development and self-efficacy are two major factors impacting teachers’ successful integration of instructional technologies. The purpose of this study was to provide a more in-depth look into (i) mathematics teachers technology uses during direct instruction, dialogic instruction, and assessment; (ii) the relationship between various types of …

Assessment Instrument For Practicum Skills In Trimyristin Separation For Undergraduate Students, Naseer Ahmed, Senam Senam, Antuni Wiyarsi

Jurnal Inovasi Pendidikan IPA

Assessment of practicum plays an essential role in gaining knowledge and skill. Because practical work is an essential component of science courses, there were need to develop new instruments to examine practicum skill. To gain the purpose, Research and Development method used, Borg and Gall's model was adopted in this research. Observation sheets were used to obtain data. The qualitative data analysis technique was used to make coding. The data were described using descriptive statistics. It was used to determine the ability of students to practice in general, purposive sampling technique used for data collection. Products of practical's skills assessment …

Grading For Growth: Using Sliding Scale Rubrics To Motivate Struggling Learners, Dina Mahmood, Hugo Jacobo

Interdisciplinary Journal of Problem-Based Learning

In an effort to adopt more equitable and humanizing grading practices, this teacher inquiry explores how educators attempted to improve students’ views of learning and assessments by utilizing rubrics on a sliding scale. Using the sliding scale rubric approach to grading provided an opportunity for students and educators to rethink how learning is evaluated. The authors found that the logistics of using sliding scale rubrics as a grading tool does need to be refined and further evaluated; however, the belief that a student can receive a grade based on her or his individual starting point did have some positive implications …

Gaining Access To The Language Of Science: A Research Partnership For Disciplined, Discursive Ways To Select And Assess Vocabulary Knowledge, H. Emily Hayden, Anupma Singh, Michelle Eades Baird

Reading Horizons: A Journal of Literacy and Language Arts

To equalize access to science learning across genders and demographic groups, access to the disciplinary language of science is one place to start. The language of science is highly challenging and specialized, and difficulties acquiring this language contribute to disparities in science achievement across diverse student groups. This study used a pre-post design to analyze effectiveness of a brief classroom science vocabulary assessment designed to assess receptive and productive vocabulary knowledge across multiple sections of one 7^th grade science teacher’s class. Vocabulary was selected and analysis conducted by an interdisciplinary research partnership including the science teacher, a literacy specialist, …

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz

Numeracy

In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …

Mastery-Based Testing In Undergraduate Mathematics, J.B. Collins, Amanda Harsy, Jarod Hart, Katie Anne Haymaker, Alyssa Marie Hoofnagle, Mike Janssen, Jessica Stewart Kelly, Austin Tyler Mohr, Jessica O'Shaughnessy

Faculty Work Comprehensive List

Mastery-based testing is an assessment scheme that challenges students to provide complete solutions to problems derived from clear course concepts. Students are allowed multiple attempts to demonstrate mastery, which helps create a classroom environment where students value persistence toward thorough understanding. In this paper, we describe in detail the benefits and implementation of mastery-based testing in college mathematics courses. We also summarize student response data that show positive reactions to this testing method.

Concept Inventories As A Resource For Teaching Evolution, Robert E. Furrow, Jeremy L. Hsu

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Understanding evolution is critical to learning biology, but few college instructors take advantage of the body of peer-reviewed literature that can inform evolution teaching and assessment. Here we summarize the peer-reviewed papers on tools to assess student learning of evolutionary concepts. These published concept inventories provide a resource for instructors to design courses, gauge student preparation, identify key misconceptions in their student population, and measure the impact of a lesson, course, or broader curriculum on student learning. Because these inventories vary in their format, target audience, and degree of validation, we outline and explain these features. In addition to summarizing …