Open Access. Powered by Scholars. Published by Universities.®
- Publication
- Publication Type
Articles 1 - 16 of 16
Full-Text Articles in Education
Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker
Establishing The Validity And Reliability Of The Locus Assessments, Tim Jacobbe, Bob Delmas, Brad Hartlaub, Jeff Haberstroh, Catherine Case, Steven Foti, Douglas Whitaker
Numeracy
The development of assessments as part of the funded LOCUS project is described. The assessments measure students’ conceptual understanding of statistics as outlined in the GAISE PreK–12 Framework. Results are reported from a large-scale administration to 3,430 students in grades 6 through 12 in the United States. Items were designed to assess levels of understanding as well as components of the statistical problem solving process as articulated in the GAISE framework. We discuss details of how the model used to develop the LOCUS assessments guided the gathering of evidence for validity and reliability arguments. Three types of validity evidence are …
Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner
Focused On Pedagogy: Qr Grading Rubrics For Written Arguments, Ruby Daniels, Kathryn Appenzeller Knowles, Emily Naasz, Amanda Lindner
Numeracy
Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students’ reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 …
Rubrics That Systematically Identify Areas For Improvement, Judy R. Wilkerson, W. Steve Lang
Rubrics That Systematically Identify Areas For Improvement, Judy R. Wilkerson, W. Steve Lang
University of South Florida (USF) M3 Publishing
Commonly used analytic and holistic formats for rubrics have significant limitations in their potential to yield meaningful feedback to students. This inhibits students’ potential to improve their work. Consistent with the recommendation of the Gordon Commission for the Future of Assessment in Education that the focus of assessment shift from accountability to improvement, this research presents one easily-implemented step toward that goal. An alternative rubric format that is designed to provide meaningful feedback to students in order to trigger necessary learning and improvement is illustrated, and feedback from students on its utility is documented. The alternative rubric format, which focuses …
Support For Teacher Candidates And The Edtpa, Dia Gary, Dylan Thomas, Joseph Miller
Support For Teacher Candidates And The Edtpa, Dia Gary, Dylan Thomas, Joseph Miller
Journal of Global Education and Research
Equipping new teachers in today’s society is a noble and challenging task. Of late, many additional licensing standards for teachers create additional responsibilities for universities that provide pedagogy, knowledge, and content for teacher candidates. Identification of best practices that support teacher candidates on the Educative Teacher Performance Assessment (edTPA) is of interest to many teacher education programs. The purpose of this research was to analyze whether incorporating a mock edTPA had beneficial results on the passage of the edTPA. This study spanned fourteen ten-week quarters and included 688 teacher candidates who were preparing to become certificated teachers at a university …
Probing For Bias: Comparing Populations Using Item Response Curves, Paul J. Walter, Edward Nuhfer, Crisel Suarez
Probing For Bias: Comparing Populations Using Item Response Curves, Paul J. Walter, Edward Nuhfer, Crisel Suarez
Numeracy
We introduce an approach for making a quantitative comparison of the item response curves (IRCs) of any two populations on a multiple-choice test instrument. In this study, we employ simulated and actual data. We apply our approach to a dataset of 12,187 participants on the 25-item Science Literacy Concept Inventory (SLCI), which includes ample demographic data of the participants. Prior comparisons of the IRCs of different populations addressed only two populations and were made by visual inspection. Our approach allows for quickly comparing the IRCs for many pairs of populations to identify those items where substantial differences exist. For each …
Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall
Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall
Numeracy
A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …
Analyzing The Retention Of Knowledge Among General Chemistry Students, James T. Kingsepp
Analyzing The Retention Of Knowledge Among General Chemistry Students, James T. Kingsepp
USF Tampa Graduate Theses and Dissertations
General chemistry is a survey course meant to form a foundation for students’ to build upon as they progress into chemistry sub-disciplines. The effectiveness of this foundation rests heavily on students’ abilities to retain or relearn concepts from the course. This study seeks to investigate the utility of a measure of general chemistry students’ knowledge retention across the time period of one semester. This approach was enacted in five different courses of either first or second semester general chemistry. The results showed that one-quarter to one-half of students exhibited a high rate of retention across the semester. A smaller group, …
Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz
Alignment Between Learning Objectives And Assessments In A Quantitative Literacy Course, Younggon Bae, Samuel L. Tunstall, Kathryn S. Knowles, Rebecca L. Matz
Numeracy
In this analysis, we examine how course assessment items were aligned with learning objectives in a quantitative literacy course at Michigan State University. The alignment analysis consisted of mapping assessment items to a list of operationalized learning objectives from the course. Our analysis shows how often the learning objectives are represented in assessment items, how often they are paired with other learning objectives, and how influential they are in contributing to a student’s course grade. In addition, through comparisons across four assessment types (e.g., exams and homework), we show how each learning objective was assessed differently within each assessment type. …
Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart
Quantitative Literacy In The Core Curriculum Of Hood College: Chapter Ii, Outcomes And Assessment, Betty Mayfield, Ann Stewart
Numeracy
In a previous article, we described our college’s new core curriculum, which included a Quantitative Literacy (QL) component for the first time. We explained how we defined QL in the college catalog, and how we used that definition to choose courses to satisfy the new requirement. We then discussed our early efforts at assessing the effectiveness of the QL program and described our plans for the future. Here we report on our progress towards those goals, including working with faculty from other departments and with our institutional research office to develop a more sophisticated assessment plan, as well as creating …
Using The Quantitative Literacy And Reasoning Assessment (Qlra) For Early Detection Of Students In Need Of Academic Support In Introductory Courses In A Quantitative Discipline: A Case Study, Nathan D. Grawe, Kristin O'Connell
Using The Quantitative Literacy And Reasoning Assessment (Qlra) For Early Detection Of Students In Need Of Academic Support In Introductory Courses In A Quantitative Discipline: A Case Study, Nathan D. Grawe, Kristin O'Connell
Numeracy
As the number of young people attending college has increased, the diversity of college students’ educational backgrounds has also risen. Some students enter introductory courses with math anxiety or gaps in their quantitative training that impede their ability to master or even grasp relevant disciplinary content. Too often professors learn of these anxieties and gaps only during the post mortem of the first midterm. By that time, a good portion of a student’s grade is determined and successful recovery may be impossible. During the 2016-17 academic year, the Department of Economics at Carleton College ran a pilot project using the …
Preliminary Evaluation Of The Psychometric Quality Of HeightenTm Quantitative Literacy, Katrina C. Roohr, Hyesun Lee, Jun Xu, Ou Lydia Liu, Zhen Wang
Preliminary Evaluation Of The Psychometric Quality Of HeightenTm Quantitative Literacy, Katrina C. Roohr, Hyesun Lee, Jun Xu, Ou Lydia Liu, Zhen Wang
Numeracy
Quantitative literacy has been identified as an important student learning outcome (SLO) by both the higher education and workforce communities. This paper aims to provide preliminary evidence of the psychometric quality of the pilot forms for HEIghten quantitative literacy, a next-generation SLO assessment for students in higher education. We evaluated the psychometric quality of the test items (e.g., item analyses), individual- and group-level reliability, the relationship with student performance and related variables (e.g., grade point average) as well as student perceptions, and differences across college-related and demographic subgroups. Our study used data from a pilot test administered to over 1,500 …
The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe
The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe
Numeracy
The Levels of Conceptual Understanding in Statistics (LOCUS) project (NSF DRL-111868) has created assessments that measure conceptual (rather than procedural) understanding of statistics as outlined in GAISE Framework (Franklin et al., 2007, Guidelines for Assessment and Instruction in Statistics Education, American Statistical Association). Here we provide a brief overview of the LOCUS project and present results from multiple-choice items on the pilot administration of the assessments with data collected from over 3400 students in grades 6-12 across six states. These results help illustrate students’ understanding of statistical topics prior to the implementation of the Common Core State Standards. Using the …
The Quantitative Reasoning For College Science (Quarcs) Assessment, 1: Development And Validation, Katherine B. Follette, Donald W. Mccarthy, Erin Dokter, Sanlyn Buxner, Edward Prather
The Quantitative Reasoning For College Science (Quarcs) Assessment, 1: Development And Validation, Katherine B. Follette, Donald W. Mccarthy, Erin Dokter, Sanlyn Buxner, Edward Prather
Numeracy
Science is an inherently quantitative endeavor, and general education science courses are taken by a majority of college students. As such, they are a powerful venue for advancing students’ skills and attitudes toward mathematics. This article reports on the development and validation of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a numeracy assessment instrument designed for college-level general education science students. It has been administered to more than four thousand students over eight semesters of refinement. We show that the QuaRCS is able to distinguish varying levels of quantitative literacy and present performance statistics for both individual items and …
Assessment For Improvement: Two Models For Assessing A Large Quantitative Reasoning Requirement, Mary C. Wright, Joseph E. Howard
Assessment For Improvement: Two Models For Assessing A Large Quantitative Reasoning Requirement, Mary C. Wright, Joseph E. Howard
Numeracy
We present two models for assessment of a large and diverse quantitative reasoning (QR) requirement at the University of Michigan. These approaches address two key challenges in assessment: (1) dissemination of findings for curricular improvement and (2) resource constraints associated with measurement of large programs. Approaches we present for data collection include convergent validation of self-report surveys, as well as use of mixed methods and learning analytics. Strategies we present for dissemination of findings include meetings with instructors to share data and best practices, sharing of results through social media, and use of easily accessible dashboards. These assessment approaches may …
Assessing Numeracy In The Upper Elementary And Middle School Years, Carol Ann Gittens
Assessing Numeracy In The Upper Elementary And Middle School Years, Carol Ann Gittens
Numeracy
Numeracy is the ability or tendency to reason critically about quantitative information. The preponderance of published research on numeracy examines this construct among either pre-K or early elementary samples, students with developmental challenges, or is focused on post-secondary and adult cohorts. The numeracy skills of upper-elementary and middle school students is less documented and understood, most notably because of the lack of valid instruments that are developmentally appropriate for the age range. A numeracy scale for use among upper-elementary and middle school students is introduced in this paper. Scale validation was performed using a gender-balanced, racially / ethnically diverse sample …
Educational Assessment Is An Enduring Theme Of Numeracy, H. L. Vacher
Educational Assessment Is An Enduring Theme Of Numeracy, H. L. Vacher
Numeracy
The Assessment Theme Collection in this issue brings the count of papers on QL assessment to 22 out of the 136 papers (16.2%) in the journal’s first 15 issues. After the first ten issues (our first five years), the counts were 13 and 85 respectively (15.1%). A table in this editorial updates the list of our papers on the subject.