Educational Assessment, Evaluation, and Research Commons^™

Thinking Beyond The Fried Egg Model: How Accurately Do Students Perceive Cells In A Living Context?, Milissa Knox

Electronic Theses and Dissertations

This exploratory study investigated three aspects of introductory undergraduate biology students’ understanding about cells. The study, which took place at the University of Maine with voluntary students in Basic Biology (“BIO100”) in the summer and fall of 2009, examined (1) students’ pre-course perceptions of cells as they exist in a living context and (2) gains in students’ perception and knowledge about cells after completing the one-semester course (BIO100). Results are based on lecture exam scores, pre-post surveys developed as a part of this thesis, and interviews with two groups of biology students. A total of 498 students participated in the …

Exploring And Training Spatial Reasoning Via Eye Movements: Implications On Performance, Victoria A. Roach

Electronic Thesis and Dissertation Repository

This dissertation sought to determine if eye movements could serve as an indicator of success in spatial reasoning, and if eye movements associated with successful completion could be applied to strategically improve spatial reasoning.

Using the line images of Shepard and Metzler, an electronic test of mental rotations ability (EMRT) was designed. Two versions of the test were created, allowing for both a timed (6 seconds per question) and untimed testing environment. Four experiments were designed and completed to relate mental rotation ability (MRA) scores from the EMRT, to patterns in chrononumeric and visual salience data. In each experiment, participants …

Matched, Somewhat-Matched Or Mismatched? Predictors Of Degree-Job Match Among Stem Graduates, Taghreed Ahmed Alhaddab

Seton Hall University Dissertations and Theses (ETDs)

The current third-generation globalization caused structural, organizational and functional changes in the STEM workforce along with changes in human capital flow. The new globalization shift produced new world order causing the STEM workforce to adopt new frameworks, new skills, and new policy approaches to maintain economic strength and achieve growth and prosperity. Available data indicate that the U.S. secondary and postsecondary education system prepares and produce more than an adequate number of STEM graduates. The perceived crisis in the number of U.S. STEM graduates was not confirmed by any data or policy report. Thus, attention should not be caught simply …

Deaf Children’S Science Content Learning In Direct Instruction Versus Interpreted Instruction, Kim B. Kurz, Brenda Schick, Peter C. Hauser

Journal of Science Education for Students with Disabilities

This research study compared learning of 6-9th grade deaf students under two modes of educational delivery – interpreted vs. direct instruction using science lessons. Nineteen deaf students participated in the study in which they were taught six science lessons in American Sign Language. In one condition, the lessons were taught by a hearing teacher in English and were translated in ASL via a professional and certified interpreter. In the second condition, the lessons were taught to the students in ASL by a deaf teacher. All students saw three lessons delivered via an interpreter and three different lessons in direct ASL; …

What I Taught My Stem Instructor About Teaching: What A Deaf Student Hears That Others Cannot, Annemarie Ross, Randy K. Yerrick

Journal of Science Education for Students with Disabilities

Overall, science teaching at the university level has remained in a relatively static state. There is much research and debate among university faculty regarding the most effective methods of teaching science. But it remains largely rhetoric. The traditional lecture model in STEM higher education is limping along in its march toward inclusion and equity. The NGSS and Common Core reform efforts do little to help university science teachers to change their orientation from largely lecture-driven practice with laboratory supplements. While it is impossible to address all diverse student groups, the need for accommodations tend to be overlooked. As a Deaf …

Dps Exemplary Schools Case Study: A Cross-Case Analysis, Honorine Nocon, Alan Davis, Tracy Keenan, Ruth Brancard, Barbara Dray, Heather Johnson, Kara Mitchell, Sally Nathenson-Mejia, Nancy Shanklin, Sheila Shannon, Shruti Poulsen, Maria Thomas-Ruzic, Ron Tzur, Geeta Verma

Geeta Verma

No abstract provided.

How Science Teachers Balance Religion And Evolution In The Science Classroom: A Case Study Of Science Classes In A Florida Public School District, Pierre Willems

Doctoral Dissertations and Projects

The purpose of this case study was to research how science teachers balance both religion and evolution in the science classroom with as little controversy as possible. In this study I attempted to provide some insight on how teachers are currently teaching evolution in their science classes in light of the religious beliefs of the students as well as their own. The case study was conducted in a school district in Florida where I attempted to answer the following questions: (a) How do science teachers in the Florida School District (FSD) approach the religion–evolution issue in preparing students for a …

The Role Of Perception, Interpretation, And Decision Making In The Development Of Beginning Teachers’ Competence, Rossella Santagata, Cathery Yeh

Education Faculty Articles and Research

This study investigates beginning US elementary teachers’ competence for teaching mathematics and its development during teacher preparation and into the first 2 years of full-time teaching. Data are drawn from three longitudinal case studies and include the classroom video analysis survey, classroom observations and interviews about teachers’ instructional decisions, and whole-day shadowing. A multi-case study design was used to examine the processes of perception, interpretation, and decision making in participants’ comments on video clips of teaching episodes and in reflections about their own teaching. Findings support the central role of these processes in teacher competence and the generative power of …

Flipping In A Technological Rich Classroom, John W. Budge

EDL Sixth Year Theses

The purpose of this study was to explore eighth grade students’ perception of a flipped classroom environment. It is difficult to engage and motivate eighth grade students. This study was created in order to determine if a flipped classroom would spark more interest and therefore eventually lead to an increased ability. More specifically, this study investigated how students perceive their learning is progressing in a flipped math classroom, and how engaged are they using the technology compared to the traditional classroom setting. The classroom environment was switched to a flipped classroom at the start of a new unit in October. …

The Impact Of Early Numeracy Intervention On Kindergarten Students, Jennifer L. Hill

EDL Sixth Year Theses

The purpose of this study was to explore the effectiveness of early numeracy intervention with kindergarten students. In order to grow a stronger understanding of how providing mathematics intervention can benefit students, the intervention was provided to kindergarten students aimed to seek answers to how providing the earliest possible intervention can positively impact the achievement gap and a child’s understanding of number. This study explored the impact early numeracy intervention had on five kindergarten students and compared their growth to those of their peers not receiving intervention to determine the positive impact providing Response to Intervention had on kindergarten students. …

A Phenomenological Study Of Differentiated Instruction For Fifth Grade Gifted And High Ability Learners Through Math In Focus, Elizabeth Keithley Sizemore

Doctoral Dissertations and Projects

his phenomenological study investigated the differentiation techniques implemented for gifted and high ability learners by fifth grade general classroom mathematics instructors utilizing the Math in Focus (Great Source/Houghton Mifflin Harcourt, 2009) Singapore Mathematics program in a suburban school district. To provide an understanding of the differentiation process currently being implemented by general classroom mathematics teachers, six participants completed an open-ended questionnaire and two representative participants were interviewed, observed, and asked to provide artifacts for analysis in the study. Data analysis using transcendental phenomenological reduction, including bracketing and horizonalization, revealed several overarching lessons. Participants analyzed multiple student data sources throughout the …

Work Integrated Learning In Stem In Australian Universities: Final Report: Submitted To The Office Of The Chief Scientist, Daniel Edwards, Kate Perkins, Jacob Pearce, Jennifer Hong

Dr Daniel Edwards

The Australian Council for Educational Research (ACER) undertook this study for the Office of the Chief Scientist (OCS). It explores the practice and application of Work Integrated Learning (WIL) in STEM, with a particular focus on natural and physical sciences, information technology, and agriculture departments in Australian universities. The project involved a detailed ‘stocktake’ of WIL in practice in these disciplines, with collection of information by interview, survey instruments, consultation with stakeholders and literature reviews. Every university in Australia was visited as part of this project, with interviews and consultation sessions gathering insight from more than 120 academics and support …

Work Integrated Learning In Stem In Australian Universities: Final Report: Submitted To The Office Of The Chief Scientist, Daniel Edwards, Kate Perkins, Jacob Pearce, Jennifer Hong

Dr Jacob Pearce

The Australian Council for Educational Research (ACER) undertook this study for the Office of the Chief Scientist (OCS). It explores the practice and application of Work Integrated Learning (WIL) in STEM, with a particular focus on natural and physical sciences, information technology, and agriculture departments in Australian universities. The project involved a detailed ‘stocktake’ of WIL in practice in these disciplines, with collection of information by interview, survey instruments, consultation with stakeholders and literature reviews. Every university in Australia was visited as part of this project, with interviews and consultation sessions gathering insight from more than 120 academics and support …

Medulla: A 2d Sidescrolling Platformer Game That Teaches Basic Brain Structure And Function, Joey R. Fanfarelli, Stephanie Vie

Faculty Scholarship and Creative Works

This article explores the design and instructional effectiveness of Medulla, an educational game meant to teach brain structure and function to undergraduate psychology students. Developed in the retro-style platformer genre, Medulla uses two-dimensional gameplay with pixel-based graphics to engage students in learning content related to the brain, information which is often pre-requisite to more rigorous psychological study. A pretest posttest design was used in an experiment assessing Medulla’s ability to teach psychology content. Results indicated content knowledge was significantly higher on the posttest than the pretest, with a large effect size. Medulla appears to be an effective learning tool. These …

Can We Identify Guessing In Student Response Patterns? A Preliminary Analysis Of A Field Trial Design, Chris Freeman

Chris Freeman

This research is grounded in the intersecting theoretical frameworks of validity of assessments (Messick, 1989), and the use of Item Response Theory (IRT) to analyse and report student achievement tests. The research questions seek to investigate the use of data from those assessments and in particular cases where guessing is an acknowledged and in some cases encouraged in student response strategies in multiple choice tests.

Session Report - Theme 6: Training, Capacity Building, Science & Research, Jim Parsons

ShipArc 2015 Conference

No abstract provided.

Using Pre-Tests And Post-Tests To Measure Student Learning, Rebecca Teed

Rebecca Teed

How much are students actually learning in our classes? The best predictor of a student’s final exam grade is how much content knowledge they had coming in. This prior knowledge can be assessed with a pre-test, allowing instructors to adjust the course based on what students already know or don’t know. The instructor can use the pre-test scores to create student groups that are either heterogeneous (for cooperative learning) or homogeneous (for differentiated instruction) with respect to content background at the start of term. A curriculum designer wishing to compare learning gains for different teaching tools such as cooperative learning …

Session H: Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw

Dr Sue Thomson

Whenever the results of the Programme for International Student Assessment (PISA) are announced, media headlines are full of reports about rankings, about how many countries Australia is outperformed by and outperforms. In early rounds of PISA, Australia ranked among the top 10 countries across all three education domains assessed. However, over time Australia’s position has declined, rather than improved, and Australia no longer sits in the top 10 of any of the assessed domains. This presentation will go behind the headlines and past the rankings, to look at where Australia has declined, and look at how we can improve outcomes …

Stealth Assessment In Video Games, Val Shute

2009 - 2019 ACER Research Conferences

Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …

Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino

2009 - 2019 ACER Research Conferences

A key challenge in shaping science learning for the future will be to develop new measures of learning that take into account what it means to be proficient in science (Pellegrino, 2013). The emergent view on proficiency, grounded in learning sciences research, emphasises using and applying knowledge in the context of disciplinary practice. Referred to as knowledge-in-use, this perspective on science proficiency is a centrepiece of the United States’ National Research Council’s (NRC) Framework for K–12 Science Education (NRC, 2012), embodied in the new US national standards (NGSS Lead States, 2013) and emphasised in the recently released NRC report on …

Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw

2009 - 2019 ACER Research Conferences

Whenever the results of the Programme for International Student Assessment (PISA) are announced, media headlines are full of reports about rankings, about how many countries Australia is outperformed by and outperforms. In early rounds of PISA, Australia ranked among the top 10 countries across all three education domains assessed. However, over time Australia’s position has declined, rather than improved, and Australia no longer sits in the top 10 of any of the assessed domains. This presentation will go behind the headlines and past the rankings, to look at where Australia has declined, and look at how we can improve outcomes …

Evaluation Of The State Of Georgia's School Instructional Extension Program (Siep) At One Middle School, Taiesha Adams

Taiesha Adams

This study examined the implementation of the State of Georgia's School Instructional Extension Program (SIEP) at one middle school in a rural school district. SIEP was adopted in this district in an effort to improve outcomes for students who demonstrate deficiencies in core-academic subjects. For the past 2 years, SIEP has been used at this study site to address low academic performance in the area of mathematics. However, to date, school leaders have not developed a system to evaluate the efficacy of the program. The purpose of this project study was to conduct a comprehensive program evaluation that addressed the …

Chemical Oxygen Demand Reduction Using The Algae Dunaliella Primolecta And Chlorella Vulgaris, Angeles L. Mora, Alejandro Hernandez, Alejandro Calderón-Urrea

STAR Program Research Presentations

Farm industry wastewater is characterized by high organic materials and by high chemical oxygen demand (COD). Farms with large livestock and poultry operations can be a major source of wastewater thus a major concern for effective environmental and industrial management. Effective environmental and industrial management are high in cost therefor biofuels produced from plants have a potential of replacing a portion of fossil fuel consumption with a renewable efficient alternative. Due to California’s water crisis in the recent years, it is questioned if a biological treatment system that uses algal growth to create renewable energy in the form of biodiesel …

Assessing High School Science Students’ Abilities To Use Cross Cutting Literacy Skills And Scientific Argumentative Writing Skills In A Mid-Western School District, Ellen M. Karel

Masters Theses

This study sought to determine to what extent a centrally focused initiative concentrated on how to teach students to not just write, but how to think, read, and speak about real world problems in a persuasive manner based on multiple sets of data related to science concepts, increased scientific argumentative writing proficiencies among high school students. A secondary area this study attempted to explore was the correlation between the implemented processes in the initiative and high school students’ scientific argumentative writing proficiencies. The study was conducted in a mid-western high school, population 1,088, with a select group of students in …

Assessing The Validity And Reliability Of Dichotomous Test Results Using Item Response Theory On A Group Of First Year Engineering Students, Edmund Nevin, Avril Behan, Gavin Duffy, Stephanie Farrell, Rachel Harding, Robert Howard, Aaron Mac Raighne, Brian Bowe

Conference papers

Traditional measurement instruments employed to assess the performance of student’s studying on STEM (Science, Technology, Engineering and Mathematics) related programmes typically involve classification based on final scores. The validity and reliability of these instruments and test forms are important considerations when assessing whether a student understands content and if not, where and in what way they are struggling. The aim of this study is to examine, validate and analyse the test results of first-year engineering student’s at an Institute of Higher Learning in Ireland who took the Purdue Spatial Visualisation Test of Rotation (PSVT:R). Results obtained were analysed using the …

Quantitative Reasoning In Environmental Science: Rasch Measurement To Support Qr Assessment, Robert L. Mayes, Kent Rittschof, Jennifer H. Forrester, Jennifer D. Schuttlefield Christus, Lisa Watson, Franziska Peterson

Numeracy

The ability of middle and high school students to reason quantitatively within the context of environmental science was investigated. A quantitative reasoning (QR) learning progression, with associated QR assessments in the content areas of biodiversity, water, and carbon, was developed based on three QR progress variables: quantification act, quantitative interpretation, and quantitative modeling. Diagnostic instruments were developed specifically for the progress variable quantitative interpretation (QI), each consisting of 96 Likert-scale items. Each content version of the instrument focused on three scale levels (macro scale, micro scale, and landscape scale) and four elements of QI identified in prior research (trend, translation, …

The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe

Numeracy

The Levels of Conceptual Understanding in Statistics (LOCUS) project (NSF DRL-111868) has created assessments that measure conceptual (rather than procedural) understanding of statistics as outlined in GAISE Framework (Franklin et al., 2007, Guidelines for Assessment and Instruction in Statistics Education, American Statistical Association). Here we provide a brief overview of the LOCUS project and present results from multiple-choice items on the pilot administration of the assessments with data collected from over 3400 students in grades 6-12 across six states. These results help illustrate students’ understanding of statistical topics prior to the implementation of the Common Core State Standards. Using the …

The Quantitative Reasoning For College Science (Quarcs) Assessment, 1: Development And Validation, Katherine B. Follette, Donald W. Mccarthy, Erin Dokter, Sanlyn Buxner, Edward Prather

Numeracy

Science is an inherently quantitative endeavor, and general education science courses are taken by a majority of college students. As such, they are a powerful venue for advancing students’ skills and attitudes toward mathematics. This article reports on the development and validation of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a numeracy assessment instrument designed for college-level general education science students. It has been administered to more than four thousand students over eight semesters of refinement. We show that the QuaRCS is able to distinguish varying levels of quantitative literacy and present performance statistics for both individual items and …

The Advanced Placement Program's Impact On Academic Achievement, Russell T. Warne, Braydon Anderson

Russell T Warne

Stem Education Research: Useful Ideas For College Instructors Using Ballooning, Stacy A. Wenzel

2017 Academic High Altitude Conference

Stratospheric ballooning is a tool of enormous promise to help STEM college faculty foster highly engaged learning of science for a wide range of students at a wide range of institutions. High altitude ballooning offers a platform for investigating science and engineering across many fields. Ballooning has been used in courses and experiences for not just undergraduate science majors, but also all undergraduates—including future teachers who, in turn, are the key to improving K-12 science education. Technological advances are lowering the cost of and expertise levels required to make launches and analyze data.

Ballooning offers a context within which faculty …