Educational Assessment, Evaluation, and Research Commons^™

What I Taught My Stem Instructor About Teaching: What A Deaf Student Hears That Others Cannot, Annemarie Ross, Randy K. Yerrick

Journal of Science Education for Students with Disabilities

Overall, science teaching at the university level has remained in a relatively static state. There is much research and debate among university faculty regarding the most effective methods of teaching science. But it remains largely rhetoric. The traditional lecture model in STEM higher education is limping along in its march toward inclusion and equity. The NGSS and Common Core reform efforts do little to help university science teachers to change their orientation from largely lecture-driven practice with laboratory supplements. While it is impossible to address all diverse student groups, the need for accommodations tend to be overlooked. As a Deaf …

How Science Teachers Balance Religion And Evolution In The Science Classroom: A Case Study Of Science Classes In A Florida Public School District, Pierre Willems

Doctoral Dissertations and Projects

The purpose of this case study was to research how science teachers balance both religion and evolution in the science classroom with as little controversy as possible. In this study I attempted to provide some insight on how teachers are currently teaching evolution in their science classes in light of the religious beliefs of the students as well as their own. The case study was conducted in a school district in Florida where I attempted to answer the following questions: (a) How do science teachers in the Florida School District (FSD) approach the religion–evolution issue in preparing students for a …

The Role Of Perception, Interpretation, And Decision Making In The Development Of Beginning Teachers’ Competence, Rossella Santagata, Cathery Yeh

Education Faculty Articles and Research

This study investigates beginning US elementary teachers’ competence for teaching mathematics and its development during teacher preparation and into the first 2 years of full-time teaching. Data are drawn from three longitudinal case studies and include the classroom video analysis survey, classroom observations and interviews about teachers’ instructional decisions, and whole-day shadowing. A multi-case study design was used to examine the processes of perception, interpretation, and decision making in participants’ comments on video clips of teaching episodes and in reflections about their own teaching. Findings support the central role of these processes in teacher competence and the generative power of …

The Impact Of Early Numeracy Intervention On Kindergarten Students, Jennifer L. Hill

EDL Sixth Year Theses

The purpose of this study was to explore the effectiveness of early numeracy intervention with kindergarten students. In order to grow a stronger understanding of how providing mathematics intervention can benefit students, the intervention was provided to kindergarten students aimed to seek answers to how providing the earliest possible intervention can positively impact the achievement gap and a child’s understanding of number. This study explored the impact early numeracy intervention had on five kindergarten students and compared their growth to those of their peers not receiving intervention to determine the positive impact providing Response to Intervention had on kindergarten students. …

Flipping In A Technological Rich Classroom, John W. Budge

EDL Sixth Year Theses

The purpose of this study was to explore eighth grade students’ perception of a flipped classroom environment. It is difficult to engage and motivate eighth grade students. This study was created in order to determine if a flipped classroom would spark more interest and therefore eventually lead to an increased ability. More specifically, this study investigated how students perceive their learning is progressing in a flipped math classroom, and how engaged are they using the technology compared to the traditional classroom setting. The classroom environment was switched to a flipped classroom at the start of a new unit in October. …

A Phenomenological Study Of Differentiated Instruction For Fifth Grade Gifted And High Ability Learners Through Math In Focus, Elizabeth Keithley Sizemore

Doctoral Dissertations and Projects

his phenomenological study investigated the differentiation techniques implemented for gifted and high ability learners by fifth grade general classroom mathematics instructors utilizing the Math in Focus (Great Source/Houghton Mifflin Harcourt, 2009) Singapore Mathematics program in a suburban school district. To provide an understanding of the differentiation process currently being implemented by general classroom mathematics teachers, six participants completed an open-ended questionnaire and two representative participants were interviewed, observed, and asked to provide artifacts for analysis in the study. Data analysis using transcendental phenomenological reduction, including bracketing and horizonalization, revealed several overarching lessons. Participants analyzed multiple student data sources throughout the …

Medulla: A 2d Sidescrolling Platformer Game That Teaches Basic Brain Structure And Function, Joey R. Fanfarelli, Stephanie Vie

Faculty Scholarship and Creative Works

This article explores the design and instructional effectiveness of Medulla, an educational game meant to teach brain structure and function to undergraduate psychology students. Developed in the retro-style platformer genre, Medulla uses two-dimensional gameplay with pixel-based graphics to engage students in learning content related to the brain, information which is often pre-requisite to more rigorous psychological study. A pretest posttest design was used in an experiment assessing Medulla’s ability to teach psychology content. Results indicated content knowledge was significantly higher on the posttest than the pretest, with a large effect size. Medulla appears to be an effective learning tool. These …

Session Report - Theme 6: Training, Capacity Building, Science & Research, Jim Parsons

ShipArc 2015 Conference

No abstract provided.

Stealth Assessment In Video Games, Val Shute

2009 - 2019 ACER Research Conferences

Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …

Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino

2009 - 2019 ACER Research Conferences

A key challenge in shaping science learning for the future will be to develop new measures of learning that take into account what it means to be proficient in science (Pellegrino, 2013). The emergent view on proficiency, grounded in learning sciences research, emphasises using and applying knowledge in the context of disciplinary practice. Referred to as knowledge-in-use, this perspective on science proficiency is a centrepiece of the United States’ National Research Council’s (NRC) Framework for K–12 Science Education (NRC, 2012), embodied in the new US national standards (NGSS Lead States, 2013) and emphasised in the recently released NRC report on …

Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw

2009 - 2019 ACER Research Conferences

Whenever the results of the Programme for International Student Assessment (PISA) are announced, media headlines are full of reports about rankings, about how many countries Australia is outperformed by and outperforms. In early rounds of PISA, Australia ranked among the top 10 countries across all three education domains assessed. However, over time Australia’s position has declined, rather than improved, and Australia no longer sits in the top 10 of any of the assessed domains. This presentation will go behind the headlines and past the rankings, to look at where Australia has declined, and look at how we can improve outcomes …

Chemical Oxygen Demand Reduction Using The Algae Dunaliella Primolecta And Chlorella Vulgaris, Angeles L. Mora, Alejandro Hernandez, Alejandro Calderón-Urrea

STAR Program Research Presentations

Farm industry wastewater is characterized by high organic materials and by high chemical oxygen demand (COD). Farms with large livestock and poultry operations can be a major source of wastewater thus a major concern for effective environmental and industrial management. Effective environmental and industrial management are high in cost therefor biofuels produced from plants have a potential of replacing a portion of fossil fuel consumption with a renewable efficient alternative. Due to California’s water crisis in the recent years, it is questioned if a biological treatment system that uses algal growth to create renewable energy in the form of biodiesel …

Assessing High School Science Students’ Abilities To Use Cross Cutting Literacy Skills And Scientific Argumentative Writing Skills In A Mid-Western School District, Ellen M. Karel

Masters Theses

This study sought to determine to what extent a centrally focused initiative concentrated on how to teach students to not just write, but how to think, read, and speak about real world problems in a persuasive manner based on multiple sets of data related to science concepts, increased scientific argumentative writing proficiencies among high school students. A secondary area this study attempted to explore was the correlation between the implemented processes in the initiative and high school students’ scientific argumentative writing proficiencies. The study was conducted in a mid-western high school, population 1,088, with a select group of students in …

Assessing The Validity And Reliability Of Dichotomous Test Results Using Item Response Theory On A Group Of First Year Engineering Students, Edmund Nevin, Avril Behan, Gavin Duffy, Stephanie Farrell, Rachel Harding, Robert Howard, Aaron Mac Raighne, Brian Bowe

Conference papers

Traditional measurement instruments employed to assess the performance of student’s studying on STEM (Science, Technology, Engineering and Mathematics) related programmes typically involve classification based on final scores. The validity and reliability of these instruments and test forms are important considerations when assessing whether a student understands content and if not, where and in what way they are struggling. The aim of this study is to examine, validate and analyse the test results of first-year engineering student’s at an Institute of Higher Learning in Ireland who took the Purdue Spatial Visualisation Test of Rotation (PSVT:R). Results obtained were analysed using the …

Quantitative Reasoning In Environmental Science: Rasch Measurement To Support Qr Assessment, Robert L. Mayes, Kent Rittschof, Jennifer H. Forrester, Jennifer D. Schuttlefield Christus, Lisa Watson, Franziska Peterson

Numeracy

The ability of middle and high school students to reason quantitatively within the context of environmental science was investigated. A quantitative reasoning (QR) learning progression, with associated QR assessments in the content areas of biodiversity, water, and carbon, was developed based on three QR progress variables: quantification act, quantitative interpretation, and quantitative modeling. Diagnostic instruments were developed specifically for the progress variable quantitative interpretation (QI), each consisting of 96 Likert-scale items. Each content version of the instrument focused on three scale levels (macro scale, micro scale, and landscape scale) and four elements of QI identified in prior research (trend, translation, …

The Levels Of Conceptual Understanding In Statistics (Locus) Project: Results Of The Pilot Study, Douglas Whitaker, Steven Foti, Tim Jacobbe

Numeracy

The Levels of Conceptual Understanding in Statistics (LOCUS) project (NSF DRL-111868) has created assessments that measure conceptual (rather than procedural) understanding of statistics as outlined in GAISE Framework (Franklin et al., 2007, Guidelines for Assessment and Instruction in Statistics Education, American Statistical Association). Here we provide a brief overview of the LOCUS project and present results from multiple-choice items on the pilot administration of the assessments with data collected from over 3400 students in grades 6-12 across six states. These results help illustrate students’ understanding of statistical topics prior to the implementation of the Common Core State Standards. Using the …

The Quantitative Reasoning For College Science (Quarcs) Assessment, 1: Development And Validation, Katherine B. Follette, Donald W. Mccarthy, Erin Dokter, Sanlyn Buxner, Edward Prather

Numeracy

Science is an inherently quantitative endeavor, and general education science courses are taken by a majority of college students. As such, they are a powerful venue for advancing students’ skills and attitudes toward mathematics. This article reports on the development and validation of the Quantitative Reasoning for College Science (QuaRCS) Assessment, a numeracy assessment instrument designed for college-level general education science students. It has been administered to more than four thousand students over eight semesters of refinement. We show that the QuaRCS is able to distinguish varying levels of quantitative literacy and present performance statistics for both individual items and …

Stem Education Research: Useful Ideas For College Instructors Using Ballooning, Stacy A. Wenzel

2017 Academic High Altitude Conference

Stratospheric ballooning is a tool of enormous promise to help STEM college faculty foster highly engaged learning of science for a wide range of students at a wide range of institutions. High altitude ballooning offers a platform for investigating science and engineering across many fields. Ballooning has been used in courses and experiences for not just undergraduate science majors, but also all undergraduates—including future teachers who, in turn, are the key to improving K-12 science education. Technological advances are lowering the cost of and expertise levels required to make launches and analyze data.

Ballooning offers a context within which faculty …

Evolution Of A First-Year Engineering Course, Noah Salzman, Janet Callahan, Gary Leroy Hunt, Carol Sevier, Amy J. Moll

Electrical and Computer Engineering Faculty Publications and Presentations

The first-year engineering course at Boise State University has evolved significantly over the past decade as a result of continuous improvement with a particular focus on student retention. The course was originally created in 1999-2001 as an “Introduction to Engineering” course in order to recruit students to one of the fields of engineering, by introducing those fields of engineering as topics across the semester. Over the first ten years, the course continued that introductory-to-field focus while also introducing a significant design element solving openended engineering problems. As a result of a five-year grant aimed toward improving first-year retention, the first-year …

Designing And Implementing A Planetary Geology Course For Engineers At The Jet Propulsion Lab, Jessica Joyce Dimizio

STAR Program Research Presentations

This project took place at NASA’s Jet Propulsion Laboratory (JPL) and involved creating an instructional tool that would increase the quality of communication between mechanical engineers and geologists who are collaboratively designing ways to collect and cache martian rock samples for the Mars 2020 rover mission. Geology and engineering do not cross paths in traditional education settings and communication is difficult due to the specialized language and processes of geology. Previous attempts to bridge communications between these two groups did not serve a large enough audience nor were they specific to the complexities of the Mars 2020 mission. Interviews with …

Work Integrated Learning In Stem In Australian Universities: Final Report: Submitted To The Office Of The Chief Scientist, Daniel Edwards, Kate Perkins, Jacob Pearce, Jennifer Hong

Higher education research

The Australian Council for Educational Research (ACER) undertook this study for the Office of the Chief Scientist (OCS). It explores the practice and application of Work Integrated Learning (WIL) in STEM, with a particular focus on natural and physical sciences, information technology, and agriculture departments in Australian universities. The project involved a detailed ‘stocktake’ of WIL in practice in these disciplines, with collection of information by interview, survey instruments, consultation with stakeholders and literature reviews. Every university in Australia was visited as part of this project, with interviews and consultation sessions gathering insight from more than 120 academics and support …

A Study Of Conceptual And Language Issues Surrounding Weight, Weightlessness, And Free Fall: Textbook Analysis, Instructional Design, And Assessment, Rex Taibu

Dissertations

Science education is an interdisciplinary field that has developed from and continues to rely on research in the fields of cognitive science, philosophy, psychology, sociology and history. This clearly reflects that learning and teaching can be studied from multiple perspectives. Despite these wide ranging roots, contemporary science education by and large is not informed by the work of research on linguistics, and in particular, the role of language in mediating conceptual understanding. The term “weight” has multiple meanings in both science and everyday language, and this unfortunately creates inherent difficulties for teaching and learning. The present study addresses a need …

A Model Of How Different Biology Experts Explain Molecular And Cellular Mechanisms, Caleb M. Trujillo, Trevor R. Anderson, Nancy J. Pelaez

PIBERG Publications

Constructing explanations is an essential skill for all science learners. The goal of this project was to model the key components of expert explanation of molecular and cellular mechanisms. As such, we asked: What is an appropriate model of the components of explanation used by biology experts to explain molecular and cellular mechanisms? Do explanations made by experts from different biology subdisciplines at a university support the validity of this model? Guided by the modeling framework of R. S. Justi and J. K. Gilbert, the validity of an initial model was tested by asking seven biologists to explain a molecular …

Analysis Of English Language Learner Performance On The Biology Massachusetts Comprehensive Assessment System: The Impact Of English Proficiency, First Language Characteristics, And Late-Entry Ell Status, Mary A. Mitchell

Graduate Doctoral Dissertations

This study analyzed English language learner (ELL) performance on the June 2012 Biology MCAS, namely on item attributes of domain, cognitive skill, and linguistic complexity. It examined the impact of English proficiency, Latinate first language, first language orthography, and late-entry ELL status. The results indicated that English proficiency was a strong predictor of performance and that ELLs at higher levels of English proficiency overwhelmingly passed. The results further indicated that English proficiency introduced a construct-irrelevant variance on the Biology MCAS and raised validity issues for using this assessment at lower levels of English proficiency. This study also found that ELLs …

From The Co-Editors, Todd Pagano

Journal of Science Education for Students with Disabilities

We continue to work diligently to improve JSESD. One of the largest challenges to the journal remains the solicitation of manuscript submissions. As such, we are asking the journal’s readership to assist us in advertising the journal. If you are familiar with individuals who might be interested in submitting a manuscript, please pass along the JSESD author link provided above. We are especially interested in articles on science education for students with varying types of disabilities and at a full range of grade levels (K-12 and postsecondary).

A Historical Perspective On The Revolution Of Science Education For Students Who Are Blind Or Visually Impaired In The United States, Cary A. Supalo Dr.

Journal of Science Education for Students with Disabilities

The following was an invited presentation given by Dr. Cary A. Supalo to the National Federation of the Blind of Illinois annual state convention that was held in Chicago, Illinois on Saturday, October 28, 2011. These remarks were slightly modified for the Journal of Science Education for Students with Disabilities.

Cary A. Supalo

What does the term Revolution mean? To some it can simply mean change. To others, it can mean drastic change, and still to others, revolution is no more than a descriptor for something else. In this context, I believe revolution refers to a time of significant change.1 …

Assessing Impact Of Exposure To Cyberphysical Systems On Student Interest In Information Technology Careers, Mayari I. Serrano Anazco

Purdue Polytechnic Masters Theses

The main purpose of this project is to determine if the use of Information Technology (IT) tools, specifically cyberphysical devices, in outreach sessions will promote interest of young individuals in pursuing IT careers. The Diversity office of Purdue’s College of Technology offers a number of outreach sessions to a variety of target populations throughout the year. Each department in the college has an opportunity to present a session related to a field of study offered by the department. The research was carried out thru the Spring 2015 semester during the DOiT and Vision outreach programs offered through the college’s Diversity …

Differentiation In The Classroom Using Chromebooks And Google Applications, Allison Carney

Honors Projects

The purpose of this research was to differentiate using Chromebook and Google technology to improve engagement and grades in the classroom. Chromebooks have been implemented into classrooms all over the country, but the use of Google applications in order to differentiate instruction and assessment is not as prominent in schools. I created four assignments on the Chromebooks that differentiated instruction and assessment based on interest and ability levels. I used a total of six applications and differentiated for forty-four students in a sixth grade math and science classroom. I found that differentiating using Chromebooks and Google applications boosted student engagement, …

Student Transition At A Residential Stem School, Olivia Kaitlin Gatten

Masters Theses & Specialist Projects

The goal of this qualitative study was to gain insight into which personal factors most affect student adjustment in a state residential STEM school. Factors from Tinto’s Model of Institutional Departure were used as the framework to capture the transition of gifted high school students from traditional high school to The Carol Martin Gatton Academy of Mathematics and Science in Kentucky, a statewide residential STEM school. Tinto’s Model predicts college persistence using pre-existing individual characteristics and institutional experiences. These qualities and experiences were used to form questions about student traits and transition. Questionnaires were administered to Gatton Academy first-year students, …

The Learning Landscape: An Assessment Of State Science Standards And Application In A Uri Outreach Center Youth Education Program, Sarah A. Robinson

Senior Honors Projects

Rhode Island state education standards provide educators with curriculum guidance and achievement goals for each grade level. In this case study, I examined the RI state standards and expectations for science education. I undertook this investigation in support of the URI Outreach Center and their elementary education program, Learning Landscape Field Trips. Learning Landscape provides Rhode Island teachers with an opportunity to meet state science standards through the medium of hands-on environmental education programs. Through my investigation, I became fluent in the Learning Landscape curriculum, teaching in more than 20 two-hour sessions. As well, I became familiar with the current …