Educational Assessment, Evaluation, and Research Commons^™

Impact Of Instructional Coaches On Elementary Mathematical Achievement, Kayla Marie Hibbard

Online Theses and Dissertations

Since the passage of the Elementary and Secondary Education Act of 1965, school leaders have sought to improve student abilities in both math and reading. Although both subjects have made improvements in both delivery and assessment over the years, mathematics still troubles the nation as students continuously fall short of local, state and federal goals (Darling-Hammond, 1998, 2005; Franke et al., 2005; Johnson & Johnson, 2002).

Instructional coaches have become a norm for many districts across the U. S. as districts seek to draw knowledge and leadership from mastery level teachers as they help improve everyday teaching and student learning. …

Finding Relevance, Competence, And Enjoyment: The Development Of Domain Identification And Interest In First-Year Science Majors, Chloe Ruff

Education Faculty Publications

The purpose of this qualitative study was to examine how first-year college students perceive their development of domain identification with, and interest in, their prospective science major during their initial year of college. Four themes emerged from the coding and analysis of interviews with eight first-year science students: Self-Definition in Flux, Feeling Competent, Expressing Interest through Enjoyment, and Relevant to Me. These themes were mainly consistent with the current model of domain identification (Osborne & Jones, 2011) but differ from the current model of interest development (Hidi & Renninger, 2006). Theoretical and practical implications are included for faculty and advisors …

A Usability And Learnability Case Study Of Glass Flight Deck Interfaces And Pilot Interactions Through Scenario-Based Training, Thomas James De Cino

CCAC Theses and Dissertations

In the aviation industry, digitally produced and presented flight, navigation, and aircraft information is commonly referred to as glass flight decks. Glass flight decks are driven by computer-based subsystems and have long been a part of military and commercial aviation sectors. Over the past 15 years, the General Aviation (GA) sector of the aviation industry has become a recent beneficiary of the rapid advancement of computer-based glass flight deck (GFD) systems.

While providing the GA pilot considerable enhancements in the quality of information about the status and operations of the aircraft, training pilots on the use of glass flight decks …

Transformative Models In K-12 Education: The Impact Of A Blended Universal Design For Learning Intervention, Kai Monet Mathews

Dissertations

Accountability measures, by way of standardized curriculum and assessments, have played a large part in the attempt to ensure that students from all backgrounds receive equal access to quality education. However, the inherent disadvantage of a standardized system is the implied assumption that all students come in with the same knowledge, learn at the same pace, and learn the same way. In the wake of an increasingly diverse K-12 population, educational researchers, learning theorists, and practitioners agree that the concept of the average student is, in fact, a myth. Students come to school with different needs, norms, interests, cultural behavior, …

When We Grade Students’ Proofs, Do They Understand Our Feedback?, Robert C. Moore, Martha Byrne, Sarah Hanusch, Timothy Fukawa-Connelly

Faculty Publications

Instructors often write feedback on students’ proofs even if there is no expectation for the students to revise and resubmit the work. It is not known, however, what students do with that feedback or if they understand the professor’s intentions. To this end, we asked eight advanced mathematics undergraduates to respond to professor comments on four written proofs by interpreting and implementing the comments. We analyzed the student’s responses using the categories of corrective feedback for language acquisition, viewing the language of mathematical proof as a register of academic English.

Integration Of Place-Based Education Into Science Classes From Prekindergarten Through Grade 5, Terri Adele Wade-Lyles

Walden Dissertations and Doctoral Studies

In a large urban district in Ohio, 29.2% of Grade 5, 28.7% of Grade 8, and 45.7% of Grade 10 students passed the state test in science. School district administrators formed a community partnership with local science institutions in order to provide students with hands-on place-based learning experiences intended to improve science academic achievement in PK-Grade 5. The purpose of this qualitative program evaluation was to determine the level of implementation of that place-based program by examining the efficacy of the teachers' embedded professional development and their experiences with the training components. Bruner's theory of cognitive development was used to …

Rural High School Mathematics Instructional Practices And Students' Academic College Readiness, Luajean Erna Bryan

Walden Dissertations and Doctoral Studies

Rural high school graduates in the United States lag behind in college math preparedness, therefore prompting researchers to identify instructional practices that would advance student math performance. This quantitative research study investigated specific teacher practices and their correlation with student gains in college math preparedness on the American College Test (ACT). Data were collected using a teacher questionnaire to quantify the level of reform practices among a sample of six math teachers and used ACT pre and posttests to assess 312 11th grade students' gains in college math readiness in a public rural high school in Southeast Tennessee. Correlation analysis …

Deaf Children’S Science Content Learning In Direct Instruction Versus Interpreted Instruction, Kim B. Kurz, Brenda Schick, Peter C. Hauser

Journal of Science Education for Students with Disabilities

This research study compared learning of 6-9th grade deaf students under two modes of educational delivery – interpreted vs. direct instruction using science lessons. Nineteen deaf students participated in the study in which they were taught six science lessons in American Sign Language. In one condition, the lessons were taught by a hearing teacher in English and were translated in ASL via a professional and certified interpreter. In the second condition, the lessons were taught to the students in ASL by a deaf teacher. All students saw three lessons delivered via an interpreter and three different lessons in direct ASL; …

What I Taught My Stem Instructor About Teaching: What A Deaf Student Hears That Others Cannot, Annemarie Ross, Randy K. Yerrick

Journal of Science Education for Students with Disabilities

Overall, science teaching at the university level has remained in a relatively static state. There is much research and debate among university faculty regarding the most effective methods of teaching science. But it remains largely rhetoric. The traditional lecture model in STEM higher education is limping along in its march toward inclusion and equity. The NGSS and Common Core reform efforts do little to help university science teachers to change their orientation from largely lecture-driven practice with laboratory supplements. While it is impossible to address all diverse student groups, the need for accommodations tend to be overlooked. As a Deaf …

The Impact Of Early Numeracy Intervention On Kindergarten Students, Jennifer L. Hill

EDL Sixth Year Theses

The purpose of this study was to explore the effectiveness of early numeracy intervention with kindergarten students. In order to grow a stronger understanding of how providing mathematics intervention can benefit students, the intervention was provided to kindergarten students aimed to seek answers to how providing the earliest possible intervention can positively impact the achievement gap and a child’s understanding of number. This study explored the impact early numeracy intervention had on five kindergarten students and compared their growth to those of their peers not receiving intervention to determine the positive impact providing Response to Intervention had on kindergarten students. …

Flipping In A Technological Rich Classroom, John W. Budge

EDL Sixth Year Theses

The purpose of this study was to explore eighth grade students’ perception of a flipped classroom environment. It is difficult to engage and motivate eighth grade students. This study was created in order to determine if a flipped classroom would spark more interest and therefore eventually lead to an increased ability. More specifically, this study investigated how students perceive their learning is progressing in a flipped math classroom, and how engaged are they using the technology compared to the traditional classroom setting. The classroom environment was switched to a flipped classroom at the start of a new unit in October. …

Medulla: A 2d Sidescrolling Platformer Game That Teaches Basic Brain Structure And Function, Joey R. Fanfarelli, Stephanie Vie

Faculty Scholarship and Creative Works

This article explores the design and instructional effectiveness of Medulla, an educational game meant to teach brain structure and function to undergraduate psychology students. Developed in the retro-style platformer genre, Medulla uses two-dimensional gameplay with pixel-based graphics to engage students in learning content related to the brain, information which is often pre-requisite to more rigorous psychological study. A pretest posttest design was used in an experiment assessing Medulla’s ability to teach psychology content. Results indicated content knowledge was significantly higher on the posttest than the pretest, with a large effect size. Medulla appears to be an effective learning tool. These …

Stealth Assessment In Video Games, Val Shute

2009 - 2019 ACER Research Conferences

Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …

Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino

2009 - 2019 ACER Research Conferences

A key challenge in shaping science learning for the future will be to develop new measures of learning that take into account what it means to be proficient in science (Pellegrino, 2013). The emergent view on proficiency, grounded in learning sciences research, emphasises using and applying knowledge in the context of disciplinary practice. Referred to as knowledge-in-use, this perspective on science proficiency is a centrepiece of the United States’ National Research Council’s (NRC) Framework for K–12 Science Education (NRC, 2012), embodied in the new US national standards (NGSS Lead States, 2013) and emphasised in the recently released NRC report on …

Assessing High School Science Students’ Abilities To Use Cross Cutting Literacy Skills And Scientific Argumentative Writing Skills In A Mid-Western School District, Ellen M. Karel

Masters Theses

This study sought to determine to what extent a centrally focused initiative concentrated on how to teach students to not just write, but how to think, read, and speak about real world problems in a persuasive manner based on multiple sets of data related to science concepts, increased scientific argumentative writing proficiencies among high school students. A secondary area this study attempted to explore was the correlation between the implemented processes in the initiative and high school students’ scientific argumentative writing proficiencies. The study was conducted in a mid-western high school, population 1,088, with a select group of students in …

Assessing The Validity And Reliability Of Dichotomous Test Results Using Item Response Theory On A Group Of First Year Engineering Students, Edmund Nevin, Avril Behan, Gavin Duffy, Stephanie Farrell, Rachel Harding, Robert Howard, Aaron Mac Raighne, Brian Bowe

Conference papers

Traditional measurement instruments employed to assess the performance of student’s studying on STEM (Science, Technology, Engineering and Mathematics) related programmes typically involve classification based on final scores. The validity and reliability of these instruments and test forms are important considerations when assessing whether a student understands content and if not, where and in what way they are struggling. The aim of this study is to examine, validate and analyse the test results of first-year engineering student’s at an Institute of Higher Learning in Ireland who took the Purdue Spatial Visualisation Test of Rotation (PSVT:R). Results obtained were analysed using the …

Stem Education Research: Useful Ideas For College Instructors Using Ballooning, Stacy A. Wenzel

2017 Academic High Altitude Conference

Stratospheric ballooning is a tool of enormous promise to help STEM college faculty foster highly engaged learning of science for a wide range of students at a wide range of institutions. High altitude ballooning offers a platform for investigating science and engineering across many fields. Ballooning has been used in courses and experiences for not just undergraduate science majors, but also all undergraduates—including future teachers who, in turn, are the key to improving K-12 science education. Technological advances are lowering the cost of and expertise levels required to make launches and analyze data.

Ballooning offers a context within which faculty …

Evolution Of A First-Year Engineering Course, Noah Salzman, Janet Callahan, Gary Leroy Hunt, Carol Sevier, Amy J. Moll

Electrical and Computer Engineering Faculty Publications and Presentations

The first-year engineering course at Boise State University has evolved significantly over the past decade as a result of continuous improvement with a particular focus on student retention. The course was originally created in 1999-2001 as an “Introduction to Engineering” course in order to recruit students to one of the fields of engineering, by introducing those fields of engineering as topics across the semester. Over the first ten years, the course continued that introductory-to-field focus while also introducing a significant design element solving openended engineering problems. As a result of a five-year grant aimed toward improving first-year retention, the first-year …

Work Integrated Learning In Stem In Australian Universities: Final Report: Submitted To The Office Of The Chief Scientist, Daniel Edwards, Kate Perkins, Jacob Pearce, Jennifer Hong

Higher education research

The Australian Council for Educational Research (ACER) undertook this study for the Office of the Chief Scientist (OCS). It explores the practice and application of Work Integrated Learning (WIL) in STEM, with a particular focus on natural and physical sciences, information technology, and agriculture departments in Australian universities. The project involved a detailed ‘stocktake’ of WIL in practice in these disciplines, with collection of information by interview, survey instruments, consultation with stakeholders and literature reviews. Every university in Australia was visited as part of this project, with interviews and consultation sessions gathering insight from more than 120 academics and support …

Analysis Of English Language Learner Performance On The Biology Massachusetts Comprehensive Assessment System: The Impact Of English Proficiency, First Language Characteristics, And Late-Entry Ell Status, Mary A. Mitchell

Graduate Doctoral Dissertations

This study analyzed English language learner (ELL) performance on the June 2012 Biology MCAS, namely on item attributes of domain, cognitive skill, and linguistic complexity. It examined the impact of English proficiency, Latinate first language, first language orthography, and late-entry ELL status. The results indicated that English proficiency was a strong predictor of performance and that ELLs at higher levels of English proficiency overwhelmingly passed. The results further indicated that English proficiency introduced a construct-irrelevant variance on the Biology MCAS and raised validity issues for using this assessment at lower levels of English proficiency. This study also found that ELLs …

From The Co-Editors, Todd Pagano

Journal of Science Education for Students with Disabilities

We continue to work diligently to improve JSESD. One of the largest challenges to the journal remains the solicitation of manuscript submissions. As such, we are asking the journal’s readership to assist us in advertising the journal. If you are familiar with individuals who might be interested in submitting a manuscript, please pass along the JSESD author link provided above. We are especially interested in articles on science education for students with varying types of disabilities and at a full range of grade levels (K-12 and postsecondary).

A Historical Perspective On The Revolution Of Science Education For Students Who Are Blind Or Visually Impaired In The United States, Cary A. Supalo Dr.

Journal of Science Education for Students with Disabilities

The following was an invited presentation given by Dr. Cary A. Supalo to the National Federation of the Blind of Illinois annual state convention that was held in Chicago, Illinois on Saturday, October 28, 2011. These remarks were slightly modified for the Journal of Science Education for Students with Disabilities.

Cary A. Supalo

What does the term Revolution mean? To some it can simply mean change. To others, it can mean drastic change, and still to others, revolution is no more than a descriptor for something else. In this context, I believe revolution refers to a time of significant change.1 …

Assessing Impact Of Exposure To Cyberphysical Systems On Student Interest In Information Technology Careers, Mayari I. Serrano Anazco

Purdue Polytechnic Masters Theses

The main purpose of this project is to determine if the use of Information Technology (IT) tools, specifically cyberphysical devices, in outreach sessions will promote interest of young individuals in pursuing IT careers. The Diversity office of Purdue’s College of Technology offers a number of outreach sessions to a variety of target populations throughout the year. Each department in the college has an opportunity to present a session related to a field of study offered by the department. The research was carried out thru the Spring 2015 semester during the DOiT and Vision outreach programs offered through the college’s Diversity …

Differentiation In The Classroom Using Chromebooks And Google Applications, Allison Carney

Honors Projects

The purpose of this research was to differentiate using Chromebook and Google technology to improve engagement and grades in the classroom. Chromebooks have been implemented into classrooms all over the country, but the use of Google applications in order to differentiate instruction and assessment is not as prominent in schools. I created four assignments on the Chromebooks that differentiated instruction and assessment based on interest and ability levels. I used a total of six applications and differentiated for forty-four students in a sixth grade math and science classroom. I found that differentiating using Chromebooks and Google applications boosted student engagement, …

Student Transition At A Residential Stem School, Olivia Kaitlin Gatten

Masters Theses & Specialist Projects

The goal of this qualitative study was to gain insight into which personal factors most affect student adjustment in a state residential STEM school. Factors from Tinto’s Model of Institutional Departure were used as the framework to capture the transition of gifted high school students from traditional high school to The Carol Martin Gatton Academy of Mathematics and Science in Kentucky, a statewide residential STEM school. Tinto’s Model predicts college persistence using pre-existing individual characteristics and institutional experiences. These qualities and experiences were used to form questions about student traits and transition. Questionnaires were administered to Gatton Academy first-year students, …

The Learning Landscape: An Assessment Of State Science Standards And Application In A Uri Outreach Center Youth Education Program, Sarah A. Robinson

Senior Honors Projects

Rhode Island state education standards provide educators with curriculum guidance and achievement goals for each grade level. In this case study, I examined the RI state standards and expectations for science education. I undertook this investigation in support of the URI Outreach Center and their elementary education program, Learning Landscape Field Trips. Learning Landscape provides Rhode Island teachers with an opportunity to meet state science standards through the medium of hands-on environmental education programs. Through my investigation, I became fluent in the Learning Landscape curriculum, teaching in more than 20 two-hour sessions. As well, I became familiar with the current …

Green Chemistry As A Tool For Understanding The Toxic Substances Control Act: A Lecture Module For Undergraduate Students, Molly R. Blessing

Honors Scholar Theses

The Toxic Substances Control Act (TSCA) is the central form of chemical regulation existent in the United States today, yet scientists are often unaware or uncertain of its provisions. Violations of TSCA by unknowing chemists set industry and government unnecessarily at odds. A lecture on TSCA was developed for undergraduate students that uses the concept of green chemistry to promote interest and incentivize learning. Green chemistry methods are cleaner and less wasteful than traditional chemical ones, and many companies using them are at the forefront of technological innovation. The lecture explains both green chemistry and TSCA, includes company case studies, …

Students’ Perceptions About High School Preparation For Mathematics In Post-Secondary Programs: A Case Study Of One High School, Wendy Pratt

All Theses And Dissertations

This qualitative case study examined how fifteen former high school students from a small, rural high school in central Vermont perceived their preparedness for college level mathematics and identified recommendations for improvement. Student interviews and math assessment data for each participant were analyzed to respond to the research question. The interview protocol consisted of one-on-one semi-structured phone interviews that were recorded for transcription. Thirteen open-ended questions were developed to answer the research question and sub-questions grounded in the research literature and specific concerns identified by the math teachers defined in the case study. The conceptual framework for this research study …

The Influences Of Mathematics Self-Efficacy, Identity, Interest, And Parental Involvement On Stem Achievement In Algebra For Female High School Students, Nicol R. Howard

Educational Studies Dissertations

The purpose of this study was to determine the predictability of STEM achievement in Algebra for female high school students utilizing mathematics self-efficacy, mathematics interest, mathematics identity, and parental involvement. This study employed data from the High School Longitudinal Study of 2009 (HSLS:09/12) which consisted of 3,938 female eleventh-grade participants randomly selected from 944 public and private high schools during the fall 2009 academic year. The results of a hierarchical multiple regression indicated that mathematics identity was the strongest predictor of STEM achievement for female high school students, regardless of race. In spite of this significant relationship, STEM achievement outcomes …

Restructuring High School Science Curriculum: A Program Evaluation, Cathy Robertson

Walden Dissertations and Doctoral Studies

One rural Midwestern high school discovered a discrepancy among school, state, and national science skill attainment, verified by ACT scores. If students do not acquire vital science skills, they may not perform proficiently on science tests, thus impacting future college options. Inquiry based instruction and constructivism provided the basis for the theoretical framework. This study questioned associations between ACT scores, inquiry science technique usage, and ACT standard usage (Phase 1), and teachers' views on science instruction (Phase 2). This sequential explanatory mixed methods program evaluation included 469 ACT scores, surveys sent to 9 science teachers, and 8 interviews. Phase 1 …