Educational Assessment, Evaluation, and Research Commons^™

The Educational Emphases Of Science Teachers In Us Evangelical Protestant High Schools, Albert Cheng

Education Reform Faculty and Graduate Students Publications

I examine the educational emphases of science teachers in Evangelical Protestant (EP) schools, including (1) teaching basic content knowledge, (2) improving scientific reasoning skills, and (3) presenting real-world applications of science. Using a nationally representative sample of US ninth-graders, I find differences in these educational emphases between science teachers in EP schools and science teachers in secular private, Catholic, and public schools. I also find suggestive evidence that differences in STEM-related student outcomes across school sectors, which have been demonstrated in prior research, are associated with cross-sector differences in the emphases of science teachers.

Multiple True–False Questions Reveal The Limits Of The Multiple-Choice Format For Detecting Students With Incomplete Understandings, Brian A. Couch, Joanna K. Hubbard, Chad E. Brassil

School of Biological Sciences: Faculty Publications

By having students select one answer among several plausible options, multiple-choice (MC) questions capture a student’s preferred answer but provide little information regarding a student’s thinking on the remaining options. We conducted a crossover design experiment in which similar groups of introductory biology students were assigned verbatim questions in the MC format or multiple true–false (MTF) format, which requires students to separately evaluate each option as either true or false. Our data reveal that nearly half of the students who select the correct MC answer likely hold incorrect understandings of the other options and that the selection rates for individual …

Comparing The Process Oriented Guided Inquiry Learning (Pogil) Method To An Independently Developed Guided Inquiry Method (Indgim) In A High School Academic Chemistry Course., Scott Zgraggen

Graduate Theses & Dissertations

A nonequivalent, control group, pretest-posttest design was used to investigate student achievement in secondary chemistry. This study investigated the effects of process oriented guided inquiry learning (POGIL) pedagogy in high school chemistry classes compared to that of an independently designed guided inquiry method (InDGIM). Data were collected from chemistry students from four college-prep chemistry classes in the same high school, over the course of the academic year, using the Particulate Nature of Matter (ParNoMA2) test, the Group Assessment of Logical Thinking (GALT), unit tests, and the final exam. DataAll data waswere analyzed using a 2 x 2 Factorial Analysis of …

Formal Learning In An Informal Setting: The Cognitive And Affective Impacts Of Visiting A Science Center During A School Field Trip, Charlie Belin

Graduate Theses and Dissertations

With the pressures of budget cuts, many schools--particularly schools serving low-income students--are eliminating school field trips to museums, zoos, and other cultural institutions despite their widely reported utility. First, through a systematic review of the literature, I examine the findings from 17 international studies on the benefits of visiting an informal science education institution during a K-12 school field trip. Almost all pre-post studies reported a positive change in both cognitive and affective outcomes after visiting an ISEI. However, studies that also included a control group to compare students who visited the ISEI with students who had yet to visit …

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Policy Insights

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Program monitoring and evaluation

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …

Success Rates Of Second Semester Anatomy Students In Online And On-Ground Classes At A Community College In East Tennessee, William Sproat

Electronic Theses and Dissertations

Educators expect the number of institutions offering online courses and the number of students enrolling in these courses to increase as many students, particularly nontraditional students, discover the advantages of online content delivery. Online courses require new methods of communication between students and faculty as well as discovering new ways to build relationships, earn student trust, conduct appropriate assessment, and deliver useful course content. Many institutions—public, private, and for-profit—offer a wide variety of online coursework but faculty, employers, and the public have expressed concerns about the quality of online course content. In particular, online delivery of coursework in the natural …

The Impact Of Computer-Based Programs On Middle School Math Achievement, Kenyatta Gilmore

Doctoral Dissertations and Projects

The purpose of this correlation research study was to investigate the impact of computer-based learning on middle school math achievement of at-risk students. The participants for this study were drawn from a convenience sample of 83 middle school students located in southeastern Georgia. At-risk middle school students were achieving below their grade equivalent and failing to meet local and state proficiency standards. Computer-based instruction was implemented as an intervention to increase student achievement in mathematics. The study used a pretest-posttest control group design and used SPSS software to conduct the statistical analyses using an ANCOVA and t-test. The results indicated …

Unpacking Teacher Practice Through A Moves-Based Formative Assessment Framework Using Video-Based Cycles Of Inquiry, Brent Duckor, Carrie Holmberg

Faculty Publications

Research has shown for over a decade that teachers who engage in formative assessment (FA) practices may have the most powerful impact on student learning (Black & Wiliam, 1998; Hattie, 2012). Yet less is known about the development of teachers’ knowledge and use of formative assessment as they plan, enact, and reflect on their questioning practices. Our qualitative case study focuses on how in-service middle school math teachers take up three specific moves (Author A, 2014) associated with formative assessment practice as as part of a video-based cycle of inquiry project. The study found focusing participants’ planning and reflection through …

Updated Guidelines, Updated Curriculum: The Gaise College Report And Introductory Statistics For The Modern Student, Beverly Wood, Megan Mocko, Michelle Everson, Nicholas J. Horton, Paul Velleman

Publications

Since the 2005 American Statistical Association's (ASA) endorsement of the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report, changes in the statistics field and statistics education have had a major impact on the teaching and learning of statistics. We now live in a world where "Statistics - the science of learning from data - is the fastest-growing science, technology, engineering, and math (STEM) undergraduate degree in the United States," according to the ASA, and where many jobs demand an understanding of how to explore and make sense of data. In light of these new reports and other …

Development Of Reporting Scales For Reading And Mathematics: A Report Describing The Process For Building The Uis Reporting Scales, Ross Turner, Ray Adams, Ursula Schwantner, Dan Cloney, Claire Scoular, Prue Anderson, Alexander Daraganov, Jen Jackson, Sandra Knowles, Gayl O'Connor, Pam Munro-Smith, Stavroula Zoumboulis, Pauline Rogers

Monitoring Learning

As a technical partner of the UNESCO Institute for Statistics, ACER-GEM has created reporting scales for reading and maths, with the intention of enabling countries to examine and report the outcomes of their assessment activities using a common framework. This report gives the theoretical and contextual background to the scales, and describes the steps in the drafting process.

Advancing Professional Development Strategies For Chemistry And Biochemistry Undergraduates, Christian A. Brown

Senior Theses

In the Department of Chemistry and Biochemistry at the University of South Carolina (the Department), most curriculum-driven professional development is reserved for third- and fourth-year students. Classroom learning occurs at all levels, but the context comes late. Early exposure to career options and hands-on training is imperative for undergraduates to obtain maximum experiential learning. The purpose of this project is to advance the current professional development strategies of the Department, specifically targeting second- and third-year students. The study surveyed students' current involvement in professional development activities. The data on extracurricular experience and post-graduation interest was used to design a workshop …

The Effect Of Undergraduate Biology Research Experiences And Mentoring Structures On Student Self-Efficacy, Kyle Harris

Doctoral Dissertations and Projects

Collaborative inquiry within undergraduate research experiences (UREs) is an effective curriculum tool to support student growth. This study seeks to understand how collaborative inquiry within undergraduate biology student experiences are affected within faculty mentored experiences and non-mentored experiences at a large private southeastern university. Undergraduate biology students engaged in UREs (faculty as mentor and non-mentor experiences) were examined for statistically significant differences in student self-efficacy. Self-efficacy was measured in three subcomponents (thinking and working like a scientist, scientific self-efficacy, and scientific identity) from student responses obtained in an online survey. Responses were analyzed using a nonparametric equivalent of a t …

Anatomy Of Stem Teaching In North American Universities, Paul J. Wendel, Kathryn M. Plank, Anna M. Young

Faculty Articles

A large body of evidence demonstrates that strategies that promote student interactions and cognitively engage students with content (1) lead to gains in learning and attitudinal outcomes for students in science, technology, engineering, and mathematics (STEM) courses (1, 2). Many educational and governmental bodies have called for and supported adoption of these student-centered strategies throughout the undergraduate STEM curriculum. But to the extent that we have pictures of the STEM undergraduate instructional landscape, it has mostly been provided through self-report surveys of faculty members, within a particular STEM discipline [e.g., (3–6)]. …

Using Argument-Based Science Inquiry To Improve Science Achievement For Students With Disabilities In Inclusive Classrooms, Jonte C. Taylor, Ching-Mei Tseng, Angelique Murillo, William Therrien, Brian Hand

Journal of Science Education for Students with Disabilities

Students with disabilities have long lagged behind their non-disabled peers when it comes to science achievement. The increased emphasis on STEM related careers and the use of science in everyday life makes learning science content and concepts critical for all students especially for those with disabilities. As suggested by the National Resource Council (2012), more emphasis is being placed on being able to critically think about science concepts in and outside of the classroom. Additionally, the Next Generation Science Standards are asking teachers and students to better understand how science is connected to the everyday world through the use of …

From The Co-Editors..., Todd Pagano

Journal of Science Education for Students with Disabilities

No abstract provided.

Equal Outcomes 4 All: A Study Of Student Learning In Ecs, Steven Mcgee, Randi Mcgee-Tekula, Jennifer Duck, Catherine Mcgee, Lucia Dettori, Ronald I. Greenberg, Eric Snow, Daisy Rutstein, Dale Reed, Brenda Wilkerson, Don Yanek, Andrew M. Rasmussen, Dennis Brylow

Computer Science: Faculty Publications and Other Works

This study investigated patterns in the development of computational thinking practices in the context of the Exploring Computer Science (ECS) program, a high school introductory CS course and professional development program designed to foster deep engagement through equitable inquiry around CS concepts. Past research indicates that the personal relevance of the ECS experience influences students’ expectancy-value towards computer science. Expectancy-value is a construct that is predictive of career choices. We extended our research to examine whether expectancy-value influences the development of computational thinking practices. This study took place in the context of two ECS implementation projects across two states. Twenty …

Copyright Information

Journal of Science Education for Students with Disabilities

No abstract provided.

A Watershed Moment: Implementing State Environmental Literacy Policy Into A Central Virginia School District, Melinda J. Vandevelder

Theses and Dissertations

Abstract

A WATERSHED MOMENT: IMPLEMENTING STATE ENVIRONMENTAL LITERACY POLICY INTO A CENTRAL VIRGINIA SCHOOL DISTRICT

By Melinda J. VanDevelder, Ph.D.

A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at Virginia Commonwealth University.

Virginia Commonwealth University, 2018

Director: Charol Shakeshaft, Ph.D., Professor, Department of Educational Leadership

Policy goals may be impossible to achieve at the classroom level (Ravitch, 2014), as policy depends on those who implement it (Lipsky, 1980). The purpose of this research was to investigate how the voluntary environmental educational executive order, EO42, was implemented and executed in a Central Virginia …

Middle Grades Science In Florida: A Comparison Of Student Achievement In Comprehensive And Subject-Specific Science Courses 2013-2017, Kenneth Moore

Electronic Theses and Dissertations

As with U.S. student achievement on national and international science assessments, Florida's 8th grade student achievement on the 2013–2017 8th grade Florida Comprehensive Assessment Test (FCAT) 2.0 Science/Statewide Science Assessment (SSA) was stagnant. To break this stagnation, many Florida school districts have changed middle grades science course offerings from traditional, subject-specific, discipline-based, layered, or field-specific science courses to comprehensive, integrated, spiraled, interdisciplinary, multidisciplinary, thematic, or general science courses. There was a lack of research showing if either type of science course improved student achievement on standardized science assessments. Controlling for school district student population, low socio-economic status (SES) student percentage, …

A Study On Science Achievement And Motivation Using Computer-Based Simulations Compared To Traditional Hands-On Manipulation, Stacey L. Hannel, Joshua Cuevas

Georgia Educational Researcher

This study was conducted to investigate whether or not computer-based simulations had a greater impact on science achievement compared to traditional hands-on methods for middle school students in an on-level science course. The study also sought to determine if either method had an impact on retention as well as motivation. The participants in the study were 6^th grade students attending a public middle school in suburban metro-Atlanta. A variety of statistical analyses were utilized to measure science achievement, retention, and motivation. Results indicated that there was no significant difference on science achievement between the traditional hands-on method and the …

Measuring Presence: A Review Of Research Using The Community Of Inquiry Instrument, Ana E. Redstone, Jill E. Stefaniak, Tian Luo

Distance Learning Faculty & Staff Publications

This systematic review provides a summary of studies on teaching, social, and cognitive presences in the community of inquiry (CoI) model using the CoI instrument in a higher education setting since its development in 2008 by Arbaugh et al. A total of 24 peer-reviewed studies on the CoI instrument from 2008–2017 were selected and analyzed explore the types of research on the instrument in higher education settings have been published, ways the instrument has been used for learning and teaching, and the implications the instrument poses for online instructors and instructional designers. It is organized into 4 themes: testing the …

An Examination Of The Algebra 1 Achievement Of Black And Hispanic Student Participants In A Large Urban School District's Mathematics Intervention Program, Elethia Bronson

Electronic Theses and Dissertations

The mathematics achievement gap between Black and White as well as Hispanic and White students has been well documented nationwide and in the school district of study. Much has been written in observance of the achievement gap, yet markedly less research has focused on practices and interventions that have improved mathematics performance for Black and Hispanic students. Consequently, this study examined the Algebra 1 achievement (indicated by student scale scores on the Florida Standards Assessments Algebra 1 End-of-Course exam) of Black and Hispanic students participating in a mathematics intervention program as compared to the Algebra 1 achievement of their similar …

The Importance Of Automaticity Development In Mathematics, Austin T. Baker, Josh Cuevas

Georgia Educational Researcher

This study examined whether students were reaching automaticity with single digit multiplication facts. A fourteen question interview was used to collect data. The first three questions asked the student basic information about themselves and their current math teacher. The next seven questions were math facts. The math facts chosen for the interview were a range of difficulty, starting with a simple problem like 1 x 9 and increasing in difficulty to 6 x 9. The last four questions were open-ended with the intent of gaining insight into whether the students were using strategies to complete the problems or if they …

Science Theater As Steam: A Case Study Of "Save It Now", Christopher D. Davidson, Willard Simms

The Transdisciplinary STEAM+ Journal

What are the markers of a successful STEAM program? How and when can educators be reasonably sure that an interdisciplinary unit or project, rich in both the sciences and the arts, has delivered on its implicit promise – by adding value to a student’s education in ways that are beyond the scope of traditional discipline-specific learning? I attempt to address this question with a case study of Theatre of Will’s “Save It Now,” a pilot program for 4^th, 5^th and 6^th graders at eight Los Angeles public schools that integrates theater arts, music and the STEM …

A Correlational Study On Critical Thinking In Nursing As An Outcome Variable For Success, Rebecca Porter

Doctoral Dissertations and Projects

Critical thinking is a required curricular outcome for nursing education; however, the literature shows a gap related to valid and reliable tools to measure critical thinking specific to nursing and relating that critical thinking measurement to meaningful outcomes. This study examined critical thinking scores, as measured by Assessment Technologies Institute (ATI) Critical Thinking Exam (CTE), to determine if a statistically significant predictive association existed between critical thinking scores, successful Associate of Science in Nursing (ASN) program completion, and National Certification Licensure Examination for Registered Nurses (NCLEX-RN®) pass rates. The research was conducted in a semi-urban, hospital-based, ASN program and included …

The Influence Of Previous Subject Experience On Interactions During Peer Instruction In An Introductory Physics Course: A Mixed Methods Analysis, Judy A. Vondruska

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Over the past decade, peer instruction and the introduction of student response systems has provided a means of improving student engagement and achievement in large-lecture settings. While the nature of the student discourse occurring during peer instruction is less understood, existing studies have shown student ideas about the subject, extraneous cues, and confidence level appear to matter in the student-student discourse. Using a mixed methods research design, this study examined the influence of previous subject experience on peer instruction in an introductory, one-semester Survey of Physics course. Quantitative results indicated students in discussion pairs where both had previous subject experience …

How Do Former Undergraduate Mentors Evaluate Their Mentoring Experience 3-Years Post-Mentoring: A Phenomenological Study, Kari L. Nelson, Christine E. Cutucache

The Qualitative Report

This phenomenological study involves a unique, longitudinal assessment of the lived experiences of former undergraduate mentors (n=7) in light of their current experiences (i.e., career or advanced schooling). The objective of a phenomenological study is to engage in in-depth probing of a representative number of participants. Specifically, we followed up with graduates of the Nebraska STEM 4U (NE STEM 4U) intervention 3 years post-program, with the overall goal of describing the mentors’ experiences using the lens of their current experiences. This type of longitudinal perspective of mentoring is greatly lacking in the current literature. At the time of the interviews, …

The Language Of Learning In Family And Consumer Sciences: English Language Learners In Career Technical Education, Kali S. Lenhoff

Empowering Research for Educators

Family and Consumer Sciences (FCS) content and English as a Second Language (ESL) strategies can be organically incorporated to create a successful education for an English Language Learner (ELL). The first objective of this research project is to discover how prepared Family and Consumer Sciences teachers feel to work with English Language Learners in the classroom. The second objective is to identify practical and effective methods and strategies that are useful for Family and Consumer Sciences teachers instructing English Language Learners. The rationale for this project is that by identifying the challenges faced by English Language Learners in education, teachers …

Design And Assessment Of Deep And Active Learning In Science, Technology, Engineering, And Mathematics (Stem) Education, Juhong Christie Liu Ph.D., Elizabeth Johnson Ph.D., Jin Joy Mao Ph.D.

Libraries

This presentation draws academic significance from a focused literature review and initial data for learning design in Science, Technology, Engineering, and Mathematics (STEM) education. The presenters will discuss strategies of fostering deep, active learning, alignment with assessment, and development of assessment instruments and methods. The presenters will share the design and development of an assessment kit to measure learning outcomes that matter in the 21st century STEM education. Through shared evidence and interactive reflection, the audience will take away up-to-date design strategies for deep and active learning as well as assessment in STEM education. The project is sponsored by National …