Educational Assessment, Evaluation, and Research Commons^™

The Impact Of Oer’S Continuous Improvement Cycles On Students’ Performance: A Longitudinal Analysis Of The Rise Framework, Daniela Castellanos-Reyes, Sandra L. Carmago Salamanca, David Wiley

Entrepreneurship Faculty Research

Open educational resources (OER) have been praised for revolutionizing education. However, practitioners and instructors battle keeping OER updated and measuring their impact on students’ performance. Few studies have analyzed the improvement of OER over time in relation to achievement. This longitudinal study uses learning analytics through the open-source Resource Inspection, Selection, and Enhancement (RISE) analysis framework to assess the impact of continuous improvement cycles on students’ outcomes. Panel data (i.e., performance and use) from 190 learning objectives of OER of an introductory sociology course were analyzed using a hierarchical linear model. Results show that more visits to an OER do …

An Exploration Of Teacher Perception And Practices Of Using Assessment Data To Improve Achievement Of Equity Student Groups, Laurie Mazelin

Theses, Dissertations and Capstones

While utilizing assessment data has been a pervasive practice in educational reform for decades, and teachers are expected to use assessment data to improve instruction, little is known about how the practice of requiring teachers to review test data affects their perception of effectiveness in addressing the learning gaps of student groups. This qualitative phenomenological research study used open-ended, semi-structured interviews to help better understand how the expectations of teachers analyzing and integrating assessment data translates into teacher instructional practice and self-efficacy. This study aimed to explore the shared experience of teachers required to participate in collaborative planning centered on …

The 5cs Of Openness: Articulating An Open Education Infrastructure (Oer), Richard E. West, David Wiley

Entrepreneurship Faculty Research

Open education needs to evolve to fully realize its potential. Emerging innovations such as generative artificial intelligence (GenAI) and open credentials provide exciting opportunities for this growth. In this chapter, we briefly define the key characteristics of open education, describing its history, current opportunities for open education through generative AI, and then articulate an overarching 5Cs framework for open education that can guide research and practice into the future.

Are Open Educational Resources (Oer) And Practices (Oep) Effective In Improving Learning Achievement? A Meta-Analysis And Research Synthesis, Ahmed Tlili, Juan Garzón, Soheil Salha, Ronghuai Huang, Lin Xu, Daniel Burgos, Mouna Denden, Robert Farrow, Aras Bozkurt, Tel Amiel, Rory Mcgreal, Aída López‑Serrano, David Wiley

Entrepreneurship Faculty Research

While several studies have investigated the various effects of open educational resources (OER) and open educational practices (OEP), few have focused on its connection to learning achievement. The related scientific literature is divided about the effects of OER and OEP with regards to their contribution to learning achievement. To address this tension, a meta-analysis and research synthesis of 25 studies (N = 119,840 participants) was conducted to quantitatively investigate the effects of OER and OEP on students’ learning achievement. The analysis included course subject, level of education, intervention duration, sample size, geographical distribution, and research design as moderating variables …

The Purpose Of And Factors In Interim Assessments In Grades 3-8, Joseph J. Mastracci

Theses, Dissertations and Capstones

This study specifically sought to examine district test coordinators' perspectives on the purpose(s) of interim assessments within a district's assessment agenda and to identify factors the district test coordinators consider when selecting district-required interim assessments. Interim assessments are part of many local school districts' strategies to monitor and measure student academic performance before the end-of-year summative assessment. The research method for this case study incorporated a non-experimental, descriptive, mixed-methods design to identify the degree to which West Virginia's school district test coordinators perceive interim assessments to function as effective instructional, evaluative, and/or predictive tools. The study additionally investigated potential factors …

Sometimes Finding Nothing Is Something: Case In Point-- Shrinking The Gap Between Emerging Bilingual Learners And English Fluent Students, Michael W. Corrigan, Douglas Grove, Sage Andersen, Josepih T. Wong, Bradley S. Hughes

Elementary & Secondary Education Faculty Research

For United States of America (USA) and other developed countries, science achievement gaps begin to emerge in elementary and primary school. Such gaps between USA student groups typically are connected to socio-economic status (SES) and issues such as students still learning the English language. Through an experimental design, this National Science Foundation funded study explores how integrating the arts into science, technology, engineering, and mathematics (STEM) curriculum and leading with a more STEAM first approach (e.g., curriculum which integrates science, technology, engineering, arts, and mathematics) might provide more equitable science learning opportunities for elementary or primary grade level students. More …

Teacher Use And Perceptions Of Writing Practices In West Virginia: Policy And Leadership Implications, Margaret Luma

Theses, Dissertations and Capstones

National standardized test scores indicate West Virginia students perform below the national average in writing achievement, yet little research has been conducted to investigate how writing is being taught. Gaining understanding of the instructional strategies West Virginia teachers use to teach writing may provide insight for educational leaders about how to better support and prepare teachers for the complex task of teaching writing. Identifying challenges and barriers to implementing evidence-based practices may provide areas of focus for school and policy improvements as they relate to writing expectations. This study investigated the practices and perceptions of fourth-grade teachers in West Virginia …

A Qualitative Examination Of Pre-Service Teachers’ Perceptions Of Self-Efficacy For Teaching Writing, Abby Rose Waldorf

Theses, Dissertations and Capstones

The purpose of this research was to determine self-efficacy levels of Secondary English Education pre-service teachers attending two public universities concerning writing and the teaching of writing. The study found that pre-service teachers were confident and identified as writers, but they felt uncertain as teachers of writing. Past teachers’ praise was found to positively increase writing self-efficacy. Even though pre-service teachers enjoyed and looked forward to teaching writing, they felt they needed more time in the classroom and preparation from college courses. College courses were found to be lacking in the preparation needed for teaching writing. Pre-service teachers did not …

An Examination Of Teacher Perceptions Of The Effectiveness Of Online, On-Demand Professional Development For West Virginia Educators, Anna Shreve

Theses, Dissertations and Capstones

This research investigated West Virginia teachers’ perceptions of online, on-demand professional development. The researcher used a mixed-methods, nonexperimental study that utilized a 16-item survey and a six-item follow-up survey to examine teacher perceptions. A convenience sample was used and was comprised of participants of the West Virginia Behavior/Mental Health Technical Assistance Center at Marshall University’s 2021 online, on-demand professional development, Keynotes for Key People. The purpose of the study was to determine if effectiveness characteristics of in-person professional development could be embodied by online, on-demand professional development. The premise of the study was that if the effectiveness characteristics of in-person …

The Effects Of Stem And Non-Stem Mathematics Corequisite Courses On Student Success At Public Institutions In West Virginia, Vanessa S. Keadle

Theses, Dissertations and Capstones

This study explored the differences in student success outcomes between students enrolled in non-STEM and STEM corequisite mathematics courses at 18 postsecondary institutions across five academic years in West Virginia, using de-identified student data. The researcher analyzed this extant data to determine if student characteristics were predictors of success, as defined as passing the mathematics corequisite course, retention to the next semester, and earning a GPA of 2.0 or higher. The researcher also conducted analyses to understand if the differences in those outcomes between STEM and non-STEM courses were significant. This study identified statistically significant gaps in success for students …

Perceptions Of Directors Of Dietetic Internships Concerning Challenges To Meet Accreditation Council For Education In Nutrition And Dietetics Core Competencies, Timothy David Bender

Theses, Dissertations and Capstones

Competency-based education is used in several healthcare profession educational programs. Competency-based education has been at the forefront of dietetics education for several years and continues to this day. It is used in the undergraduate programs as well as in dietetic internships. The mastery of these competencies reflects the skillset a student or intern has achieved to be ready to advance to the next level. For an undergraduate student, mastery of all undergraduate competencies would indicate the ability to graduate the program and be eligible to apply to a dietetic internship. For a dietetic intern, mastery of all competencies would indicate …

Advisor Perceptions Of Technology In Academic Advising Practices In West Virginia Educator Preparation Programs, Kandice Kaye Rowe

Theses, Dissertations and Capstones

The purpose of this research was to gain, from the academic advisor’s perspective, an understanding of what technologies are being used in advising practices, the effectiveness of these technologies, and advisors’ perceptions of quality advising set forth by the Council for the Advancement of Standards in Higher Education. A qualitative phenomenological approach was utilized to connect academic advisors’ perceptions of the usage of technology while participating in the advising experiences. Through a combination of purposeful and snowballing sampling techniques, academic advisors from fourteen educator preparation programs in West Virginia were chosen to participate in this study. One-on-one, semi-structured interviews were …

Student Perspectives On The Presence And Usefulness Of Navigational Course Elements In Distance Education Courses, Christopher Joseph Sochor

Theses, Dissertations and Capstones

The Quality Matters Standards for Course Design (2018) rubric is a course development rubric for online courses in higher education. General Standard 1 provides a list of specific review standards that are integral in the development of courses, including course expectations, course structure, learning guidance, communication expectations, technology skill requirements, criteria for student assessment, and overall course organization. Student feedback is necessary in order to determine whether students view elements of the course overview and introduction as present in their courses, and whether those elements are useful for the successful completion of their online course. This research utilized a mixed-methods …

Technology In Social Work Field Education According To The Standards: A Field Instructor Perspective On The Benefits, Challenges, And Implications For Student Learning, Alysha Nicole Nichols

Theses, Dissertations and Capstones

This study utilized a qualitative phenomenological approach to gather the insight and perceptions of social work field instructors about the role and effect of technology on the student field practicum experience. Through convenience and purposeful sampling techniques, social work field instructors from the seven accredited social work programs in West Virginia were chosen to participate in this study. Semi-structured interviews were conducted with 22 field instructors to gather their perspective on the integration of technology into the supervision of field students. Thematic analysis was utilized to organize and interpret the information gathered from these interviews. It was found that technologies …

The Interaction Of Open Educational Resources (Oer) Use And Course Difficulty On Student Course Grades In A Community College, Lane Fischer, John Hilton Iii, Virginia Clinton-Lisell, Yao Xiong, David Wiley, Linda Williams

Entrepreneurship Faculty Research

Students report that not being able to afford course materials has adverse academic consequences. It is possible that this would be more problematic in relatively more difficult courses. Open Educational Resources (OER) are teaching and learning materials that are openly licensed and often available at low or no cost to students. This study examined the interaction between OER use through a campus zero textbook cost (ZTC) initiative and course difficulty on student course grades from 35 different courses at a community college while controlling for student gender, previous grade point average, and Pell grant eligibility status. Although the main effect …

Continuous Improvement Of Instructional Materials, David Wiley, Ross Strader, Robert Bodily

Entrepreneurship Faculty Research

From time-to-time new technologies provide us with a qualitatively different ability to engage in previously possible activities. For example, 20 years ago it was already possible to publish an essay online. You simply used the command line program Telnet to login to a remote server, navigated into the directory from which your webserver made html files available to the public, launched the pico editor from the command line, wrote your essay, and manually added all the necessary html tags. Today, open-source blogging software like WordPress makes publishing an essay online as easy as using a word processor. Yes, it was …

Why American Parents Choose Homeschooling, Kimberly Mcfall

Elementary & Secondary Education Faculty Research

This study explored factors that impact parents’ decisions to homeschool their children and examined the relationship between selected demographic factors and families that homeschool using an online survey snowball sample. Past research has focused on four main constructs: religious reasons, school safety, academic instruction, and a child’s special needs. This study elaborated on these four constructs and expanded to include other reasons parents might homeschool such as a need for family time, family travel, distance to school, financial reasons, or wanting to take a nontraditional approach to student learning. Findings suggest that academic instruction, family time and the desire to …

Identifying Student Perceptions Of Different Instantiations Of Open Pedagogy, John Hilton, Bryson Hilton, Tarah K. Ikahihifo, Reta Chaffee, Jennifer Darrow, Joann Guilmett, David Wiley

Entrepreneurship Faculty Research

As the adoption of open educational resources (OER) continues to increase, instructors have started using these resources for more than simply delivering content. Open pedagogy is a term used to describe a range of instructional practices that often incorporate OER into the learning process. This study examined student perceptions of two approaches to open pedagogy—student creation of multiple-choice questions and student creation of the syllabus and corresponding course assignments. The sample included responses from 84 students at two colleges in the United States. Results showed that students who created the syllabus and assignments had a more positive experience and were …

Academic Librarians Examination Of University Students’ And Faculty’S Perceptions Of Open Educational Resources, Lane Fischer, Olga Belikov, Tarah K. Ikahihifo, John Hilton, David Wiley, M. Troy Martin

Entrepreneurship Faculty Research

A survey of 2,574 students and 1,157 faculty members across ten institutions of postsecondary education in the state of Utah was conducted by the Utah Academic Libraries Consortium. Survey items were created to understand the influence of textbook costs on student academic behavior and the viability of faculty adopting open educational resources (OER) as a solution to the cost of textbooks and the possible need for librarian support of OER. Two-year and four-year institutions were compared to identify differences that might exist between them. Most students felt that their academic success was negatively impacted by textbook cost, particularly at two-year …

Substituting Open Educational Resources For Commercial Curriculum Materials: Effects On Student Mathematics Achievement In Elementary Schools, John Hilton Iii, Ross Larsen, David Wiley, Lane Fischer

Entrepreneurship Faculty Research

Open Educational Resources (OER) have the potential to replace commercial learning materials in education. An empirical examination of this potential was conducted, comparing the end-of-year mathematics test results of 12,110 elementary school students clustered within 95 schools from five school districts in the state of Washington in the United States of America. Of this group, 6796 students used open learning materials, and 5314 used commercial educational resources. When three years of test scores were considered, there were no statistically significant differences in the exam scores of students who used open versus commercial curriculum materials. The lack of statistical significance may …

Defining Oer-Enabled Pedagogy, David Wiley, John Hilton Iii

Entrepreneurship Faculty Research

The term “open pedagogy” has been used in a variety of different ways over the past several decades. In recent years, its use has also become associated with Open Educational Resources (OER). The wide range of competing definitions of open pedagogy, together with its semantic overlap with another underspecified term, open educational practices, makes it difficult to conduct research on the topic of open pedagogy. In making this claim we do not mean to cast doubt on the potential effectiveness of the many pedagogical approaches labeled open. In this article, rather than attempting to argue for a canonical definition of …

Teacher And Administrator Perspectives On Formative Student Assessment In Career And Technical Education: For Career And Technical Teachers And Administrators, Ryan K. Haught

Theses, Dissertations and Capstones

The purpose of this study was to investigate career and technical education teachers’ level of knowledge and use of formative student assessment practices in the classrooms and laboratories of comprehensive high schools and technical education centers across West Virginia. In addition, this study examined factors identified by teachers as supports or barriers to implementation of formative student assessment. Finally, this study described administrator perspectives on teachers’ knowledge and use of formative student assessment practices and explore administrator perspectives on identified supports and barriers to their teachers’ implementation of formative student assessment practices.

A researcher-developed survey was used to collect data …

Impact Of Educator Preparation Routes And Teacher Characteristics On Student Academic Achievement, Robert Hagerman

Theses, Dissertations and Capstones

This study investigated the effect of traditional and alternative teacher preparation, years of service, and type of licensure held and teacher quality on English language arts and mathematics summative assessment scaled scores and performance levels among West Virginia students in grades 5 and 11. Specifically, this research analyzed the existing assessment data in West Virginia’s 55 counties, regarding teacher preparation routes, teacher experience, teacher licensure, and the teacher’s Highly Qualified (HQ) designation to determine the effect on student achievement. The study was designed with the aforementioned variables and applied a standardized summative content assessment outcome to the two grade levels …

The Rise Framework: Using Learning Analytics To Automatically Identify Open Educational Resources For Continuous Improvement, Robert Bodily, Rob Nyland, David Wiley

Entrepreneurship Faculty Research

The RISE (Resource Inspection, Selection, and Enhancement) Framework is a framework supporting the continuous improvement of open educational resources (OER). The framework is an automated process that identifies learning resources that should be evaluated and either eliminated or improved. This is particularly useful in OER contexts where the copyright permissions of resources allow for remixing, editing, and improving content. The RISE Framework presents a scatterplot with resource usage on the x-axis and grade on the assessments associated with that resource on the y-axis. This scatterplot is broken down into four different quadrants (the mean of each variable being the origin) …

Effectiveness Of Essentials For College Math As A High School Transitional Course, Jennifer S. Riggleman

Theses, Dissertations and Capstones

Statistics on the number of students who leave high school underprepared for postsecondary education, and have to take remedial coursework upon entrance to college vary, but, unfortunately, for at least the last 10 years, these statistics have remained high. This study examined the effectiveness of one transitional high school math curriculum called Essentials for College Math and its impact on 887 students in the state of North Carolina for the 2014-2015 academic year. The results of the study showed that there was a statistically significant improvement seen in pre- and post-test scores of students that completed the course. There was …

Analysis Of Student And Faculty Perceptions Of Textbook Costs In Higher Education, Michael Troy Martin, Olga Maria Belikov, John Hilton Iii, David Wiley, Lane Fischer

Entrepreneurship Faculty Research

The cost of textbooks has continued to impact students in higher education. Students have reported that they make decisions on which courses to take based on the specific cost of textbooks. Faculty have reported willingness to use open textbooks to help ease the burden on students but are unsure where to find viable options. We examined the responses of 676 students and 573 faculty from a large private university (Brigham Young University, Provo, Utah) to understand the real impact of textbooks costs to students and how they are dealing with this ongoing problem. We found that 66% of students at …

Maintaining Momentum Toward Graduation: Oer And The Course Throughput Rate, John Hilton Iii, Lane Fischer, David Wiley, Linda Williams

Entrepreneurship Faculty Research

Open Educational Resources (OER) have the potential to replace traditional textbooks in higher education. Previous studies indicate that use of OER results in high student and faculty satisfaction, lower costs, and similar or better educational outcomes. In this case study, we compared students using traditional textbooks with those using OER at Tidewater Community College to compare their performance on what we call course throughput rates, which is an aggregate of three variables – drop rates, withdrawal rates, and C or better rates. Two self-selecting cohorts were compared over four semesters, with statistically significant results. The study found that, subject to …

The Tidewater Z-Degree And The Intro Model For Sustaining Oer Adoption, David Wiley, Linda Williams, Daniel Demarte, John Hilton

Entrepreneurship Faculty Research

A growing body of research confirms the financial and academic benefits that accrue to students whose faculty adopt open educational resources, or OER. While there are no content licensing costs associated with using OER, there are several real costs that must be incurred by an institution that chooses to support its faculty in adopting OER. The Z-Degree initiative at Tidewater Community College utilizes only OER for the 21 courses, providing a pathway for students to earn an associate of science degree in business administration without ever buying a textbook. The authors introduce and illustrate the INTRO (Increased Tuition Revenue through …

Principal Perceptions Of Standards-Based Teacher Evaluation In West Virginia, Brent Douglas Griffith

Theses, Dissertations and Capstones

Standards-based teacher evaluations have become the norm in many states due to an increased focus on student achievement and teacher effectiveness. These evaluations have become integral to the improvement of classroom instruction efforts and the planning of specific professional development for teachers. West Virginia deployed a new standards-based teacher evaluation system in 2014, using the West Virginia Professional Teaching Standards as a basis for measuring teacher performance and growth in certain areas. The new evaluation system also included teacher self-reflection and goal-setting portions. The purpose of this study was to assess the perceptions of school principals as to the effectiveness …

A Study Of Outcomes Based Educational Interventions And Moral Development Of Undergraduate College Students, Jay Christopher Robert Wildt

Theses, Dissertations and Capstones

Discussions regarding moral development and subsequent behavior are common in political and philosophical arenas. The consensus is that resolutions of moral dilemmas are best accomplished through careful deliberation and the use of principled moral reasoning. The purpose of this study was to examine changes in moral development in undergraduate college students who participated in an outcomes based education program. The study also investigated the influence of certain demographic and attribute variables on moral development within the same population.

This study examined extant data from 295 University of Charleston (UC) students who took the Defining Issues Test as freshmen and then …