Educational Assessment, Evaluation, and Research Commons^™

The Impact Of The Corona Pandemic On The Quality Of High School Exam Questions In Jordan أثر جائحة كورونا في جودة أسئلة امتحان الثانوية العامة في الأردن, Haidar Zaza

Association of Arab Universities Journal for Education and Psychology

The study aimed to identify the quality of the high school exam questions by measuring that the questions do not violate the rules of their writing. The number of questions that formed the study population was 4,915 distributed over 160 exams held during the coronavirus pandemic in 2020. The descriptive analytical approach was followed to analyze 1230 multiple-choice questions using the violation detection tool. The results showed that 434 (35.3%) questions violated at least one rule, and 736 (59.8%) questions violated two or more rules. In total, the analysis revealed that 1170 (95.1%) questions violated five rules out of 18 …

Self-Study Portfolio Jessica Hanig, Jessica Hanig

Master of Education in Teacher Leadership Portfolios

No abstract provided.

Effects Of Transition From Closed-Book To Open-Book Assessment On Students’ Scores In A Pharmacokinetics Course, Reza Mehvar, Richard Beuttler

Pharmacy Faculty Articles and Research

Closed-book summative assessment of student learning, common in pharmacy education, is challenging to administer in a remote setting due to the need for costly and intrusive monitoring technology. Therefore, open-book assessments without monitoring have been considered an alternative in remote settings. The present study investigated the effects of the transition from in-person closed-book to remote open-book format on the students’ scores in different assessment categories in a Pharmacokinetics course. The students’ performances in the transition cohort (Transition, n = 96) during the in-person and remote periods were compared with those of an in-person cohort (Control, n = 85) during the …

Implementing Social Emotional Activities Into The English Language Arts Curriculum, Allison M. Sherbel

Masters Theses

Over the last decade social emotional learning has revealed itself to be an important element in students' academic growth. Social emotional learning requires students to learn the skills necessary to effectively communicate with others as well as maintaining a positive classroom environment, where all students feel supported, safe and heard. When students become more connected to their own emotions, they are developing an essential skill that will help them inside and outside of the classroom. Research shows that implementation of social emotional lessons can improve both immediate and long-term social-emotional ability as well as academic growth. Despite this research, teachers …

How Teachers Conceptualise Shared Control With An Ai Co-Orchestration Tool: A Multiyear Teacher-Centred Design Process, Luettamae Lawrence, Vanessa Echeverria, Kexin Yang, Vincent Aleven, Nikol Rummel

Instructional Technology and Learning Sciences Faculty Publications

Artificial intelligence (AI) can enhance teachers' capabilities by sharing control over different parts of learning activities. This is especially true for complex learning activities, such as dynamic learning transitions where students move between individual and collaborative learning in un-planned ways, as the need arises. Yet, few initiatives have emerged considering how shared responsibility between teachers and AI can support learning and how teachers' voices might be included to inform design decisions. The goal of our article is twofold. First, we describe a secondary analysis of our co-design process comprising six design methods to understand how teachers conceptualise sharing control with …

Ensuring Quality In Qualitative Research: A Researcher's Reflections, Niroj Dahal

The Qualitative Report

This reflective paper is the outcome of my qualitative research engagement aligned with quality standards. I began with autoethnography in my master's research in mathematics education (see Dahal, 2013), then moved on to narrative inquiry in my MPhil research (see Dahal, 2017), and collaborative autoethnography in my doctoral research (see Dahal, 2023). With the above, this paper aims to clarify the quality criteria used in autoethnography, narrative inquiry, and collaborative autoethnography based on my experiences to evaluate the robustness of qualitative research from various ontological and epistemological vantage points. Likewise, this article offers a comprehensive overview of the key elements …

Building A World-Class Learning System: Insights From Some Top-Performing School Systems, Geoff N. Masters

School and system improvement

The result of a multi-year study, this book explores how five school systems - British Columbia, Estonia, Finland, Hong Kong and South Korea - have been rethinking and reforming their schools systems. It addresses questions including: What policies need to be in place for every child to experience an engaging and supportive learning environment that motivates not only high performance but a desire to keep learning? What do students really need to know and be able to do to thrive in a changing world? How can systems engage in ongoing improvement while also cultivating innovation? The book provides a framework …

Ctl Impact Report (Fy23), Center For Teaching & Learning

CTL Publications

The Sacred Heart University CTL was founded in 2022 as an integrated scaffold of teaching and learning support. Its founding brought together instructional development for SHU faculty with academic support services for SHU undergraduate and graduate students. In this report, we share our center’s reach and impact during FY23 (July 1, 2022 – June 30, 2023), marking the first full academic year in which the CTL has operated in its current model.

Nonparametric Analysis In Educational Test Development - A Mokken Scale Approach To Evaluating Efl Vocabulary Proficiency, Ali Jahanaray, Akram Faravani

Publications

Mokken Scale Analysis (MSA) can offer a more flexible approach to common Item Response Theories (IRT) as a non-parametric method for evaluating educational tests with ordinal data. This study applied MSA on a Vocabulary Levels Test (VLT) originally developed with IRT methods among 234 English as a Foreign Language (EFL) students to test the assumptions of MSA, including unidimensionality, monotonicity, local independence, and invariant item ordering (IIO) with mokken package in R. MSA assumptions successfully met with the VLT validated with validating the VLT being a unidimensional test with Automated Item Selection Procedures (AISP) and Genetic Algorithm (GA) methods utilized. …

Undergraduate Students’ Perception Of Leadership Development Programs And Leadership Self-Efficacy, Benjamin Phillips, Juliann Sergi Mcbrayer, Brandon Hunt, Antonio Gutierrez De Blume, Katherine Fallon

Leadership, Technology & Human Development: Faculty Publications

Colleges and universities across the United States face continual pressure to meet enrollment and retention goals, as budgets in this performance-based environment continue to become more important. On-campus student involvement, such as in undergraduate leadership development programs, has been shown to have a positive influence on both student retention and success. A survey was utilized to examine leadership self-efficacy and engagement of undergraduate students that participated in campus-based leadership development programs and explore some motivators (contributing factors) and barriers (detracting factors) to involvement in those programs. One emergent theme within contributing factors to participation was alignment with personal goals (74.7%), …

Report On Odu Findings From The Virginia Course Materials Survey Fall 2021, Karen Vaughan

Libraries Reports and Documents

From Introduction:

From October 1-December 31, 2021, the Virtual Library of Virginia (VIVA) conducted a survey of students at Virginia colleges and universities. More than 5,600 valid student responses from 41 institutions were received, reflecting an overall response rate of 10%. The largest response (58.5%) was from doctoral institutions, with private, two-year, and four-year institutions responding at 12-14%. A random sample of ODU students produced 287 responses (see Appendix A for ODU demographics). The survey aimed to answer these questions:

• What is the impact of course material costs on educational equity among Virginia students?
• What course content materials do students …

A Qualitative Inquiry Of Research Administrator Perceptions Of Job Satisfaction In A Central Research Administration Unit At The University Of Denver, Noelle L. Strom

Electronic Theses and Dissertations

The Sponsored Programs Administration (SPA) team provides critical research administration services for the research community at the University of Denver. As research funding continues to rise at the University of Denver, retention of research administrators is critically important. Job satisfaction is key to employee engagement and retention. Higher job satisfaction contributes to several positive outcomes for institutions, including lower turnover, higher productivity, lower costs, and employee loyalty. The need to retain experienced research administration professionals is highlighted by the fact that few formal educational routes exist that prepare employees for a career in research administration; rather, developing expertise takes a …

Professional Development For Teaching In The Digital Age: Addressing Teachers’ Digital Competency, Blanca Nery Ibarra

Theses and Dissertations

The purpose of this study was to identify teachers’ digital skills proficiency gaps in order to determine preparedness for teaching in the digital age. Using a survey research design helped identify teachers’ digital skills self-confidence, attitudes towards the use of technology in the classroom, and current uses of technology for instructional purposes. The participants in this research study consisted of 320 middle school teachers from a border school district in south Texas. The data was collected using a survey instrument consisting of the TPSA C-21 and researcher-developed items. The data was analyzed using the Spearman-rank order correlation to describe the …

Vamos A Pláticar: The Sense-Making Process Of Career Services Practitioners At California Community Colleges In A Guided Pathways Epoch, Claudia Estrada-Howell

Electronic Theses, Projects, and Dissertations

The California Community College system and its vision for success, which includes a focus on increasing students' degree and certificate completion, as well as increasing the percentage of existing Career and Technical Education students who report being employed in their field of study is highlighted. To help support these goals, the California Community College System has adopted the Guided Pathways framework. This framework requires all campuses to fundamentally redesign their programs and support services to ensure they are clear, more educationally coherent pathways to credentials that in turn prepare students for success in the workforce and further education. To do …

School-Wide Academic Outcomes And Instructional Modality Used During The 2018-2022 School Years, Matthew Bowser

Electronic Theses and Dissertations

The purpose of this quantitative study was to determine if there was a significant relationship between school-wide academic outcomes and the instructional modalities utilized by public schools during the 2019-2022 school years. This study also determined if there was a significant difference in assessment scores earned by public school students in Tennessee before and after the shift from in-person schooling caused by the COVID-19 Pandemic. The researcher used a chi-squared test for independence to determine if there was a significant relationship between the modality of instruction used within a school during the 2020-2021 and 2021-2022 school years and the school-wide …

School Accountability Within The Dominican Republic: A Qualitative Study Of School Principals’ Beliefs And Knowledge, Massiel Cohen Camacho

Dissertations

The school accountability system in the Dominican Republic (DR) involves the use of several national assessments, the reporting of such data, and the training of principals on how to use such data as part of school improvement efforts. While this type of indicator accountability system does not include specific consequences, there is still significant measuring and reporting of student achievement data, with the implied connotation of teacher and principal responsibility for specific school outcomes. The problem addressed in this study was the lack of research on what school principals know about such school accountability in the DR, and how they …

Investigation Of Chinese Students’ Writing Perceptions At An English Young Writers Camp, Jingshu Chen

Graduate Theses and Dissertations

This study explores how a young writers camp that catered to 40 Chinese English as a Foreign Language (EFL) learners, ranging from students entering the fourth grade to seventh grade, mediated the students’ writing perceptions. More specifically, the main objective of this research was to investigate the impact of the camp on the students' perceptions of writing and their self-identification as writers. The study employed the theoretical framework of Cultural Historical Activity Theory to guide the analysis. Various types of data were collected from the 40 participating students, including pre- and post-camp survey questions, classroom observations, and open-ended interviews. By …

Ai For Connectivism Learning: Undergraduate Students’ Experiences Of Chatgpt In Advanced Programming Courses, Swapna Gottipati, Kyong Jin Shim, Venky Shankararaman

Research Collection School Of Computing and Information Systems

Advanced programming skills are required for computing courses on merging topics, and students often struggle to develop these skills to solve complex problems. To address this challenge, faculty members provide additional lectures, practice sessions, and educational technology tools. This paper discusses the challenges faced by computer science students in developing advanced programming skills and explores the use of AI chatbots, specifically ChatGPT, as a support tool for learning. We study the engagement and effectiveness of ChatGPT in helping students learn advanced programming skills using two engagement learning frameworks (CIE and MELT) for evaluation. The study involves designing a computing lab …

Exploring The Experiences Of Underrepresented Students Pursuing Health-Related Graduate Or Professional Programs, Alison Williams

Electronic Theses and Dissertations

For many years graduate and professional education programs for the health professions have sought to increase the diversity of their student body to include students from a wider variety of backgrounds. Increasing the diversity of healthcare providers is an essential component of addressing inequities in healthcare. However, despite initiatives to increase racial and ethnic diversity in the health professions, these professions remain largely White and female. Previous researchers have sought to identify the reasons that racial and ethnic minorities are underrepresented in healthcare, and the barriers to persistence and success. Little research exists explaining why men are underrepresented in the …

When Data Matter: Evaluating Data Prioritization For Department-Level Decision-Making In Higher Education, Cindy Cragg

Electronic Theses and Dissertations

The purpose of this program evaluation was to better understand the department-level leadership’s decision-making process and, within that process, when data are used to inform decisions related to the school’s mission to deliver an exceptional student experience. The evaluation took place at a school of professional and continuing education at a private institution in the Mountain West region. This evaluation’s central focus was to learn what the assumptions were that informed how the leadership prioritized data related to the student experience in their decision-making process. Secondarily, the evaluation explored what organizational conditions would be necessary for unused student-generated qualitative data …

Teaching Them To Fish: Using A Districtwide System Of Supports To Improve College And Career Readiness In A Rural School District, Lavonia Johnson-Davis

All Dissertations

This dissertation served as a case study that examined the impact of a districtwide system of support drawn from existing literature and organizational structure and management. The identified framework, the Limelight County College and Career Readiness Intervention (LCRI) Framework, utilized the Plan, Do, Study, Act (PDSA) cycle of improvement science. Three reoccurring themes or focus areas were identified as significant: curriculum instructional framework redesign, comprehensive guidance, and professional development.

While the study's findings are constrained by the density of the data gathered within a limited time frame, the findings provide many opportunities for longitudinal studies and confirm the integrity of …

Cross-Cutting Skills: The Role Of Major, Maureen Snow Andrade, Eugene Seeley, Ron Miller

International Journal for Business Education

Employers want recent college graduates prepared with skills that cut across majors, such as written and oral communication, teamwork, ethical decision-making, critical thinking, and applying knowledge in real-life situations. What is largely unknown is if some fields of study lend themselves to producing these desired skills over others. This is particularly relevant to schools of business, which strive to help students develop professional career skills and often emphasize a range of practical, hands-on, engaged learning activities. This study focused on obtaining the insights of hiring managers about desired skills and areas of study that prepare students with these skills. Survey …

The Relationship Of Levels Of Hearing And Course Format With Course Satisfaction: A Predictive Correlational Study, Diana Blakeney-Billings

Doctoral Dissertations and Projects

The purpose of this quantitative study using a predictive, correlational design was to investigate the relationship between two unrelated predictor variables (levels of hearing and course format) and one criterion variable (course satisfaction scores). The study included 239 undergraduate students enrolled in HED 101 at an HBCU institution in Alabama. Hearing loss is an invisible disorder that impacts social, emotional, and educational aspects. This study was critical to determine whether course modality and hearing loss can influence students’ course satisfaction. Data collection involved administering the collaborative learning, social presence, and satisfaction (CLSS) questionnaire and an audiological hearing screening that involved …

Pengaruh Pembelajaran Dengan Menggunakan Modul Berbantuan Simulasi Terhadap Peningkatan Penguasaan Konsep Mahasiswa Calon Guru Fisika Pada Materi Gelombang Mekanik, Widya Rohmawati, Sutopo Sutopo, Ahmad Taufiq, Zuerdiana Binti Manaf

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study aims to determine the effectiveness of simulation-assisted teaching materials in increasing conceptual understanding of prospective physics teacher students about mechanical waves. Research method is a one-group pretest-posttest design with subjects consisted of 25 physics education undergraduate students at Universitas Negeri Malang. Research instrument is a conceptual understanding test item of mechanical waves. The results showed that the acquisition of an increase in learning outcomes through the calculation of the normalized average gain is 0.77 was included in the "high" category so that the use of simulation-assisted teaching materials effective in improving students' conceptual understanding. Similar learning can be …

Describing The Ele Fresh Graduate Students’ Habit Of Listening To English Songs And Listening Self-Efficacy, Firlyano Fadly, Mirjam Anugerahwati

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

Listening is one of the essential language skills, but previous research has shown that listening is one of the most difficult language skills to acquire. There are two main factors that can cause problems when learning listening skills, there are external and internal. Self-efficacy is one of the internal factors. On the other hand, English songs are said to be an effective medium for students to learn listening skills. The purpose of this study is to describe the ELE fresh graduate student’s habit of listening to English songs and their listening self-efficacy. The study is using descriptive study, there are …

Materi Budaya Indonesia Sebagai Kebutuhan Pemelajar Bipa Dalam Program Immersion, Vania Maherani, Yulianeta Yulianeta, Nuny Sulistiany Idris, Nor Hasimah Ismail

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

In the immersion program, cultural introduction materials are needed to minimize the culture shock. This study aims to describe (1) the Indonesian cultural orientation sessions obtained and (2) Indonesian cultural materials needed by BIPA students prior to the immersion program. This study uses a qualitative approach. The results of this study indicate that (1) Indonesian cultural orientation sessions obtained by BIPA students can help them anticipate culture shock and (2) Indonesian cultural materials needed by BIPA students are material on how to dress, communicate, eat, use transportation, food information, and relations between women and men. The result of this research …

The Mental Set In Classroom Management During Distance Learning, Dinda Khamaril Kusumawardani, Sri Rachmajanti

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This paper aims to reveal the English teachers’ beliefs about their classroom management during distance learning. Moreover, this study also presented the solution that the expert teachers gave to conquer those difficulties. This study involved big number of participants and presented the solution, therefore the descriptive survey research design was chosen. A questionnaire and interview used to collect data in which the items were taken from three books related to Classroom Management. The findings showed that the English teachers found difficulties in the aspect of Mental Set. Related to those difficulties several suggestions were provided. The solutions were related to …

Suburban Area English Teachers’ Implementation Of Distance Learning: Methods, Challenges, And Perceptions, Brian Asprilla Yusdiansyah, Johannes Ananto Prayogo, Ekaning Dewanti Laksmi

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study employs a multiple case study method and aims to investigate, discover, and describe the suburban area English teachers teaching methods during the distance learning, challenges which are faced by the teachers, how the teachers solve those challenges, and the teachers’ perceptions towards the implementation of distance learning. The findings revealed that the teachers use direct teaching and more focused on utilizing the technology. Some of those challenges are mainly caused by the students ‘conditions. In order to obtain more genuine and valid results, a future study with better research instruments need to be conducted.

Developing An English Summative Computer-Based Test (Cbt) For Tenth Grade Students, Putro Bagus Wahida Machtowil, Sintha Tresnadewi, Francisca Maria Ivone

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The use of ICT in language testing has recently expanded to more diverse computer-based exams. This includes achievement test like UNBK (Ujian Nasional Berbasis Komputer) and university entrance test such as SBMPTN (Seleksi Nasional Masuk Perguruan Tinggi Negeri). thus, students need to get used to using this kind of test before taking a competency exam. The method employed in this study is Research and Development (R&D). Based on the process and results of the development of this English Computer Based Test, it has many features that can cover the difficulties in conducting online tests such as timers, anti-cheating, and other …

Using Video Games To Jumpstart Student-Centered Research And Inquiry In The General Education Humanities Classroom, Melissa Ridley Elmes

International Journal of Emerging and Disruptive Innovation in Education : VISIONARIUM

This article discusses preliminary results of a study of the author’s use of gaming to facilitate research-based writing assignments in her classes, focusing specifically on a 200-level general education introductory literature course, The Medieval World, taught in Spring 2023 at a U.S. midwestern private university. The purpose of the study was to determine whether approaching topic selection for the research-based writing assignment in a general education literature course through gaming could result in more student buy-in and thus, greater student retention, better student work, and a more successful learning experience and outcome for such an assignment than does a traditional …