Educational Assessment, Evaluation, and Research Commons^™

Digital Stories Of Resilience: A Case Study Of Urban Community College English Learners, Patricia George Hunter

Journal of English Learner Education

This study utilizes a qualitative case study approach to learn how project-based, digital storytelling (DST) voices the resilience of post-secondary English language learners (ELLs) attending a minority-serving, open-access, community college in New York City. Along with many studies that have examined the usefulness of DST in oral production, this research investigates whether project-based digital storytelling enhances students’ understanding of academic content related to resilience and conventional composition. Narrative inquiry (NI) research technique is the basis of the digital story project in an English as a Second Language (ESL) course. In this case, the study relies on observations and artifacts to …

Game-Based Learning With Augmented Reality, Kantida Nanon

Dissertations

Augmented Reality (AR) technology provides an effective and controllable learning environment, especially for complicated, potentially dangerous, or critical content. Effective implementation of interaction and platforms for educational tools can maximize learner engagement and optimize the learning experience. This dissertation explores the potential of AR technology to enhance learning experiences across multiple platforms and subject areas, particularly within chemistry and mathematics. The dissertation is grounded in the field of Human-Computer Interaction (HCI) and explores the potential of AR to increase learner engagement, improve learning outcomes, and transform traditional pedagogical practices.

The dissertation is divided into two parts. The first part examines …

Exploring The Perceptions Of Literacy In Assessment For Learning Among High School English Teachers, Sukarno Sukarno, Nur Hidayanto Pancoro Setyo Putro, Ihtiara Fitrianingsih, Yasir Ayed Alsamiri, Fadhl Mohammed Awadh Gharamah, Ingrid A. Gavilan Tatin

REID (Research and Evaluation in Education)

In the field of English language education, the crucial role of assessment for learning (AfL) requires teachers to possess robust assessment literacy. This study explores AfL literacy among high school English teachers in Yogyakarta, Indonesia by utilizing Alonzo's validated AfL survey that establishes a comprehensive six-factor model, delineating teachers as assessors, pedagogists, student partners, motivators, learners, and stakeholder partners. Exploiting confirmatory factor analysis and examining demographic variations, this quantitative research invited 202 English teachers in the Special Region of Yogyakarta, Indonesia selected purposively based on the geographical service area. Data were collected through an online questionnaire adopting Alonzo's 42-questions AfL …

Understanding Barriers To Optimal Supervision And Delivery Of The Nationalcertificate (Vocational) Curriculum Through Tvet College Lecturers’Reflective Evaluations, Angelona Rewhydah Williams, Karel Prins, Bongani Innocent Nkambule, Sindile Amina Ngubane

REID (Research and Evaluation in Education)

Propounded by reflective theory, this qualitative case study drew on TVET lecturers' reflective evaluations of factors that they considered to have a bearing on optimal supervision and delivery of the National Certificate (Vocational) curriculum. Data were collected from participants across three campuses of a TVET college in the Eastern Cape Province, South Africa. Twelve lecturers of different seniority were purposively sampled and interviewed in two focus group sessions. The first focus session involved six participants: four post-level 2 and two post-level 3 personnel recognized by the South African Council for Educators (SACE) as "office-based lecturers" and classified within the middle …

Number Sense Profile Of Prospective Elementary School Teachers In Blendedmathematics Learning, Welly Novitasari, Herwin Herwin, Supartinah Supartinah, Putri Wulandari, Budiharti Budiharti

REID (Research and Evaluation in Education)

Number sense is a skill that contributes significantly to learning mathematics. However, number sense is often positioned as a fundamental skill whose development is more focused on children. The contribution of number sense in mathematics is even more apparent at higher levels of education. Ironically, number sense seems ignored and has become a rarely studied topic in higher education. Thus, the student’s number sense ability profile seems buried with various problems. This study aims to reveal the profile of prospective elementary school teachers’ number sense abilities and the factors causing their failure in solving math problems during the implementation of …

A Psychometric Evaluation Of An Item Bank For An English Readingcomprehension Tool Using Rasch Analysis, Louis Wai Keung Yim, Che Yee Lye, Poh Wee Koh

REID (Research and Evaluation in Education)

This study reports the psychometric evaluation of an item bank for an Assessment for Learning (AfL) tool to assess primary school students’ reading comprehension skills. A pool of 46 primary 1 to 6 reading passages and their accompanying 522 multiple choice and short answer items were developed based on the Progress in International Reading Literacy Study (PIRLS) assessment framework. They were field-tested at 27 schools in Singapore involving 9834 students aged between 7 and 13. Four main com- prehension processes outlined in PIRLS were assessed: focusing on and retrieving ex- plicitly stated information, making straightforward inferences, interpreting and inte- grating …

Simulation Of Low-High Method In Adaptive Testing, Rukli Rukli, Noor Azeam Atan

REID (Research and Evaluation in Education)

The era of disruption significantly engineered a classic testing system into an adaptive testing system where each test taker takes a unique test. However, the carrying capacity of the adaptive testing system engineering is experiencing obstacles in terms of the method of presenting the test questions. The study aims to introduce the low-high adaptive tracking method with the item response theory approach, where the difficulty level of the questions is adapted to the test takers' abilities. The number of test questions in the question bank is 400 questions. Data analysis used the Bilog-MG program. The range of the difficulty level …

Construction Of An Instrument For Evaluating The Teaching Process In Highereducation: Content And Construct Validity, Risky Setiawan, Wagiran Wagiran, Yasir Alsamiri

REID (Research and Evaluation in Education)

This study aims to reveal the content validity, construct validity, and reliability of the instrument for evaluating the teaching process in higher education. This research is development research applying the ADDIE model from Molenda. The indicators evaluated consist of context, inputs, processes, and products. The sample consisted of 1200 students from eight faculties, each represented by three study programs. Data analysis uses three stages: content validity test analysis using the V-Aiken method involving six panellists or experts; construct validity test using Confirmatory Factor Analysis (CFA). Quantitative descriptive analysis and interpretive qualitative analysis used the Miles and Huberman method. The results …

Constructing And Providing Content Validity Evidence Through The Aiken's Vindex Based On The Experts' Judgments Of The Instrument To Measuremathematical Problem-Solving Skills, Nia Kania, Yaya S. Kusumah, Jarnawi Afgani Dahlan, Elah Nurlaelah, Ferit Gürbüz, Ebenezer Bonyah

REID (Research and Evaluation in Education)

Test content-based proof of validity is a type of evidence that supports the validity of a measuring instrument. This research aims to develop a mathematical problem-solving assessment instrument utilizing five experts. This study is classified as developmental research and follows a research design that includes two separate stages: the preliminary design stage and the prototype stage. However, its application is restricted to Prototype 1 and Prototype 2, specifically for expert evaluation. This instrument was designed explicitly for grade VIII students studying mathematics, covering all the topics from the odd semesters. The analysis progressed through three distinct stages— curriculum analysis, content …

Stability Of Estimation Item Parameter In Irt Dichotomy Considering The Number Of Participants, Zulfa Safina Ibrahim, Heri Retnawati, Alfred Irambona, Beatriz Eugenia Orantes Pérez

REID (Research and Evaluation in Education)

This research is related to item response theory (IRT) which is needed to measure the goodness of a test set, while item parameter estimation is needed to determine the technical properties of a test item. Stability of item parameter estimation is conducted to determine the minimum sample that can be used to obtain good item parameter estimation results. The purpose of this study is to describe the effect of the number of test takers on the stability of item parameter estimation with the Bayes method (expected a posteriori, EAP) on dichotomous data. The minimum sample for stability is 1,000 participants …

Predictor Factors For Teacher Innovative Behavior During Curriculum Reform: The Role Of Cognitive Flexibility, Positive Affect, And Negative Affect, Khairunnisa Syafira Dumbi, Stephanie Yuanita Indrasari

REID (Research and Evaluation in Education)

Teacher innovative behavior is a key capability for maximizing teacher performance as well as the student learning process, especially when teachers face new changes in their education system such as curriculum reform. However, insufficient attention has been given to understanding the interaction of predictor factors to encourage teacher innovative behavior. This study aims to assess the role of cognitive flexibility, positive affect, and negative affect in predicting teacher innovative behavior. A cross-sectional and quantitative design was used for this study. The data collection procedure used convenience sampling, with questionnaires distributed online via social media through several teacher communities. Three instruments …

Automatic Generation Of Physics Items With Large Language Models (Llms), Moses Oluoke Omopekunola, Elena Yu Kardanova

REID (Research and Evaluation in Education)

High-quality items are essential for producing reliable and valid assessments, offering valuable insights for decision-making processes. As the demand for items with strong psychometric properties increases for both summative and formative assessments, automatic item generation (AIG) has gained prominence. Research highlights the potential of large language models (LLMs) in the AIG process, noting the positive impact of generative AI tools like ChatGPT on educational assessments, recognized for their ability to generate various item types across different languages and subjects. This study fills a research gap by exploring how AI-generated items in secondary/high school physics aligned with educational taxonomy. It utilizes …

Developing A Pancasila Students' Character Instrument: Proof Of Construct Validity And Estimation Of Construct Reliability, Wiwin Mistiani, Edi Istiyono, Amir Syamsudin, Nor Hasnida Md. Ghazali

REID (Research and Evaluation in Education)

This study aims to prove construct validity and estimate construct reliability of the character scale of Pancasila students by using confirmatory factor analysis. The research approach used is quantitative with a sample of 200 high school students selected at random. This study measured the variables by six aspects, 15 indicators, and 20 questions. The six aspects include faith and piety to God Almighty, global nationality, cooperation, independence, critical reasoning, and creativity. The data analysis technique used is confirmatory factor analysis. The study results concluded that the instrument for assessing the character of Pancasila students in high school had a loading …

Changing Images Of Favorite Schools After The Student Admission System Reform In Indonesia, Janu Arlinwibowo, Sri Fajar Martono, Ikhya Ulumudin, Hermanto Waruwu, Yufridawati Yufridawati, Yunita Murdiyaningrum, Gupita Nadindra Fatima, Benjamin Leong Tack Khang

REID (Research and Evaluation in Education)

The study aims to unearth public perceptions of the label of favorite schools after the implementation of student admission reform in Indonesia, namely the zoning system, and to explore the underlying causes. Adopting a qualitative method with a phenomenological approach, this study involved participants from nine provincial education services, nine regency education services, 72 teachers, and 72 parents. Data collected through in-depth interviews and focus groups reveal three distinctive perceptions of favorite schools. The first view posits that after the implementation of the zoning system, the quality among schools is relatively similar, indicating that the new policy is effective in …

Transformation Of Accreditation Of Higher Education In Health In Indonesia: Qualitative Assessment, Yefta Moenadjat, Insan Sosiawan A. Tunru, Sutrisno Soemardjo

The New Ropanasuri Journal of Surgery

Accreditation of higher education in health in Indonesia shifts to the qualitative assessment driven to ensure quality improvement. The method replaces the former quantitative assessment method that has been applied since 2012; it will be effective in January 2025. The driving factors and rationale of transformation are outlined in this article. The rationale of the qualitative assessment that applies principle–based accreditation and the quantitative assessment that applies rule–based accreditation is reviewed here. Information on the accreditation procedure and the goal is presented, aiming for institutions to prepare for this new version of accreditation.

The Importance Of School Leadership Practices In Social-Emotional Learning Of Elementary And Secondary Schools, Janice Filer Ph.D.

The Scholarship Without Borders Journal

Abstract: The purpose of this qualitative phenomenological study was to interview school administrators in the Los Angeles area who utilized social-emotional learning programs in their individual schools. Since the worldwide pandemic, schools have emphasized the importance of social-emotional learning. This research was conducted in an effort to provide school administrators with additional strategies to support the importance of social-emotional learning. In-depth interviews were conducted to collect leadership practices. The data was collected during the Spring 2024 and Summer 2024 school calendar year. Seven participants completed the interview process. Four themes emerged from the data including the importance of equity, belonging/relationships, …

Society Of American Foresters (Saf) Academic Publications As They Relate To The Curriculum Standards For Saf Forestry Program Accreditation: A Content Analysis, Lisa M. Bentley

Electronic Theses and Dissertations

Goals that impact decision-making components within academic programs in the university system have the potential to define and change the direction of a field of study, and, with that, should be thoughtfully approached with a certainty of evidence that supports responsible paradigms in forestry education. Periodic revision of the standards for accreditation by SAF influences institutional expectations that result in shifts in forestry education and should be consistent with professional forestry standards. The methodology utilized in this research contextualizes data from a sociological perspective intentionally as a method to holistically integrate data as evidence to support the interpretation of Society …

Exploring Teacher Pathway Programs: The Importance Of High School Students’ Perspectives, Mackenzie C. Kasgorgis

Honors College Theses

This thesis explores and investigates the effectiveness of teacher pathway programs for high school students interested in education. The aim is to find and discuss the importance of teacher pathway programs and how they benefit the participants involved. This paper intertwines my analysis of the extant scholarly literature and my use of qualitative research methods during my immersion in two summer programs. Through participant observations and a survey, I gained insights into the participants’ perspectives that provided me with raw, unbiased views and opinions on the teacher pathway program. Student participants’ perspectives include the experiences they faced during the program, …

Connecting Through Screens: A Case Study On Student Engagement In Online Esol Classes In The Post Pandemic Era, Meral Kacar

Master's Theses

The sudden shift to emergency online education during the global pandemic affected various academic fields, including English language teaching. While many schools faced challenges, some successfully implemented online educational programs. Despite the large impact of the global pandemic on education, there is limited research that examines the effectiveness of online ESOL programs with a focus on the key factors that contribute to student engagement. This thesis explores the factors contributing to effective online ESOL instruction, focusing on fostering engagement and improving teaching practices in the post-pandemic era. The study for this thesis employs an instrumental case study methodology, focusing on …

A Predictive Correlational Study Of The Relationship Between Two-Year College Faculty Participation In Professional Development And Career Commitment, Faculty Leadership, And Professional Service Activities, Deborah Josey Burks

Doctoral Dissertations and Projects

The purpose of this predictive correlational non-experimental study was to examine the relationships between faculty participation in professional development, and career commitment, faculty leadership, and engagement in professional service activities. The predictor variable was faculty professional development and criterion variables were career commitment, faculty leadership, and engagement in professional service by faculty employed within two-year colleges in the southeastern United States. This study contained a convenience sample of 76 faculty employed at two-year colleges within a system of colleges. Data was gathered utilizing the combined self-reported Career Growth Opportunity Measure (Adams, 1999), the Teacher Leadership Inventory [TLI] (Angelle & DeHart, …

Exploring How Religiously Affiliated Schools’ Ecological Systems Influence Policies On Students With Disabilities, Michelle Lyon Bizeau

Doctoral Dissertations and Projects

The purpose of this exploratory multiple-case study was to gain an understanding of the ecological systems that are most influential in how religiously affiliated schools establish their policies that ultimately include or exclude students with disabilities in California. The theory guiding this study was Urie Bronfenbrenner’s ecological systems theory as it emphasizes that an individual’s development is influenced by dynamic interplay between individual characteristics and the broader social, cultural, and environmental contexts in which they live. The participants in this study were school leaders who were purposely selected as representatives of their primary and/or secondary religiously affiliated school located in …

Full Issue_ Artizein_2024, R. Michael Fisher, Barbara Bickel

Artizein: Arts and Teaching Journal

This special issue, Ettingerian Matrixial Theory, Education and the Arts attunes with and brings together the cross-currents of creative and scholarly works that are emerging internationally between Ettingerian Matrixial Theory (EMT), Education and the Arts.

A Historical Review Of Course Requirements In Agricultural Mechanics For Agricultural Education, Teacher Education Undergraduates At Nine 1862 Land-Grant Universities, Kristopher R. L. Rankin Iii, M. Craig Edwards

Journal of Research in Technical Careers

Preparing pre-service students to teach agricultural mechanics is a difficult task due to the career pathway including a great variety of topics (Byrd et al., 2015). This study examined the trend in requirements in 1862 land-grant universities for number of courses, course credit hours, and course topics related to agricultural mechanics, as well as the total credit hours needed for degree completion in agricultural education, teacher education. Overall, the universities examined had lessened the total course credit hours related to agricultural mechanics courses from 8.33 to 11.83 credit hour requirements in 1980, to a range of 6.67 to 8.33 credit …

Integrating A Practical Sport Analytics Course Into Sport Management Education, Bradley Congelio

The COSMA Journal

Integrating analytics into sport management curricula has become increasingly crucial as the sport industry embraces data-driven decision-making. However, many programs struggle to bridge the gap between theoretical knowledge and practical application in analytics education. This paper presents a comprehensive approach to teaching sport analytics that emphasizes hands-on experience with data using the R programming language and RStudio. The course structure and content described herein focus on leveraging the tidyverse ecosystem and National Football League (NFL) data to immerse students in conducting sport analytics. By progressing through modules on data manipulation, visualization, web scraping, and statistical analysis, students acquire both the …

Timss 2023 Australia. Volume 1: Student Performance, Nicole Wernert, Marina Schmid, Sima Rodrigues

TIMSS 2023

The Trends in International Mathematics and Science Study (TIMSS) is an international comparative study of student achievement directed by the International Association for the Evaluation of Educational Achievement (IEA). TIMSS was first conducted in 1995 and the 2023 assessment formed the eighth cycle, providing 28 years of trends in mathematics and science achievement at Year 4 and Year 8. In Australia, TIMSS is managed by the Australian Council for Educational Research (ACER) and is jointly funded by the Australian Government and the state and territory governments. TIMSS is a key part of Australia’s National Assessment Program. The goal of TIMSS …

Cultural Responsiveness And Its Effect On Rural Science Achievement, Nerissa C. Deramus

College of Education

Low student achievement in science was explored to determine if teachers with high culturally responsive education (CRE) self-efficacy levels matched the student science achievement in rural, suburban, and urban schools in Alabama. The study aimed to determine if rural teachers with high CRE self-efficacy could improve science achievement. The self-efficacy theory was formulated by Bandura (1977) based on the idea that individuals with a high belief in their abilities to perform tasks have greater outcomes. CRE self-efficacy was measured using the Culturally Responsive Teaching Self-Efficacy (CRTSE) scale based on the culturally responsive teaching theory. The theory incorporates the works of …

The Impact Of Student Engagement Activities On Future Climate Change Adaptation: The Case Of Student Simulation Models, Bassel Mostafa Elkalaf

Future Journal of Social Science

This paper explores the critical role of student engagement in addressing the growing challenges of climate change, with a focus on the Model United Nations (MUN) as a case study. As climate-related security threats increase globally, educational platforms that prepare youth for effective leadership in climate politics are more essential than ever. MUN, a widely practiced student activity simulating global policy-making, provides a valuable opportunity for students to deepen their understanding of the interconnectedness between climate change, peace, and security. By participating in MUN simulations, students engage in debates, develop innovative solutions, and practice diplomatic skills, all while exploring the …

An Exploration Of How Education Stakeholders Perceive The Implications Of Grade Repetition In Secondary Education In Western Uganda: A Qualitative Multiple-Case Study, Patrick Tumwine

Theses & Dissertations

Grade repetition is one of the bottlenecks to Uganda’s vision of producing skilled human capital to transform the nation’s status from peasant to middle class. This study explored how education stakeholders perceived the implication of students’ grade repetition at a secondary school level. I employed a qualitative approach with an embedded multiple-case study design, through which cross-case synthesis on each school’s perspective revealed similarities and differences in understanding grade repetition at a secondary school level. Individualism-collectivism theory guided the study, to understand how students realized educational expectations through an interplay of educational and cultural influence on a school’s instructional process. …

Indiana School Teachers’ Self-Efficacy Perceptions In The Areas Of Clear And High Expectations, Collaborative Inquiry, And Feedback, Jacinda Smith

All-Inclusive List of Electronic Theses and Dissertations

This study examined Indiana public school educators' perceptions of self-efficacy in three instructional practices: setting clear and high expectations, fostering collaborative inquiry, and providing feedback. Using a quantitative approach, it explored whether these perceptions varied by teaching experience (0–5, 6–15, 16+ years), school location (urban, rural, suburban), grade level (PK–2, Intermediate 3–5, Middle School 6–8, High School 9–12), and socioeconomic status of the student population (0–25%, 26–50%, 51–75%, 76%+). Findings revealed significant differences, with veteran teachers and those in rural schools reporting higher efficacy levels than peers in urban settings or with fewer years of experience. These results suggest the …

Assessment And Analytical Framework: Standardised Teacher Assessment And Review, Priyanka Sharma

Teaching standards and teacher evaluation

The Standardised Teacher Assessment and Review (STAR) assessment framework provide operational definitions and understanding of the key aspects of teacher competencies measured by STAR. It details on how these competencies are measured, enabling necessary decisions related with teacher proficiency. The framework establishes parameters for test development through a principled design approach and defines the scope of content for the assessment instrument organised into four domains and 12 strands. The subsequent sections describe the detailed content related to each domain, ensuring comprehensive coverage and clarity in the assessment process. The robust structure not only supports the integrity of the assessment but …