Educational Assessment, Evaluation, and Research Commons^™

Pre-Service Teachers' Agentive Projections Toward Innovation In Online English Language Teaching (Elt) Classes, Santi Farmasari, Lalu Ali Wardana, Baharuddin Baharuddin, Amrullah Amrullah, Mh Isnaeni, Husnul Lail

REID (Research and Evaluation in Education)

This study examines the pre-service teachers' agentive projections toward innovation in online English Language Teaching (ELT) classes. Employing teacher agency theory, this instrumental case study views projections as agentive when they are informed by the students' ecological aspects (past and present), oriented to solve potential learning problems and improve learning outcomes. The study involved 84 pre-service teachers who were voluntarily asked to fill in a questionnaire, submit a lesson plan, and be interviewed. nVivo Pro was used to organize themes. The study indicates that the pre-service teachers, M=3.81, SD=.590, perceive that innovation in online ELT classes is closely related to …

The Implementation Of Geography Learning With Spatial Representation Using The Discrepancy Evaluation Model, Muhammad Nursa'ban, Mukminan Mukminan

REID (Research and Evaluation in Education)

This study aims to evaluate the learning process of geography with spatial representation in high school using the Discrepancy Evaluation Model (DEM) from Provus. Evaluation goes through five stages: design, installation, process, and product, as well as implementation comparison. Respondents were five teachers and 208 students from SMA 1 Srandakan, MAN 2 Yogyakarta, and SMA 1 Pundong in Yogyakarta. The evaluation was carried out in February-July 2021. The focus of the evaluation includes (1) learning design, (2) learning tools, (3) learning implementation, (4) learning outcomes, geographic critical thinking, and (5) implementing learning comparisons. Data were collected through document studies, observations, …

Gaining A Deeper Understanding Of The Meaning Of The Carelessness Parameter In The 4pl Irt Model And Strategies For Estimating It, Timbul Pardede, Agus Santoso, Diki Diki, Heri Retnawati, Ibnu Rafi, Ezi Apino, Munaya Nikma Rosyada

REID (Research and Evaluation in Education)

Three popular models are used to describe the characteristics of the test items and estimate the ability of examinees under the dichotomous IRT model, namely the one-, two-, and three-parameter logistic models. The three-item parameters are discriminating power, difficulty, and pseudo-guessing. In the development of the dichotomous IRT model, carelessness or upper asymptote parameter was proposed, which forms a four-parameter logistic (4PL) model to accommodate a condition where a high-ability examinee gives an incorrect response to a test item when he/she should be able to respond to the test item correctly. However, the carelessness parameter and the 4PL model have …

Smartphone Application For Assessing Teacher Performance, Hesty Marlianawati, Suranto Suranto, Badrun Kartowagiran

REID (Research and Evaluation in Education)

This work seeks to design a smartphone application for assessing teacher performance utilizing a 4D development model modified with the Mardapi instrument development model of (1) define (defining); (2) design (deciding instrument requirements, determi­ning application media specifications, creating flowcharts, and creating storyboards); (3) develop (assemble instruments, code, execute tests, evaluate test results, and interpret measurement findings); and (4) disseminate (spread). Proof of the application's viability was established through product testing with 26 principals acting as application users and evaluations by material and media specialists. The content validity of the acquired results was evaluated using the Aiken method, and the construct …

The Development Of Measurement Instruments Of Sharia Students' Perceptions About Khilafah, Joko Subando, Muhammad Kurniawan Budi Wibowo, Farkhani Farkhani

REID (Research and Evaluation in Education)

This study aims to develop an instrument to measure Sharia students' perception of the Khilafah. The research applied the ADDIE development research approach. The activity began with reviewing Taqiyuddin An-Nabhani's books and articles about Khilafah to get the instrument construct (analysis). The next stage was to compile the grid and assemble the instrument items (design). The items of the assembled instrument were then assessed by 11 experts (development). The validated Instruments were then carried out with limi­ted and expanded trials. The limited trial was conducted on 26 students at Universitas Islam Negeri (UIN) Salatiga, and the expanded trial was …

Evaluation Of Music Learning During The Covid-19 Pandemic In Senior High Schools, Putra Andino Nugrahhu

REID (Research and Evaluation in Education)

The purpose of this study is to see the extent to which the implementation of teaching and learning activities for Cultural Arts subjects, especially in the field of Music Arts at high schools in Palangka Raya, was carried out during the COVID-19 pandemic. This research is evaluation research with a descriptive qualitative approach that uses a discre­pancy evaluation model that measures the gaps in the learning process. Data was collec­ted through observation, interview, and documentation techniques and validated using triangulation and source triangulation. The results of the study found that in the evalua­tion of input, music art learning consisting of …

An Evaluation Of The Level Of Financial Reporting Compliance Of Public Schools In Kwazulu-Natal, Haruna Maama, Amos Zungu, Alexander Markey Oluka, Ferina Marimuthu

REID (Research and Evaluation in Education)

The financial management and reporting practices of public schools in KwaZulu-Natal (KZN) are a matter of concern. Section 42 of the South African Schools Act (SASA) requires that the Member of the Executive Council (MECs) for Education in KZN develops financial reporting guidelines for the schools. As a result, each province in South Africa has its l financial reporting guidelines that provide a framework for schools to report their financial information accurately and transparently. However, there are concerns about the lack of financial accountability and transparency emanating from improper financial reporting on the parts of the schools. Poor reporting practices …

Development And Validation Of A Self-Assessment-Based Instrument To Measure Elementary School Students' Attitudes In Online Learning, Ari Setiawan, Wiputra Cendana, Mark Ayres, Azim Abdurakhmanovich Yuldashev, Sri Panca Setyawati

REID (Research and Evaluation in Education)

Online learning during the COVID-19 pandemic makes it difficult for teachers to assess student learning attitudes. Limited availability of instruments to measure attitudes of students when they are engaged in online learning leads to difficulty of teachers to conduct appropriate assessments on that measure. The current study, therefore, mainly was intended to produce a self-assessment-based instrument that is feasible to use to measure students' attitudes in online learning. In order to produce such instrument, we used developmental research method by following steps in the instrument design that is proposed by McCoach, Gable, and Madura. Furthermore, in order to provide feasibility …

Determinant Factors Affecting The Research Performance Of Lecturers Receiving External Funds, Haryanto Haryanto, Nur Kholis, Samsul Hadi, Ezi Apino, Muh. Asriadi Am, Cerry Kartika Trizkyana

REID (Research and Evaluation in Education)

Quality research can positively impact the development of science and technology and improve the reputation of universities. This study investigates the determinant factors that affect the research performance of lecturers who obtain external funding. The sample was 41 lecturers who obtained external research funds from various institutions (e.g., Directorate of Research, Technology and Community Service, Ministry of Education, Culture, Research and Technology of the Republic of Indonesia; National Research and Innovation Agency of the Republic of Indonesia; and similar institutions) for the last three years (2021 - 2023). Cluster analysis using secondary data (Science and Technology Index or SINTA data) …

Comparison Of Item Characteristic Analysis Models Of Reading Literacy Test With Polytomous Item Response Theory, Firyal Nabila Harsana, Heri Retnawati, Septinda Rima Dewanti, Rogers Andrew Lumenyela, Maulana Fatahillah Adzima, Atut Reni Septiana

REID (Research and Evaluation in Education)

This study aims to compare the analysis model of the characteristics of reading literacy items with the polytomous item response theory, which uses the Graded Response Model (GRM), Partial Credit Model (PCM), Generalized Partial Credit Model (GPCM), and Nominal Reasons Model (NRM). This research is quantitative research in nature, and secondary datawere used from about 1000 test takers’ responses to reading literacy items in the 2018 reading literacy study analyzed with the R program. This model comparison was carried out so that the analysis results obtained were more accurate in representing the level of reading literacy skills in Indonesia. The …

Measuring Students' Generic Skills Through National Assessment, Toha Makhshun, Bassam Abul A'La, Kusaeri Kusaeri

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to measure the generic skills (GS) of Madrasah Aliyah (MA) students in Indonesia. Respondents who participated in this study were madrasah students scattered in East Java and Central Java as representatives of MAs in Indonesia. The method used in this research is a survey distributed via Google Form. Three dimensions are mentioned in the research instrument for measuring GS: religious moderation, critical and creative thinking skills, and interpersonal skills. Using SPPS version 16 software, a descriptive analysis was employed as the data analysis technique. The results of this study showed that the GS of students with religious …

Instrument And Evaluation Of Students' Involvement In Learning Mathematics In 21-Century Skills At Senior High Schools Of Riau Province, Dedek Andrian, Leo Adhar Effendi

Jurnal Penelitian dan Evaluasi Pendidikan

Student engagement is the most crucial factor in learning activities because it is the main factor in improving student learning outcomes in class. This study aims to develop instruments and evaluate student involvement in learning mathematics to achieve maximum learning outcomes at school. The population in this study was all high school students in Riau Province. The sample is 150 high school students selected by multiple-stage random sampling based on high, medium, and low student achievement levels. Data analysis in this study was carried out four times: (1) data analysis based on the results of expert assessment of the instrument …

A Meta-Analysis Of The Relationship Between Self-Assessment And Mathematics Learning Achievement, Fransidha Sidhara Hadi, Janu Arlinwibowo, Gupita Nadindra Fatima

Jurnal Penelitian dan Evaluasi Pendidikan

This study uses a meta-analysis model to describe the relationship between self-assessment and achievement in learning mathematics. This meta-analysis covers articles published from 2011 to 2022 and is restricted to studies published in English. Indexed articles by Google Scholar were chosen. The data must meet these criteria: quantitative research, containing correlational research on the relationship between self-assessment and mathematics learning achievement (including correlation values and sample size). Through the data screening process with predetermined criteria, 12 research results were obtained, containing 43 studies to be analyzed. This meta-analysis uses a random effect model due to the heterogeneous data distribution. A …

Developing And Implementing An Instrument For Assessing Critical Thinking And Visual Representations In Learning Physics Materials Of Optical Instruments, Dewi Nurulhasni, Eka Ayu Nurbaiti, Rosa Safirotun Nabila, Jumadi Jumadi

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to develop an assessment instrument to measure students' critical thinking and visual representation abilities in optical instrument material. This research and development (R&D) employed the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) instructional model. This research develops a test instrument that has more specific stages so the ADDIE development stage is integrated with the development stage of the test instrument developed by Mardapi. The subjects in this study are grade XI students of State Madrasah Aliyah (MAN) 4 Bantul. This study produced a test instrument for measuring students' critical thinking and visual representation abilities, with high validity,and …

Analysis Of Students' Perceptions On The Freedom Of Learning - Independent Campus (Mbkm) Program At Chemistry Study Program Of Ma Chung University, Yuyun Yuniati, Lilis Lestari Wilujeng

Jurnal Penelitian dan Evaluasi Pendidikan

Considering that Indonesian education has gone through such a long journey from 1922 to 2022 now, it is necessary to have an educational program that is able to meet the demands of workers' needs in this era of globalization. In the end, the Directorate General of Higher Education, Research, and Technology designed an education policy system in the realm of higher education, namely "Freedom of Learning - Independent Campus", as an accurate strategy for optimizing academics in today's Indonesia. In this study, a survey was aimed at 40 undergraduate students of the Chemistry Study Program at Ma Chung University. Data …

Item Quality Analysis Using The Rasch Model To Measure Critical Thinking Ability In The Material Of The Human Digestive System Of Biology Subject In High School, Wanda Agus Prasetya, Anggi Tias Pratama

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to determine the quality of the Biology instrument items on the digestive system material with the Rasch model for analyzing critical thinking skills. The research employed a quantitative descriptive method involving 63 students of senior high schools in Yogyakarta. The data were collected using a critical thinking skills description test and processed using the Rasch model with the Winstep 5.0.3.4 program. The study shows that the overall validity is acceptable. The item validity did not require improvement in items 14, 3, 8, 13, 12, 1, 4, 10, 6, 2, 7, 11, 15, and 9, and required improvement …

A Study Of The Readiness Of Post-Pandemic Computer-Based Four-Tier Diagnostic Test (Cbftdt): A Review Of Economic Level, School Grades, And Device Accessibility, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Made Rai Shanti Ayub, Duden Saepuzaman, Rizki Zakwandi, Anisyah Rachman, Eri Yusron, Purwoko Haryadi Santoso

Jurnal Penelitian dan Evaluasi Pendidikan

Student readiness for using computer-based assessment was affected by economic level, school grade, and device accessibility. This study analyzed student readiness using a computer-based assessment, the four-tier diagnostic test (CBFTDT). The data in this study were students' responses to a questionnaire consisting of 16 statements about three aspects: mental access, skill access, and usage. The questionnaire consists of 16 statements with three aspects: items, media, and effectivity. The questionnaire was proved valid by experts and its estimated reliability score was 0.99. This study proved that the Student is still not ready to use the computer-based assessment, with an average readiness …

An Analysis Of Interaction Patterns In Students' Research Essay Guidance To Build Six Main Parameters Of The Indonesian National Qualification Framework: Covid-19 Pandemic Period, Undang Rosidin, M. Setyarini, Widyastuti Widyastuti

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to reveal the interaction patterns and inhibiting factors for the final project guidance in the Mathematics and Natural Sciences Education Department, Universitas Lampung, to develop the six main parameters of the Indonesian National Qualifications Framework (INQF). The study employed a mixed method involving 67 students who composed the final project for the 2021/2022 academic year selected from 314 final project students using the cluster random sampling technique. The data in this study were primary and secondary data obtained by questionnaires, interviews, and documents, analyzed qualitatively, quantitatively, and descriptively. The closed-response questionnaire was used regarding the interaction pattern, …

Developing An Instrument For Measuring Views On Muhammadiyah Ideology, Joko Subando, Muh Samsuri, Edy Muslimin

Jurnal Penelitian dan Evaluasi Pendidikan

This research aims at developing an instrument for measuring views on Muhammadiyah ideology that is valid and reliable. This study adapted Borg and Gall's development model through initial research, planning, initial product development, limited testing, product revision, expanded testing, and product revision. The steps started with initial research to obtain the ideology construct of books related to Muhammadiyah. The ideology construct obtained was used as the basis to arrange instrument items which were then validated by five experts in the fields of measurement, Muhammadiyah ideology, practitioners, and Muhammadiyah cadres by filling the sheet of variable appropriateness with indicators and indicators …

Comparing Item-Total Correlation And Item-Theta Correlation In Test Item Selection: A Simulation And Empirical Study, Sukaesi Marianti, Ana Rufaida, Nur Hasanah, Sofia Nuryanti

Jurnal Penelitian dan Evaluasi Pendidikan

One of the important processes in the evaluation of the psychometric properties of a test is item selection. The item selection process usually uses a very popular technique called item-total correlation. This study attempts to describe the item-total correlation technique and explore it using a similar technique called item-theta correlation. Both techniques are applied using simulation studies by creating several conditions related to test length and sample size. After the simulation study, the next step is the study using empirical data as an illustration of the results of the simulation study. The results of this study show that there are …

The Online Evaluation Of The Teacher Certification Program Using The Cipp Model, Intan Kemala Sari, Lili Kasmini, Rosdiana Rosdiana, Mayor M. H. Manurung

Jurnal Penelitian dan Evaluasi Pendidikan

The Teacher Certification Program (PPG) is a government program to support competency improvement and standardization of teachers in Indonesia. Program organizers are LPTKs that have met the requirements for further preparation and fulfillment of human resources, infrastructure, and supporting policies. Evaluation of the PPG Program is essential, especially for LPTKs still new to implementation. Evaluation of the PPG Program is carried out using the CIPP Model, an evaluation model in terms of Context, Input, Process, and Product. The evaluation was carried out using a qualitative descriptive approach using observation, documentation, interviews, and survey instruments. The PPG program on the subject …

Assessment Of Geography Learning Process Standards In The Indonesian Curriculum: Instrument Development And Quality, Tuti Amalia, Muhammad Nursa'ban

Jurnal Penelitian dan Evaluasi Pendidikan

The need for mapping the achievement of geography learning process standards in the Indonesian curriculum can provide recommendations in accordance with the conditions in the field. This study aims to determine and describe the quality of geography learning process standard instruments in the Indonesian curriculum, namely: 1) content validity 2) construct validity 3) reliability. This research is instrument development research. The development stage used is the development stage of the instrument test by Heri Retnawati. The process of preparing the instrument, namely: determining the purpose of instrument preparation, searching for relevant theories, compiling indicators of instrument items, compiling instrument items, …

Development Of A Scientific Attitude Measurement Instrument For Dharmacariya Department Students At Stabn Using The Fishbein And Ajzen Model, Rahmat Syah, Daddy Darmawan, Syaiful Syamsuddin

Jurnal Penelitian dan Evaluasi Pendidikan

This study applies the Fishbein and Ajzen model to develop a Scientific Attitude Measurement Instrument for Students, focusing on attitudes, beliefs, and intentions towards scientific behaviors. The quantitative research employs an instrument development method, initially constructing dimensions reflecting various scientific attitudes such as attitudes towards the scientific method, collaboration, openness to knowledge, criticality, respect, honesty, independence, and interest in data analysis. The instrument measures students' scientific attitudes across three main dimensions: attitude, subjective norms, and behavioral control, aligning with the Fishbein and Ajzen model. It covers key aspects like attitudes towards the scientific method, emphasizing rigorous approaches like Popper's Falsification …

The Emotional Intelligence And Burnout Of In-Service English Teachers In Yogyakarta, Shabrina Yumna Azhra, Yasir Alsamiri, Nur Hidayanto Pancoro Setyo Putro

Jurnal Penelitian dan Evaluasi Pendidikan

Emotional intelligence and burnout of teachers are highly discussed in previous studies. This study set out to examine (1) the dimensions of emotional intelligence, (2) the dimensions of burnout, (3) the level of burnout, and (4) the relationship among the dimensions of in-service English teachers in Yogyakarta. The method used in this study is a quantitative correlational study through a survey. The instruments used were questionnaires adapted from the Maslach Burnout Inventory (MBI) and The Schutte Self-Report Emotional Intelligence Test (SSEIT). The participants of this study were 204 in-service English teachers in Yogyakarta. The data were analyzed using Confirmatory Factor …

Boundaries Of Empirical Approaches In Educational Research, Christopher Olusola Omoregie

Journal of Research Initiatives

This paper critically reviews the research done in education faculties in Nigerian universities. This research, though categorized in postgraduate schools or colleges as mainly in the liberal arts/humanities and the social sciences, depends on the theories and methodologies from other disciplines. The arts and social sciences are disciplines where undergraduates in education take courses in teaching to earn bachelor’s degrees, the postgraduate level offers varied opportunities for educational research to maximize the uniqueness of mixed method research for education.

The Impact Of Teacher Preparedness And Professional Development On Fourth-Grade Students' Science Achievement, Craig L. Mayo, Faye Bradley

Journal of Research Initiatives

Science scores among US fourth-grade students have declined compared to their international counterparts in recent years. Recent results show that teachers are the most impactful influence on student success and accountability. Teacher preparedness and professional development are two key areas that serve as indicators of providing relevant and essential information for students' success. A correlational quantitative study was conducted to assess the relationship between teacher preparedness and professional development on fourth-grade students’ science achievement. The TIMSS 2019 data were secured from the Boston College, TIMSS, and PIRLS International websites. The data was evaluated using the SPSS 27 Hierarchical Linear Regression. …

Health Profession Education Students’ Satisfaction Toward Online Courses During The Covid-19 Pandemic, Diantha Soemantri, Zhafirah Salsabila, Vernonia Yorasaki

Makara Journal of Health Research

Background: Given the extensive use of e-learning, especially during the COVID-19 pandemic, a validated instrument is deemed important for continuous evaluation. This study aimed to measure health profession education students’ satisfaction toward the e-learning process within all health sciences cluster (HSC) courses, following further validation of the satisfaction scale for the e-learning process.

Methods: A cross-sectional study using an exploratory factor analysis (EFA) was conducted to validate the 29-item Indonesian version of the satisfaction scale for the e-learning process. That the validated tool was used to measure 2,471 students’ satisfaction toward the e-learning process.

Results: The EFA …

Reducing Food Scarcity: The Benefits Of Urban Farming, S.A. Claudell, Emilio Mejia

Journal of Nonprofit Innovation

Urban farming can enhance the lives of communities and help reduce food scarcity. This paper presents a conceptual prototype of an efficient urban farming community that can be scaled for a single apartment building or an entire community across all global geoeconomics regions, including densely populated cities and rural, developing towns and communities. When deployed in coordination with smart crop choices, local farm support, and efficient transportation then the result isn’t just sustainability, but also increasing fresh produce accessibility, optimizing nutritional value, eliminating the use of ‘forever chemicals’, reducing transportation costs, and fostering global environmental benefits.

Imagine Doris, who is …

Application Of Multicultural Literature In The Early Childhood Classroom, Deborah Wheeler, Jennifer Hill

Journal of English Learner Education

Culture equates to identity; therefore, the implementation of multicultural literature in the early childhood curriculum is an essential method for securing children’s concept of self and cultural identity. This qualitative study explored the implementation of multicultural literature in early childhood classrooms, and the research included questions pertaining to multicultural literature training, instructional methods, and barriers encountered. The purpose of the study was to answer questions regarding teachers use of multicultural literature in the classroom, how often teachers read multicultural literature and how teachers integrated multicultural literature into instruction. An additional question inquired about what multicultural books titles were teachers reading …

Best Practices For English Learners With Disabilities In Us Schools – A Systematic Review, Samiratu Bashiru, Jennifer E. Smith

Journal of English Learner Education

This systematic review investigated best practices for enhancing academic achievement among English Learners with Disabilities (ELDs) in US schools. By examining 17 peer-reviewed articles and comparing them to the CEC 2014 Quality Indicators, the study identifies significant practices, including culturally responsive methods, technology integration, evidence-based strategies, addressing service delivery challenges, and improving assessment tools. This review has limitations related to inconsistent terminology and highlights the need for standardized language and continued research. It recommends integrating culturally responsive practices, leveraging technology, and refining inclusive assessment tools. This review provides educators, policymakers, and researchers insights, emphasizing ongoing teacher development and policy alignment …