Digital Commons Network^™

Dominant Factors That Determine College Students Completing Studies In Mathematics Education Study Programs, Sintha Sih Dewanti, Aji Joko Budi Pramono

REID (Research and Evaluation in Education)

Failure to graduate on time is a problem for both the university and the students themselves. Beside the competencies possessed by students, many other factors affect the completion of student studies. This study aims to reduce the variables that really affect the completion of student studies. The approach of this research was survey research on students of the Mathematics Education Study Program at least in semester 7 (currently taking a final project course). There are 17 factors that determine the completion of student studies, namely achievement motivation, discipline, interest, intelligence, study habits, health, part-time work activities, organizational activities, curriculum, mentoring …

Misconception Tendency Of Differentiated Instruction In Publicly Shared Teaching And Learning Videos On Youtube: A Mixed-Methods Exploration Study, Guruh Sukarno Putra

Jurnal Penelitian dan Evaluasi Pendidikan

Differentiated instruction is a pedagogical approach in which teachers fulfill students' needs based on their interests and learning profiles. This paradigm is new to the Indonesian educational sector as the government of Indonesia introduced the Merdeka curriculum in 2022, which offers a new style of teaching and learning in Indonesia through differentiation in the classroom. As an unfamiliar approach, the recent practice of differentiated instruction may lead to a misconception, particularly in its implementation. This paper focuses on witnessing teachers' misconceptions regarding differentiated instruction in three major aspects: teacher-student relations, teacher-learning design, and teacher-learning goals, using a mixed method with …

The Effectiveness Of Item Parceling To Increase The Model Fit: A Case Study Of Paps, Anindita Dwi Hapsari, Wahyu Widhiarso

Jurnal Penelitian dan Evaluasi Pendidikan

The impact of item parceling to improve model fit indexes in confirmatory factor analysis has been on debate amongst psychometricians. In this study, the effectiveness of item parceling was examined using Tes Potensi Akademik Pascasarjana (PAPS) or Postgraduate Academic Potential Test in Universitas Gadjah Mada. Item parceling approach, second-order approach, and item-based approach of confirmatory factor analysis (CFA) were used for examination. Data were collected from a sample of 1374 postgraduate candidates in 2017. The result found that model fit indices such as the chi-squared test, comparative fit index, Tucker-Lewis index, and standardized root mean square residual were improved in …

Measuring The Perceptions Of Prospective Teachers: Planning Technology-Based Learning During The Covid-19 Pandemic, Memet Sudaryanto, M. Zainudin

Jurnal Penelitian dan Evaluasi Pendidikan

Online learning planning presents unique challenges that aspiring teachers must prepare for. This study aims to identify potential teachers' perspectives on designing technology-based instruction. Competency dimensions were created based on the findings of focused group discussions (FGD) with teachers and lecturers, which resulted in aspects of social networking, managing digital identity, filtering, creating content, and reusing. Following the FGD, indicators of nine dimensions"”pre-learning, opening planning, material mastery, learning models, learning resources, student involvement, assessment of processes and results, interaction mastery, and closing learning"”were created. Samples were taken through simple random sampling of 250 prospective teachers in education study programs at …

Item Analysis Of Reading Comprehension Questions For English Proficiency Test Using Rasch Model, Henda Harmantia Dewi, Siti Maftuhah Damio, Sukarno Sukarno

REID (Research and Evaluation in Education)

The need to take English as a foreign language proficiency test (known as TOEFL [Test of English Language Proficiency]) has been gaining popularity in Indonesia. The increasing demands for such a test and its expensive cost have reinforced many institutions to develop TOEFL instruments and administer the test internally. However, constructing a test instrument is a complex process that makes conducting item analysis become more challenging. Meanwhile, item analysis is crucial to assess the items' quality. Therefore, this study reported the results of statistically analyzing 20 questions of TOEFL reading comprehension that were analyzed in terms of the test reliability, …

Evaluation Of English Language Improvement Program For Information System Graduates Using A Comparative Analysis Method, Ratih Purwasih, Rahimullaily Rahimullaily, Zikri Zikri

REID (Research and Evaluation in Education)

STMIK Indonesia Padang seeks to improve the quality of its graduates by providing several academic training in information systems science and soft skills. One of them is training to improve graduates' English skills, including English I and II, English for career, and TOEFL training. The purpose of the study was to evaluate the success of the English language improvement program given to graduates of STMIK Indonesia Padang by comparing the scores for all English programs. This research method is explanatory. Data processing and analysis used descriptive statistics and comparative mean analysis techniques with Friedman test statistics on 4 data groups …

Developing A Religiosity Scale For Indonesian Muslim Youth, Shodiq Abdullah, Warsiyah Warsiyah, Ju'subaidi Ju'subaidi

REID (Research and Evaluation in Education)

This study aims to construct and test the validity of the Islamic youth religiosity scale. The population in this study is Muslim students of senior high schools in Surakarta, Central Java, with a sample of 258 established using the random sampling technique. The data analysis used the Linear Structural Model. The result shows that the RMSEA (‰¤ 0.08) and GFI (‰¥ 0.09) values from the four dimensions (belief, ritual, social, commitment meet the standard values of compatibility with the respective values for RMSEA beliefs = 0.055 GFI = 0.94, RMSEA rituals = 0.026 GFI = 0.99, social RMSEA = 0.059 …

Pre-Service Teachers' Agentive Projections Toward Innovation In Online English Language Teaching (Elt) Classes, Santi Farmasari, Lalu Ali Wardana, Baharuddin Baharuddin, Amrullah Amrullah, Mh Isnaeni, Husnul Lail

REID (Research and Evaluation in Education)

This study examines the pre-service teachers' agentive projections toward innovation in online English Language Teaching (ELT) classes. Employing teacher agency theory, this instrumental case study views projections as agentive when they are informed by the students' ecological aspects (past and present), oriented to solve potential learning problems and improve learning outcomes. The study involved 84 pre-service teachers who were voluntarily asked to fill in a questionnaire, submit a lesson plan, and be interviewed. nVivo Pro was used to organize themes. The study indicates that the pre-service teachers, M=3.81, SD=.590, perceive that innovation in online ELT classes is closely related to …

Gaining A Deeper Understanding Of The Meaning Of The Carelessness Parameter In The 4pl Irt Model And Strategies For Estimating It, Timbul Pardede, Agus Santoso, Diki Diki, Heri Retnawati, Ibnu Rafi, Ezi Apino, Munaya Nikma Rosyada

REID (Research and Evaluation in Education)

Three popular models are used to describe the characteristics of the test items and estimate the ability of examinees under the dichotomous IRT model, namely the one-, two-, and three-parameter logistic models. The three-item parameters are discriminating power, difficulty, and pseudo-guessing. In the development of the dichotomous IRT model, carelessness or upper asymptote parameter was proposed, which forms a four-parameter logistic (4PL) model to accommodate a condition where a high-ability examinee gives an incorrect response to a test item when he/she should be able to respond to the test item correctly. However, the carelessness parameter and the 4PL model have …

Smartphone Application For Assessing Teacher Performance, Hesty Marlianawati, Suranto Suranto, Badrun Kartowagiran

REID (Research and Evaluation in Education)

This work seeks to design a smartphone application for assessing teacher performance utilizing a 4D development model modified with the Mardapi instrument development model of (1) define (defining); (2) design (deciding instrument requirements, determi­ning application media specifications, creating flowcharts, and creating storyboards); (3) develop (assemble instruments, code, execute tests, evaluate test results, and interpret measurement findings); and (4) disseminate (spread). Proof of the application's viability was established through product testing with 26 principals acting as application users and evaluations by material and media specialists. The content validity of the acquired results was evaluated using the Aiken method, and the construct …

The Development Of Measurement Instruments Of Sharia Students' Perceptions About Khilafah, Joko Subando, Muhammad Kurniawan Budi Wibowo, Farkhani Farkhani

REID (Research and Evaluation in Education)

This study aims to develop an instrument to measure Sharia students' perception of the Khilafah. The research applied the ADDIE development research approach. The activity began with reviewing Taqiyuddin An-Nabhani's books and articles about Khilafah to get the instrument construct (analysis). The next stage was to compile the grid and assemble the instrument items (design). The items of the assembled instrument were then assessed by 11 experts (development). The validated Instruments were then carried out with limi­ted and expanded trials. The limited trial was conducted on 26 students at Universitas Islam Negeri (UIN) Salatiga, and the expanded trial was …

Development And Validation Of A Self-Assessment-Based Instrument To Measure Elementary School Students' Attitudes In Online Learning, Ari Setiawan, Wiputra Cendana, Mark Ayres, Azim Abdurakhmanovich Yuldashev, Sri Panca Setyawati

REID (Research and Evaluation in Education)

Online learning during the COVID-19 pandemic makes it difficult for teachers to assess student learning attitudes. Limited availability of instruments to measure attitudes of students when they are engaged in online learning leads to difficulty of teachers to conduct appropriate assessments on that measure. The current study, therefore, mainly was intended to produce a self-assessment-based instrument that is feasible to use to measure students' attitudes in online learning. In order to produce such instrument, we used developmental research method by following steps in the instrument design that is proposed by McCoach, Gable, and Madura. Furthermore, in order to provide feasibility …

Determinant Factors Affecting The Research Performance Of Lecturers Receiving External Funds, Haryanto Haryanto, Nur Kholis, Samsul Hadi, Ezi Apino, Muh. Asriadi Am, Cerry Kartika Trizkyana

REID (Research and Evaluation in Education)

Quality research can positively impact the development of science and technology and improve the reputation of universities. This study investigates the determinant factors that affect the research performance of lecturers who obtain external funding. The sample was 41 lecturers who obtained external research funds from various institutions (e.g., Directorate of Research, Technology and Community Service, Ministry of Education, Culture, Research and Technology of the Republic of Indonesia; National Research and Innovation Agency of the Republic of Indonesia; and similar institutions) for the last three years (2021 - 2023). Cluster analysis using secondary data (Science and Technology Index or SINTA data) …

Comparison Of Item Characteristic Analysis Models Of Reading Literacy Test With Polytomous Item Response Theory, Firyal Nabila Harsana, Heri Retnawati, Septinda Rima Dewanti, Rogers Andrew Lumenyela, Maulana Fatahillah Adzima, Atut Reni Septiana

REID (Research and Evaluation in Education)

This study aims to compare the analysis model of the characteristics of reading literacy items with the polytomous item response theory, which uses the Graded Response Model (GRM), Partial Credit Model (PCM), Generalized Partial Credit Model (GPCM), and Nominal Reasons Model (NRM). This research is quantitative research in nature, and secondary datawere used from about 1000 test takers’ responses to reading literacy items in the 2018 reading literacy study analyzed with the R program. This model comparison was carried out so that the analysis results obtained were more accurate in representing the level of reading literacy skills in Indonesia. The …

Measuring Students' Generic Skills Through National Assessment, Toha Makhshun, Bassam Abul A'La, Kusaeri Kusaeri

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to measure the generic skills (GS) of Madrasah Aliyah (MA) students in Indonesia. Respondents who participated in this study were madrasah students scattered in East Java and Central Java as representatives of MAs in Indonesia. The method used in this research is a survey distributed via Google Form. Three dimensions are mentioned in the research instrument for measuring GS: religious moderation, critical and creative thinking skills, and interpersonal skills. Using SPPS version 16 software, a descriptive analysis was employed as the data analysis technique. The results of this study showed that the GS of students with religious …

Instrument And Evaluation Of Students' Involvement In Learning Mathematics In 21-Century Skills At Senior High Schools Of Riau Province, Dedek Andrian, Leo Adhar Effendi

Jurnal Penelitian dan Evaluasi Pendidikan

Student engagement is the most crucial factor in learning activities because it is the main factor in improving student learning outcomes in class. This study aims to develop instruments and evaluate student involvement in learning mathematics to achieve maximum learning outcomes at school. The population in this study was all high school students in Riau Province. The sample is 150 high school students selected by multiple-stage random sampling based on high, medium, and low student achievement levels. Data analysis in this study was carried out four times: (1) data analysis based on the results of expert assessment of the instrument …

A Meta-Analysis Of The Relationship Between Self-Assessment And Mathematics Learning Achievement, Fransidha Sidhara Hadi, Janu Arlinwibowo, Gupita Nadindra Fatima

Jurnal Penelitian dan Evaluasi Pendidikan

This study uses a meta-analysis model to describe the relationship between self-assessment and achievement in learning mathematics. This meta-analysis covers articles published from 2011 to 2022 and is restricted to studies published in English. Indexed articles by Google Scholar were chosen. The data must meet these criteria: quantitative research, containing correlational research on the relationship between self-assessment and mathematics learning achievement (including correlation values and sample size). Through the data screening process with predetermined criteria, 12 research results were obtained, containing 43 studies to be analyzed. This meta-analysis uses a random effect model due to the heterogeneous data distribution. A …

Item Quality Analysis Using The Rasch Model To Measure Critical Thinking Ability In The Material Of The Human Digestive System Of Biology Subject In High School, Wanda Agus Prasetya, Anggi Tias Pratama

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to determine the quality of the Biology instrument items on the digestive system material with the Rasch model for analyzing critical thinking skills. The research employed a quantitative descriptive method involving 63 students of senior high schools in Yogyakarta. The data were collected using a critical thinking skills description test and processed using the Rasch model with the Winstep 5.0.3.4 program. The study shows that the overall validity is acceptable. The item validity did not require improvement in items 14, 3, 8, 13, 12, 1, 4, 10, 6, 2, 7, 11, 15, and 9, and required improvement …

A Study Of The Readiness Of Post-Pandemic Computer-Based Four-Tier Diagnostic Test (Cbftdt): A Review Of Economic Level, School Grades, And Device Accessibility, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Made Rai Shanti Ayub, Duden Saepuzaman, Rizki Zakwandi, Anisyah Rachman, Eri Yusron, Purwoko Haryadi Santoso

Jurnal Penelitian dan Evaluasi Pendidikan

Student readiness for using computer-based assessment was affected by economic level, school grade, and device accessibility. This study analyzed student readiness using a computer-based assessment, the four-tier diagnostic test (CBFTDT). The data in this study were students' responses to a questionnaire consisting of 16 statements about three aspects: mental access, skill access, and usage. The questionnaire consists of 16 statements with three aspects: items, media, and effectivity. The questionnaire was proved valid by experts and its estimated reliability score was 0.99. This study proved that the Student is still not ready to use the computer-based assessment, with an average readiness …

An Analysis Of Interaction Patterns In Students' Research Essay Guidance To Build Six Main Parameters Of The Indonesian National Qualification Framework: Covid-19 Pandemic Period, Undang Rosidin, M. Setyarini, Widyastuti Widyastuti

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to reveal the interaction patterns and inhibiting factors for the final project guidance in the Mathematics and Natural Sciences Education Department, Universitas Lampung, to develop the six main parameters of the Indonesian National Qualifications Framework (INQF). The study employed a mixed method involving 67 students who composed the final project for the 2021/2022 academic year selected from 314 final project students using the cluster random sampling technique. The data in this study were primary and secondary data obtained by questionnaires, interviews, and documents, analyzed qualitatively, quantitatively, and descriptively. The closed-response questionnaire was used regarding the interaction pattern, …

Developing An Instrument For Measuring Views On Muhammadiyah Ideology, Joko Subando, Muh Samsuri, Edy Muslimin

Jurnal Penelitian dan Evaluasi Pendidikan

This research aims at developing an instrument for measuring views on Muhammadiyah ideology that is valid and reliable. This study adapted Borg and Gall's development model through initial research, planning, initial product development, limited testing, product revision, expanded testing, and product revision. The steps started with initial research to obtain the ideology construct of books related to Muhammadiyah. The ideology construct obtained was used as the basis to arrange instrument items which were then validated by five experts in the fields of measurement, Muhammadiyah ideology, practitioners, and Muhammadiyah cadres by filling the sheet of variable appropriateness with indicators and indicators …

Comparing Item-Total Correlation And Item-Theta Correlation In Test Item Selection: A Simulation And Empirical Study, Sukaesi Marianti, Ana Rufaida, Nur Hasanah, Sofia Nuryanti

Jurnal Penelitian dan Evaluasi Pendidikan

One of the important processes in the evaluation of the psychometric properties of a test is item selection. The item selection process usually uses a very popular technique called item-total correlation. This study attempts to describe the item-total correlation technique and explore it using a similar technique called item-theta correlation. Both techniques are applied using simulation studies by creating several conditions related to test length and sample size. After the simulation study, the next step is the study using empirical data as an illustration of the results of the simulation study. The results of this study show that there are …

Assessment Of Geography Learning Process Standards In The Indonesian Curriculum: Instrument Development And Quality, Tuti Amalia, Muhammad Nursa'ban

Jurnal Penelitian dan Evaluasi Pendidikan

The need for mapping the achievement of geography learning process standards in the Indonesian curriculum can provide recommendations in accordance with the conditions in the field. This study aims to determine and describe the quality of geography learning process standard instruments in the Indonesian curriculum, namely: 1) content validity 2) construct validity 3) reliability. This research is instrument development research. The development stage used is the development stage of the instrument test by Heri Retnawati. The process of preparing the instrument, namely: determining the purpose of instrument preparation, searching for relevant theories, compiling indicators of instrument items, compiling instrument items, …

Development Of A Scientific Attitude Measurement Instrument For Dharmacariya Department Students At Stabn Using The Fishbein And Ajzen Model, Rahmat Syah, Daddy Darmawan, Syaiful Syamsuddin

Jurnal Penelitian dan Evaluasi Pendidikan

This study applies the Fishbein and Ajzen model to develop a Scientific Attitude Measurement Instrument for Students, focusing on attitudes, beliefs, and intentions towards scientific behaviors. The quantitative research employs an instrument development method, initially constructing dimensions reflecting various scientific attitudes such as attitudes towards the scientific method, collaboration, openness to knowledge, criticality, respect, honesty, independence, and interest in data analysis. The instrument measures students' scientific attitudes across three main dimensions: attitude, subjective norms, and behavioral control, aligning with the Fishbein and Ajzen model. It covers key aspects like attitudes towards the scientific method, emphasizing rigorous approaches like Popper's Falsification …

The Emotional Intelligence And Burnout Of In-Service English Teachers In Yogyakarta, Shabrina Yumna Azhra, Yasir Alsamiri, Nur Hidayanto Pancoro Setyo Putro

Jurnal Penelitian dan Evaluasi Pendidikan

Emotional intelligence and burnout of teachers are highly discussed in previous studies. This study set out to examine (1) the dimensions of emotional intelligence, (2) the dimensions of burnout, (3) the level of burnout, and (4) the relationship among the dimensions of in-service English teachers in Yogyakarta. The method used in this study is a quantitative correlational study through a survey. The instruments used were questionnaires adapted from the Maslach Burnout Inventory (MBI) and The Schutte Self-Report Emotional Intelligence Test (SSEIT). The participants of this study were 204 in-service English teachers in Yogyakarta. The data were analyzed using Confirmatory Factor …

Boundaries Of Empirical Approaches In Educational Research, Christopher Olusola Omoregie

Journal of Research Initiatives

This paper critically reviews the research done in education faculties in Nigerian universities. This research, though categorized in postgraduate schools or colleges as mainly in the liberal arts/humanities and the social sciences, depends on the theories and methodologies from other disciplines. The arts and social sciences are disciplines where undergraduates in education take courses in teaching to earn bachelor’s degrees, the postgraduate level offers varied opportunities for educational research to maximize the uniqueness of mixed method research for education.

The Impact Of Teacher Preparedness And Professional Development On Fourth-Grade Students' Science Achievement, Craig L. Mayo, Faye Bradley

Journal of Research Initiatives

Science scores among US fourth-grade students have declined compared to their international counterparts in recent years. Recent results show that teachers are the most impactful influence on student success and accountability. Teacher preparedness and professional development are two key areas that serve as indicators of providing relevant and essential information for students' success. A correlational quantitative study was conducted to assess the relationship between teacher preparedness and professional development on fourth-grade students’ science achievement. The TIMSS 2019 data were secured from the Boston College, TIMSS, and PIRLS International websites. The data was evaluated using the SPSS 27 Hierarchical Linear Regression. …

Health Profession Education Students’ Satisfaction Toward Online Courses During The Covid-19 Pandemic, Diantha Soemantri, Zhafirah Salsabila, Vernonia Yorasaki

Makara Journal of Health Research

Background: Given the extensive use of e-learning, especially during the COVID-19 pandemic, a validated instrument is deemed important for continuous evaluation. This study aimed to measure health profession education students’ satisfaction toward the e-learning process within all health sciences cluster (HSC) courses, following further validation of the satisfaction scale for the e-learning process.

Methods: A cross-sectional study using an exploratory factor analysis (EFA) was conducted to validate the 29-item Indonesian version of the satisfaction scale for the e-learning process. That the validated tool was used to measure 2,471 students’ satisfaction toward the e-learning process.

Results: The EFA …

Best Practices For English Learners With Disabilities In Us Schools – A Systematic Review, Samiratu Bashiru, Jennifer E. Smith

Journal of English Learner Education

This systematic review investigated best practices for enhancing academic achievement among English Learners with Disabilities (ELDs) in US schools. By examining 17 peer-reviewed articles and comparing them to the CEC 2014 Quality Indicators, the study identifies significant practices, including culturally responsive methods, technology integration, evidence-based strategies, addressing service delivery challenges, and improving assessment tools. This review has limitations related to inconsistent terminology and highlights the need for standardized language and continued research. It recommends integrating culturally responsive practices, leveraging technology, and refining inclusive assessment tools. This review provides educators, policymakers, and researchers insights, emphasizing ongoing teacher development and policy alignment …

Self-Compassion As Moderator Of Istiqomah Learning And Perfectionism In High School Students, Adhitia Wardani Fauzyyah, Lydia Freyani Hawadi, Mulawarman Hannase

Journal of Middle East and Islamic Studies

Abstract

The stages of adolescent development are generally at the age of high school students who are equipped with developmental tasks to have a good self-identity. Previous research mentioned that there was a public opinion that one form of achieving successful students' self-identity is that they succeed in becoming students at the State Higher Education Universities (PTN). In order to meet these perfect expectations, some students try to be istiqomah in learning by following tutoring program outside of school. By using quantitative research and data collection using purposive random sampling, this research tries to see how the relationship between …