Digital Commons Network^™

Pre-Service Teachers' Agentive Projections Toward Innovation In Online English Language Teaching (Elt) Classes, Santi Farmasari, Lalu Ali Wardana, Baharuddin Baharuddin, Amrullah Amrullah, Mh Isnaeni, Husnul Lail

REID (Research and Evaluation in Education)

This study examines the pre-service teachers' agentive projections toward innovation in online English Language Teaching (ELT) classes. Employing teacher agency theory, this instrumental case study views projections as agentive when they are informed by the students' ecological aspects (past and present), oriented to solve potential learning problems and improve learning outcomes. The study involved 84 pre-service teachers who were voluntarily asked to fill in a questionnaire, submit a lesson plan, and be interviewed. nVivo Pro was used to organize themes. The study indicates that the pre-service teachers, M=3.81, SD=.590, perceive that innovation in online ELT classes is closely related to …

Gaining A Deeper Understanding Of The Meaning Of The Carelessness Parameter In The 4pl Irt Model And Strategies For Estimating It, Timbul Pardede, Agus Santoso, Diki Diki, Heri Retnawati, Ibnu Rafi, Ezi Apino, Munaya Nikma Rosyada

REID (Research and Evaluation in Education)

Three popular models are used to describe the characteristics of the test items and estimate the ability of examinees under the dichotomous IRT model, namely the one-, two-, and three-parameter logistic models. The three-item parameters are discriminating power, difficulty, and pseudo-guessing. In the development of the dichotomous IRT model, carelessness or upper asymptote parameter was proposed, which forms a four-parameter logistic (4PL) model to accommodate a condition where a high-ability examinee gives an incorrect response to a test item when he/she should be able to respond to the test item correctly. However, the carelessness parameter and the 4PL model have …

Smartphone Application For Assessing Teacher Performance, Hesty Marlianawati, Suranto Suranto, Badrun Kartowagiran

REID (Research and Evaluation in Education)

This work seeks to design a smartphone application for assessing teacher performance utilizing a 4D development model modified with the Mardapi instrument development model of (1) define (defining); (2) design (deciding instrument requirements, determi­ning application media specifications, creating flowcharts, and creating storyboards); (3) develop (assemble instruments, code, execute tests, evaluate test results, and interpret measurement findings); and (4) disseminate (spread). Proof of the application's viability was established through product testing with 26 principals acting as application users and evaluations by material and media specialists. The content validity of the acquired results was evaluated using the Aiken method, and the construct …

The Development Of Measurement Instruments Of Sharia Students' Perceptions About Khilafah, Joko Subando, Muhammad Kurniawan Budi Wibowo, Farkhani Farkhani

REID (Research and Evaluation in Education)

This study aims to develop an instrument to measure Sharia students' perception of the Khilafah. The research applied the ADDIE development research approach. The activity began with reviewing Taqiyuddin An-Nabhani's books and articles about Khilafah to get the instrument construct (analysis). The next stage was to compile the grid and assemble the instrument items (design). The items of the assembled instrument were then assessed by 11 experts (development). The validated Instruments were then carried out with limi­ted and expanded trials. The limited trial was conducted on 26 students at Universitas Islam Negeri (UIN) Salatiga, and the expanded trial was …

Development And Validation Of A Self-Assessment-Based Instrument To Measure Elementary School Students' Attitudes In Online Learning, Ari Setiawan, Wiputra Cendana, Mark Ayres, Azim Abdurakhmanovich Yuldashev, Sri Panca Setyawati

REID (Research and Evaluation in Education)

Online learning during the COVID-19 pandemic makes it difficult for teachers to assess student learning attitudes. Limited availability of instruments to measure attitudes of students when they are engaged in online learning leads to difficulty of teachers to conduct appropriate assessments on that measure. The current study, therefore, mainly was intended to produce a self-assessment-based instrument that is feasible to use to measure students' attitudes in online learning. In order to produce such instrument, we used developmental research method by following steps in the instrument design that is proposed by McCoach, Gable, and Madura. Furthermore, in order to provide feasibility …

Determinant Factors Affecting The Research Performance Of Lecturers Receiving External Funds, Haryanto Haryanto, Nur Kholis, Samsul Hadi, Ezi Apino, Muh. Asriadi Am, Cerry Kartika Trizkyana

REID (Research and Evaluation in Education)

Quality research can positively impact the development of science and technology and improve the reputation of universities. This study investigates the determinant factors that affect the research performance of lecturers who obtain external funding. The sample was 41 lecturers who obtained external research funds from various institutions (e.g., Directorate of Research, Technology and Community Service, Ministry of Education, Culture, Research and Technology of the Republic of Indonesia; National Research and Innovation Agency of the Republic of Indonesia; and similar institutions) for the last three years (2021 - 2023). Cluster analysis using secondary data (Science and Technology Index or SINTA data) …

Comparison Of Item Characteristic Analysis Models Of Reading Literacy Test With Polytomous Item Response Theory, Firyal Nabila Harsana, Heri Retnawati, Septinda Rima Dewanti, Rogers Andrew Lumenyela, Maulana Fatahillah Adzima, Atut Reni Septiana

REID (Research and Evaluation in Education)

This study aims to compare the analysis model of the characteristics of reading literacy items with the polytomous item response theory, which uses the Graded Response Model (GRM), Partial Credit Model (PCM), Generalized Partial Credit Model (GPCM), and Nominal Reasons Model (NRM). This research is quantitative research in nature, and secondary datawere used from about 1000 test takers’ responses to reading literacy items in the 2018 reading literacy study analyzed with the R program. This model comparison was carried out so that the analysis results obtained were more accurate in representing the level of reading literacy skills in Indonesia. The …

Measuring Students' Generic Skills Through National Assessment, Toha Makhshun, Bassam Abul A'La, Kusaeri Kusaeri

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to measure the generic skills (GS) of Madrasah Aliyah (MA) students in Indonesia. Respondents who participated in this study were madrasah students scattered in East Java and Central Java as representatives of MAs in Indonesia. The method used in this research is a survey distributed via Google Form. Three dimensions are mentioned in the research instrument for measuring GS: religious moderation, critical and creative thinking skills, and interpersonal skills. Using SPPS version 16 software, a descriptive analysis was employed as the data analysis technique. The results of this study showed that the GS of students with religious …

Instrument And Evaluation Of Students' Involvement In Learning Mathematics In 21-Century Skills At Senior High Schools Of Riau Province, Dedek Andrian, Leo Adhar Effendi

Jurnal Penelitian dan Evaluasi Pendidikan

Student engagement is the most crucial factor in learning activities because it is the main factor in improving student learning outcomes in class. This study aims to develop instruments and evaluate student involvement in learning mathematics to achieve maximum learning outcomes at school. The population in this study was all high school students in Riau Province. The sample is 150 high school students selected by multiple-stage random sampling based on high, medium, and low student achievement levels. Data analysis in this study was carried out four times: (1) data analysis based on the results of expert assessment of the instrument …

A Meta-Analysis Of The Relationship Between Self-Assessment And Mathematics Learning Achievement, Fransidha Sidhara Hadi, Janu Arlinwibowo, Gupita Nadindra Fatima

Jurnal Penelitian dan Evaluasi Pendidikan

This study uses a meta-analysis model to describe the relationship between self-assessment and achievement in learning mathematics. This meta-analysis covers articles published from 2011 to 2022 and is restricted to studies published in English. Indexed articles by Google Scholar were chosen. The data must meet these criteria: quantitative research, containing correlational research on the relationship between self-assessment and mathematics learning achievement (including correlation values and sample size). Through the data screening process with predetermined criteria, 12 research results were obtained, containing 43 studies to be analyzed. This meta-analysis uses a random effect model due to the heterogeneous data distribution. A …

Item Quality Analysis Using The Rasch Model To Measure Critical Thinking Ability In The Material Of The Human Digestive System Of Biology Subject In High School, Wanda Agus Prasetya, Anggi Tias Pratama

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to determine the quality of the Biology instrument items on the digestive system material with the Rasch model for analyzing critical thinking skills. The research employed a quantitative descriptive method involving 63 students of senior high schools in Yogyakarta. The data were collected using a critical thinking skills description test and processed using the Rasch model with the Winstep 5.0.3.4 program. The study shows that the overall validity is acceptable. The item validity did not require improvement in items 14, 3, 8, 13, 12, 1, 4, 10, 6, 2, 7, 11, 15, and 9, and required improvement …

A Study Of The Readiness Of Post-Pandemic Computer-Based Four-Tier Diagnostic Test (Cbftdt): A Review Of Economic Level, School Grades, And Device Accessibility, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Made Rai Shanti Ayub, Duden Saepuzaman, Rizki Zakwandi, Anisyah Rachman, Eri Yusron, Purwoko Haryadi Santoso

Jurnal Penelitian dan Evaluasi Pendidikan

Student readiness for using computer-based assessment was affected by economic level, school grade, and device accessibility. This study analyzed student readiness using a computer-based assessment, the four-tier diagnostic test (CBFTDT). The data in this study were students' responses to a questionnaire consisting of 16 statements about three aspects: mental access, skill access, and usage. The questionnaire consists of 16 statements with three aspects: items, media, and effectivity. The questionnaire was proved valid by experts and its estimated reliability score was 0.99. This study proved that the Student is still not ready to use the computer-based assessment, with an average readiness …

An Analysis Of Interaction Patterns In Students' Research Essay Guidance To Build Six Main Parameters Of The Indonesian National Qualification Framework: Covid-19 Pandemic Period, Undang Rosidin, M. Setyarini, Widyastuti Widyastuti

Jurnal Penelitian dan Evaluasi Pendidikan

This study aims to reveal the interaction patterns and inhibiting factors for the final project guidance in the Mathematics and Natural Sciences Education Department, Universitas Lampung, to develop the six main parameters of the Indonesian National Qualifications Framework (INQF). The study employed a mixed method involving 67 students who composed the final project for the 2021/2022 academic year selected from 314 final project students using the cluster random sampling technique. The data in this study were primary and secondary data obtained by questionnaires, interviews, and documents, analyzed qualitatively, quantitatively, and descriptively. The closed-response questionnaire was used regarding the interaction pattern, …

Developing An Instrument For Measuring Views On Muhammadiyah Ideology, Joko Subando, Muh Samsuri, Edy Muslimin

Jurnal Penelitian dan Evaluasi Pendidikan

This research aims at developing an instrument for measuring views on Muhammadiyah ideology that is valid and reliable. This study adapted Borg and Gall's development model through initial research, planning, initial product development, limited testing, product revision, expanded testing, and product revision. The steps started with initial research to obtain the ideology construct of books related to Muhammadiyah. The ideology construct obtained was used as the basis to arrange instrument items which were then validated by five experts in the fields of measurement, Muhammadiyah ideology, practitioners, and Muhammadiyah cadres by filling the sheet of variable appropriateness with indicators and indicators …

Comparing Item-Total Correlation And Item-Theta Correlation In Test Item Selection: A Simulation And Empirical Study, Sukaesi Marianti, Ana Rufaida, Nur Hasanah, Sofia Nuryanti

Jurnal Penelitian dan Evaluasi Pendidikan

One of the important processes in the evaluation of the psychometric properties of a test is item selection. The item selection process usually uses a very popular technique called item-total correlation. This study attempts to describe the item-total correlation technique and explore it using a similar technique called item-theta correlation. Both techniques are applied using simulation studies by creating several conditions related to test length and sample size. After the simulation study, the next step is the study using empirical data as an illustration of the results of the simulation study. The results of this study show that there are …

Assessment Of Geography Learning Process Standards In The Indonesian Curriculum: Instrument Development And Quality, Tuti Amalia, Muhammad Nursa'ban

Jurnal Penelitian dan Evaluasi Pendidikan

The need for mapping the achievement of geography learning process standards in the Indonesian curriculum can provide recommendations in accordance with the conditions in the field. This study aims to determine and describe the quality of geography learning process standard instruments in the Indonesian curriculum, namely: 1) content validity 2) construct validity 3) reliability. This research is instrument development research. The development stage used is the development stage of the instrument test by Heri Retnawati. The process of preparing the instrument, namely: determining the purpose of instrument preparation, searching for relevant theories, compiling indicators of instrument items, compiling instrument items, …

Development Of A Scientific Attitude Measurement Instrument For Dharmacariya Department Students At Stabn Using The Fishbein And Ajzen Model, Rahmat Syah, Daddy Darmawan, Syaiful Syamsuddin

Jurnal Penelitian dan Evaluasi Pendidikan

This study applies the Fishbein and Ajzen model to develop a Scientific Attitude Measurement Instrument for Students, focusing on attitudes, beliefs, and intentions towards scientific behaviors. The quantitative research employs an instrument development method, initially constructing dimensions reflecting various scientific attitudes such as attitudes towards the scientific method, collaboration, openness to knowledge, criticality, respect, honesty, independence, and interest in data analysis. The instrument measures students' scientific attitudes across three main dimensions: attitude, subjective norms, and behavioral control, aligning with the Fishbein and Ajzen model. It covers key aspects like attitudes towards the scientific method, emphasizing rigorous approaches like Popper's Falsification …

The Emotional Intelligence And Burnout Of In-Service English Teachers In Yogyakarta, Shabrina Yumna Azhra, Yasir Alsamiri, Nur Hidayanto Pancoro Setyo Putro

Jurnal Penelitian dan Evaluasi Pendidikan

Emotional intelligence and burnout of teachers are highly discussed in previous studies. This study set out to examine (1) the dimensions of emotional intelligence, (2) the dimensions of burnout, (3) the level of burnout, and (4) the relationship among the dimensions of in-service English teachers in Yogyakarta. The method used in this study is a quantitative correlational study through a survey. The instruments used were questionnaires adapted from the Maslach Burnout Inventory (MBI) and The Schutte Self-Report Emotional Intelligence Test (SSEIT). The participants of this study were 204 in-service English teachers in Yogyakarta. The data were analyzed using Confirmatory Factor …

Boundaries Of Empirical Approaches In Educational Research, Christopher Olusola Omoregie

Journal of Research Initiatives

This paper critically reviews the research done in education faculties in Nigerian universities. This research, though categorized in postgraduate schools or colleges as mainly in the liberal arts/humanities and the social sciences, depends on the theories and methodologies from other disciplines. The arts and social sciences are disciplines where undergraduates in education take courses in teaching to earn bachelor’s degrees, the postgraduate level offers varied opportunities for educational research to maximize the uniqueness of mixed method research for education.

The Impact Of Teacher Preparedness And Professional Development On Fourth-Grade Students' Science Achievement, Craig L. Mayo, Faye Bradley

Journal of Research Initiatives

Science scores among US fourth-grade students have declined compared to their international counterparts in recent years. Recent results show that teachers are the most impactful influence on student success and accountability. Teacher preparedness and professional development are two key areas that serve as indicators of providing relevant and essential information for students' success. A correlational quantitative study was conducted to assess the relationship between teacher preparedness and professional development on fourth-grade students’ science achievement. The TIMSS 2019 data were secured from the Boston College, TIMSS, and PIRLS International websites. The data was evaluated using the SPSS 27 Hierarchical Linear Regression. …

Health Profession Education Students’ Satisfaction Toward Online Courses During The Covid-19 Pandemic, Diantha Soemantri, Zhafirah Salsabila, Vernonia Yorasaki

Makara Journal of Health Research

Background: Given the extensive use of e-learning, especially during the COVID-19 pandemic, a validated instrument is deemed important for continuous evaluation. This study aimed to measure health profession education students’ satisfaction toward the e-learning process within all health sciences cluster (HSC) courses, following further validation of the satisfaction scale for the e-learning process.

Methods: A cross-sectional study using an exploratory factor analysis (EFA) was conducted to validate the 29-item Indonesian version of the satisfaction scale for the e-learning process. That the validated tool was used to measure 2,471 students’ satisfaction toward the e-learning process.

Results: The EFA …

Best Practices For English Learners With Disabilities In Us Schools – A Systematic Review, Samiratu Bashiru, Jennifer E. Smith

Journal of English Learner Education

This systematic review investigated best practices for enhancing academic achievement among English Learners with Disabilities (ELDs) in US schools. By examining 17 peer-reviewed articles and comparing them to the CEC 2014 Quality Indicators, the study identifies significant practices, including culturally responsive methods, technology integration, evidence-based strategies, addressing service delivery challenges, and improving assessment tools. This review has limitations related to inconsistent terminology and highlights the need for standardized language and continued research. It recommends integrating culturally responsive practices, leveraging technology, and refining inclusive assessment tools. This review provides educators, policymakers, and researchers insights, emphasizing ongoing teacher development and policy alignment …

Self-Compassion As Moderator Of Istiqomah Learning And Perfectionism In High School Students, Adhitia Wardani Fauzyyah, Lydia Freyani Hawadi, Mulawarman Hannase

Journal of Middle East and Islamic Studies

Abstract

The stages of adolescent development are generally at the age of high school students who are equipped with developmental tasks to have a good self-identity. Previous research mentioned that there was a public opinion that one form of achieving successful students' self-identity is that they succeed in becoming students at the State Higher Education Universities (PTN). In order to meet these perfect expectations, some students try to be istiqomah in learning by following tutoring program outside of school. By using quantitative research and data collection using purposive random sampling, this research tries to see how the relationship between …

Authentic Leadership Measures: An Authentic Measure For Authentic Leadership?, Mitch Butterworth, Jessica Black, Robert Terry

The Journal of Values-Based Leadership

This study broadly addresses some of the criticisms associated with authentic leadership theory related to measurement and antecedents. Measurement: One purpose of this study was to verify the dimensionality of authentic leadership by testing the construct validity of three measures for authentic leadership: the Authentic Leadership Questionnaire (ALQ), the Authentic Leadership Inventory (ALI), and the Authentic Leadership Integrated Questionnaire (AL-IQ), proposed by Levesque-Cote et al. (2018) as an improvement on the previous two scales. This study was designed to replicate and extend Levesque-Cote et al. (2018) study with an English-speaking sample to further test the structural validity of the AL-IQ. …

School Improvement Tool Elaborations: Student Engagement And Wellbeing. Background Report And Literature Review, Fabienne Van Der Kleij, Pauline Taylor-Guy, Tanya Vaughan, Marijne Medhurst, Christina Rogers

School and system improvement

This literature review outlines the evidence that underpins the development of a set of evidence-informed elaborations, or specific practices, that support student engagement and wellbeing across the 9 domains of the National School Improvement Tool (NSIT). These observable, measurable practices to support student engagement and wellbeing have been developed from a review of relevant literature in the areas of socio-emotional learning (SEL), health and wellbeing, student engagement and a sense of belonging, and motivations for engagement. They also take account of commissioned research reports by the Queensland Department of Education and the Department's (2018) approach to student learning and wellbeing …

Evaluating Principal Effectiveness: A Review Of The Literature, Jerry Burkett

Journal of Educational Leadership in Action

The evaluation of a campus principal can be a challenging process due largely to the complicated factors that exist to capture an accurate assessment of a principal’s leadership effectiveness. Generally, principal evaluations are conducted by district-level officials who often do not have the time or the resources to observe campus principals on a regular basis. Further, principal evaluation systems (PES) are designed to improve the practice of principals (Clifford & Ross, 2012; Davis, Kearney, Sanders, Thomas, & Leon, 2011; Fuller & Hollingworth, 2014a; Fuller et al., 2015), and there has historically been an acknowledgment that these evaluations do not always …

The Virtual Counseling Transition And Its Influence On School Counselor Self-Efficacy, Tara Hornor, Lee A. Westberry

Journal of Educational Leadership in Action

The purpose of this qualitative study was to examine school counselors’ experiences transitioning to virtual counseling during the Covid-19 pandemic, the factors influencing their sense of confidence, and successes and challenges associated with the transition to virtual counseling. Study participants characterized the transition to virtual counseling as challenging and reported the process decreased their self-efficacy. Participants identified four salient categories of challenges associated with the transition to virtual counseling, including difficulty maintaining accountability and contact with students, decreased work/life balance, diminished sense of connection with students, and lack of preparation to conduct virtual school counseling. Successes resulting from the transition …

Title: Assessment Of Student Perception Regarding Clinical Training In Undergraduate Dental Programs Using Clin Ed Iq., Sanaa Ahmed, Samira Adnan, Syed Mahmood Haider

Internet Journal of Allied Health Sciences and Practice

Purpose. Clinical training is essential part of the dental curriculum. Both clinical environment and Teachers are essential factors which affect the acquired clinical skills. The objective was to assess the perceptions of dental students regarding their clinical training. Methods. This mixed method study using Clin Ed IQ questionnaire was conducted on Dental students graduating from both Private and Public sector institutes of Karachi. The questionnaire had four sections, the first three based on various aspect of clinical training, with responses based on 5-point Likert scale. Section four had open-ended items about dental curriculum. Results. For responses of 220 participants related …

Re-Thinking Education For Sustainable Development: Key Learning Insights From The Sdsn Usa Transformative Education Summit 2023, Radhika Iyengar, Sumie Song, Deepak Sridhar, Wendy M. Purcell, Ann Nielsen, Iveta Silova, Matthew A. Witenstein, Wen-Wen Tung

Educational Leadership Faculty Publications

This paper summarizes key learning insights from the 2023 U.S. Summit on Transformative Education organized by the Sustainable Development Solutions Network USA. Over 400 members from higher education institutions, non-governmental organizations, think tanks, students, and teachers, joined the online event held February 23-25. The Summit created a bridge between social justice issues with an historical lens and sustainable development. Learning insights include those shared by session speakers, dialogue among participants during thematic conversations and regional networking forums, comments made by attendees on session Jamboards and the Zoom Chat function, and post-Summit feedback. A high-level thematic review was undertaken to cluster …

Peer Feedback Among Nursing Students: Does It Enhance Learning?, Sydney Everett, Rachel Joseph, Tracey Turner, Dorothy Murphy

Wisdom & Compassion: The LUSON Journal

Background: The American Nurses Association (ANA) describes that peer review is essential for excellent nursing practice and describes the principles of Peer Review. The Magnet program has embraced this in clinical excellence. Peer feedback has multiple benefits.

Purpose: The purpose of this manuscript is to examine the literature on peer feedback and identify the benefits of peer feedback on student learning and information retention.

Methods: Search terms such as Peer assessment, peer coaching, peer tutoring, peer-assisted learning, and informal peer learning were used to retrieve peer-reviewed publications from databases such as CINAHL, PubMed, and Google Scholar. The term Peer feedback …