Educational Assessment, Evaluation, and Research Commons^™

Construct Validity Of Creative Thinking Skills Instrument For Biology Student Teachers In The Subject Of Human Physiology, Andi Ulfa Tenri Pada, Siti Salina Mustakim, Bambang Subali

Jurnal Penelitian dan Evaluasi Pendidikan

This article discusses the construct validity of the creative thinking skill instrument supporting a conation idea aspect for biology student-teachers in the subject of Human Physiology. Two hundred and eighteen students participated in this study. Construct validity was obtained through Confirmatory Factor Analysis technique (CFA). Reliability was estimated by composite reliability. Findings show that the construct validity and the reliability of the instrument are high. A thorough discussion on the findings and future implications are provided towards the end of this paper.

Developing Scale To Measure Student's Honesty Characters On Mathematics Learning Using Subject Scaling, Kana Hidayati, Budiyono Budiyono, Sugiman Sugiman

Jurnal Penelitian dan Evaluasi Pendidikan

The purpose of this study is to develop a scale to measure honesty characters of students on mathematics learning using sucject scaling model. This development research is carried out in several steps namely: preparing initial scales, trials, and interpretation of trials result. The research is conducted on students of SMP N 5 Yogyakarta, SMP Muhammadiyah 2 Yogyakarta, and SMPIT Abu Bakar Yogyakarta. The first trial involves 688 students and the second trial involves 696 students. Content validity is obtained through expert judgment. The construct validity is determined by Lisrel's second order CFA. Reliability coefficients include Omega coefficients (ω) and Alpha …

The Accuracy Of The Cheating Detection Methods In Large-Scale Tests: Mathematics National Examination, Thomas Mbenu Nulangi, Djemari Mardapi

Jurnal Penelitian dan Evaluasi Pendidikan

This study aimed to describe (1) the characteristics of items based on the Item Response Theory, (2) the cheating level in the implementation of the national examinartion based on Angoffs B-Index method, Pair 1 method, Pair 2 method, Modified Error Similarity Analysis (MESA) method, and G2 method, (3) the most accurate method to detect the cheating in the mathematics national examination at the senior secondary school level in the academic year of 2015/2016 in East Nusa Tenggara Province. The result of the item response theory analysis showed that 17 (42.5%) items of the mathematics national examination fit with the 3-PL …

Evaluasi Pemanfaatan Laboratorium Pada Diklat Pengendali Hama Dan Penyakit Ikan Di Balai Diklat Aparatur Kementerian Kelautan Dan Perikanan, Fajar Nugroho

Jurnal Penelitian dan Evaluasi Pendidikan

Keberadaan laboratorium menjadi hal yang penting dalam pelaksanaan Diklat Pengendali Hama dan Penyakit Ikan (PHPI) oleh karena itu Balai Diklat Aparatur (BDA) Kementerian Kelautan dan Perikanan (KKP) bekerjasama dengan Stasiun Karantina Ikan Kelas II Cirebon pada tahun 2014 membangun laboratorium uji karantina ikan di lingkungan kampus BDA KKP. Kajian ini bertujuan untuk mengevaluasi pemanfaatan laboratorium Diklat PHPI dengan mengukur perubahan kepuasan peserta terhadap ketersediaan media pembelajaran dan kelengkapan fasilitas belajar mengajar, nilai hasil belajar, peningkatan pengetahuan dan keterampilan peserta sebelum dan setelah laboratorium digunakan. Data diperoleh melalui pengisian angket/ kuesioner evaluasi pelaksanaan diklat kepada peserta. Validitas dan reabilitas instrumen telah …

An Evaluation Of Islamic Moral Teaching For Students Of Madrasah Aliyah Negeri (Man), Siti Amanah, Haryanto Haryanto

REID (Research and Evaluation in Education)

This research is aimed at evaluating: the preparation, implementation, and outcome of the moral teaching program using Stake Countenance evaluation model (antecedent, implementation, and outcome). The study was conducted at Madrasah Aliyah Negeri (MAN) Cilacap, MAN Kroya, and MAN Majenang. The subjects were the principals, teachers of Aqidah Akhlak, chairpersons of the Madrasah Committee, and 276 grade XII students. Interview, observation, questionnaire, and documentation were used as data collection techniques. The data analysis method used was the quantitative-qualitative descriptive analysis. The result of the evaluation shows that: (1) the preparation of the moral teaching is in 'good' category; (2) …

Developing An Instrument Of National Examination Of Equivalency Education Package C Of Mathematics Subject, Ian Harum Prasasti, Edi Istiyono

REID (Research and Evaluation in Education)

The national examination of equivalency education is a competency test to equalize non-formal education with formal education. Departing from the importance of the quality and expectations of the national examination of equivalency education package C mathematics subjects and because the results are inseparable from the implementation process, developing an evaluation instrument to assess the implementation of the national examination of equivalency education package C mathematics subjects is important. The purpose of this study is to develop a suitable instrument for conducting an evaluation of the national examination implementation of the equivalency education package C mathematics subject. The respondents in this …

Pengembangan Instrumen Asesmen Diri Guru Terhadap Aktivitas Pengembangan Keprofesian Berkelanjutan, Wirman Kasmayadi, Kumaidi Kumaidi, Sumarno Sumarno

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini bertujuan untuk mengembangkan instrumen asesmen diri guru pada aktivitas pengembangan keprofesian berkelanjutan yang handal. Metode penelitian yang digunakan adalah penelitian pengembangan yang mengacu pada lima tahapan dalam model Plomp. Subyek penelitian adalah guru SMA di Provinsi Nusa Tenggara Barat yang dipilih dengan teknik cluster random sampling. Jumlah subyek penelitian pada uji coba awal sebanyak 350 orang dan uji coba lapangan utama sebanyak 950 orang. Pengumpulan data menggunakan kuesioner skala Likers (1-5). Pengujian validitas isi menggunakan expert judgment, sedangkan validitas dan reliabilitas empiris menggunakan analisis faktor konfirmatori (CFA) dengan bantuan program Lisrel 8.80. Hasil penelitian menunjukkan bahwa: (1) konstrak …

Validitas Dan Reliabilitas Instrumen Asesmen Kinerja Literasi Sains Pelajaran Fisika Berbasis Stem, Khoirul Bashooir, Supahar Supahar

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini merupakan bagian dari penelitian pengembangan asesmen kinerja literasi sains berbasis STEM pada pembelajaran fisika. Tujuan dari penelitian ini adalah untuk mengungkapkan validitas isi, validitas empiris, dan reliabilitas instrumen asesmen kinerja literasi sains berbasis STEM yang sebelumnya telah disusun. Instrumen yang dikembangkan berupa lembar pengamatan dan tes pilihan ganda. Analisis validitas isi dari lembar pengamatan menggunakan Koefisien V oleh Aiken sedangkan validitas isi instrumen tes dianalisis dengan menggunakan CVI (Content Validity Index) oleh Lawshe. Validitas empiris reliabilitas instrumen tes diestimasi dengan IRT (Item Response Theory). Reliabilitas lembar pengamatan ditentukan dengan ICC (Item Correlation …

Developing Higher-Order Thinking Skill (Hots) Test Instrument Using Lombok Local Cultures As Contexts For Junior Secondary School Mathematics, Syukrul Hamdi, Iin Aulia Suganda, Nila Hayati

REID (Research and Evaluation in Education)

The study was aimed at producing a valid and reliable higher-order thinking skill (HOTS) test instrument using Lombok local cultures as contexts in the junior secondary school mathematics subject matter. The study is developmental research involving a field try-out of 75 students of Grade VIII. Data were analyzed using classical test theories of difficulty levels, discriminating powers, and functioning distractors. The test validity is assessed using the Aiken formula and reliability is estimated by Cronbach Alpha. Findings show that, of the 20 initial multiple-choice items, 15 were valid and reliable and had the characteristics of good test items with a …

Comparing The Methods Of Vertical Equating For The Math Learning Achievement Tests For Junior High School Students, Chairun Nisa, Heri Retnawati

REID (Research and Evaluation in Education)

Developing the students' mathematical ability needs to be carried out to improve the teaching process. This is very important for continuous education. This study aimed to describe: (1) the characteristics of the mathematics achievement tests for grades VII and VIII; (2) the equity constant of the vertical equating result of the mathematics achievement; (3) the accuracy of the mean & mean method, mean and sigma, Haebara characteristics curve, Stocking & Lord characteristics curve methods in the vertical equating of the tests for grades VII and VIII. The data were the students' scores for the Higher Order Thinking tests collected with …

Continuing Professional Development (Cpd) For Junior High School Mathematics Teachers: An Evaluation Study, Pika Merliza, Heri Retnawati

REID (Research and Evaluation in Education)

Responding to the importance of conducting evaluation on continuing professional development program for teachers, this study is aimed at describing the implementation and difficulty of Continuing Professional Development (CPD) of mathematics teachers of Junior High School (JHS) in Bandar Lampung, Indonesia. This research used a descriptive approach employing a quantitative-qualitative method with sequential explanatory strategy. The population of the research was 181 junior high school mathematics teachers who have already become civil servants. The samples were 63 teachers for quantitative research selected using stratified random sampling and proportional random sampling technique, while eight teachers for qualitative research were selected using …

Technology-Enhanced Pre-Instructional Peer Assessment: Exploring Students' Perceptions In A Statistical Methods Course, Yosep Dwi Kristanto

REID (Research and Evaluation in Education)

There has been strong interest among higher education institution in implementing technology-enhanced peer assessment as a tool for enhancing students' learning. However, little is known on how to use the peer assessment system in pre-instructional activities. This study aims to explore how technology-enhanced peer assessment can be embedded into pre-instructional activities to enhance students' learning. Therefore, the present study was an explorative descriptive study that used the qualitative approach to attain the research aim. This study used a questionnaire, students' reflections, and interview in collecting student's perceptions toward the interventions. The results suggest that the technology-enhanced pre-instructional peer assessment helps …

Performance Assessment And The Factors Inhibiting The Performance Of Buddhist Education Teachers In The Teaching Duties, Hesti Sadtyadi

REID (Research and Evaluation in Education)

This research aims to examine the components and inhibiting factors of the teacher's work performance in the teaching assignments of Buddhist education teachers. The authors believe that the theoretical as well as the practical problems of Buddhist education teachers can be solved by examining its components and the inhibiting factors. This research was developmental research that begins by compiling the component of performance instrument and the inhibiting factors instrument through Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). The data were then analyzed through regression analysis. The subjects of research were Buddhist education teachers in Central Java, Indonesia. The …

Mapping Of Physics Problem-Solving Skills Of Senior High School Students Using Physpross-Cat, Edi Istiyono, Wipsar Sunu Brams Dwandaru, Revnika Faizah

REID (Research and Evaluation in Education)

Evaluation using computerized adaptive tests (CAT) is an alternative to paper-based tests (PBT). This study was aimed at mapping physics problem-solving skills using PhysProSS-CAT on the basis of the item response theory (IRT). The study was conducted inSleman Regency, Yogyakarta, involving 156 students of Grade XI of senior high school. Sampling was done using stratified random sampling technique. The results of the study show that the PhysProSS-CAT is able to accurately measure physics problem-solving skills. Students' competences in physics problem solving can be mapped as 6% of the very high category, 4% of the high category, 36% of the medium …

Assessing Mechanistic Reasoning: Supporting Systems Tracing, Paul J. Weinberg

Journal of Pre-College Engineering Education Research (J-PEER)

Reasoning about mechanism is central to disciplined inquiry in science and engineering and should thus be one of the foundations of a science, technology, engineering, and mathematics education. In addition, mechanistic reasoning is one of the core competencies listed in the Next Generation Science Standards (NGSS) Engineering Concepts and Practices (NGSS Lead States, 2013). Mechanistic explanations focus on the processes that underlie cause–effect relationships and consider how the activities of system components affect one another.

While some assessment work has been accomplished in engineering education, to date mechanistic reasoning is an area where limited assessment development has been accomplished for …

The Better Player In The Chinese Educational Reform, Party Secretary Or School Principal?, Qian Zhao, Yuwei Liang

Journal of Organizational & Educational Leadership

In the “top-down” reform of the teacher personnel system, the principal is the core of policy implementation, who also serves as the secretary of the Party organization. We focus on which type of leadership should principals choose to maximize his impact on teachers' professional ability and work stress. The HLM method was used to conduct a longitudinal study of teachers in Mentougou District of Beijing from 2013 to 2015. 603 teachers from 34 schools participated in this research. It is found that the policy couldn’t affect teachers directly, the principals plays a role as a bridge between them. Taking the …

The Effect Of Feedback Given On Informal Assessments And Its Continued Effect On Formal Assessments, Britta Teeples, Britta Teeples

Dissertations, Theses, and Projects

This quantitative study investigates the use of immediate and delayed answer corrective feedback provided on informal assessments, with the use of technological tools, and its impact on formal assessments on senior level, high school students from a rural Minnesota high school. Specifically, this study investigated the impact of both immediate and delayed answer corrective feedback to determine if both/either are effective in helping improve students formally. Students participated in an eight-week study in which two smaller sections were provided immediate answer corrective feedback informally, with the use of Kahoot. An additional (one) section was provided delayed answer corrective feedback with …

Copyright And Open Access

Journal of Science Education for Students with Disabilities

No abstract provided.

Attitudes To Interprofessional Education Among Health Science Students Engaging In A Multidisciplinary Workshop Series, Emer M. Guinan, Emer M. Barrett, Freda Neill, Tamasine Grimes, Derek Sullivan, Maria O'Sullivan, Aileen Patterson, Tadhg Stapleton, Irene Walsh, John J. Walsh, Kevin C. Conlon

International Journal of Health Sciences Education

Introduction: Interprofessional education (IPE) provides an opportunity for students from single-professions to interact with other disciplines. Student attitude to IPE can impact engagement and change in attitude may provide an indicator of the impact of IPE. This study examines pre-workshop attitudes to IPE and change in attitude following a series of three IPE workshops.

Methods: Preworkshop attitudes were examined using the Readiness for Interprofessional Learning Scale (RIPLS) and the Interprofessional Education Perception Scale (IEPS). The IEPS was repeated at the start of Workshop 1 and at the end of Workshop 3. Data were analyzed using linear regression analysis and linear …

Conceptualizing Equity In The Implementation Of California Education Finance Reform, Taylor N. Allbright, Julie A. Marsh, Michelle Hall, Laura Tobben, Lawrence O. Picus, Magaly Lavadenz

Education Faculty Articles and Research

We examine how district administrators’ conceptions of equity relate to the implementation of finance reform. We use sensemaking theory and four views of equity—libertarian, liberal, democratic liberal, and transformative—to guide a case study of two districts, finding evidence of two conceptions of equity: (1) greater resources for students with greater needs and (2) equal distribution of resources for all students. One district demonstrated an organization-wide belief in the first conception, whereas the other conveyed individual-level understandings of both conceptions. These beliefs were mirrored in resource allocation decisions and informed by districts’ student demographics, organizational identities, and perceptions of adequacy.

The Impact Of The Dual-Enrollment Modality On Subsequent Collegiate Performance, Daniel Archer

Electronic Theses and Dissertations

Dual-enrollment College Algebra is offered in three modalities: at the college, at the high school, and online. The purpose of this study was to examine if the dual-enrollment College Algebra modality impacts early collegiate performance. A program evaluation was conducted using a causal-comparative design to explore potential cause-and-effect relationships between the dual-enrollment College Algebra modalities and five outcomes. The population included Oklahoma State System of Higher Education students who completed dual-enrollment College Algebra and subsequently earned freshman College Algebra postrequisite math grades, freshman College Algebra postrequisite science grades, or college credit in the fall semester after high school graduation. One-way …

Assessment Strategies To Promote Peer Learning In An Online Course, Pauline Rooney, Caitríona Ní Shé

Papers, presentations and other resources

The value of peer learning in higher education is now well recognised. Just as we continually learn from eachother in our everyday lives, so our students also learn from eachother as part of informal and formal learning experiences. Within educational programmes, peer learning is facilitated through a variety of pedagogical strategies which promote active participation, collaboration and the sharing of knowledge and ideas. With the increasing ubiquity of social networking and online learning platforms, new opportunities for facilitating peer learning, have emerged. Within online courses – where students often study at geographically disparate locations – peer learning strategies assume arguably …

My Experience Teaching General Chemistry To A Student Who Is Visually Impaired, Katherine M E Stewart

Journal of Science Education for Students with Disabilities

This paper summarizes my experience with teaching a first-year, General Chemistry course to a visually impaired student. This includes accommodations and modifications for both the lecture material and the laboratory. Included are also examples of formats and syntax for txt-based quizzes, tests, and laboratory reports, as well as other general accommodations for both the student and the service dog.

Science Instruction For Secondary Students With Emotional Or Behavioral Disorders: A Guide For Curriculum Development, Tal Slemrod, Leah Wood, Shelley Hart, William Coleman

Journal of Science Education for Students with Disabilities

This article provides a step-by-step guide for the organization and development of science lessons and units, to support the academic and behavioral performance of secondary students with challenges with related disabilities. This clinical practice guide provides a process for curriculum development for students with emotional or behavior disorders (EBD) in the science classroom. Steps include recommendations, goals, and examples for administrators and educators to discover appropriate plans and interventions to promote engagement and learning, including supporting success on State mandated High Stakes Assessments.

Implications Of 3-D Printing For Teaching Geoscience Concepts To Students With Visual Impairments, Karen E. Koehler, Tiffany A. Wild, Sean Tikkun

Journal of Science Education for Students with Disabilities

This article presents the results of a study on the use of 3-D printed models in a science classroom for students with visual impairments and examines whether the use of these models impacts student conceptual understanding and misconceptions related to geosciences concepts, specifically plate tectonics.

Data were collected one week prior to instruction, one week after instruction and throughout the 3-week instructional period. Results showed that students with visual impairments held many of the same misconceptions about plate tectonics as students who are typically sighted. All students in this study had fewer misconceptions after the instructional period than they held …

An Evaluative Study Of A Health Information Management Program Following A Significant Curricular Change, Jennifer Lynn Peterson

Theses and Dissertations

The advent of electronic health records (EHRs) has led to significant changes in the role of those who managing patient health information, Health Information Management (HIM) professionals. These changes have further led to significant changes in the educational training required for HIM professionals, leading to new curriculum requirements. Based on the need for well-prepared professionals in the changing HIM environment, it is essential to insure that educational programs are effectively preparing students for the new roles they will be expected to fill. This study is an in-depth case study of the HIM academic program at Illinois State University. The purpose …

Queensland Teacher Workload Study: Final Report To The Queensland Teachers’ Union, Sheldon Rothman, Lawrence Ingvarson, Darren Matthews

Teacher workforce and careers

The Australian Council for Educational Research (ACER) conducted an online survey of members on behalf of the Queensland Teachers’ Union (QTU). The survey was open to teachers, school leaders (principals and assistant principals) and heads of program working in Queensland government schools. It was based on one conducted for the Victorian branch of the Australian Education Union (AEU) in 2016 and the AEU – Tasmanian Branch in 2017. The survey of the work of union members in Queensland government schools focussed on the hours of work by school staff, staff perceptions of their work, and the relationship between work practices …

Voluntary Professional Development In Thailand: Teachers’ Motivation, Professional Life Phase, And Contingencies Of Self-Worth, Pongwat Fongkanta

Dissertations

To address the increasing focus on teacher proficiency, professional development opportunities for teachers are routinely provided in Thailand. The focus of this work is on professional development at the individual level and addresses teachers’ motivation for self-improvement and their own worth. Specifically, the purpose of this study was to first validate the relative importance of teachers’ motivation for participating in voluntary professional development and contingencies of self-worth. Secondly, the study sought to determine the relationship of the indicators that contribute to teacher participation with contingencies of self-worth. Lastly, this study examined in what way professional life phase may be related …

Risky Business: Pilot Of The Social Norms Program For Secondary Schools, Katherine Dix, Toby Carslake

Wellbeing

Intent on contributing to drug and alcohol education in secondary schools, Life Education set out in 2017 to explore the viability of using a social norms approach that confronted young people's misconceptions about risk-taking behaviours amongst their peers. A literature review (Ahmed, Mitchell & Trevitt, 2018) provided strong foundations for developing and piloting Australia's first social norms-based drug and alcohol program for secondary school students. Norms are considered to have a behavioural dimension – how the majority of people in a group behave – as well as an attitudinal dimension – how this majority believes they and others should behave. …

Young Women In Stem: An Analysis Of Outreach Programs For Middle School Girls, Rachel Lundeen

Honors Projects

Historically, and still presently, women face many obstacles when attempting to pursue science, technology, engineering, and math (STEM) fields. Women have been systematically barred from entering STEM programs at universities and today face cultural obstacles, resulting in marginalization. Research points to adolescence as the age where this sense of marginalization begins to develop. As a result, many outreach programs for young women interested in STEM are targeted toward the middle school age group. This study adds to this research by examining two such outreach programs for young women in STEM to determine their effectiveness, including Camp GEMS at Ohio Northern …