Educational Assessment, Evaluation, and Research Commons^™

Investing In Teachers, Australian Department Of Foreign Affairs And Trade Office Of Development Effectiveness, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs

Initial Teacher education

This evaluation compares evidence from the literature with Australia’s experience in supporting teacher development in a range of developing countries. It uses case studies to good effect in explaining choices made, the extent to which expectations were or were not met, and the lessons for future Australian assistance for teacher development. The evaluation found mixed results. In cooperation with governments and other donors, Australia has made positive contributions, such as improving teacher frameworks and curriculums, and training teachers through a range of interventions. However, there is room to improve—for example, in enhancing policy, strengthening analysis and negotiating new investments—so teacher …

An Evaluation Of Formative Audio Feedback Within Part Time Professional Development Programmes In Dit., Claire M. Mcdonnell, Roisin Donnelly, Claire Mcavinia

Other resources

Evidence from the literature indicates that learners often view feedback in terms of assessment only, even though it can play an important role in improving engagement and consolidating and enriching learning. It is well accepted that the feedback strategy used should be appropriate to the purpose and context of the work, but in order for feedback to be truly helpful, it needs to be goal-referenced, tangible, transparent, actionable, user-friendly (specific and personalized), timely, ongoing and consistent. Technology can also play a useful supporting role in achieving this. This paper explores the impact of formative audio feedback across part time programmes …

Exploring Stakeholders' Perceptions Of The Evaluation Of Early Fieldwork Experience In An Undergraduate Teacher Preparation Program, Amber R. Peacock

Theses and Dissertations

This study is a qualitative meta-evaluation of the early field experience (EFE) program at a small, private, undergraduate teacher preparation program in Virginia focusing on the perceptions of preservice teachers, cooperating teachers and course instructors about the EFE evaluation objectives, evaluation experience, and resulting data usage. The EFE evaluation protocol at the study site is explored using a participatory-oriented evaluation model that solicited the perceptions of stakeholders. Analysis of EFE evaluation documents and semi-structured interviews with the stakeholders were conducted to explore the extent to which (1) official EFE objectives are congruent with the EFE evaluation, (2) the intended evaluation …

Exemplary Teachers' Perspectives On Effective Teaching Elements In Danielson's Framework For Teaching, Derek Jon Olson

Walden Dissertations and Doctoral Studies

Reforms in teacher evaluation are enacted to increase student achievement. Although there is research on teacher evaluation and teacher quality, there is little that addresses effective teaching as conceptualized in Danielson's Framework for Teaching, a commonly used evaluation tool. The purpose of this quantitative study was to determine which of the 4 domains and 76 elements of Danielson's framework are viewed by award-winning teachers as having the greatest impact on effective teaching and learning. Constructivism formed the theoretical basis for this study. The research questions examined to what extent state and national teachers of the year perceive differences in the …

K-5 Elementary Balanced Literacy Reading Program Implementation Evaluation, Suzanne Marie Anderson

Walden Dissertations and Doctoral Studies

Students who struggle with reading in their elementary years are likely to make poor academic progress, leave school before graduation, and struggle in the workplace. The district leaders at 24 K-5 elementary schools in a large Midwestern district were interested in a formative reading program evaluation to determine reading program effectiveness. This mixed methods study, approached from a cognitive and social theoretical framework, was a formative evaluation of the Balanced Literacy Reading Program implementation at these elementary schools. The purpose of this study was to capture the K-5 classroom teachers' (n = 113), instructional coaches' (n = 18), and principals' …

Pengembangan Instrumen Evaluasi Cipp Pada Program Pembelajaran Tahfiz Al-Qur'an Di Pondok Pesantren, Muyasaroh Muyasaroh, Sutrisno Sutrisno

Jurnal Penelitian dan Evaluasi Pendidikan

Studi ini bertujuan untuk: (1) menghasilkan model pengembangan evaluasi program pembelajar'an tahfiẓ al-Quran diberi nama Coni P2, (2) menghasilkan teknik pelaksanaan evaluasi program pembelajaran tahfiẓ al-Qur'an, dan (3) menghasilkan struktur komponen dan indikator model evaluasi. Studi ini merupakan penelitian dan pengembangan (R&D) dengan menggunakan sembilan langkah dari 10 langkah model Borg dan Gall. Jumlah subjek uji coba pertama 33 orang, uji coba kedua 49 orang, dan uji coba ketiga 224 orang. Komponen model evaluasi yang digunakan adalah model evaluasi Stufflebeam (CIPP). Langkah-langkah evaluasi yang digunakan adalah langkah Malcolm Provus. Teknik pengumpul data yang digunakan adalah Delphi, FGD, kuesioner, …

Pengembangan Model Evaluasi Pendidikan Kecakapan Hidup Pada Pendidikan Luar Sekolah, Sofyan Hadi, Yoyon Suryono

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini bertujuan untuk mengembangkan model evaluasi penyelenggaraan pendidikan life skills. Model pengembangan yang digunakan adalah research and development yang dikembangkan Borg dan Gall dengan pendekatan kuantitatif. Prosedur pengembangan dipetakan menjadi tahap pra-pengembangan, pengembangan, dan penerapan model. Berdasarkan hasil penelitian dapat disimpulkan (1) Model evaluasi life skills education (ELSEd) meliputi komponen input, proses, dan hasil pendidikan life skills, (2) Evaluasi model ELSEd memiliki kepekaan yang baik terhadap objek yang diteliti dan mengungkap data yang dihasilkan, (3) Tingkat koherensi instrument ELSEd sesuai dengan rancangan, (4) Karakteristik Model ELSEd berbeda dengan evaluasi model lain, (5) Reliabilitas butir ketiga komponen evaluasi …

Tech Edge Student Rubric Grades 2-3, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades 2-3.

Tech Edge Student Rubric K-1, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades K-1.

Tech Edge Student Rubric Grades 4-5, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades 4-5.

Hand Function Evaluation For Dental Hygiene Students, Sara Taft

Electronic Theses and Dissertations

Dental hygiene students may struggle in dental hygiene curriculum in regards to hand function. Currently, this is not an aspect dental hygiene programs screen for or have protocol in place to help students. The research in the study examined if hand function could improve with hand function exercises and if exercises improved instrumentation scores. During a 6-week pilot study, an occupational therapist tested the hand function of a cohort of dental hygiene students. The results were recorded and the students began a 6-week hand function exercise regimen. After 6 weeks the same evaluations were preformed and the pre- and posttest …

Successive Study Of Diversity Conference Evaluations Of Presenters By Race, Gender, Sexual Orientation, And Disability, Autumn M. Palmer, Christine M. Wilson, Judith Puncochar

Conference Presentations

A Midwestern university’s annual diversity conference hosts about 1,500 attendees from a campus of 9,000 students. Using a successive independent samples design, a series of cross-sectional surveys were conducted to answer the research question, how does a presenter’s race, gender, and ability/disability affect participant responses on conference evaluations. A review of the literature has determined that our research represents the largest and longest empirical study of a higher education diversity conference in the United States. The research is a comparative study of evaluation trends of conference attendees toward diversity conference presenters based on race, gender, and disability over eight years …

Developing An Exit Evaluation For A Public Service Graduate Program, Emma Gelsinger

Muskie School Capstones and Dissertations

Students in a public service graduate program vary in their motivation, background, professional experience and educational goals. This variety requires evaluations be tailored to the needs of students to ensure effective program development and improvement for the student experience. Student needs can range from assistance with a financial aid application or the effect of faculty advising on their graduate student experience. An exit evaluation that is easily accessible to students and useful to faculty and administrators is essential to any public service graduate program.

A combination of semi-structured interviews, background research, coursework from the Public Policy and Management graduate program, …

The Evaluation Of Impact The South Carolina System For Teacher And Student Advancement Professional Development Model Has On Teacher Dispositions, Andrew Hooker

Education Dissertations and Projects

Education is continually looking for ways to increase student achievement. This is appropriate because the goal of education is to increase student achievement. Student achievement has continued to be unpredictable throughout the country due to the many factors which present themselves throughout the educational process.

The purpose of this dissertation was to look at a specific professional development model, South Carolina System for Teacher and Student Advancement (SCTAP), to measure the impact this model had on teacher dispositions. The following research question guided this study: To what extent does the SCTAP professional development model impact teacher disposition within the following: …

Evaluation Of Gogirlgo!; A Practitioner Based Program To Improve Physical Activity, Jennifer L. Huberty, Danae M. Dinkel, Michael W. Beets

Health and Kinesiology Faculty Publications

Background:
GoGirlGo! (GGG) is designed to increase girls’ physical activity (PA) using a health behavior and PA-based curriculum and is widely available for free to afterschool programs across the nation. However, GGG has not been formally evaluated. The purpose of this pilot study was to evaluate the effectiveness of the GGG curricula to improve PA, and self-efficacy for and enjoyment of PA in elementary aged girls (i.e., 5-13 years).

Methods:
Nine afterschool programs were recruited to participate in the pilot (within subjects repeated measures design). GGG is a 12-week program, with a once a week, one-hour lesson with 30 minutes …

Validity Of The Educator Evaluation Instrument In The State Of West Virginia, Carla Howe

Wayne State University Dissertations

In the state of West Virginia, the educator evaluation system was implemented in 2010 as part of a comprehensive system of support to increase teacher effectiveness and student learning. As part of the system, the Educator Evaluation Instrument was developed to measure teachers' effectiveness. This study was conducted to determine whether the Educator Evaluation Instrument was valid for use in measuring effectiveness.

A hierarchical confirmatory factor analysis (HCFA) was conducted on the scores from the demonstration year. The data were not normal, nor was good model fit established based on the current model. Because good model fit could not be …

Pengembangan Model Evaluasi Kultur Sma, Siswanto Siswanto

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini bertujuan untuk 1) mengindentifikasi, 2) me-ngembangkan model evaluasi, dan 3) mengetahui kelayakan model evaluasi kultur SMA yang dikembangkan. Penelitian ini merupakan penelitian dan pengembangan. Langkah-langkah penelitian dan pe-ngembangan menggunakan acuan pokok dari Plomp, sedangkan penentuan jumlah subjek uji coba menggunakan acuan dari Borg & Gall. Hasil penelitian menunjukkan bahwa 1) keadaan kultur akademik yang berkembang di SMA saat ini terdiri atas enam aspek budaya, yaitu berprestasi dan berkompetisi, disiplin dan efisien, jujur dan terbuka, gemar membaca, teguran dan penghargaan, serta kerja sama dan kebersamaan; 2) keadaan kultur sosial yang ber-kembang di SMA saat ini terdiri atas sembilan aspek …

Evaluasi Kinerja Guru Sekolah Menengah Kejuruan Sumatera Barat Pascasertifikasi, Ramli Ramli, Nizwardi Jalinus

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini bertujuan untuk mengevaluasi (1) tingkat capaian UU no. 14 tahun 2005 tentang guru dan dosen, (2) beban mengajar guru SMK yang telah disertifikasi, dan (3) dampak sertifikasi ter-hadap kinerja guru di mata masyarakat. Metode penelitian yang di-gunakan deskriptif, populasi sebanyak 954 orang guru, sampel di-pilih sebanyak 247 orang dengan teknik random sampling. Data di-kumpulkan dengan angket dan dianalisis menggunakan teknik des-kriptif. Hasil penelitian ini menunjukkan bahwa (1) secara umum guru SMK telah memenuhi kriteria UU No. 14 Tahun 2005 ten-tang Guru dan Dosen; (2) sebagian besar guru SMK telah mem-peroleh beban mengajar yang sesuai dengan yang ditetapkan …

Modification And Adaptation Of The Program Evaluation Standards In Saudi Arabia, Mohammed Alyami

Dissertations

The Joint Committee on Standards for Educational Evaluation’s Program Evaluation Standards is probably the most recognized and applied set of evaluation standards globally. The most recent edition of The Program Evaluation Standards includes five categories and 30 standards. The five categories are Utility, Feasibility, Propriety, Accuracy, and Evaluation Accountability. In recent years, evaluation has grown into a global practice with more than sixty national evaluation associations around the world. Examples include Japan, Malaysia, Sri Lanka, Mongolia, Russia, Brazil, Colombia, Peru, South Africa, Zimbabwe, Niger, and New Zealand. Because countries differ from one another in context and culture, they may need …

Reflections On A Decade Of Global Rankings: What We've Learned And Outstanding Issues, Ellen Hazelkorn

Articles

Ten years after the first global rankings appeared, it is clear that they have had an extraordinary impact on higher education. While there are fundamental questions about whether rankings measure either quality or what’s meaningful, they have succeeded in exposing higher education to international comparison. Moreso, because of the important role higher education plays as a driver of economic development, rankings have exposed both an information deficit and national competitiveness. Accordingly, both nations and institutions have sought to maximise their position vis-á-vis global rankings with positive and perverse effects. Their legacy is evident in the way rankings have become an …

The Impact Of National And International Assessment Programmes On Education Policy, Particularly Policies Regarding Resource Allocation And Teaching And Learning Practices In Developing Countries, Maura Best, Pat Knight, Petra Lietz, Craig Lockwood, Dita Nugroho, Mollie Tobin

Assessment and Reporting

There is a documented global rise in the number of countries undertaking national learning assessments, as well as international and regional learning assessments. Much of this growth, especially in national learning assessments, has occurred in economically developing countries. Little is known, however, on how these assessments affect education policy and practice in developing countries. This review examined the impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries. This particular focus on policies regarding resources and teaching and learning practices stemmed from an observation that, particularly in …

An Empirical Examination And Metaevaluation Of The Impact Evaluation Process, Anne Maechling Blake

Wayne State University Dissertations

This dissertation empirically examines the Guerra-Lopez (2007a) Impact Evaluation Process (IEP), which is a prescriptive program evaluation model. Since there is no generally accepted process for arriving at final judgments about the usefulness, appropriateness, effectiveness, reliability, and validity of evaluation models, this study used a combination of approaches to begin to build a body of evidence about the effectiveness of the IEP. Primarily, the study used Stufflebeam's (2011) recently revised Program Evaluations Metaevaluation Checklist to examine the model. The Checklist is based on the Joint Committee on Standards for Educational Evaluation's (2010) Program Evaluation Standards. Fitzpatrick, Sanders, & Worthen (2011) …

Self-Assessment Of Employability Skill Outcomes Among Undergraduates And Alignment With Academic Ratings, Denise Jackson

Research outputs 2013

Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in over- and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in more than 1000 Australian business undergraduates. It evaluates the extent to which student self-assessments differ from academics, in what ways and the influence of certain individual and background characteristics - such as stage of degree, gender and academic ability - on rating accuracy. Explanations for documented disparities are presented, in addition to implications and strategies …

Evaluasi Mata Kuliah Piano Untuk Menghasilkan Guru Musik Di Sekolah, Diah Latifah

Jurnal Penelitian dan Evaluasi Pendidikan

Studi ini bertujuan untuk mengevaluasi mata kuliah instrumen pilihan wajib piano dan relevansinya terhadap tujuan kurikulum Jurusan Pendi-dikan Seni Musik Universitas Pendidikan Indonesia yang berkomitmen untuk menghasilkan pendidik musik profesional. Untuk memenuhi tuntut-an ini, metode penelitian yang digunakan adalah studi kasus sosial inkuiri. Instrumen penelitian yang digunakan adalah pedoman observasi, pedoman wawancara, lembar pertanyaan lanjutan hasil informasi, dan kajian doku-men serta dokumentasi. Hasil Penelitian menyatakan bahwa partisipan ma-ta kuliah ini belum mampu untuk mengggunakan piano sebagai pengantar pembelajaran musik umum. Informasi ini ditindaklanjuti dengan rekomen-dasi, penyempurnaan silabus dan implementasi pembelajaran mata kuliah instrumen pilihan wajib piano, seyogyanya dilengkapi dengan subjek …

Teach For Australia Pathway : Evaluation Report Phase 2 Of 3, Paul R. Weldon, Phillip Mckenzie, Elizabeth Kleinhenz, Kate Reid

Initial Teacher education

The evaluation of the Teach for Australia Pathway was commissioned by DEEWR and commenced in March 2010. The purpose of the evaluation is to assess whether the delivery of the Pathway can be modified to better achieve intended outputs and outcomes, and whether the Pathway is achieving expected outcomes.

This report (Part 2) concerns the second of three phases of the evaluation of the TFA Pathway. The first report (Part 1) was designed to provide a summary of data gathered on the operation of the Pathway in its initial stages. Data for that report were collected via site visits with …

Theory Building Through Praxis Discourse: A Theory- And Practice-Informed Model Of Transformative Participatory Evaluation, Michael Allen Harnar

CGU Theses & Dissertations

Stakeholder participation in evaluation, where the evaluator engages stakeholders in the process, is prevalent in evaluation practice and is an important focus of evaluation research. Cousins and Whitmore proposed a bifurcation of participatory evaluation into the two streams of transformative participatory and practical participatory evaluation (T-PE and P-PE respectively). T-PE stems from a social justice perspective and P-PE has more of a use orientation. T-PE is an underdeveloped evaluation theory with relatively low operational specificity. Case examples provide some understanding of it in practice, but comprehensive empirical support is still forthcoming. This study aims to develop a greater understanding of …

Final Report : The Deadly Awards Nomination And Voting System Review And Research Project, Australian Council For Educational Research (Acer), Michele Lonsdale

Indigenous Education Research

The Australian Council for Educational Research (ACER) was commissioned in late 2010 by Vibe Australia to investigate the current nomination and voting system for the Deadly Awards and identify ways in which the current system could be strengthened. The Deadlys are in their 17th year. Beginning as a music award, the categories have expanded over the years to include sport, the arts, community awards and nominations for the Hall of Fame. Given their longevity and the debate that ensued after last year’s awards, it is timely to review the current nomination and voting system. The Deadly Awards are intended to …

Using Learning Goals To Promote Self-Directedness: How Problems In Research Led To Solutions In Teaching, Jaya Kannan, Larry Lutsky, Lisa Bauer, Yasmine Alwan

CTL Publications

In promoting self-directedness, our process at MCNY’s Learning Enhancement Center begins by having the student construct learning goals. A qualitative analysis of these student learning goals was conducted based on the premise that a student’s ability to articulate a goal in a clear, specific, complex, and measurable manner will improve over time. Although our findings did not support our hypothesis, the complex exercise of creating a customized rubric to measure the goals helped us arrive at a standardized evaluation method and build a transparent self-assessment tool to foster independent learning. This attempt to quantify student learning goals created successful iterative …

With Scholarship & Practice In Mind: The Case Study As Research Method, Paula Dawidowicz

Walden Faculty and Staff Publications

Unlike theoretical scholars who seek knowledge to expand humanity’s (or their) understanding of a topic, scholar practitioners seek knowledge that can be applied to understand change or create change in a specific phenomenon. Although many of the same research methods can be used by both groups of educational scholars, and although research designs are determined in large part by the research questions being asked, several research methods can prove most useful for scholar practitioners examining learning environments. One, the case study, stands out as perhaps the most versatile and researcher-friendly, though. A case study, bounded by specific location and topic …

Rankings And The Reshaping Of Higher Education:The Battle For World Wide Excellence, Ellen Hazelkorn

Books/Book chapters

No abstract provided.