Education Commons^™

Identifying Support Structures Associated With Informal Formative Evaluation In Instructional Design, Suzanne Smith, Tian Luo

STEMPS Faculty Publications

Instructional designers perform informal formative evaluation in design practice. An evaluation may be used to locate errors in alignment of instructional objectives or to increase the quality or effectiveness of a design. An instructional design review is similar to peer reviews in higher education which are often structured, and tools are provided to contribute to the review. A study was performed to identify the support structures and tools that contribute to building a community of feedback within the practice of instructional design reviews. Six instructional designers and design managers were interviewed to gather the processes they use in design reviews …

Professional Learning Conversations: Adaptive Expertise For Schools. Supplementary Digital Materials, Helen Timperley

Educational leadership

School leaders face complex challenges, that typically have multiple causes and often persist despite everyone’s best attempts to address them. Addressing complex challenges requires juggling both the big picture, and the specific parts of the challenge. Without a roadmap, this process is fraught and unlikely to succeed in improving outcomes. In order to make a difference, schools need adaptive expertise; a skill which can be learnt through professional conversations and inquiry. In Leading professional conversations, Emeritus Professor Helen Timperley deftly outlines the key enablers for effective professional conversations – relationships, resources, processes, knowledge and culture – which support teachers to …

Alternative Assessment In Education, Eugene Jack Constandaki

Student Research Projects

No abstract provided.

Administrator Feedback To Teachers, Regina Frazier, Candace Wilkerson, Jacquie Cioffi, Patrick Simmons, Makeba Lindsay D'Abreu, Thea Racelis, Amanda Simmons, Melissa Yancey, Deanna Fierro, David B. Naff

MERC Publications

This brief from the Metropolitan Educational Research Consortium (MERC) curates peer-reviewed scholarship as well as state and school board policies in Virginia related to administrator feedback to teachers. It explores the following questions: 1) What is the purpose of administrators providing feedback to teachers? 2) How do administrators typically provide feedback to teachers? 3) How do teachers typically receive feedback from administrators? 4) What are research-based strategies for administrators to provide productive feedback to teachers? It concludes with key takeaways and recommendations for how administrators provide feedback to teachers.

Looking Behind Virtual Lenses: Field Experience, Modeling, Coaching, Partnerships, Supervision, And Feedback, Tamara Lynn, Shantel Farnan, Jessica A. Rueter, Adam Moore

Education Faculty Publications

Small special education programs (SSEPs) are composed of limited faculty tasked with educating interns dispersed across large geographical areas (Reid, 1994). These needs underscore a call for more flexible educational program options. Moreover, Kebritchi et al. (2017) found professors in higher education institutions sought a variety of instructional methods to critically respond to barriers experienced by SEPPs. The purpose of this article is to highlight virtual methods utilized by SSEPs for field experiences, modeling, coaching, feedback, supervision, and partnerships to leverage faculty expertise effectively and efficiently, to expand recruitment in programs, and to support teacher retention efforts. Using the Council …

Ungrading, Supporting Our Students Through A Pedagogy Of Care, Shaun Ferns, Robert Hickey, Helen Williams

Articles

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Grades became more widely established in the twentieth century becoming ubiquitous across most educational institutions. There is increasing evidence to suggest that grades are not effective tools for promoting or measuring learning. One alternative approach for promoting and measuring learning is "Ungrading," in which no letter grades or marks are given to students. Instead, they are replaced with formative feedback provided through strategies such as individual feedback, peer review and self-assessment. An Ungrading approach promises increased learner motivation, a reduction in stress, and …

Peer Observation: Enhancing The Experience Of Giving And Receiving Feedback, Deepali Dharmaraj

Teacher India

In this article, Deepali Dharmaraj explores the role of feedback in the context of peer observation and identifies key principles and practices that enable the experience to be mutually beneficial for both the observer and observed.

Interpreting Average Effect Sizes: Never A Center Without A Spread, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

School leaders today are making important decisions regarding education innovations based on published average effect sizes, even though few understand exactly how effect sizes are calculated or what they mean. This article explains how average effect sizes are determined in meta-analyses and the importance of including measures of variability with any average effect size. By considering the variation in effect sizes among studies of the same innovation, education leaders can make better decisions about innovations and greatly increase the likelihood of achieving optimal results from implementation.

Tipping The Balance Towards 21st Century Skills Through Peer-To-Peer Learning: A Cross-Disciplinary Pilot Of Peer Review Software, John Mccormick, Lisa Spitz, Liv Cummins

Staff Scholarship

There is growing recognition that many college students enter the workplace lacking “21st Century Skills” such as critical thinking, collaboration and communication. Peer-to-peer feedback provides a large number of benefits, including these “lifelong learning” skills valued by industry. Peer review, however, poses many challenges: for instructors; these include management of the process and poor quality of peer feedback; and for students, socioemotional barriers. Key socioemotional challenges are learners’ lack of trust in the process, in their peers, and in themselves as reviewers. This paper describes a pilot of a web-based peer review software called “Peergrade”, which was found highly effective …

Grades Versus Comments: Research On Student Feedback, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Are comments on student work superior to grades? It depends.

If At First You Do Not Succeed: Student Behavior When Provided Feedforward With Multiple Trials For Online Summative Assessments, Emily Faulconer, J. C. Griffith, H. Frank

Publications

Best practices suggest that timely, actionable feedback is provided with the option to apply the feedback. We used a learning management system to deliver assessments with automatic feedback provided at the conclusion of the assessment, allowing for multiple attempts in order to apply the knowledge gained. Questions were pooled so each attempt was unique, the highest score earned was awarded, with no penalty for failure to use multiple attempts. We found that students who did not earn an A on their first attempt were more likely to try again. Those that did tended to score better on their second attempt. …

A Different Way To Provide Feedback Of Student Learning, Dr. Deborah Bracke

Education: Faculty Scholarship & Creative Works

This article provides an alternative to traditional letter grading.

A Review Of Tools And Techniques For Data-Enabled Formative Assessment, Rob Nyland

University Author Recognition Bibliography: 2018

The purpose of this literature review is to understand the current state of research on tools that collect data for the purpose of formative assessment. We were interested in identifying the types of data collected by these tools, how these data were processed, and how the processed data were presented to the instructor or student for the purpose of formative assessment. We identified two categories of data: machine graded and activity stream data. The data were processed using three methods: unprocessed activity streams, descriptive data analysis, and data mining. Processed data were presented to students through reports and real-time feedback, …

Middle School Classroom Teacher Perceptions Of The Impact Of Formative Assessments On The Needs Of At-Risk Students: A Phenomenological Study, Gaye Walk

Doctoral Dissertations and Projects

The purpose of this phenomenological study was to explore the perceptions of middle school classroom teachers regarding the impact of formative assessments on the needs of at-risk students. A phenomenological approach was used to gain understanding of how the teacher works with at-risk students and how the steps of formative assessments meets the needs of at-risk students. The theory framing this study was Albert Bandura’s (1977) social cognitive theory and the self-efficacy belief system. Data collection took place with 12 middle school teachers and included a questionnaire, individual interviews, and a focus group. The study was guided by three research …

Efficacy And Implementation Of Automated Essay Scoring Software In Instruction Of Literacies To High Level Ells, Aaron J. Alvero

FIU Electronic Theses and Dissertations

This thesis explored the integration of automated essay scoring (AES) software into the writing curriculum for high level ESOL students (levels 3, 4, and 5 on a 1-5 scale) at a high school in Miami, Fl. Issues for Haitian Creole speaking students were also explored. The Spanish and Haitian Creole speaking students were given the option to write notes, outlines, and planning sheets in their L1.

After using AES in the middle of the writing process as a revision assistant tool, 24 students responded to a Likert Scale questionnaire. The students responded positively to the AES based on the results …

Learning From Mistakes, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

A willingness to acknowledge and learn from failure is essential for all progress, writes Professor Geoff Masters AO.

The Role Of Calibration Bias And Performance Feedback In Achievement Goal Regulation, Krista R. Muis, Philip H. Winne, John Ranellucci

Publications and Research

Do achievement goals change across time in response to performance feedback? Does goal orientation relate to calibration of estimated to actual achievement? We studied these issues over three tasks spanning a semester-long course where ninety-nine undergraduates received feedback about performance on each task. Learners were consistently and quite substantially biased in estimating performance with bias inversely related to actual performance. Goal orientation was not stable across time as a function of task, and it varied in some tasks in relation to calibration accuracy. These findings demonstrate goal orientations are sensitive to task and feedback. Moreover, goal orientation had varying and …

Applications Of Peer Assessment And Self-Assessment In Music, Christopher Valle, Heidi Andrade, Maria Palma, Joanna Hefferen

Educational & Counseling Psychology Faculty Scholarship

Feedback is crucial to students’ growth as musicians. Fortunately, the teacher is not the sole source of feedback in the music classroom. Under the right conditions, students can provide actionable feedback to themselves and each other. This article showcases the work of three elementary music specialists who have innovatively incorporated formative peer assessment and self-assessment in their music lessons to promote student learning and self-direction.

An Evaluation Of Formative Audio Feedback Within Part Time Professional Development Programmes In Dit., Claire M. Mcdonnell, Roisin Donnelly, Claire Mcavinia

Other resources

Evidence from the literature indicates that learners often view feedback in terms of assessment only, even though it can play an important role in improving engagement and consolidating and enriching learning. It is well accepted that the feedback strategy used should be appropriate to the purpose and context of the work, but in order for feedback to be truly helpful, it needs to be goal-referenced, tangible, transparent, actionable, user-friendly (specific and personalized), timely, ongoing and consistent. Technology can also play a useful supporting role in achieving this. This paper explores the impact of formative audio feedback across part time programmes …

Online Instructor's Use Of Audio Feedback To Increase Social Presence And Student Satisfaction, Laura Portolese, Robert Trumpy

All Faculty Scholarship for the College of Education and Professional Studies

This study investigates the impact of written group feedback, versus audio feedback, based upon four student satisfaction measures in the online classroom environment. Undergraduate students in the control group were provided both individual written feedback and group written feedback, while undergraduate students in the experimental treatment group were provided both individual written feedback and audio group feedback. Using a one-tailed t-test, the four student satisfaction measures were analyzed and one was found to be significant for students’ perception that the instructor seemed genuinely concerned with whether students learned. The authors believe the study, when combined with their previous research, has …

Experiential Project Presentation Using Story Sack, Geraldine French

Assessment & Feedback Cases

This use case describes how one assessment method was designed and implemented by a lecturer or a group of lecturers in DIT. The use case was compiled from an interview conducted as part of DIT’s RAFT project (2013‐14), the aim of which was to provide a database of assessment practices designed and implemented by academic staff across DIT.

Feedback Dynamics In The Academic And Industrial Environment, David Kennedy, Dermot Mcgarthy

Conference Papers

Feedback is essential in all companies, in society and in educational environments. We learn, improve and develop from it in our examinations, group work, work environment and relationships. Feedback however must be supported with good communications and be consistent. In the classroom environment this means providing feedback in a positive and supportive manner, and being consistent to all. Most if not all managers and leaders, including lecturers have not undertaken any form of training in feedback methods and therefore it is not translated effectively, causing stress or misguidance to students and colleagues. This paper highlights the importance of good feedback, …

Work Placement Blogs To Harness Diverse Learning Experiences, Provide Timely Assessment And Feedback, And Foster A Community Of Learning, Julie Dunne, Sinead Ryan

Teaching Fellowships

Students on work placement will have very different experiences from each other; however they are generally not connected to their peers, but working with professionals under the guidance of a work placement co-ordinator. Therefore during work placement they are not formally supported by peers and cannot learn from the diverse range of activities their peers will experience. The aim of this project is to enhance the student experience while on work placement by introducing a blog assessment. The implementation of work placement blogs will allow work placement experiences to be shared with the whole class. Feedback mechanisms are discussed, along …

Atlas Program Profile Analysis Framework Data From: Adult Transitions Longitudinal Study, Laura Gluck

Master's Capstone Projects

This paper explores the theoretical basis and past research exploring what helps adults to learn effectively in the Adult Basic Education (ABE) setting. Information on eleven ABE-to-college transition programs was compiled through the Adult Transitions Longitudinal Study (ATLAS) data collection. Statistical analyses of the resulting program-level variables were conducted to examine their effect on transition course participants’ college outcomes. Four of the twelve variables analyzed were found to significantly impact the likelihood of participants enrolling in college and successfully earning at least three credits: 1) whether the program uses grades versus pass/fail marks; 2) whether the program has a documented …

Improving The Undergraduate Laboratory Learning Experience Through Redesigned Teaching And Assessment Strategies Integrating Transferable Skills And Focusing On Feedback., Julie Dunne, Barry Ryan

Teaching Fellowships

This project aimed to improve the laboratory learning experience for undergraduate science students, focusing initially on first and third year cohorts, through specific objectives. Firstly, to incorporate novel teaching and assessment methods, including student led laboratories, in- house produced instructional videos, “Clickers” audience response devices, and pre-practical on-line multiple choice questionnaires (MCQ) assessments. Secondly, to develop timely feedback mechanisms, including peer review, tutor face-to-face and audio feedback, online automatic feedback, and report checklists. Finally, to embed transferable skills into the laboratory including group work, communication skills (written and oral), organisation and project planning, health and safety, and preparedness for laboratories, …

The Enhancement Of Student Learning Through Engagement And Feedback In The Assessment Process, Niall Delaney, Alan O'Donnell

Conference Papers

The Technological University Dublin is one of the largest multi-level higher education providers in Ireland, catering for over 22000 students annually. Under the 1999 Qualifications (Education and Training) Act, DIT became an awarding body in its own right. Programme provision covers apprenticeships, short continuous professional development courses, taught undergraduate and postgraduate, research MPhil and PhDs. The Institute’s traditional mission has always been focused on learning and teaching in the field of advanced technical vocational education and training (TVET), and one of its current agendas is to foster and encourage changes in teaching practice and methodology in order to enhance a …

Assessment Practices: Student’S And Teachers’ Perceptions Of Classroom Assessment, Sayed Ahmad Javid Mussawy

Master's Capstone Projects

The primary aim of this study is to explore pre-service teachers’ perceptions of classroom assessment. A secondary purpose is to explore the faculty members’ perceptions of classroom assessment and their expectations of students’ learning. This study examines what assessment approaches are being used in Baghlan Higher Education Institution, School of Education. In addition, the investigator was interested in learning the extent to which assessment results were used to improve students’ learning and classroom instruction.

An Examination Of The Use Of Portfolios For Faculty Evaluation At Community Colleges, Becky Sain, Mitchell R. Williams

Educational Foundations & Leadership Faculty Publications

This study provides community college leaders with insights regarding how administrators and faculty members perceive faculty portfolios as an evaluation tool in two-year colleges. Utilizing a qualitative design, this study focused on perceptions of administrators and faculty members regarding the use of portfolios as the primary instrument for faculty evaluation. Overall, faculty and administrators found portfolios useful when the process encouraged and allowed for faculty self-reflection and honest feedback from administrators.

Academic Advising At Western: Some Feedback From Alumni, Carl Simpson, Gary (Gary Russell) Mckinney, Joseph E. Trimble, Joanna Gregson, Linda D. (Linda Darlene) Clark

Office of Institutional Effectiveness

Executive Summary: Repeated studies in recent years, both at Western and elsewhere, have found students less satisfied with advising services than with instruction or various university services. For example, 77% of recent Western alumni are "very" or "mostly" satisfied with the undergraduate courses they took at Western, while 41% are similarly satisfied with the academic advising they received from all sources at Western. Satisfaction with advising received from faculty and major departments was lower than satisfaction with advising from the Academic Advising Center. Because of the concerns these studies raise, Western's Academic Advising Center requested that our 1992 alumni survey …

The Effectiveness Of Videotaped Practice Teaching Sessions In The Preparation Of Elementary Intern Teachers. Final Report., Warren Kallenbach

Faculty Publications

To extend previous research findings on the effectiveness of microteaching techniques, all 40 candidates in the 1967 San Jose State College summer elementary intern teaching program were randomly divided into 2 groups. f3oth groups had the same program except that 1 participated in an oft-campus observation and teaching program; the other participated in an on-campus microteaching program. Five-minute pre- and post-summer lesson excerpts were video tape-recorded for each of the candidates. These were judged independently by each member of 2 independent teams of trained evaluators using the Stanford Teacher Competence Appraisal Guide and the Instrument for the Observation of Teaching …