Education Commons^™

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

Neville Chiavaroli

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Gina C Milgate

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey Review by …

Plunging Beneath The Surface: Uncovering Internal Dispositions, Lori Piowlski, Karen Colum

Lori Piowlski, Ph. D.

Teacher preparation programs face the challenge of measuring candidates’ competencies that can be considered internal dispositions; which impact the quality of their instruction. This study delves into candidate edTPA scores in correlation with their IDI mindsets to support program development.

Preparing Culturally Proficient Teachers, Lori Piowlski

Lori Piowlski, Ph. D.

This session helps frame the demographic and educational changes that are resulting in the restructuring of teacher preparation programs. Discussion of qualitative study provides a platform to begin reflecting on how to deliver a comprehensive teacher education program that instills cultural proficiency.

Beware Of The Collision Between Cultural Proficiency And Teacher Candidate Performance Assessment, Lori Piowlski

Lori Piowlski, Ph. D.

An issue facing teacher preparation programs is that higher education must be able to measure teacher candidates' competencies that can be considered internal dispositions, which directly impact the quality of their instruction. This session delves into the teacher performance assessment (edTPA) scores candidates are earning in correlation to their Intercultural Development Inventory (IDI) levels

Investing In Teachers, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs

Dr Kate Reid

This evaluation compares evidence from the literature with Australia’s experience in supporting teacher development in a range of developing countries. It uses case studies to good effect in explaining choices made, the extent to which expectations were or were not met, and the lessons for future Australian assistance for teacher development. The evaluation found mixed results. In cooperation with governments and other donors, Australia has made positive contributions, such as improving teacher frameworks and curriculums, and training teachers through a range of interventions. However, there is room to improve—for example, in enhancing policy, strengthening analysis and negotiating new investments—so teacher …

Investing In Teachers, Adeola Capel, Hilary Hollingsworth, Elizabeth Kleinhenz, Alison Lonsdale, Yung Nietschke, Rachel Parker, Kate Reid, Jeaniene Spink, Mollie Tobin, Mary Fearnley-Sander, Jacinta Overs

Dr Hilary Hollingsworth

This evaluation compares evidence from the literature with Australia’s experience in supporting teacher development in a range of developing countries. It uses case studies to good effect in explaining choices made, the extent to which expectations were or were not met, and the lessons for future Australian assistance for teacher development. The evaluation found mixed results. In cooperation with governments and other donors, Australia has made positive contributions, such as improving teacher frameworks and curriculums, and training teachers through a range of interventions. However, there is room to improve—for example, in enhancing policy, strengthening analysis and negotiating new investments—so teacher …

Investing In Teachers

Adeola Capel

Session P: Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

Juliette Mendelovits

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Session P: Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

Julian Fraillon

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …

Cyber Professional Development In Inquiry Science: An Iterative Evaluation Strategy, Heather Leary, Tamara Sumner, Cathy Ringstaff, Danielle Brown, Holly Devaul

Heather Leary, Ph.D.

Traditional models of professional development (PD) for teachers are changing, and there is a move to use approaches that capitalize on technological tools to deliver PD online and blended. Offering PD using these technological approaches has the potential to save resources for districts. It is crucial to determine if these approaches are meeting the needs of teachers, especially when they are learning to implement new curricula. This study describes the process two partnering institutions used, working in parallel, to conduct fine- and coarse-grained formative evaluation of a CyberPD environment and course. Data collection included surveys, online focus groups, and interviews. …

Rethinking Assessment In Vet, Dave Tout

David (Dave) Tout

No abstract provided.

The Impact Of National And International Assessment Programmes On Education Policy, Particularly Policies Regarding Resource Allocation And Teaching And Learning Practices In Developing Countries, Maura Best, Pat Knight, Petra Lietz, Craig Lockwood, Dita Nugroho, Mollie Tobin

Dr Petra Lietz

There is a documented global rise in the number of countries undertaking national learning assessments, as well as international and regional learning assessments. Much of this growth, especially in national learning assessments, has occurred in economically developing countries. Little is known, however, on how these assessments affect education policy and practice in developing countries. This review examined the impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries. This particular focus on policies regarding resources and teaching and learning practices stemmed from an observation that, particularly in …

Self-Assessment Of Employability Skill Outcomes Among Undergraduates And Alignment With Academic Ratings, Denise Jackson

Denise Jackson

Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in over- and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in more than 1000 Australian business undergraduates. It evaluates the extent to which student self-assessments differ from academics, in what ways and the influence of certain individual and background characteristics - such as stage of degree, gender and academic ability - on rating accuracy. Explanations for documented disparities are presented, in addition to implications and strategies …

Teach For Australia Pathway : Evaluation Report Phase 2 Of 3, Paul R. Weldon, Phillip Mckenzie, Elizabeth Kleinhenz, Kate Reid

Dr Kate Reid

The evaluation of the Teach for Australia Pathway was commissioned by DEEWR and commenced in March 2010. The purpose of the evaluation is to assess whether the delivery of the Pathway can be modified to better achieve intended outputs and outcomes, and whether the Pathway is achieving expected outcomes. This report (Part 2) concerns the second of three phases of the evaluation of the TFA Pathway. The first report (Part 1) was designed to provide a summary of data gathered on the operation of the Pathway in its initial stages. Data for that report were collected via site visits with …

Teach For Australia Pathway : Evaluation Report Phase 2 Of 3, Paul R. Weldon, Phillip Mckenzie, Elizabeth Kleinhenz, Kate Reid

Dr Phillip McKenzie (retired)

The evaluation of the Teach for Australia Pathway was commissioned by DEEWR and commenced in March 2010. The purpose of the evaluation is to assess whether the delivery of the Pathway can be modified to better achieve intended outputs and outcomes, and whether the Pathway is achieving expected outcomes. This report (Part 2) concerns the second of three phases of the evaluation of the TFA Pathway. The first report (Part 1) was designed to provide a summary of data gathered on the operation of the Pathway in its initial stages. Data for that report were collected via site visits with …

Teach For Australia Pathway : Evaluation Report Phase 1 Of 3 (April-July 2010), Catherine Scott, Paul R. Weldon, Stephen Dinham

Dr Paul Weldon

This Report (Part 1) is designed to provide a summary of data gathered on the operation of the Teach for Australia Pathway to date. Data were collected via site visits with schools and phone interviews with the program partners, the Associates, their mentors, principals and other school personnel, and the Educational Advisers over April through July 2010. The information gathered to date aims to provide early feedback on how the program is being implemented – to synthesise emerging themes in the delivery of the program and to inform future development and implementation.

Teach For Australia Pathway : Evaluation Report Phase 2 Of 3, Paul R. Weldon, Phillip Mckenzie, Elizabeth Kleinhenz, Kate Reid

Dr Paul Weldon

The evaluation of the Teach for Australia Pathway was commissioned by DEEWR and commenced in March 2010. The purpose of the evaluation is to assess whether the delivery of the Pathway can be modified to better achieve intended outputs and outcomes, and whether the Pathway is achieving expected outcomes. This report (Part 2) concerns the second of three phases of the evaluation of the TFA Pathway. The first report (Part 1) was designed to provide a summary of data gathered on the operation of the Pathway in its initial stages. Data for that report were collected via site visits with …

Learning As Doing –Common Goals And Interests Across Management And Education., Pauline Joyce

Pauline Joyce

Aim: The aim of this study was to evaluate approaches to learning of healthcare professionals in a postgraduate management programme.

Background: The study was carried out in a higher education institution.

Methods: An evaluation research study of an interprofessional healthcare group was carried out with students (insider stakeholders), and their lecturers and external examiner (external stakeholders). All three perspectives are presented here. Data was collected by interview, document analysis and reflection.

Results: This paper focused on the domain of learning as doing, as a major theme of the study, drawing variances between nurses and other healthcare professionals. The study highlights …

"Thinking" In A Deweyan Perspective: The Law School Exam As A Case Study For Thinking In Lawyering, Donald J. Kochan

Donald J. Kochan

As creatures of thought, we are thinking all the time, but that does not necessarily mean that we are thinking well. Answering the law school exam, like solving any problem, requires that the student exercise thinking in an effective and productive manner. This Article provides some guidance in that pursuit. Using John Dewey’s suspended conclusion concept for effective thinking as an organizing theme, this Article presents one basic set of lessons for thinking through issues that arise regarding the approach to a law school exam. This means that the lessons contained here help exercise thought while taking the exam — …

Electronic Teaching Evaluation: Student Perceptions And Teacher Responses, Shelley Kinash, Vishen Naidu, Kayleen Wood

Professor Shelley Kinash

Teach For Australia Pathway: Evaluation Report Phase 1 Of 3 (April-July 2010), Catherine Scott, Paul R. Weldon, Stephen Dinham

Dr Paul Weldon

No abstract provided.

Evaluating The Effectiveness Of Upward Bound Programs, Bradley J. Coverdale

Bradley J Coverdale

No abstract provided.

Harnessing Innovative Technologies In Higher Education, Kathleen P. King, Joan K. Griggs

Kathleen P King

This publication is an attempt to capture the evolution of distributed higher education over the last decade by tracing the applications of new technologies funded by the Fund for the Improvement of Postsecondary Education (FIPSE). As FIPSE surveyed the current state of distance/distributed education, there existed an opportunity to help post econdary education make the transition to this new generation of distance education made possible by the explosive growth of the Internet and other new technologies. These technologies created the potential for students to access learning that was interactive, customized, and self-paced; to more easily merge lifelong learning with the …

Values Driven Evaluation, P. Cristian Gugiu, Nadini Persuad, Brandon Youker

Brandon W. Youker Ph.D

Values are the basis for defining what aspects of the evaluand should be considered meritous in a particular context. They are something which is in principle or quality intrinsically valuable or desirable. So in evaluation, factual premises describe performance, while value premises can be thought of as the qualities that, when converted to standards, determine the degree to which the performance was good or bad, worthwhile or worthless, and significant or insignificant. Value premises can be validated using commonsense or based on such things as the severity of needs, resource efficiency, legal requirements, professional requirements, and so on. There are …

Review Of The Evaluation Exchange, Volume Xi(1), Xi(2), And Xi(3), Brandon W. Youker Ph.D

Brandon W. Youker Ph.D

The Evaluation Exchange is a free, online evaluation periodical (http://www.gse.harvard.edu/hfrp/eval.html) published by the Harvard Family Research Project (HFRP) three or four times annually. It is aimed at addressing issues that program evaluators frequently encounter. The journal emphasizes innovative methods and approaches to evaluation, emerging trends in practice, and practical applications of evaluation theory. It is designed to serve as a medium for evaluators, program practitioners, funders, and policymakers.

International Association For Impact Assessment, Brandon W. Youker Ph.D

Brandon W. Youker Ph.D

International Association for Impact Assessment (IAIA) defines impact assessment as “the process of identifying the future consequences of current or proposed action.” “IAIA is a forum for advancing innovation, development and communication of best practice in impact assessment. Its international membership promotes development of local and global capacity for the application of environmental assessment in which sound science and full public participation provide a foundation for equitable and sustainable development.”

Ethnography And Evaluation: Their Relationship And Three Anthropological Models Of Evaluation, Brandon W. Youker Ph.D

Brandon W. Youker Ph.D

This paper examines the relationship between ethnographic research methods and evaluation theory and methodology. It is divided into two main sections: (a) ethnography in evaluation and (b) anthropological models of evaluation. Three levels of the leading anthropological models of evaluation are summarized, which include responsive evaluation, goal-free evaluation, and constructivist evaluation. In conclusion, (a) there is no consensual definition of ethnography; (b) in many circumstances, ethnographic evaluation models may be beneficial; and (c) ethnography can be used in evaluation but requires a high level of analysis to transform ethnographic data into useful information for eliciting an evaluative conclusion.

The Evaluation Exchange--Harvard Family Research Project, Brandon W. Youker Ph.D

Brandon W. Youker Ph.D

Harvard Family Research Project (HFRP) was founded by the Harvard Graduate School of Education in 1983. The HFRP aims to help strengthen family, school, and community partnerships of early childhood care and education; promote evaluation and accountability; and offer professional development to those who work with children and/or their families. The project has aided philanthropies, policymakers, and practitioners by collecting, analyzing, and synthesizing research and information. HFRP publishes the journal The Evaluation Exchange.

Evaluation In Latin America And The Caribbean: An Overview Of Recent Developments, Thomas Chianca, Brandon Youker

Brandon W. Youker Ph.D

In the past ten years, evaluation, as a professional field, has undergone significant development in several countries in Latin America and the Caribbean (LAC). Four considerations provide clear evidence of such development: (1) establishment of professional evaluation organizations; (2) intensified dissemination of ideas and use of professional evaluation in the three key societal sectors: government, private, and philanthropic; (3) increased number of evaluation-related publications; and (4) growing establishment of short-term and graduate-level training programs in evaluation.