Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 15 of 15

Full-Text Articles in Educational Assessment, Evaluation, and Research

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli Jan 2023

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli

Higher education research

The use of decision-making support tools during assessments, such as electronic differential diagnosis in examinations, is just the tip of the iceberg when it comes to how technology is currently changing assessment practice. We have reached a transformative stage in the development of artificial intelligence (AI). We can no longer rely on non-invigilated assessments and submitted ‘artefacts’ to demonstrate student learning and competence. This is bringing many long-term demands on educators, course coordinators and curriculum designers, forcing us to rethink assessment approaches. Going forward, we see an important distinction between ‘assisted’ assessments and ‘unassisted’ assessments. With the recent increase and …


Australian General Practice Training Program: National Report On The 2022 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff Nov 2022

Australian General Practice Training Program: National Report On The 2022 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health and Aged Care’s (the Department) monitoring and quality improvement activities. From June 27 until August 12, 2022, the Australian Council for Educational Research (ACER) administered the AGPT NRS to registrars enrolled in active training on …


Australian General Practice Training Program: National Report On The 2021 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff Nov 2021

Australian General Practice Training Program: National Report On The 2021 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities. The information collected in the AGPT NRS can be used to assure the quality of training provision in the program, enables continuous improvement and allows responses to be …


Australian General Practice Training Program: National Report On The 2020 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff Mar 2021

Australian General Practice Training Program: National Report On The 2020 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities. From October 12 to December 9, 2020, the Australian Council for Educational Research (ACER) administered the AGPT NRS to registrars enrolled in active training on the AGPT program …


Systematic Review Of The Literature On Professional Education Accreditation, Neville Chiavaroli, Kate Reid, Pru Mitchell, Jenny Trevitt Mar 2020

Systematic Review Of The Literature On Professional Education Accreditation, Neville Chiavaroli, Kate Reid, Pru Mitchell, Jenny Trevitt

Higher education research

This report is critical and systematic review of the literature on professional education accreditation models, associated methods, and the effectiveness and impact of each model. The review was conducted to inform a review and update of the Royal College of Vetinerary Surgeons (RCVS) standards of accreditation for veterinary degrees. The purpose of the study was to rapidly appraise the evidence for the effectiveness, impact, and feasibility of different accreditation approaches, in order to inform best practices for the accreditation of professional education programs. The study focused on accreditation for programs which produce practice-ready graduates, including for veterinary programs. The authors …


Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli Aug 2019

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …


Australian General Practice Training Program National Report On The 2018 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Daniel Edwards Dec 2018

Australian General Practice Training Program National Report On The 2018 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Daniel Edwards

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey was previously known as the AGPT Registrar Satisfaction Survey (AGPT RSS). From July 31 to September 7 2018, the Australian Council for Educational Research (ACER) administered the AGPT NRS to registrars enrolled in active training on the AGPT program across 11 training …


Australian General Practice Training Program National Report On The 2017 National Registrar Survey, Rebecca Taylor, Ali Radloff, Daniel Edwards, Leyna Clarke Apr 2018

Australian General Practice Training Program National Report On The 2017 National Registrar Survey, Rebecca Taylor, Ali Radloff, Daniel Edwards, Leyna Clarke

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program that collects information about registrar satisfaction, experience and future career plans. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities and the information can be used to assure the quality of training provision, enable continuous improvement and allow results to be benchmarked nationally. Previously known as the AGPT Registrar Satisfaction Survey (AGPT RSS), the AGPT NRS also collects information on registrars’ demographics and training contexts and other aspects of …


Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson Jan 2016

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Higher education research

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …


Agpt Registrar Satisfaction Survey November 2015, Rebecca Taylor, Ali Radloff, Jennifer Hong, Daniel Edwards Nov 2015

Agpt Registrar Satisfaction Survey November 2015, Rebecca Taylor, Ali Radloff, Jennifer Hong, Daniel Edwards

Higher education research

The Australian General Practice Training (AGPT) Registrar Satisfaction Survey (RSS) is used for ensuring continuous improvement in the training of doctors in the AGPT program. It was developed to gauge the level of registrar satisfaction with the quality of their training, with training providers, and with career progression.


Implementing Common Assessment: Lessons And Models From Amac Developed By The Australian Medical Assessment Collaboration, Daniel Edwards Sep 2014

Implementing Common Assessment: Lessons And Models From Amac Developed By The Australian Medical Assessment Collaboration, Daniel Edwards

Higher education research

The aim of this document is to provide insight into the implementation of common assessments in higher education in order to assist in future work on conducting these kinds of projects. The discussion here draws heavily on the AMAC experience, attempting to broaden the learning from this project for use in future collaborations. The focus of this project has been on medical education, and as such, much of the detail is related to this field. However, it is hoped that the general ideas discussed here can be seen as informative for other fields and disciplines in higher education and at …


Australian Medical Assessment Collaboration: From Proof Of Concept To Proof Of Sustainability: Final Report 2014, Daniel Edwards, David Wilkinson Sep 2014

Australian Medical Assessment Collaboration: From Proof Of Concept To Proof Of Sustainability: Final Report 2014, Daniel Edwards, David Wilkinson

Higher education research

This is the final report for AMAC-2, entitled Australian Medical Assessment Collaboration: from proof of concept to proof of sustainability (OLT project ID12-2482). This project advanced previous work funded by the ALTC and was undertaken from early 2013 to mid 2014. AMAC-2 took the proof of concept achieved through the initial AMAC project with the aim of building an ongoing, sustainable and successful collaboration between medical schools in Australia and New Zealand.


Determining The Quality Of Assessment Items In Collaborations: Aspects To Discuss To Reach Agreement Developed By The Australian Medical Assessment Collaboration, Lambert Schuwirth, Jacob Pearce Sep 2014

Determining The Quality Of Assessment Items In Collaborations: Aspects To Discuss To Reach Agreement Developed By The Australian Medical Assessment Collaboration, Lambert Schuwirth, Jacob Pearce

Higher education research

The Australian Medical Assessment Collaboration (AMAC) project, funded by the Office of Learning and Teaching, seeks to provide an infrastructure and a road map to support collaboration between Australian medical schools in matters of assessment. This may not seem very new perhaps, because there are already several collaborations taking place in Australia, and, typically, they relate to joint item banks, (such as the IDEAL consortium), or joint test administration, (such as the International Foundation of Medicine tests). The AMAC project seeks to build on these existing collaborations in two ways: first, by tying these initiatives together and thus bundling the …


Governance Models For Collaborations Involving Assessment, Australian Medical Assessment Collaboration (Amac), Ben Canny, Hamish Coates Jan 2014

Governance Models For Collaborations Involving Assessment, Australian Medical Assessment Collaboration (Amac), Ben Canny, Hamish Coates

Higher education research

This paper is driven by a desire to improve assessment in higher education to yield better outcomes for communities, professions and individuals. The analysis unfolds within the field of medicine but is conceptualised to be of much broader relevance to other professional fields and academic disciplines. The focus is on assessment during the course as opposed to assessment for admissions or licensing purposes. The interest in assessment is not simply to produce practitioners, but to develop better practitioners. As well, the remarks are bounded by the context of universities in Australia and hence the complex but important assumption of academic …


The Australian Medical Assessment Collaboration: Developing The Foundations For A National Assessment Of Medical Student Learning Outcomes, David Wilkinson, Daniel Edwards, Hamish Coates, Ben Canny, Jacob Pearce, Jennifer Schaefer, Tracey Papinczak, Lindy Mcallister Jan 2012

The Australian Medical Assessment Collaboration: Developing The Foundations For A National Assessment Of Medical Student Learning Outcomes, David Wilkinson, Daniel Edwards, Hamish Coates, Ben Canny, Jacob Pearce, Jennifer Schaefer, Tracey Papinczak, Lindy Mcallister

Higher education research

In late December 2010 the Australian Learning and Teaching Council Ltd (ALTC) provided a grant to The University of Queensland along with the Australian Council for Educational Research (ACER) and Monash University to develop foundations for a national assessment that evaluates the learning outcomes of later‐year medical students in Australia. The project, titled ‘Developing the foundation for a national assessment of medical student learning outcomes’ responds to the growing need to prove and improve the standards of medical education by establishing an Australian Medical Assessment Collaboration (AMAC). This project includes scoping work, wide‐ranging sector engagement, development of an assessment framework, …