Education Commons^™

The Australian Council For Educational Research (Acer) Response To The Australian Universities Accord Panel Interim Report, Australian Council For Educational Research (Acer)

Higher education research

The Australian Council for Educational Research (ACER) recognises the importance of universities, and the higher education sector more broadly, to the prosperity and success of Australia. ACER welcomes the intent and focus of the Universities Accord in creating a system that enables all Australians to consider the option of university education and be supported in embracing this opportunity. In our submission to the Accord Panel, we would like to provide reflection and insight into the following key areas:

• Recognising the higher education ‘life cycle’ begins well before university enrolment.
• Continuing to build the emphasis on equality of opportunity and equity-focussed …

Australia Awards Alumni Global Tracer Survey 2022, Michelle Hsien, Daniel Edwards

Australia Awards Global Tracer Facility

This report details the findings of the Global Tracer Survey 2022 of alumni from the Australia Awards and predecessor development scholarships. The research was undertaken by the Australia Awards Global Tracer Facility (GTF), which is managed by the Australian Council for Educational Research (ACER). The survey was administered online between November 2022 and January 2023 to alumni from 114 countries who had studied in Australia as part of a scholarship or fellowship. In total, 5116 alumni participated in the survey (a 24% response rate globally). Among this group were alumni who completed their award during the 1980s through to alumni …

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli

Higher education research

The use of decision-making support tools during assessments, such as electronic differential diagnosis in examinations, is just the tip of the iceberg when it comes to how technology is currently changing assessment practice. We have reached a transformative stage in the development of artificial intelligence (AI). We can no longer rely on non-invigilated assessments and submitted ‘artefacts’ to demonstrate student learning and competence. This is bringing many long-term demands on educators, course coordinators and curriculum designers, forcing us to rethink assessment approaches. Going forward, we see an important distinction between ‘assisted’ assessments and ‘unassisted’ assessments. With the recent increase and …

Australian General Practice Training Program: National Report On The 2022 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health and Aged Care’s (the Department) monitoring and quality improvement activities. From June 27 until August 12, 2022, the Australian Council for Educational Research (ACER) administered the AGPT NRS to registrars enrolled in active training on …

A Formative Evaluation Of The Program For Student Representatives In A University Discipline Panel, Diana Genevive Layag

International Conference on Assessment and Learning (ICAL)

The university employs a representation of different sectors in the academic community when dealing with major student conduct violations. Among them is the representative of the students. At the time of the study, the student representatives were qualified students who were recruited and trained to become part of the university discipline case conference panel. Upon successful completion of the training, these students were appointed to be members of a program for the pool of student representatives who sit as part of the university adjudicating body, which makes decisions for the university student discipline cases. Terminally, the researcher wanted to improve …

Australian General Practice Training Program: National Report On The 2021 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities. The information collected in the AGPT NRS can be used to assure the quality of training provision in the program, enables continuous improvement and allows responses to be …

Australian General Practice Training Program: National Report On The 2020 National Registrar Survey, Rebecca Taylor, Leyna Clarke, Ali Radloff

Higher education research

The Australian General Practice Training National Registrar Survey (AGPT NRS) is an annual, national survey of GP registrars currently training in the AGPT program. It collects information via an online questionnaire about registrar satisfaction, experience and future career plans. It also collects information about registrars’ demographics and training contexts and other aspects of their training experience. This survey is part of the Department of Health’s (the Department) monitoring and quality improvement activities. From October 12 to December 9, 2020, the Australian Council for Educational Research (ACER) administered the AGPT NRS to registrars enrolled in active training on the AGPT program …

National Education Policy 2020: Education Opportunities After School Completion, Jyoti Sharma, Prasad K. D. V. Yarlagadda

Teacher India

The reforms under the New Education Policy 2020 make it easier for Indian students to enter reputed international universities and enhance inter-institutional collaboration between Indian and foreign universities, say Jyoti Sharma and Prasad K. D. V. Yarlagadda.

A Man Of Measure And More: John P. Keeves 1924-2020, Petra Lietz Ed., Katherine Dix Ed., Juliet Young-Thornton Ed.

Shannon Research Press

John Philip Keeves was an eminent researcher with a lifelong quest to improve teaching and learning by being a researcher, teacher, supervisor and mentor. He produced a myriad of scholarly publications, many on topics of research design, comparative research and educational measurement. In 1962, John was recruited to the Australian Council for Educational Research and he moved to Melbourne, later becoming Associate Director from 1972 to 1977 and then Director until his retirement in 1984. During this time, he also undertook research fellowships at the Australian National University and the Institute of International Education in the University of Stockholm. After …

International Education In Regional Study Destinations: Building The Evidence Base: Final Report, Justin Brown, Jo Doyle, Leyna Clarke, Ali Radloff, Darren Matthews

Higher education research

The objectives of this project are to develop the evidence base in ways that enable the development of marketing messages that attract international students into regional areas in Australia. To achieve this objective, the project has identified: the profile of international students in regional areas; the pull factors that attract them to study there; the rate at which students appear to convert from short-term non-award courses into formal qualifications; and factors underpinning success in attracting international students to regional areas. Drawing on significant advancements in the geocoding of enrolment data to the Australian Statistical Geography Standard (ASGS) Remoteness Structure and …

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Education Expenditure In Australia, James Mahmud Rice, Daniel Edwards, Julie Mcmillan

Policy Analysis and Program Evaluation

Australia invested $111.8 billion in education in 2015. The sources of this funding and the pathways it follows through various systems are complex. Rarely are all the components of this system captured in the one place. This report offers a detailed insight into investment in Australian education, capturing data from all levels – from early childhood to higher education – and all funding sources – the federal government, state governments, private contributions and the transfers that take place between these. The complex picture shown in this report offers an important reference point for policy-makers, educators, researchers and economists. It draws …

International Graduate Outcomes Survey 2018 Final Report, Darren Matthews, Ali Radloff, Jo Doyle, Leyna Clarke

Higher education research

The 2018 International Graduates Outcomes Survey (IGOS) provides an insight into international graduates from Australian universities post-study employment, work readiness, and reflections on course experiences, study motivation and overall satisfaction. Over 10,000 international students who graduated from an Australian university in the last decade (international graduates) were asked a range of questions about their current employment status and their opinions on their Australian qualification. In brief the results indicate that: 90 per cent of graduates who are available for employment are currently employed - incorporating 93 per cent who returned home and 85 percent who were still in Australia; 77 …

Australian Higher Education Equity Ranking Project: Final Report, Tim Pitman, Paul Koshy, Daniel Edwards, Liang-Cheng Zhang, Julie Mcmillan

Higher education research

This report details the findings of a feasibility study for the Department of Education and Training (DET) into the development of a higher education student equity ranking index. The purpose of study was to determine whether it was possible to measure higher education equity performance at the institutional level and convey each institution’s relative performance through an ‘equity rank’. The ranking was to be based on institutional performance in regard to equity-group students, including students from low socio-economic backgrounds; students from regional/remote areas of Australia; Indigenous students; students with disability; and students from non-English speaking backgrounds.

The Japan University Experience Survey (Jues), Darren Matthews, Leyna Clarke

Higher education research

An overview of the Japan University Experience Survey (JUES) including its background and aims, and the ACER - Kawaijuku Group partnership. The presentation discusses the development, delivery, reporting and results of the survey, and considers Japanese and Australian UES/SES comparisons and the potential for benchmarking.

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Higher education research

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey Review by …

Pisa Australia In Focus Number 2: Educational Expectations, Kylie Hillman

OECD Programme for International Student Assessment (PISA) Australia

PISA has established a profile of what 15-year-old students can do and what they are like as learners. Gaining an understanding about other aspects, including what they want to do in the future is another important goal of PISA. This report seeks to explore how students’ expectations for further education are measured in PISA 2015. It addresses educational expectations across countries and across Australian jurisdictions, as well as educational expectations for different demographic groups in Australia. It also considers changes in educational expectations for Australian students over time, and for different demographic groups in Australia.

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Teacher education

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

Higher Education: Practitioner Level, Australian Council For Educational Research (Acer)

Education Analytics Service

This Practitioner level module is designed to ensure staff members who engage with and lead policy dialogue with international and domestic partners are informed about pathways through higher education and strategies for investing in and ensuring the quality of higher education. It is recommended that staff complete the Higher Education: Foundation level module as background information to this Practitioner level module. Topics covered in this module include how higher education links with technical and vocational education and training (TVET), secondary education, workforce planning and lifelong learning; investment options for higher education; how higher education is financed, how it is quality …

The Australian Education System: Practitioner Level, Australian Council For Educational Research (Acer)

Education Analytics Service

This Practitioner level module is designed to ensure that Department of Foreign Affairs and Trade (DFAT) staff members who engage with and lead policy dialogue with international and domestic partners are informed about Australia's education and training system. It is recommended that staff complete the Australian Education System: Foundation level module as background information to this Practitioner level module. Topics covered include an overview of the structure of the Australian education system, how the system is financed, how Australian education compares with other countries, and Australian education tools and data sources.

Higher Education: Foundation Level, Australian Council For Educational Research (Acer)

Education Analytics Service

The purpose of this module is to provide introductory information about the importance, structure, purpose, key issues and outcomes of higher education. It provides a foundation to engage in this topic and apply advice from staff with operational or expert levels of knowledge in education. On successful completion you will be able to be an informed participant in forums related to higher education.

The Australian Education System: Foundation Level, Australian Council For Educational Research (Acer)

Education Analytics Service

The purpose of this module is to provide an overview of the Australian education system. It provides a foundation to engage in this topic and apply advice from staff with operational or expert levels of knowledge in education. On successful completion you will be able to be an informed participant in multi-stakeholder forums related to Australian education.

The Case For Urgency: Advocating For Indigenous Voice In Education, Kevin P. Gillan, Suzanne Mellor, Jacynta Krakouer

Australian Education Review

In 2004 the Australian Council for Educational Research (ACER) published an Australian Education Review (AER) on Indigenous Education: The Case for Change: A review of contemporary research on Indigenous education outcomes, AER 47 (Mellor & Corrigan, 2004). In the 13 years since its publication, the state of Indigenous education outcomes has remained substantially unaltered. All the social indicators demonstrate that Australia’s First Nations people continue to be the most socio-economically disadvantaged population cohort in Australian society. This is after decades of continued policy efforts by successive Commonwealth, state and territory governments to ameliorate Indigenous education disadvantage. We still struggle with …

What Do Employers Really Want? Helping Vocational Learners Crack The Code, Kate Perkins

Transition and Post-School Education and Training

In the majority of vocational qualifications, assessment of competence incorporates a structured work placement (SWP). Increasingly, host employers are using these placements as part of recruitment strategies, particularly for entry level roles. In effect, the placement is becoming the new ‘interview’, and the new interview is morphing into an extended audition where a learner’s non-technical, ‘employability’ skills may play a critical role. But do learners know what their host employers are really looking for, and to what extent are their training programs helping them to develop and demonstrate the skills that are most likely to influence an employer’s recruitment decisions? …

Investigating The Relationship Between Equity And Graduate Outcomes In Australia, Sarah Richardson, Dawn Bennett, Lynne Roberts

Higher education research

Australian higher education equity policy focusses mostly on access and participation with the implicit assumption that disadvantage will be ameliorated through educational achievement. Less is known as to whether patterns of disadvantage continue post-completion. In a context in which graduate employability is becoming an important yardstick against which to measure institutional effectiveness, this question is of fundamental importance to higher education equity practitioners and policymakers. This study employed Commonwealth graduate outcome data to investigate relationships between disadvantage and graduate outcomes in Australia, with disadvantage defined as a graduate belonging to one or more of the following groups – low SES, …

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Higher education research

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

National Research On The Postgraduate Student Experience : Case Presentation: Volume 1: First Year Postgraduate Student Experience, Gary Hamlin, Shelley Kinash, Linda Crane, Amy Bannatyne, Madelaine-Marie Judd, Ashley Stark, Bill Eckersley, Helen Partridge, Ken Udas

Higher education research

This is volume one of a set of case studies that explore the postgraduate student experience. The theme of this case study is first year postgraduate student experience and is based on experiences derived from student engagement breakfasts, interviews, and focus groups with 366 people across the stakeholder groups of postgraduate students, educators, and university executives from 26 institutions. The case studies constitute part of the output from the project, Engaging postgraduate students and supporting higher education to enhance the 21st century student experience.

National Research On The Postgraduate Student Experience : Case Presentation : Volume 2 : Postgraduate Student Diversity, Bill Eckersley, Linda Crane, Shelley Kinash, Amy Bannatyne, Gary Hamlin, Helen Partridge, Sarah Richardson, Harry Rolf, Ken Udas

Higher education research

This is volume two of a set of three case studies that explore the postgraduate student experience. The theme of this case study is postgraduate student diversity and is based on experiences derived from student engagement breakfasts, interviews, and focus groups with 366 people across the stakeholder groups of postgraduate students, educators, and university executives from 26 institutions. The case studies constitute part of the output from the project, Engaging postgraduate students and supporting higher education to enhance the 21st century student experience.

National Learning And Teaching Resource Audit And Classification Final Report, Philip Hider, Barney Dalgarno, Sue Bennett, Ying-Hsang Liu, Carole Gerts, Carla Daws, Barbara Spiller, Pru Mitchell, Robert Parkes, Raylee Macaulay

Information Management

The Australian Office for Learning and Teaching's (OLT) research repository is used to disseminate the results of higher education research. This is the final report of a project that investigated how the resources in the research repository should be described and indexed so that they could be accessed more effectively. The project team ascertained which attributes of the resources needed to be described and how they should be described, developed a metadata schema, selected and/or created appropriate indexing vocabularies and reindexed the resources.

Hacking Assessment, Phillip Dawson

2009 - 2019 ACER Research Conferences

Hackers exploit weaknesses in a system to achieve their own goals. In this paper I argue that hacking presents a significant threat to the growing world of online assessment. This threat needs to be addressed through a variety of means; technological anti-hacking approaches will not be sufficient. The most effective ways to prevent hacking may be changes to the assessment tasks themselves to make hacking less tempting; these approaches also have a range of positive side effects in terms of authenticity, transparency of criteria, and ensuring tasks involve work beyond the exam. I conclude with a brief exploration of the …