Education Commons^™

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Dr Daniel Edwards

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

Final Report: Development Of An Online Engagement Scale, Darren Matthews, Ling Tan, Daniel Edwards

Dr Daniel Edwards

The Commonwealth Department of Education and Training commissioned the Australian Council for Educational Research (ACER) to review the Learner Engagement Scale (LES), a key measure of student experience. It is administered as part of the Student Experience Survey, an annual survey of a sample of the 400 000 first and final year undergraduates studying at Australian Higher Education institutions – 80 per cent on-campus and around 8 per cent off-campus. Over the years, LES results have consistently shown substantially lower engagement levels in off-campus students – far in excess of the variation between teaching modes that might be expected – …

Understanding The Completion Patterns Of Equity Students In Regional Universitites, Karen Nelson, Catherine Picton, Julie Mcmillan, Daniel Edwards, Marcia Devlin, Kerry Martin

Dr Daniel Edwards

Higher Education Standards Panel Consultation : Transparency Of Higher Education Admissions Processes: Response From The Australian Council For Educational Research, Daniel Edwards, Brad Jackel

Dr Daniel Edwards

This document has been prepared by the Australian Council for Educational Research (ACER) in response to the Higher Education Standards Panel’s Consultation on the Transparency of Higher Education Admissions Processes. In developing the document, ACER has drawn on previous experience working in admissions research and admissions testing, and on discussions over time with universities in Australia as a result of this work relating to the issues of relevance to this consultation. This document explores four key areas identified by ACER as critical to improving the admissions processes of higher education providers in Australia. In developing this document, we have approached …

Nationwide, Collaborative Assessment Of Medical Student Learning Outcomes: The Australian Medical Assessment Collaboration, David Wilkinson, Benedict J. Canny, Jacob Pearce, Hamish Coates, Daniel Edwards

Dr Daniel Edwards

No abstract provided.

Supply, Demand And Characteristics Of The Higher Degree By Research Population In Australia, Daniel Edwards, Ali Radloff, Hamish Coates

Dr Daniel Edwards

This research has been undertaken for the Department of Innovation, Industry, Science and Research by researchers from the Australian Council for Educational Research. It was conducted during May and June 2009. Its focus is on identifying the higher research degree (HDR) population in Australia, examining the characteristics of this population, and the levels of demand and supply for people with these qualifications now and into the future. This research also catalogues a number of existing data sources that can be utilised for research into this population and identifies key gaps in the current collections which inhibit some areas of analyses …

Monitoring Risk And Return: Critical Insights Into Graduate Coursework Engagement And Outcomes, Daniel Edwards

Dr Daniel Edwards

Coursework graduate courses have been a significant growth area over the last few decades and are of immense importance to Australian higher education. The knowledge and skills achieved through postgraduate study make a significant contribution to individuals and society. Nearly one quarter of all higher education students in Australia are enrolled in a coursework postgraduate degree. These students generate substantial income for institutions through the fees they pay. Nearly one third of all international students in Australian higher education are enrolled in postgraduate coursework degrees. Overall, international students make up around 50 per cent of all coursework masters enrolments, a …

Engaging College Communities: The Impact Of Residential Colleges In Australian Higher Education, Hamish Coates, Daniel Edwards

Dr Daniel Edwards

Residential colleges play a vital role in many of the best universities in the world. Intuitively, it seems clear that living in a university-affiliated residence would enhance students’ educational involvement and outcomes. Reports from those closely involved in residential colleges provide a considerable amount of support for this proposition. Anecdotal reports help build a rich picture of residential life in Australian higher education, but overly relying on such data limits the extent to which colleges can be situated, compared and understood within broader contexts. Hence it is helpful to complement perceptual reports with data that offer more objective insights into …

Finding The Right Fit: University Course Selection And Completion, Daniel Edwards

Dr Daniel Edwards

As higher education enrolments continue to climb, the proportion of students failing to graduate remains high among some cohorts, according to analysis by Daniel Edwards.

Work Integrated Learning In Stem In Australian Universities: Final Report: Submitted To The Office Of The Chief Scientist, Daniel Edwards, Kate Perkins, Jacob Pearce, Jennifer Hong

Dr Daniel Edwards

The Australian Council for Educational Research (ACER) undertook this study for the Office of the Chief Scientist (OCS). It explores the practice and application of Work Integrated Learning (WIL) in STEM, with a particular focus on natural and physical sciences, information technology, and agriculture departments in Australian universities. The project involved a detailed ‘stocktake’ of WIL in practice in these disciplines, with collection of information by interview, survey instruments, consultation with stakeholders and literature reviews. Every university in Australia was visited as part of this project, with interviews and consultation sessions gathering insight from more than 120 academics and support …

Completing University In A Growing Sector: Is Equity An Issue?, Daniel Edwards, Julie Mcmillan

Dr Daniel Edwards

Access to university has always been an issue for students from disadvantaged backgrounds. In the recent context of an expanding higher education system in Australia, some accessibility issues have been alleviated. This context offers an opportunity to explore the pathways of disadvantaged students through university. In this expanded system, will disadvantaged students be more or less likely to complete university? Will demographic or enrolment characteristics influence the likelihood of these students to complete? This report details the findings from a research project funded by the National Centre for Student Equity in Higher Education (NCSEHE) that explores new data tracking student …

Quality Assurance In Gp Training, Daniel Edwards

Dr Daniel Edwards

An annual survey is collecting information about the postgraduate training experiences of General Practice registrars across Australia.

Work Integrated Learning: A Lesson In Good Wil, Daniel Edwards

Dr Daniel Edwards

Successful and sustainable work integrated learning programs share a number of key elements, as Daniel Edwards explains.

University Completions And Equity, Daniel Edwards

Dr Daniel Edwards

University students from disadvantaged groups have a lower completion rate than their more advantaged peers, but most disadvantaged students do complete their degrees, research reveals.

Improving Assessment Processes And Quality In Medical Specialisations, Daniel Edwards

Dr Daniel Edwards

ACER’s work for a number of specialist colleges in medicine is contributing to higher quality education, as Daniel Edwards explains.

Remember The Students: Lessons For Learning Outcomes Assessments, Jacob Pearce, Daniel Edwards

Dr Daniel Edwards

Assessments of student learning outcomes are important for institutional and system-level quality assurance, but should also help students improve their knowledge and skills.

Pathways To University: Beyond Prior School Achievement, Daniel Edwards

Dr Daniel Edwards

Daniel Edwards explores whether Australia’s university admissions pathways adequately meet the needs of students and society.

The Rationale For And Use Of Assessment Frameworks: Improving Assessment And Reporting Quality In Medical Education, Jacob Pearce, Daniel Edwards, Julian Fraillon, Hamish Coates, Benedict Canny, David Wilkinson

Dr Daniel Edwards

An assessment framework provides a structured conceptual map of the learning outcomes of a programme of study along with details of how achievement of the outcomes can be measured. The rationale for using frameworks to underpin the targeting of essential content components is especially relevant for the medical education community. Frameworks have the capacity to improve validity and reliability in assessment, allowing test developers to more easily create robust assessment instruments. The framework used by the Australian Medical Assessment Collaboration (AMAC) is an interesting and relevant case study for the international community as it draws and builds on established processes …

University Admissions In Australia: Multiple Pathways To The Same Destination, Daniel Edwards

Dr Daniel Edwards

The undergraduate population in Australian universities is a diverse group. A mixture of age cohorts, and relatively large numbers of international students, as well as an increasing variety of entry pathways mean that examining policy and practice in admissions to university in Australia is very interesting while at the same time substantially complex. This chapter offers a background on the Australian university student population in order to highlight this diversity, and then explores different approaches to admissions within the university sector. Exploration of admissions policies and outcomes in Australia is timely. In recent years an emphasis on growth in the …

Improving The Quality Of Medical Education, Daniel Edwards

Dr Daniel Edwards

An ongoing collaboration is developing tools and processes to help prove and improve the quality of medical education in Australia through quality comparison, the sharing of expertise and high-quality assessment, as Dan Edwards explains.

Australian Medical Assessment Collaboration: From Proof Of Concept To Proof Of Sustainability: Final Report 2014, Daniel Edwards, David Wilkinson

Dr Daniel Edwards

This is the final report for AMAC-2, entitled Australian Medical Assessment Collaboration: from proof of concept to proof of sustainability (OLT project ID12-2482). This project advanced previous work funded by the ALTC and was undertaken from early 2013 to mid 2014. AMAC-2 took the proof of concept achieved through the initial AMAC project with the aim of building an ongoing, sustainable and successful collaboration between medical schools in Australia and New Zealand.

Implementing Common Assessment: Lessons And Models From Amac Developed By The Australian Medical Assessment Collaboration, Daniel Edwards

Dr Daniel Edwards

The aim of this document is to provide insight into the implementation of common assessments in higher education in order to assist in future work on conducting these kinds of projects. The discussion here draws heavily on the AMAC experience, attempting to broaden the learning from this project for use in future collaborations. The focus of this project has been on medical education, and as such, much of the detail is related to this field. However, it is hoped that the general ideas discussed here can be seen as informative for other fields and disciplines in higher education and at …

Improving Engineering Work And Study, Daniel Edwards, Jacob Pearce

Dr Daniel Edwards

Daniel Edwards and Jacob Pearce discuss a study that explores the perceptions of the engineering workforce, including engineering education and barriers to participation and career advancement.

Focus Groups For Informing Awpa’S Engineering Workforce Study 2014: Final Report, Daniel Edwards, Jacob Pearce, Kate Perkins, Justin Brown

Dr Daniel Edwards

This report highlights the findings of a project undertaken by the Australian Council for Educational Research (ACER) for the Australian Workplace and Productivity Agency (AWPA) that will contribute to a wider study of the Engineering Workforce. The project involved the development, coordination, implementation of focus groups and the reporting of outcomes in a way that generates first-hand information about the experiences and attitudes of specific groups of people in relation to the engineering labour market – women, mature-age workers and new graduates. The work here also explored the views of the next generation of engineers, gathering information from school students …

Collaborative Assessments Of Learning Outcomes: Generating Positive Institutional Change, Jacob Pearce, Daniel Edwards

Dr Daniel Edwards

Insight into the development of higher education assessment collaborations in two fields (medical education and engineering education) is presented. These collaborations aim to improve and share assessment and assessment practice in order to enhance educational outcomes of students. This model is efficient and effective, can be applied nationally or internationally, and can generate positive institutional change around the globe.

Predicting Success In Medical Studies, Daniel Edwards

Dr Daniel Edwards

Daniel Edwards discusses the findings of a multi-institution investigation of the ability of Australia’s medical school admissions processes to predict future achievement levels.

Growth And ‘Quality’ In Higher Education, Daniel Edwards, Ali Radloff

Dr Daniel Edwards

Strong growth in university enrolments may not necessarily be affecting quality, according to analysis by Daniel Edwards and Ali Radloff.

Developing Outcomes Assessments For Collaborative, Cross-Institutional Benchmarking : Progress Of The Australian Medical Assessment Collaboration, Daniel Edwards, David Wilkinson, Benedict Canny, Jacob Pearce, Hamish Coates

Dr Daniel Edwards

The Australian Medical Assessment Collaboration (AMAC) began in 2010. This article charts the development of the collaboration over its initial years. AMAC was instigated as a way of improving the quality of medical education through the recognition of the need for tools for comparison and evaluation of learning outcomes, acknowledgement of the need for high quality assessment, and to share expertise in these areas. In a climate of increasing regulation and accountability, this collaboration was formed as a means of increasing assessment practices by, with and for medical schools. This article provides an overview of the background issues stimulating the …

Outcomes Assessment In Practice: Reflections On Two Australian Implementations, Daniel Edwards, Jacob Pearce

Dr Daniel Edwards

This chapter provides a critical reflection of the experiences of the authors in two different projects that have explored the assessment of learning outcomes of higher education students. Both projects were undertaken in the context of a growing higher education system and in an era of increased calls for accountability in higher education, and a ‘search’ for metrics to help monitor ‘quality’. Each project involved the development of assessments, engagement of higher education institutions and students, implementation of assessments and reporting of outcomes. While these projects both focused on measuring learning outcomes and were implemented in the same higher education …

Research Report : Higher Education Enrolment Growth : Exploring Recent Change By Provider Type, Daniel Edwards, Ali Radloff

Dr Daniel Edwards

This paper provides a snapshot of the higher education sector following recent policy changes that have promoted growth and expansion. The emphasis of this work is to highlight the relative enrolment changes among the different types of higher education providers in the sector during this growth period. The analyses show that most growth in the sector has been in universities – because it is universities which were the specific aim and beneficiaries of substantial change in policy and funding provision. However, the data also suggest that at the same time, other providers such as Private HEPs and TAFEs have managed …