Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 11 of 11

Full-Text Articles in Education

The Rationale For And Use Of Assessment Frameworks: Improving Assessment And Reporting Quality In Medical Education, Jacob Pearce, Daniel Edwards, Julian Fraillon, Hamish Coates, Benedict Canny, David Wilkinson Jun 2015

The Rationale For And Use Of Assessment Frameworks: Improving Assessment And Reporting Quality In Medical Education, Jacob Pearce, Daniel Edwards, Julian Fraillon, Hamish Coates, Benedict Canny, David Wilkinson

Dr Jacob Pearce

An assessment framework provides a structured conceptual map of the learning outcomes of a programme of study along with details of how achievement of the outcomes can be measured. The rationale for using frameworks to underpin the targeting of essential content components is especially relevant for the medical education community. Frameworks have the capacity to improve validity and reliability in assessment, allowing test developers to more easily create robust assessment instruments. The framework used by the Australian Medical Assessment Collaboration (AMAC) is an interesting and relevant case study for the international community as it draws and builds on established processes …


Remember The Students: Lessons For Learning Outcomes Assessments, Jacob Pearce, Daniel Edwards Feb 2015

Remember The Students: Lessons For Learning Outcomes Assessments, Jacob Pearce, Daniel Edwards

Dr Jacob Pearce

Assessments of student learning outcomes are important for institutional and system-level quality assurance, but should also help students improve their knowledge and skills.


Improving Engineering Work And Study, Daniel Edwards, Jacob Pearce Feb 2015

Improving Engineering Work And Study, Daniel Edwards, Jacob Pearce

Dr Jacob Pearce

Daniel Edwards and Jacob Pearce discuss a study that explores the perceptions of the engineering workforce, including engineering education and barriers to participation and career advancement.


Assessment Of Medical Students’ Learning Outcomes In Australia : Current Practice, Future Possibilities, David Wilkinson, Benedict Canny, Jacob Pearce, Hamish Coates, Daniel Edwards Feb 2015

Assessment Of Medical Students’ Learning Outcomes In Australia : Current Practice, Future Possibilities, David Wilkinson, Benedict Canny, Jacob Pearce, Hamish Coates, Daniel Edwards

Dr Jacob Pearce

All 19 medical schools in Australia examine and assess the performance of their students, but do so largely in isolation from each other. That is, most schools design, develop and deliver their own exams, against their own curriculum and standards, and students pass, fail and are graded with little external moderation or comparison. Accreditation of schools by the Australian Medical Council (AMC) provides some reassurance that assessment practices are appropriate in medical schools. However, very limited data are available for benchmarking performance against any national standard, or between medical schools in Australia. The Australian Medical Assessment Collaboration has been designed …


Outcomes Assessment In Practice: Reflections On Two Australian Implementations, Daniel Edwards, Jacob Pearce Feb 2015

Outcomes Assessment In Practice: Reflections On Two Australian Implementations, Daniel Edwards, Jacob Pearce

Dr Jacob Pearce

This chapter provides a critical reflection of the experiences of the authors in two different projects that have explored the assessment of learning outcomes of higher education students. Both projects were undertaken in the context of a growing higher education system and in an era of increased calls for accountability in higher education, and a ‘search’ for metrics to help monitor ‘quality’. Each project involved the development of assessments, engagement of higher education institutions and students, implementation of assessments and reporting of outcomes. While these projects both focused on measuring learning outcomes and were implemented in the same higher education …


Collaborative Assessments Of Learning Outcomes: Generating Positive Institutional Change, Jacob Pearce, Daniel Edwards Feb 2015

Collaborative Assessments Of Learning Outcomes: Generating Positive Institutional Change, Jacob Pearce, Daniel Edwards

Dr Jacob Pearce

Insight into the development of higher education assessment collaborations in two fields (medical education and engineering education) is presented. These collaborations aim to improve and share assessment and assessment practice in order to enhance educational outcomes of students. This model is efficient and effective, can be applied nationally or internationally, and can generate positive institutional change around the globe.


Same Admissions Tools, Different Outcomes : A Critical Perspective On Predictive Validity In Three Undergraduate Medical Schools, Daniel Edwards, Tim Friedman, Jacob Pearce Feb 2015

Same Admissions Tools, Different Outcomes : A Critical Perspective On Predictive Validity In Three Undergraduate Medical Schools, Daniel Edwards, Tim Friedman, Jacob Pearce

Dr Jacob Pearce

Admission to medical school is one of the most highly competitive entry points in higher education. Considerable investment is made by universities to develop selection processes that aim to identify the most appropriate candidates for their medical programs. This paper explores data from three undergraduate medical schools to offer a critical perspective of predictive validity in medical admissions. This study examined 650 undergraduate medical students from three Australian universities as they progressed through the initial years of medical school (accounting for approximately 25 per cent of all commencing undergraduate medical students in Australia in 2006 and 2007). Admissions criteria (aptitude …


Assessing Vocational Competencies In Civil Engineering: Lessons From Ahelo For Future Practice, Jacob Pearce Jan 2015

Assessing Vocational Competencies In Civil Engineering: Lessons From Ahelo For Future Practice, Jacob Pearce

Dr Jacob Pearce

There has been much interest in the notion of vocational competencies of late. The pressing question, however, is how to measure vocational competencies. In order to contribute to this ‘how’, the results of the Civil Engineering strand of the recent Assessment of Higher Education Learning Outcomes (AHELO) Feasibility Study are discussed. The focus of the assessment instrument was explicitly on “above content” areas of the domain, and the assessment framework provides an example of a construct which articulates certain domain-specific competence components. This paper draws specific attention the Constructed Response Tasks (CRTs) in the instrument and discusses the results of …


Determining The Quality Of Assessment Items In Collaborations: Aspects To Discuss To Reach Agreement, Lambert Schuwirth, Jacob Pearce Aug 2014

Determining The Quality Of Assessment Items In Collaborations: Aspects To Discuss To Reach Agreement, Lambert Schuwirth, Jacob Pearce

Dr Jacob Pearce

No abstract provided.


Ensuring Quality In Ahelo Item Development And Scoring Processes, Jacob Pearce Dec 2013

Ensuring Quality In Ahelo Item Development And Scoring Processes, Jacob Pearce

Dr Jacob Pearce

This chapter summarises the work undertaken in the Engineering Strand of the OECD's Assessment of Higher Education Learning Outcomes (AHELO) Feasibility Study. The iterative processes of design, review and revision that were followed to ensure that the assessment instrument and scoring processes were of high quality are outlined in detail. There are several lessons which can be drawn out of these experiences for future practice. The chapter offers an example of the amount of thinking and effort that is required in the development of an assessment instrument and the scoring processes related to it, if high quality data and directions …


Group Of National Experts On The Ahelo Feasibility Study : Engineering Assessment Framework : Ahelo Feasibility Study, Hamish Coates, Sarah Richardson, Jacob Pearce, Julian Fraillon Oct 2011

Group Of National Experts On The Ahelo Feasibility Study : Engineering Assessment Framework : Ahelo Feasibility Study, Hamish Coates, Sarah Richardson, Jacob Pearce, Julian Fraillon

Dr Jacob Pearce

This AHELO Engineering Assessment Framework describes and illustrates the domain of engineering competency that is used in the AHELO Feasibility Study. The framework gives an organisational structure for the domain in terms of engineering knowledge, processes and contexts; describes the types of assessment items that have been developed; and details how reporting will be carried out. - p.4