Educational Assessment, Evaluation, and Research Commons^™

Computer-Based Exams In Schools: Freedom From The Limitations Of Paper?, Christopher Paul Newhouse

Research outputs 2013

There is little doubt that the curriculum content and pedagogy in schools is driven by the structure and forms of assessment employed, particularly for summative purposes. When most such assessment was limited to what a student could do with a pen and paper in short ‘exams’ this pushed the content of the curriculum towards small descriptive chunks, and the pedagogy towards memorisation and replication techniques. Over the past two decades alternative forms of assessment supported by the power of computer systems have been conceived and tried. This paper discusses progress towards various forms of computer-based exams and how these may …

E-Invigilator: A Biometric-Based Supervision System For E-Assessments, Nathan L. Clarke, P Dowland, Steven M. Furnell

Research outputs 2013

The creation of Virtual Learning Environments (VLEs) have revolutionized the online delivery of learning materials, from traditional lectures slides through to podcasts, blogs and wikis. However, such advances in how we assess such learning have not evolved - with physical attendance at proctored exams still a necessity for formal assessments. This paper presents a novel model to enable remote and electronic invigilation of students during formal assessment. The approach utilizes transparent authentication to provide for a non-intrusive and continuous verification of the candidates identity throughout the examination timeframe. A prototype is developed and a technology evaluation of the platform demonstrates …

Digital Representation Of Visual Artworks For High-Stakes Assessment, Christopher P. Newhouse

Research outputs 2013

The collection and marking of student artwork across a large jurisdiction such as Western Australia is challenging where the work is submitted to a central location to be marked by experts and returned to students. An alternative approach would be to submit digital representations of the artworks online for marking. However, to give a valid and reliable measure the representations would need to be of adequate quality. Further, judgements of artworks are necessarily subjective giving concern about the reliability of marking for high-stakes assessment. The comparative pairs method of marking lends itself to addressing this problem and is feasible where …

Engaging Students In Peer Review: Feedback As Learning, Catherine Moore, Susan Teather

Research outputs 2013

There is a growing interest in tertiary education in Australia about developing the capacity of learners to evaluate and improve both their own work and that of others (Boud & Falchikov, 2006; Oliver, 2011). In order to successfully direct their own learning beyond university (and engage in lifelong learning), students need to be able to evaluate their performance in relation to a standard, identify gaps, and determine how to bridge them in order to achieve the desired standard if required. One strategy that can be employed to help students achieve this is engaging them actively in a feedback process, so …

Self-Assessment Of Employability Skill Outcomes Among Undergraduates And Alignment With Academic Ratings, Denise Jackson

Research outputs 2013

Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in over- and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in more than 1000 Australian business undergraduates. It evaluates the extent to which student self-assessments differ from academics, in what ways and the influence of certain individual and background characteristics - such as stage of degree, gender and academic ability - on rating accuracy. Explanations for documented disparities are presented, in addition to implications and strategies …

The Contribution Of Work-Integrated Learning To Undergraduate Employability Skill Outcomes, Denise Jackson

Research outputs 2013

WIL has attracted considerable attention as an instrument for enhancing professional practice and developing work-readiness in new graduates. It is widely considered as a point of difference in developing graduate employability by enhancing skill outcomes, such as team-work, communication, self-management and problem solving, employment prospects and student understanding of the world-of-work. This paper investigates the role of WIL in improving undergraduate employability skills; gauging its impact on a range of skills; and identifying variations in outcomes for certain demographic, study background and placement characteristics using survey data from 131 WIL students in an Australian university. Results indicate a significant improvement …

Student Perceptions Of The Importance Of Employability Skill Provision In Business Undergraduate Programs, Denise Jackson

Research outputs 2013

Studies examining student perceptions of employability skill development in business undergraduate programs are limited. Assurance of student buy-in is important to ensure learners engage with skill provision; to enable them to articulate their capabilities to potential employers and to facilitate the transfer of acquired skills. This study examines 1019 students’ perceptions of the importance of employability skill development, the relative importance of skills and the influence of certain demographic/background characteristics. Findings indicate undergraduates value skill development, most particularly communication and team-working, and some significant variations in importance ratings. Alignment with other stakeholder perceptions and the influence of context are discussed.

The Reality Of Reform : Teachers Reflecting On Curriculum Reform In Western Australia, Jessica Lyle

Theses: Doctorates and Masters

Australia is implementing its first national curriculum, the Australian Curriculum, after many years of debate regarding the validity and practicality of such an undertaking. Although it is widely accepted that “the effects of education policies and programs depend chiefly on what teachers make of them” (Cohen & Ball, 1990, p. 233), little is known about teachers’ perceptions of the Australian Curriculum or their prior experiences of mandatory curriculum reform as they begin engaging with this unique reform. To provide a means of exploring these perceptions and experiences, 18 teachers, four Head of Learning Areas (HOLAs) and the principal from a …

Investigation Of Partnership And Engagement Methods To Increase Research Capability At Edith Cowan University, Darren Gibson

Research outputs 2011

There is an increasing interest within all areas of research to collaborate, with networks and partnerships being used to develop research ideas and enhance research outcomes. A Collaboration Research Network (CRN) is one such method that can enhance a research system. Correspondingly Edith Cowan University (ECU) has established CRN activities in four areas of national importance; health, education, ICT and environment with a view to enhancing the University’s research output. However, CRN dynamics and mechanisms are complex and having a CRN per se does not guarantee enhanced research outcomes. This study will use both quantitative and qualitative methods to investigate …

Aboriginal Research And Study Protocols, Dan Mcaullay, Colleen Hayward

Research outputs 2012

The Aboriginal Research and Study Protocols have been developed as a guide for ECU staff and students undertaking research, projects or fieldwork that involve Indigenous Australian issues, people or knowledge or that impact on Indigenous people or communities.

These protocols fulfil a strategic priority of ECU’s Reconciliation Action Plan: Develop clear and agreed protocols around Indigenous Australian research to ensure that research activity is informed by thorough cultural awareness and respect.

They also reflect the requirements of key documents that must be addressed by applicants as required by the ECU Human Research Ethics Committee. If the proposed project relates to …

Managing Eresearch Data Within A Collaborative Research Network, Darren Gibson, Julia Gross

Research outputs 2011

Edith Cowan University (ECU) is one of twelve Australian universities striving to create world-class research capacity and capability through investment in the Collaborative Research Network (CRN) project. The CRN project at ECU aims to accelerate the growth of research activity in four key areas: Health, Education, ICT, and Environment. These areas align to both the Australian Government’s National Research Priorities and ECU’s strategic research plan. Managing eResearch data is essential, especially within a CRN to ensure the maximum benefit is achieved from the investigations. Currently, there is no set model to follow. Normally an institution will establish its own policy …

Collaborative Research Network Showcase And Scholarship Opportunities, Donna S. Cross, Robert Newton, Cobie Joan Rudd, Kamal Alameh, Mark Hackling, Kathryn Mcmahon

ECU Research Week

No abstract provided.

Evidence For Practice: Whole-School Strategies To Enhance Students' Social Skills And Reduce Bullying In Schools, Donna Cross (Ed.)

Research outputs 2012

While bullying behaviour is widespread and harmful in schools, research conducted at the Child Health Promotion Research Centre (CHPRC) at Edith Cowan University and elsewhere11 - 31 suggests bullying behaviour can be reduced. The CHPRC research team's ongoing empirical research, conducted since 1999, has focused primarily on what schools can do to effectively prevent and reduce bullying behaviour.

One of the most effective means to reduce bullying among young people is to enhance their social and emotional understandings and competencies, in developmentally appropriate ways throughout their schooling, using a whole-school approach. Friendly Schools Plus addresses the social and emotional learning …

Lessons For Teachers: What Lower Secondary School Students Tell Us About Learning A Musical Instrument, Geoffrey Lowe

Research outputs 2012

In this study I set out to investigate why many students drop out from elective instrument programmes, particularly in lower secondary school. I examined the values and beliefs a sample of students in their first year in secondary school attach to learning an instrument, and the impact of the instrument lesson upon these values and beliefs. Forty-eight year 8 students (aged 12-13) from the Perth metropolitan area participated in eight focus groups. The study found that, while participants had strong cognitive and affective reasons for learning, their competence beliefs were fragile, due in part to the dislocation associated with the …

Testing A Model Of Undergraduate Competence In Employability Skills And Its Implications For Stakeholders, Denise Jackson

Research outputs 2012

Despite the development of employability skills being firmly entrenched in higher education’s strategic agenda worldwide; recent graduates’ standards in certain skills are not meeting industry expectations. This paper presents and tests a model of undergraduate competence in employability skills. It highlights those factors which impact on competence in employability skills and identify ways in which stakeholders can adjust curricula and pedagogy to enhance graduate skill outcomes. Data was gathered from an online survey of 1008 business undergraduates who self-rated their competence against a framework of employability skills typically considered essential in graduates. The data was analysed using multiple regression techniques. …

Principles For Designing An Effective, Post-Compulsory Music Curriculum Suitable For Western Australia, Andrew T. Sutherland

Theses: Doctorates and Masters

A new post-compulsory Music course known as the Western Australian Certificate of Education (WACE) Music course was recently introduced into Year 11 and 12 in Western Australian (WA) schools. Following a convoluted process of creation, its implementation into classrooms has been problematic. Given criticism levelled at its process of creation and implementation, the researcher questions whether the WACE Music course embodies effective, recognised principles to support the effective teaching and learning of music. This study investigates the principles which should form the basis of an effective, post-compulsory music curriculum, suitable for WA. It involved a literature review which sought to …

Business Undergraduates' Perceptions Of Their Capabilities In Employability Skills : Implications For Industry And Higher Education, Denise Jackson

Research outputs 2012

In response to the continuing disparity between industry expectations and higher education provision, this study examines the self-assessed capabilities of 1,024 business undergraduates in employability skills typically considered important by industry in developed economies. The findings indicate relative perceived strengths in 'social responsibility and accountability', 'developing professionalism' and 'working effectively with others', and weaknesses in 'critical thinking', 'developing initiative and enterprise' and 'self-awareness'. Although these findings align with those of recent employer-based studies, undergraduates rate themselves considerably higher than their industry counterparts. The implications of this overconfidence in personal ability, commonly associated with so-called Generation Y graduates, for persistent graduate …

The 3-Year Fast-Track Phd, Terence Love

ECU Research Week

No abstract provided.

Assessing Practical Laboratory Skills In Undergraduate Molecular Biology Courses, Lynne Hunt, Annette Koenders, Vidar Gynnild

Research outputs 2011

This study explored a new strategy of assessing laboratory skills in a molecular biology course to improve: student effort in preparation for and participation in laboratory work; valid evaluation of learning outcomes; and students’ employment prospects through provision of evidence of their skills. Previously, assessment was based on written laboratory reports and examinations, not on the demonstration of practical skills per se. This action research project involved altering the assessment design so that a greater proportion of the marks was allocated to active participation and learning in the laboratory, partially replacing a single examination with direct observation of student participation …

A Comparative Study Of The Views Of Planning Students And Professionals About Planning Education In Western Australia, Garry Middle, Timothy J. Perkins, Jenny George

Research outputs 2011

This paper reports the finding of a study into the relevance of Planning Education in Western Australia (WA). Phase one involved surveying students Planning at both Curtin and Edith Cowan Universities and WA Planning professionals. Participants were asked to rate the importance of the various 'streams' of planning education, their passion for planning, and to identify what were the key attributes of an 'excellent' planner. The survey was followed up with qualitative research involving focus groups of selected students to explore in depth the similarities and differences between the views of students and professionals and the issues raised by the …

Integrating The Academic Experience: An Inter-Disciplinary Approach To The Authentic Marketing Research Experience, Gary J. Marchioro, Maria M. Ryan, Timothy J. Perkins

Research outputs 2011

This paper describes the evolution of an innovative inter–disciplinary approach to teaching and learning in a University Faculty of Business. Further, it reviews the implementation of a series of unique, integrated and authentic assessments involving units based in the marketing, urban planning and business communication disciplines. The project has used the production of Revitalization Plans for the University‘s campuses as the basis for integrating student teaching and learning. It has championed an approach which moves away from the traditional ‗silo‘ methods of academic assessment to integrated, contextualised learning which develops both generic and discipline-specific skills such as client/consultation roles, business …

Who Stole My Idea? Why Researchers Need To Look At Past Theses On Their Own And Associated Topics, Ken Gasmier

ECU Research Week

No abstract provided.

An Investigation Into The Feasibility Of Using Digital Representations Of Students’ Work For Authentic And Reliable Performance Assessment In Applied Information Technology, David G. Miller

Theses: Doctorates and Masters

The assessment of student performance in areas such as drama, physical education, art and Information Technology (IT), does not lend itself to traditional, paper-based testing methods. In these domains, much emphasis is placed on the acquisition and demonstration of practical skills and these may be difficult, if not impossible, to measure by scores on theoretical, written assessments. Alternative forms of assessment, which are both valid and reliable, need to be devised for the practical aspects of these subject areas. The capture, in digital form, of students’ work, may allow the development of authentic forms of summative, high-stakes assessment with high …

How Does Your Research Find An Audience? Discover Research Online, Julia Gross

ECU Research Week

Introduction to online research outputs and ECU's own Research Online.

Measuring Research Impact Using Bibliometrics, Constance Wiebrands

ECU Research Week

Introduces a range of tools for bibliometric analysis.

What Examiners Look For In A Thesis, Alan Brown

ECU Research Week

Professor Alan Brown uses his extensive experience as both a supervisor and thesis examiner to take you inside the minds of thesis examiners. This presentation will address a range of things which you should and shouldn’t do in your thesis, which includes, some basic overall advice along with suggestions and a checklist for each chapter of your thesis. Additionally, key issues which annoy examiners and which are frequently overlooked by students.

Study In Prison: Consumption Or Investment?, Margaret Giles

ECU Research Week

Research into prisoner education and training in WA's adult prisons.

Online Metacognitive Tool Development: Final Development, Joseph Luca, Mark Mcmahon

Research outputs pre 2011

The authors of this paper have been developing an online metacognitive tool over the past four years through a process of iterative design and development stages using Design-Based research. Based on feedback from students, tutors and peers, the application has now been finally developed and is available for public download. The application helps students working in teams reflect on their learning strategies through a process of planning, monitoring and evaluation, and allows students to reflect on their performance.

Introducing A New Technology To Enhance Community Sustainability: An Investigation Of The Possibilities Of Sun Spots, S Tantisureeporn, L J. Armstrong

EDU-COM International Conference

The introduction of the Sun SPOT, Small Programmable Object Technology, developed by Sun Microsystems has been depicted as providing a revolutionary change in cyber physical interaction. Based on Sun Java Micro Edition (ME), this sensor technology has the potential to be used across a number of discipline areas to interface with systems, the environment and biological domains. This paper will outline the potential of Sun SPOTs to enhance community sustainability. An action based research project was carried out to investigate the potential uses of these technologies and develop a prototype system as a proof of concept. The research will compare …

Item Banking With Rasch Measurement: An Example For Primary Mathematics In Thailand, Chaowprapha Chuesathuchon, Russell F. Waugh

EDU-COM International Conference

This study was conducted in Thailand to create a Mathematics item bank and a Computerized Adaptive Test (CAT) for the students to ‗interrogate‘ the bank. First, 290 multiple-choice test items on mathematical equations were created for an item bank. They consisted of nine aspects: (1) identifying an equation; (2) identifying the true equation; (3) identifying equations with an unknown; (4) finding the value of an unknown that satisfies the equation; (5) identifying a method to solve an equation; (6) finding the solutions to equations; (7) finding a solution to an equation related to a given condition; (8) selecting an equation …