Educational Assessment, Evaluation, and Research Commons^™

Education In A Warming World: Trends, Opportunities And Pitfalls For Institutes Of Higher Education, Orla Kelly, Sam Illingworth, Fabrizio Butera, Vaille Dawson, Peta White, Mindy Blaise, Pim Martens, Geertje Schuitema, Maud Huynen, Susan Bailey, Sian Cowman

Research outputs 2022 to 2026

Higher education institutes (HEI) face considerable challenges in navigating how to respond to the escalating and intertwined socio-ecological sustainability crises. Many dedicated individuals working in the sector are already driving meaningful action through rigorous research, teaching, knowledge sharing, and public engagement, while there is a growing consensus that sector-wide change is needed to ensure that aspirational declarations and positive individual actions translate into sustainable and transformative change. This article seeks to contribute to such efforts by illustrating a number of trends, examples, and reflections on how third-level educational institutes can act sustainably. We highlight the potential of five strategies HEI …

Enhancing Quality And Equity? Performance Assessment Validation In Examination Physical Education In Western Australia, Dawn Penney, Eibhlish O'Hara, Rob Lund

Research outputs 2022 to 2026

The positioning and format of performance assessment in examination physical education varies between courses across Australia and internationally. This paper centres on developments in performance assessment in the Physical Education Studies (PES) course in Western Australia (WA). In 2021 The School Curriculum and Standards Authority (SCSA) undertook an assessment validation trial of school-based assessment of students participating in modified format competitive game play in the 10 PES sports. This contrasted to existing centralised examination arrangements. The paper reports on findings from observation of the trial in nine of the 10 sport contexts, and semi-structured interviews with teachers, validators and SCSA …

The Knowledge Produced Through Student Drawings, Vesife Hatisaru

Research outputs 2022 to 2026

Drawings have been extensively used as a research method to gather data from research participants including school students regarding their perceptions of mathematics and its teaching and learning. What is valued in drawing-based research in mathematics education, and what kind of knowledge is produced through student drawings, however, is not known. This study examines drawing-based research studies to understand these questions by applying a novel framework – the legitimation code theory (LCT). The study focuses on two cases: one of which looked at middle school students’ images of mathematicians (draw a mathematician) and the other examined the same age group …

Stt Kadesi’S Disrupting The Teaching And Learning Process During Covid-19, Muner Daliman, Hana Suparti, Jonathan D. James, Eudia Anggelia Ika Agustin, Hengky Wijaya

Research outputs 2022 to 2026

In this paper we report on a pilot study of the teaching and learning at Sekolah Tinggi Teologi KADESI (STTK), a tertiary theological institution in Yogyakarta, during the Covid-19 pandemic in 2020. Our methods for collecting data were to survey the 40 students and conduct one-to-one interviews with the 10 lecturers at STTK. The analysis of data drew on two theoretical constructs: Donald Schön’s reflection-in-action and the notion of empowerment in an educational context. We found challenges and difficulties to do with the logistics of teaching and the barriers to communication between instructors and students. And on the positive side, …

International Professional Skills: Interdisciplinary Project Work, Thomas Mejtoft, Helen Cripps, Christopher Blöcker

Research outputs 2022 to 2026

Higher education should provide learning situations that prepare students for a future profession and make them world-ready. This paper reports insights from an international interdisciplinary collaborative project aiming to create learning experiences that are close to a professional situation. The collaboration setup simulates a setting of a digital agency with a development team in Sweden and a marketing team in Australia working together to solve a task. The collaborative project has been active since 2017, completing its fifth iteration in 2021. Postcourse survey results show that the students felt that a real situation was created with a high level of …

Curriculum Reform In Wales: Physical Education Teacher Educators' Negotiation Of Policy Positions, David Aldous, Victoria Evans, Dawn Penney

Research outputs 2022 to 2026

This paper reports on research that explored the experiences of secondary Physical Education Teacher Education (PETE) professionals' simultaneous negotiation and implementation of the new Curriculum for Wales (CfW) Health and Well-Being (HWB) Area of Learning and Experience (AoLE) and policies focused on the transformation of Initial Teacher Education (ITE) in Wales. The study was an exploratory case study of PETE professionals working within one university's ITE programme. Data were generated through documentary analysis of PETE and ITE programme materials and semi-structured interviews with staff involved in programme management and delivery. Data analysis employed Ball and colleagues' conceptualisation of policy actors …

Pre-Service Teachers' Use Of Ict To Collaborate To Complete Assessment Tasks, Eileen V. Slater, Donna Barwood, Zina Cordery

Research outputs 2022 to 2026

This research explored the use of ICT products by n = 123 pre-service teachers to complete collaborative assessments. Students responded to a questionnaire relating to the use, benefits and limitations, and what would better enable the use of ICT for collaborative assessment purposes. The ICT products favoured by students did not support some key elements necessary for online collaboration, through either student use or product functionality. Poor Internet access was a commonly cited limitation with the effect of reducing access to available ICT skills training. Suggestions for changes to course structure and content and further research are made.

The Policy-Driven Dimensions Of Teacher Beliefs About Assessment, Dennis Alonzo, Velma Labad, Jean Bejano, Florence Guerra

Australian Journal of Teacher Education

Despite the advancement of the conceptualisations of teacher assessment literacy, teachers’ assessment practices remain relatively low due to misalignment between teachers’ beliefs on assessment and principles of effective assessment practices. The current assessment reform in the Philippines has not gained significant traction despite the ongoing professional development programs focused on enhancing teacher assessment literacy. We argue that to change teachers’ exam-dominated assessment practices towards a more student-centred approach, there is a need to explore teachers’ beliefs in assessment. Hence, we developed a context-driven tool using both theoretical and empirical approaches that could measure this construct, and which the results could …

How Constructivist Theories Of Development Can Be Used To Re-Conceptualise Naplan As An Opportunity To Develop Student Resilience, Robert M. Vanderburg, Paul Trotter

Australian Journal of Teacher Education

Teachers have come under increased pressure to improve educational outcomes as Australia has sought to meet the challenges of competing on an international level. This intensified pressure has been accompanied by improved levels of funding, a National Curriculum for all Australian states, and territories, along with assessments to measure these key outcomes. However, this increased level of scrutiny has affected the pedagogical choices of teachers. Traditional modes of instruction have been reinforced, with teachers moving away from effective constructivist approaches to learning. This article will propose that a reinterpretation of constructivist theories of development is needed to arrest this decline, …

Using An Online Numeracy Practice Test To Support Education Students For The Numeracy Component Of The Lantite, Thuan Thai, Kate Hartup, Adelle Colbourn, Amanda Yeung

Australian Journal of Teacher Education

In Australia, teacher education students must pass the Literacy and Numeracy Test for Initial Teacher Education (LANTITE) to meet accreditation requirements. Although this has been mandated since 2016, there are currently few resources available for students to use in preparation for the test. To help students prepare for the numeracy component of the LANTITE, we developed an online Numeracy Practice Test (NPT) through the institution’s learning management system. This study assessed the learning analytics from the NPT between students who subsequently passed the numeracy component of the LANTITE with those that failed. Our results show that students who passed performed …

The Value Of Praxis-Based Assessment To Stimulate Practical Engagement And Classroom Readiness In Online Initial Teacher Education, Katie M. Burke, Melissa Fanshawe

Australian Journal of Teacher Education

The opportunity to undertake teaching degrees entirely via online learning has proliferated in the last decade. Research shows that students choose to engage with content and application activities when they are directly aligned to assessment. The researchers trialled praxis-based assessment which required completion of practical learning tasks embedded in core learning content over two semesters in two Australian Initial Teacher Education courses. The aim was to enhance online student engagement in practical learning. Insights into the student perspective were gained through a survey, interviews, and learning analytics. The results from this study showed praxis-based assessment increased student confidence, classroom readiness …

The Role Of The Teacher As Assessor: Developing Student Teacher’S Assessment Identity., Audrey Doyle, Marie Conroy Johnson, Enda Donlon, Elaine Mcdonald, Pj Sexton

Australian Journal of Teacher Education

The closure of schools across the globe due to the Covid-19 pandemic had the potential to have a catastrophic impact on a fundamental pillar of initial teacher education: school placement. This paper maps a new “site” of professional practice for “school placement” called “Teacher Online Programme” (TOP) using Xu and Brown’s (2016) conceptual framework of teacher assessment literacy in practice. Its main focus lies in the integration of the assessment baseline knowledge into the programme under the seven elements proposed by the framework. A case study methodology informed the approach taken. Data was collected and analysed in three phases: the …

The State Of Micro-Credentials Implementation And Practice In Australasian Higher Education, Ratna Selvaratnam, Michael Sankey

Research outputs 2014 to 2021

Micro-credentialing is rapidly growing globally as learning that is both life-long and life-wide and this has only accelerated due to COVID-19. To understand what this means for higher education, The Australasian Council on Open, Distance and eLearning has conducted two surveys on the implementation and practice of micro-credentialing in the Australasian sector. With the surveys conducted a year apart, before and after the pandemic, significant changes are noted in the delivery of learning. The results show an increased interest and intention in rolling out micro-credentials, as evidenced, particularly, in work undertaken at the policy level. However, in relation to actual …

Digital Representation For Assessment Of Spoken Efl At University Level: A Case Study In Vietnam, Thi Bich Hiep Vu

Theses: Doctorates and Masters

Assessing the speaking performance of students who are studying English as a Foreign Language (EFL) has mainly been conducted with face-to-face speaking tests. While such tests are undoubtedly interactive and authentic, they have been criticised for subjective scoring, as well as lacking an effective test delivery method and recordings for later review.

Technology has increasingly been integrated into speaking tests over the last decade and become known as computer-assisted or computer-based assessment of speaking. Although this method is widely acknowledged to measure certain aspects of language speaking effectively, such as pronunciation and grammar, it has not yet proved to be …

How Teachers Use Formative Assessment Strategies During Teaching: Evidence From The Classroom, Hem Chand Dayal

Australian Journal of Teacher Education

Using lesson observations, the study reported in this article explores how two practising secondary mathematics teachers implemented formative assessment actions in their classroom teaching. The study also investigated whether teachers’ beliefs about teaching and assessment could be mapped onto their classroom practices. In particular, while the two teachers were implementing student portfolio assessment in their own Year 9 mathematics lessons, the classroom observations focused on how they utilised formative assessment actions such as clarifying and sharing learning criteria intentions and criteria for success; activating students as instructional resources; and, providing feedback that moves learners forward. The findings suggest that one …

Initial Education Of Philosophy Teachers In Colombia: Association Between New Public Policy Requirements And National Standardized Tests, Alejandro Farieta-Barrera

Australian Journal of Teacher Education

This paper evaluates the association between new public policy requirements for B.Ed. programs in Colombia —1) demand high-quality accreditation, 2) restrict distance modality, 3) restrict multidisciplinary programs, and 4) increase academic credits in education courses and pedagogical practices— and the outcomes of 1387 B.Ed. in Philosophy students in the National Saber Pro test 2016-2018, in ‘Education’ component. The methodology was multilevel linear regression; the residential region is the level variable, and were included other control variables (gender, age, ethnic minority, socioeconomic index, etc.). The results show that outcomes are associated with pedagogical practices and with non-multidisciplinary programs, supporting new regulations. …

Voices On Data Literacy And Initial Teacher Education: Pre-Service Teachers’ Reflections And Recommendations, Shannon Kennedy-Clark, Vilma Galstaun, Peter Reimann, Taylor Martyn, Kiatin Williamson, Jessica Weight

Australian Journal of Teacher Education

The purpose of study was gain insight into pre-service teachers’ experiences in using classroom data to make learning and teaching decisions. The qualitative study is based on the reflections and recommendations of three pre-service teachers’ that participated in a data-driven decision-making intervention whilst on an immersive 10-week professional learning experience. This study is underpinned by an action research framework. There are many understandings of action research, here the approach is understood to be a systematic investigation into one’s own practice with the aim of improving teaching and learning. From the thematic analysis of the reflections, several recommendations were put forward …

Investigating The Assessment Practices Within An Initial Teacher Education Program In An Australian University: Staff Perceptions And Practices, Georgina M. Barton, Margaret Baguley, Martin Kerby, Abbey Macdonald

Australian Journal of Teacher Education

Effective assessment design and subsequent assessment practices are essential for student success in the higher education sector. A plethora of research on assessment in higher education exists which tends to focus primarily on the student experience. This paper shares results from a 3 phased study that explored staff perceptions related to assessment practices in an undergraduate Initial Teacher Education program within an Australian metropolitan university. First, course learning objectives, activities and assessment items were mapped to identify the presence of constructive alignment. Second, staff were invited to complete a survey and a follow-up interview in relation to understanding of assessment …

Implementing A Teaching Performance Assessment: An Australian Case Study, John Buchanan, George Harb, Terry Fitzgerald

Australian Journal of Teacher Education

This paper reports on the implementation of a Teaching Performance Assessment (TPA), a component of graduation recently introduced into the teaching workforce in Australia. The TPA typically requires graduates to demonstrate that they can plan, implement, assess and reflect on a series of lessons given to school students. This case study used grounded theory to analyse the initial implementation of a TPA at an Australian university, based on interviews, student focus groups, and a classroom readiness survey. We investigated the TPA’s contribution to final-year pre-service teachers’ learning and professional readiness. We conclude that the TPA, as a threshold task, is …

Factor Structure Of Multicultural Teaching Competency Scale For School-Teachers In Hong Kong, Chi Hung Leung, Ming Tak Hue

Australian Journal of Teacher Education

This study investigates the perceptions of teaching competency in multicultural classrooms held by 421 teachers at 16 schools in Hong Kong. The aims of the study are (a) to use confirmatory factor analysis to validate a culturally appropriate version of the Multicultural Teaching Competency Scale (MTCS), (b) to assess three types of multicultural-teaching competency, and (c) to provide recommendations for teacher-education institutes and policy makers on developing effective training in multicultural education. The results indicate that a tripartite model assessing skills, knowledge, and relationships, the core features of multicultural-teaching competency as assessed by the MTCS from a Hong Kong sample. …

Teacher Perspectives On The Use Of The Australian Professional Standards For Teachers As Part Of Their Evaluation Process, Damien Barry, Donna Pendergast, Katherine Main

Australian Journal of Teacher Education

Teacher effectiveness has a powerful impact on student performance and a teacher evaluation process that supports professional growth can be a key lever for improving teaching quality. The purpose of this study was to examine teacher perspectives on the use of the Australian Professional Standards for Teachers, when used as part of their evaluation process, and, to determine what other factors may need to be considered in the design and implementation of such a process. A single case study of a school in Victoria, Australia was conducted, using a pre and post interview approach with six teachers. Responses were analysed …

Indonesian Teachers Beliefs On The Gap Between Educational Research And Practice, Yoppy Wahyu Purnomo, Puri Pramudiani, Tian Abdul Aziz, Amrita Kaur, Siti Noor Ismail, Ishaq Nuriadin

Australian Journal of Teacher Education

Teachers' beliefs towards educational research has become one significant factor in explaining the gap between research and practice. The present study aimed at reviewing the scale to measure teachers' beliefs about the causes and problems related to research-based practices, describing beliefs that teachers appear to hold, and examining its relation to their demographic characteristics. The study involved 466 in-service teachers in Jakarta Province. The study employed the 24-item scale developed by Broekkamp and van Hout-Wolters (2007). The study indicated that 20 out of 24 items of the scale were valid and reliable to measure the teachers’ beliefs. The scale consisted …

The Viability Of Simulated Large-Scale Marking As Professional Development For Preservice Teachers, Nathanael Reinertsen

Theses: Doctorates and Masters

Judging the quality of student work is a core skill of a proficient teacher. This professional competency is often utilised by organisations that run large-scale marking operations when they recruit teachers as markers. These organisations and the teachers themselves often claim that large-scale marking is valuable professional development.

This research aimed to determine whether professional learning outcomes similar to those reported by experienced teachers can be achieved for preservice teachers through participation in a live simulation of a large-scale marking operation. The research was conducted in three phases: an online survey of Australian teachers to establish that reports of benefit …

Professional Learning Interventionn In Mathematics: A Case Of Developing Portfolio Assessment, Hem Chand Dayal, Bronwen Cowie

Australian Journal of Teacher Education

: This paper reports findings from a Fijian study that engaged secondary mathematics teachers in a two-day professional development workshop on the use of portfolios as an alternative means of assessing student learning in mathematics. Utilising an action research approach with a view to involve teachers as key stakeholders in mathematics education, the professional development prompted a small group of secondary mathematics teachers to think about the mathematics content and processes which could not be assessed using written tests, and to develop assessments that would reflect higher-order thinking in mathematics. While the majority of the teachers came up with ideas …

Assessment For Learning While Learning To Assess: Assessment In Initial Teacher Education Through The Eyes Of Pre-Service Teachers And Teacher Educators, Nicole Brunker, Ilektra Spandagou, Christine Grice

Australian Journal of Teacher Education

Competing demands on assessment pose an ongoing challenge for Higher Education. In Initial Teacher Education (ITE) these demands are problematised further in meeting the roles of assessment for measurement, accountability, learning and curriculum. ITE holds a dual role of teaching through content and practice, whereby Pre-Service Teachers (PST) are assessed for learning while learning to assess, thus positioning assessment as curriculum. This exploratory study sought insight into PST and Teacher Educator’s (TE) perceptions of assessment within a postgraduate ITE program. TEs and PSTs alike recognised and valued the assessment processes in focusing attention on learning while developing understanding of assessment …

Australia’S Literacy And Numeracy Test For Initial Teacher Education Students: Trends In Numeracy For Low- And High-Achieving Students, Jennifer Hall, Simone Zmood

Australian Journal of Teacher Education

The numeracy capabilities of pre-service teachers are a recent focus in the Australian educational system. In this article, we discuss findings from an analysis of data from the Literacy and Numeracy Test for Initial Teacher Education Students (LANTITE), which is administered by the Australian Council for Educational Research. In our analysis, we considered numeracy test data from 20 students from one Australian university: those who achieved the 10 highest and the 10 lowest overall numeracy scores in 2016 at this university on their first attempt of the test. We found that these groups clearly have particular characteristics that were linked …

Issues In Academic Educational Research: The Impact Of Current Issues On Research Activity, Natalie Brown

Theses: Doctorates and Masters

Previous investigations into educational research in Australia have highlighted important issues affecting research, with the majority of issues remaining to date. The Australian government and several research academics have examined issues relevant to educational research, including areas such as research design, dissemination of research results, and effectiveness of research. However, few studies have given voice to the academic researchers working in this field. Therefore, in light of the complexities and broadness of issues faced by educational researchers, this study aimed to investigate what current issues were pertinent to academic educational researchers through an examination of their experiences. This study also …

Engaging And Partnering With Aboriginal And Torres Strait Islander Parents And Caregivers, Simone White, Peter Anderson, Graeme Gower, Matt Byrne, Maria Bennet, Alison Quin, Anna Darling

Research outputs 2014 to 2021

The Engaging and partnering with Aboriginal and Torres Strait Islander parents and caregivers two-year project has culminated in a unique interactive website (see www.yourstoryourjourney.net) that houses a number of learning and teaching tools, strategies and resources designed to support all those working to improve the educational success of Aboriginal and Torres Strait Islander students in schools, Australia’s First Nations peoples. It is intended to be used in teacher education programs (pre-service and in-service), by teachers and school leaders, and by Aboriginal and Torres Strait Islander communities. The resource has been created to help all educators form relationships and partnerships with …

Exploring Teachers’ Assessment Literacy: Impact On Learners’ Writing Achievements And Implications For Teacher Development, Morteza Mellati, Marzieh Khademi

Australian Journal of Teacher Education

Teacher-mediated classroom assessment might have significant impacts on learners’ academic achievements and teachers’ development. The current study investigated teachers’ assessment literacy and its impact on their current assessment practices and learners’ writing outcomes. The study sought to gain an understanding of the extent to which teachers’ assessment literacy affects their practices and their learners’ outcomes. To conduct the study and gather the required data, the researchers employed teachers’ assessment literacy inventory, semi-structured interview, non-participatory observation, and Writing Competence Rating Scale (WCRS). Ten male EFL instructors and 75 male sophomores from Iranian EFL contexts were selected from four language schools in …

Australian Teacher Education Policy In Action: The Case Of Pre-Service Internships., Susan Ledger, Lesley Vidovich

Australian Journal of Teacher Education

Studies on internships within initial teacher education have existed in literature since the early 1900s, they have espoused the benefits of experiential learning or critiqued the variance available in terms of structure, length of time and purpose. However, little research on teacher internships has been reported within a policy context. This study employs a modified ‘policy trajectory’ framework to capture the impact of teacher internship models emerging from policy reform in Australia driven by the National Partnership Agreement on Improving Teacher Quality Program (NPTQ). It highlights how policy contexts and practices are inextricably interconnected and influenced by key policy ‘threads’ …