Educational Assessment, Evaluation, and Research Commons^™

Revision Or Re-Vision: Exploring Approaches To The Differentiation Of Qualification Types In The Australian Qualifications Framework, Kate Perkins, Justin Brown, Paul R. Weldon, Louise Wignall

Dr Paul Weldon

In March 2019, the Department of Education commissioned the Australian Council for Educational Research (ACER) to conduct a conceptual analysis of the most appropriate way to develop and present a taxonomy of learning outcomes within a qualifications framework; and a technical analysis and revision of the Knowledge, Skills and Application of Knowledge and Skills descriptors used in the Australian Qualifications Framework (AQF). Later this was extended to development of two alternative models that: (a) reflect the new conceptual base developed in Part I; (b) comprise a set of revised domain definitions (along with a new typology for each domain); and …

Revision Or Re-Vision: Exploring Approaches To The Differentiation Of Qualification Types In The Australian Qualifications Framework, Kate Perkins, Justin Brown, Paul R. Weldon, Louise Wignall

Dr Justin Brown

In March 2019, the Department of Education commissioned the Australian Council for Educational Research (ACER) to conduct a conceptual analysis of the most appropriate way to develop and present a taxonomy of learning outcomes within a qualifications framework; and a technical analysis and revision of the Knowledge, Skills and Application of Knowledge and Skills descriptors used in the Australian Qualifications Framework (AQF). Later this was extended to development of two alternative models that: (a) reflect the new conceptual base developed in Part I; (b) comprise a set of revised domain definitions (along with a new typology for each domain); and …

Revision Or Re-Vision: Exploring Approaches To The Differentiation Of Qualification Types In The Australian Qualifications Framework, Kate Perkins, Justin Brown, Paul R. Weldon, Louise Wignall

Kate Perkins

In March 2019, the Department of Education commissioned the Australian Council for Educational Research (ACER) to conduct a conceptual analysis of the most appropriate way to develop and present a taxonomy of learning outcomes within a qualifications framework; and a technical analysis and revision of the Knowledge, Skills and Application of Knowledge and Skills descriptors used in the Australian Qualifications Framework (AQF). Later this was extended to development of two alternative models that: (a) reflect the new conceptual base developed in Part I; (b) comprise a set of revised domain definitions (along with a new typology for each domain); and …

Collaborative Code Envy: Ils Vs Marc For Acrl Statistics, Susan A. Massey

Susan A. Massey

Measuring The Value Of Professional Indexing, Philip Hider, Pru Mitchell, Robert Parkes

Pru Mitchell

This study provides both a quantitative estimate and qualitative analysis of the additional ‘retrieval power’ that professionally assigned subject indexing affords users of a typical database in the field of education. A full version of Informit’s A+ Education database and one stripped of its subject indexing were searched by four research assistants tasked with compiling exhaustive bibliographies on forty-eight topics. The searchers were then surveyed about their use of the two databases, while their bibliographies and search logs were also examined. A two-way ANOVA model was constructed to estimate the percentage of additional resources found by the searchers on the …

Book Review Of "Differentiating Instruction And Assessment For English Language Learners: A Guide For K-12 Teachers", Melanie Gonzalez

Melanie González

Text: Fairbairn, S. & Jones-Vo, S. (2010). Differentiating Instruction and Assessment for English Language Learners: A Guide for K-12 Teachers. Philadelphia: Calson.

Developing A Tool For Analysing National Assessment Systems, Ursula Schwantner

Dr Ursula Schwantner

The Global Partnership for Education (GPE) Secretariat appointed the Australian Council for Educational Research (ACER) to develop a tool for analysing national assessment systems and identifying areas for improvement. Known as the Analysis of National Learning Assessment Systems (ANLAS), it provides a framework and tools that help countries, particularly GPE partner developing countries, to examine their national learning assessments and design strategies to address any gaps.

The Role Of Learning Progressions In Global Scales, Ray Adams

Professor Ray Adams

Learning progressions are valuable tools for the international assessment community. Ray Adams reports.

Effective Child-Focused Education And Nurturing Care Interventions, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Syeda Kashfee Ahmed

Child-focused education and nurturing care interventions provide learning support directly to the child. In line with the International Standard Classification of Education (ISCED Level 0), the support is typically provided by either centre- or home-based Early Childhood Education and Care (ECEC) services outside the child’s family and includes an educative and caring component with an active child development element. The 35 child-focused interventions in this review (of a total of 109 studies; see further details under background) occurred in 29 countries in five regions – the widest geographical spread of all intervention types under consideration. The most frequently represented countries …

Effective Child-Focused Education And Nurturing Care Interventions, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Toby Carslake

Child-focused education and nurturing care interventions provide learning support directly to the child. In line with the International Standard Classification of Education (ISCED Level 0), the support is typically provided by either centre- or home-based Early Childhood Education and Care (ECEC) services outside the child’s family and includes an educative and caring component with an active child development element. The 35 child-focused interventions in this review (of a total of 109 studies; see further details under background) occurred in 29 countries in five regions – the widest geographical spread of all intervention types under consideration. The most frequently represented countries …

Income Supplementation Interventions In Economically Developing Countries, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Dr Petra Lietz

Income supplementation interventions provide cash transfers directly to the parents/families of young children, with the objective of improving learning and other outcomes. Interventions of this type directly address poverty as the origin of many of the challenges to children’s learning in economically developing contexts. Such programs seek to affect positively child wellbeing and readiness to learn as well as the home learning environments. These effects can be achieved by using the additional income, for example, to support centre-based childcare or school attendance, to buy more nutritious food or to enable parents to spend more time with their children. The eight …

Effective Child-Focused Education And Nurturing Care Interventions, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Dr Petra Lietz

Child-focused education and nurturing care interventions provide learning support directly to the child. In line with the International Standard Classification of Education (ISCED Level 0), the support is typically provided by either centre- or home-based Early Childhood Education and Care (ECEC) services outside the child’s family and includes an educative and caring component with an active child development element. The 35 child-focused interventions in this review (of a total of 109 studies; see further details under background) occurred in 29 countries in five regions – the widest geographical spread of all intervention types under consideration. The most frequently represented countries …

Parent-Focused Interventions In Economically Developing Countries, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Dr Jen Jackson

The authors conducted a scoping review of Early Childhood Education and Care (ECEC) interventions in economically developing countries between 1998 and 2017, aimed at improving children’s learning in the years before school. The review identified 37 parent-focused studies from 19 countries which provide an evidence base for parent-focused interventions that have both depth and geographical breadth. This policy note outlines characteristics of these interventions which contribute to changes in developmental outcomes for children. It found that of all ECEC interventions, the largest body of effectiveness evidence is available for parent-focused programs.

Effective Child-Focused Education And Nurturing Care Interventions, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Dr Jen Jackson

Child-focused education and nurturing care interventions provide learning support directly to the child. In line with the International Standard Classification of Education (ISCED Level 0), the support is typically provided by either centre- or home-based Early Childhood Education and Care (ECEC) services outside the child’s family and includes an educative and caring component with an active child development element. The 35 child-focused interventions in this review (of a total of 109 studies; see further details under background) occurred in 29 countries in five regions – the widest geographical spread of all intervention types under consideration. The most frequently represented countries …

Income Supplementation Interventions In Economically Developing Countries, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Dr Jen Jackson

Income supplementation interventions provide cash transfers directly to the parents/families of young children, with the objective of improving learning and other outcomes. Interventions of this type directly address poverty as the origin of many of the challenges to children’s learning in economically developing contexts. Such programs seek to affect positively child wellbeing and readiness to learn as well as the home learning environments. These effects can be achieved by using the additional income, for example, to support centre-based childcare or school attendance, to buy more nutritious food or to enable parents to spend more time with their children. The eight …

Measurement Of Young Children's Learning For Program Evaluation, Jen Jackson, Syeda Kashfee Ahmed, Toby Carslake, Petra Lietz

Dr Jen Jackson

The global commitment to early learning has been expressed in the United Nations (UN) Sustainable Development Goals Agenda (SDG) (United Nations, 2016) and access to support for early learning is considered a human right for all children, whether provided by the family, community, or institutional programs (UNESCO, 2013). Inadequate cognitive stimulation has been identified as one of the key psychosocial risk factors associated with poor child development – a factor that is modifiable, with the right interventions (Walker et al., 2007). Thus, insights into how early learning supports may be delivered effectively in various contexts are essential. To explore the …

Kidsmatter Primary Evaluation: Technical Report And User Guide, Katherine Dix, John P. Keeves, Phillip T. Slee, Michael J. Lawson, Alan Russell, Helen Askell-Williams, Grace Skrzypiec, Laurence Owens, Barbara Spears

Dr Katherine Dix

This Technical Report and User Guide is the culmination of an evaluation investigating the effectiveness of KidsMatter Primary, involving over 5000 participants in 100 Australian primary schools over a two year period. It brings together an extensive data gathering exercise and presents technical aspects of the statistical and thematic analyses used in the KidsMatter Evaluation Final. The series of data files and the analysis in which the files have been used, are from the KidsMatter Evaluation Whole Cohort Longitudinal Study (predominantly quantitative data) and the Stakeholder and Student Voice Studies (qualitative data), in addition to data obtained from Project Officers …

The Effect Of Team-Building Interventions On Group Cohesion And Academic Performance, Olivia Boyd, Erica Green, Andie Burns, Carly Nasch, Hannah Pickerell, Benjamin D. Rosenberg

Benjamin Rosenberg

The present study investigates the effect of group cohesion on academic success in undergraduate students in a semester-long group project. Students in Research Methods classes form small groups at the beginning of the semester and conduct experiments with their teammates throughout the course. Oftentimes, professors do not include any team-building interventions in their class sessions. However, research shows that a sense of group cohesion enhances group performance across various settings (e.g., on sports teams). The more cohesive a group feels both socially and professionally, the more likely they are to work together towards shared goals. This research aims to test …

Libraries Curating Evidence, Pru Mitchell

Pru Mitchell

Sugar Creek Style Research Essay, Michael Belding Iii

Michael Belding III

The following is a research essay assignment asking students to write a research essay in the style of John Mack Faragher's Sugar Creek on the Ames, Iowa area. The assignment includes a style guide along with a prescribed bibliography for students to work from.

Theoretical Considerations For Extracting Meaning From Personal Profile System Data: The Need For Independent Construct Validity Studies, Thomas G. Henkel, James Noel Wilmoth

Tom G. Henkel

The Personal Profile System (PPS) is a psychological testing instrument that has been widely used. The construct validity of the PPS was studied through a review of the literature. This paper organizes the literature review into three broad categories: the background of the PPS; the reliability of the PPS; and the validity of the PPS. The PPS is a self-scoring instrument measuring the behavioral responses of people along four dimensions: (1) dominance; (2) influencing; (3) steadiness; and (4) compliance. The instrument is designed to provide a systematic and comprehensive perception of an individual's behavioral tendencies and the behavioral tendencies of …

Researching Mbti Personality Types: Project Management Master’S Degree Students, Thomas G. Henkel, James W. Marion Jr, Debra T. Bourdeau

Tom G. Henkel

The purpose of this research study was twofold: 1) to explore if a university’s Master of Science in Project Management students’ MBTI® personalities differ significantly; 2) to gain a better understanding if the MBTI® personality traits of university students enrolled in a project management degree differ significantly from those MBTI® personalities of the general population. The goodness of fit test was used in order to test the hypotheses that the 177 graduate project management students (observed data) have the same MBTI® distribution as in the general population (expected data). Overall, the present study showed that the student population has 27.18% …

Factor Analysis Of The Personal Profile System, Thomas G. Henkel, James Noel Wilmoth

Tom G. Henkel

Principal components extraction with orthogonal and oblique rotations tested construct validity for the Personal Profile System. MOST-LIKE endorsements of 96 behavioral descriptors were coded with 4, LEAST-LIKE with 1, and unendorsed with 2.5. Descriptor data from 1,045 senior noncommissioned Air Force officers were normalized. Four factors accounted for 85% of total variance, with 19 descriptors loading significantly on two factors and the remaining 77 on just one factor. The measure of sampling adequacy for every descriptor exceeded .94. One factor for the varimax-rotated (best) analysis was bi-scalar, loading on Steadiness and Compliance descriptors; a second resembled Influencing, a third loaded …

Determining Which Delivery Styles Are Best Suited For Instructing In The Distance Learning Environment, James T. Schultz, Marian C. Schultz, Thomas G. Henkel

Tom G. Henkel

The purpose of this study was to ascertain if there is a specific style of teaching which is better suited for the distance learning (virtual) environment, as opposed to the traditional classroom environment. Numerous studies have shown that individuals have different delivery styles in the classroom. The study utilized instructor delivery styles and faculty perceptions of distance learning programs to develop an instrument which identifies the style that would be more successful in the distance learning environment. The study employed an author developed instrument, which included a derivative of the Kolb Learning Style Inventory (LSI) instrument, to determine the teaching …

A Field Study To Promote Undergraduate Student Learning Through Inquiry-Based Research, Thomas G. Henkel, James Paul, Debra T. Bourdeau

Tom G. Henkel

The purpose of this study was to explore methods to promote effective undergraduate student learning through inquiry-based research in the classroom and to determine what the benefits of doing so might be. The study begins by outlining how undergraduate inquiry-based research increases the undergraduate student learning model and then lists steps to accomplish this process. The study outlines two options offered as a workable process to promote faculty and student inquiry-based in-class research. The first option is for undergraduate students to engage in inquiry-based research with the assistance of one-on- one mentoring by the instructor. The second option allows for …

What Can Early Childhood Education And Care Settings Teach Us About Skills For The 21st Century?, Dan Cloney, Kellie Picker

Dr Dan Cloney

Early childhood education and care (ECEC) settings are naturally oriented towards promoting 21st century skills. This can be seen in Australia, where learning is defined as the development of identity, social and emotional skills, problem-solving, and communication skills. A 21st century orientation is also seen in the playbased pedagogies implemented in ECEC settings. A gap, however, exists in the ability of the ECEC sector to communicate its successes. This gap relates to the lack of measurement tools to quantify the quality of the adult–child interactions in ECEC settings, and children’s growth in these 21 century skills and abilities. This paper …

Assessing Computational Thinking, Daniel Duckworth

Daniel Duckworth

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

Digital Literacy: Myths And Realities, Julian Fraillon

Julian Fraillon

Digital literacy, under a wide variety of names, is routinely classified as a 21st-century skill and is frequently reported as an area of high priority in school education systems internationally. In comparison with students in other countries, Australian students have high levels of access to digital technologies both at and outside of school. With this access comes the expectations that students will be highly-proficient users of digital technologies and that schools will use digital technologies in transformative ways to support student learning. This session will examine how concepts of digital literacy have developed over time, what data from large-scale assessments …

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

Neville Chiavaroli

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Assessing And Understanding Social And Emotional Skills: The Oecd Study On Social And Emotional Skills, Sue Thomson

Dr Sue Thomson

In an increasingly fast-changing and diverse world, the importance of developing social and emotional skills is becoming more evident. The large body of accumulated evidence shows that these skills have strong relationships with life outcomes and they have been referred to as a key component of 21st century skills. The Organisation for Economic Co-operation and Development (OECD) Study on Social and Emotional Skills is a new international assessment of these skills in students at primary and secondary schools. This study also gathers information on students’ families, schools and community learning contexts, aiming to provide information about the conditions or practices …