Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

2015

Conference

Institution
Keyword
Publication
File Type

Articles 1 - 30 of 56

Full-Text Articles in Education

Enhanced Alphabet Knowledge In Preschool Children, Ana Paz Dec 2015

Enhanced Alphabet Knowledge In Preschool Children, Ana Paz

South Florida Education Research Conference

Providing a child the opportunity to succeed in school is a main worry of parents and teachers. When children are able to connect letters with their corresponding sounds allows for literacy to grow. Using Enhanced Alphabet Knowledge (EAK) instruction will allow children to evolve their literacy skills by connecting.


The Excitement Of Conducting Research And The Practical Implications, Georges Halpern Nov 2015

The Excitement Of Conducting Research And The Practical Implications, Georges Halpern

Practical Social and Industrial Research Symposium

Prof Halpern is a Medical Doctor in Internal Medicine & Allergy/Immunology, a Commander in the French National Order of the Mérite Agricole, and an outside consultant for the World Health Organisation. He is an expert of environment public health issues, psychopharmacology and positive role of pleasure. In his keynote speech, Prof Halpern will share his experience of conducting applied research in the past decades.


Keynote Address, Mitchell L. Stevens Phd Oct 2015

Keynote Address, Mitchell L. Stevens Phd

Higher Education on the Growing Edge: Uncommon Thinking Around the Common Core

Mitchell L. Stevens is an Associate Professor of Education and (by courtesy) Organizational Behavior and Sociology at Stanford, where he also serves as Director of Digital Research and Planning. He studies the organization of US higher education, the quantification of academic performance, and alternative school forms. The author of prize-winning studies of home education and selective college admissions, he currently is writing a book about how US research universities organize research and teaching about the rest of the world. He serves as the third Director of the Scandinavian Consortium for Organizational Research, a cooperative institution that has brought more than …


Development And Application Of A Multi-Dimensional Strategy For Measuring Fidelity Of Implementation Of A Districtwide Intervention, Gerene K. Starratt, Maria R. Ligas, Russsell W. Clement, Isadore Newman, Steve J. Rios, Latrell Carr Sep 2015

Development And Application Of A Multi-Dimensional Strategy For Measuring Fidelity Of Implementation Of A Districtwide Intervention, Gerene K. Starratt, Maria R. Ligas, Russsell W. Clement, Isadore Newman, Steve J. Rios, Latrell Carr

South Florida Education Research Conference

This symposium describes a multi-dimensional strategy to examine fidelity of implementation in an authentic school district context. An existing large-district peer mentoring program provides an example. The presentation will address development of a logic model to articulate a theory of change; collaborative creation of a data set aligned with essential concepts and research questions; identification of independent, dependent, and covariate variables; issues related to use of big data that include conditioning and transformation of data prior to analysis; operationalization of a strategy to capture fidelity of implementation data from all stakeholders; and ways in which fidelity indicators might be used.


What Are The Effects Of The 6 +1 Writing Traits On The Attitudes And Writing Skills Of Fifth Grade Ells?, Leeann D. Forbes Sep 2015

What Are The Effects Of The 6 +1 Writing Traits On The Attitudes And Writing Skills Of Fifth Grade Ells?, Leeann D. Forbes

South Florida Education Research Conference

In the Bahamas, ELLs consist mainly of Haitian descent students. Unfortunately, this demographic of students continuously score below their Bahamian counterparts in Creative Writing. This research examined the affects the 6 + 1 Writing Traits assessment had on the attitudes and writing abilities of fifteen, fifth grade, Haitian descent students.


Session Report - Theme 6: Training, Capacity Building, Science & Research, Jim Parsons Aug 2015

Session Report - Theme 6: Training, Capacity Building, Science & Research, Jim Parsons

ShipArc 2015 Conference

No abstract provided.


Hacking Assessment, Phillip Dawson Aug 2015

Hacking Assessment, Phillip Dawson

2009 - 2019 ACER Research Conferences

Hackers exploit weaknesses in a system to achieve their own goals. In this paper I argue that hacking presents a significant threat to the growing world of online assessment. This threat needs to be addressed through a variety of means; technological anti-hacking approaches will not be sufficient. The most effective ways to prevent hacking may be changes to the assessment tasks themselves to make hacking less tempting; these approaches also have a range of positive side effects in terms of authenticity, transparency of criteria, and ensuring tasks involve work beyond the exam. I conclude with a brief exploration of the …


Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits Aug 2015

Assessing General Capabilities, Julian Fraillon, Juliette Mendelovits

2009 - 2019 ACER Research Conferences

There is growing interest in general capabilities and cross-curricular learning outcomes such as literacy in information and communication technologies, creative thinking and collaborative and individual problem-solving. As the expectation for such competencies to be taught in schools has increased, so has the need for teachers and schools to validly and reliably assess student learning in those areas, and to report on them in ways that teaching and learning. In this presentation examine the challenges of assessing on student learning and learning growth capabilities and cross-curricular learning present approaches used in research some of these challenges and reflect can be applied …


Translating Rich Learning Assessments Into Certified Results And University Selection Devices, Gabrielle Matters Aug 2015

Translating Rich Learning Assessments Into Certified Results And University Selection Devices, Gabrielle Matters

2009 - 2019 ACER Research Conferences

There are challenges in designing a set of high-quality processes in senior assessment and tertiary entrance that meet the needs of future senior secondary school students and future users of the certified results of learning assessments. Assessment and selection arrangements should look to the future rather than backwards to arrangements that might have existed in the past or that presently operate, unexamined, in other places. Teachers need to be convinced that the richness of students’ learning assessments will not be lost or transmogrified in any new processes for grading or ranking. A set of principles should guide the design of …


The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz Aug 2015

The Move To Naplan Online: The Advantages And The Road Ahead, Stanley Rabinowitz

2009 - 2019 ACER Research Conferences

The task of developing and delivering the National Assessment Program — Literacy and Numeracy (NAPLAN) online presents enormous challenges. Nonetheless, the benefits of taking this on are well worth the efforts. With a tailored test design, NAPLAN online will provide a better measure of the Australian Curriculum, more precise results and a significantly faster turnaround of those results. NAPLAN will begin its delivery online in 2017, with an opt-in period until 2019. To ensure readiness, a large amount of research is being conducted through the Australian Curriculum, Assessment and Reporting Authority to inform the development process. This presentation will address …


Stealth Assessment In Video Games, Val Shute Aug 2015

Stealth Assessment In Video Games, Val Shute

2009 - 2019 ACER Research Conferences

Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …


Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge Aug 2015

Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

2009 - 2019 ACER Research Conferences

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …


Assessment Standards, ‘Intentional Alignment’, And Dialogic Inquiry, Claire Wyatt-Smith Aug 2015

Assessment Standards, ‘Intentional Alignment’, And Dialogic Inquiry, Claire Wyatt-Smith

2009 - 2019 ACER Research Conferences

Internationally, the policy move towards standards-aligned instruction is gaining momentum. In Australia, standards have assumed unprecedented prominence in education policy relating both to classroom practice and to teacher preparation and career progression. The move is also evident in the United States, where the lure of standards to inform improvement is clear: significant investment has been committed to longitudinal research to examine at state and district levels the desirable conditions for implementing standards, their impact on developing college- and career-ready teachers, and in turn, the impact on teacher instruction and student outcomes. Moves such as this are occurring in the absence …


Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino Aug 2015

Measuring What Matters: Challenges And Opportunities In Assessing Science Proficiency, James W. Pellegrino

2009 - 2019 ACER Research Conferences

A key challenge in shaping science learning for the future will be to develop new measures of learning that take into account what it means to be proficient in science (Pellegrino, 2013). The emergent view on proficiency, grounded in learning sciences research, emphasises using and applying knowledge in the context of disciplinary practice. Referred to as knowledge-in-use, this perspective on science proficiency is a centrepiece of the United States’ National Research Council’s (NRC) Framework for K–12 Science Education (NRC, 2012), embodied in the new US national standards (NGSS Lead States, 2013) and emphasised in the recently released NRC report on …


Should Generic Curriculum Capabilities Be Assessed?, Rosemary Hipkins Aug 2015

Should Generic Curriculum Capabilities Be Assessed?, Rosemary Hipkins

2009 - 2019 ACER Research Conferences

Both Australia and New Zealand have recently taken up the idea of ‘key competencies’ (‘capabilities’ in the Australian national curriculum) initially proposed by the Organisation for Economic Co-operation and Development. In both countries we have made them our own by adapting them to suit our own educational contexts. People often say that these capabilities won’t be taken seriously unless they are assessed. So whether, and how, to assess them continue to be vexed questions. In this paper I argue that capabilities are more appropriately seen as changing the curriculum rather than adding to it. If we are serious about preparing …


Collaborative Problem-Solving: Assessment And Reporting, Patrick Griffin Aug 2015

Collaborative Problem-Solving: Assessment And Reporting, Patrick Griffin

2009 - 2019 ACER Research Conferences

This practical session will present a live administration of interactive collaborative problem-solving assessment and reporting. The presenter will demonstrate example tasks and reports. Audience representatives will have the opportunity to role-play as students being assessed across a range of social and cognitive skills associated with collaborative problem-solving. The discussion will then explore how these social and cognitive skills can be incorporated into the teaching program, enabling higher-order skills to be assessed in key learning areas across the curriculum.


Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw Aug 2015

Pisa: Behind The Headlines And Past The Rankings, Sue Thomson, Chris Wardlaw

2009 - 2019 ACER Research Conferences

Whenever the results of the Programme for International Student Assessment (PISA) are announced, media headlines are full of reports about rankings, about how many countries Australia is outperformed by and outperforms. In early rounds of PISA, Australia ranked among the top 10 countries across all three education domains assessed. However, over time Australia’s position has declined, rather than improved, and Australia no longer sits in the top 10 of any of the assessed domains. This presentation will go behind the headlines and past the rankings, to look at where Australia has declined, and look at how we can improve outcomes …


Reflecting On Teacher Research On Assessment: Challenges And Innovations For The Future, Marie Brennan Aug 2015

Reflecting On Teacher Research On Assessment: Challenges And Innovations For The Future, Marie Brennan

2009 - 2019 ACER Research Conferences

The theme of the 2015 Excellence in Professional Practice Conference (EPPC), held by ACER in May, was Improving assessments of student learning. A review of content and presentations for EPPC showed up some important trends and issues for further analysis and discussion. In a significant number of schools, the focus on assessment was well integrated into an overall school improvement plan or approach. In other schools, the school process overwhelmed the focus on assessment, and at times even overshadowed the focus of the study to be shared. One group of presentations focused on using existing instruments in ways that advanced …


Learning Assessments: Designing The Future, Geoff N. Masters Aug 2015

Learning Assessments: Designing The Future, Geoff N. Masters

2009 - 2019 ACER Research Conferences

Processes for assessing student learning are undergoing fundamental transformation.This presentation will consider three developments which can be expected to shape how student learning is assessed in the future. First is fundamental change in how assessment is conceptualised and approached, with a focus on monitoring learning. Second is growing interest in the assessment of a broader range of skills and attributes than those addressed in most current assessment efforts. Third is advances in technology which are opening the door to new ways of gathering information about student learning, including through records of real-time interactions in online learning environments. In ACER’s Centre …


Creating Stealth Assessments, Val Shute, Michael Timms Aug 2015

Creating Stealth Assessments, Val Shute, Michael Timms

2009 - 2019 ACER Research Conferences

In this workshop, participants will learn how to create stealth assessments to measure student performance during interactions within computer-based learning environments, like digital games or intelligent tutoring systems. These measures are then used to estimate various competencies, including hard-to-measure constructs like creativity, persistence, problem-solving and systems thinking. First, we will explain how evidence-centred design can be used as a theoretical approach to designing such assessments. Next, we’ll illustrate how evidence-centred design was applied in the development of stealth assessment within a particular game (using the example of Plants vs. Zombies 2). Participants will have a chance to create their …


Improving Assessment For Indigenous Students, Alison Quin Aug 2015

Improving Assessment For Indigenous Students, Alison Quin

2009 - 2019 ACER Research Conferences

This workshop will introduce a teaching scenario and existing unit of work built around Indigenous culturally inclusive practices. Participants will work in small groups to devise assessment items in a scaffolded process. The development of assessment tasks will be informed by clarifying Indigenous education, the process of building relationships between schools and Indigenous communities that contribute to co-developed units of work, and principles of Indigenous culturally inclusive practice such as place-based, community-grounded and group production practices.


New Measures For An Old Friend: A Learning Progression For Ict Literacy, Mark Wilson Aug 2015

New Measures For An Old Friend: A Learning Progression For Ict Literacy, Mark Wilson

2009 - 2019 ACER Research Conferences

This workshop will present new thinking and new results from the work of the Assessment and Teaching of 21st-Century Skills (ATC21S) project, on the learning progression for information and communications technology literacy — learning in digital networks. This project, initially sponsored by Cisco, Intel and Microsoft, aimed to help educators around the world enable students with the skills to succeed in future career and college goals. The workshop will be structured to show the how the development of the new ideas and measures for ICT literacy followed the logic of the assessment system developed by the Berkeley Evaluation and Assessment …


Assessing Young Children's Literacy And Mathematics Understandings, Collette Taylor, Joanne Mulligan, Maurice Walker, Prue Anderson, Marion Meiers Aug 2015

Assessing Young Children's Literacy And Mathematics Understandings, Collette Taylor, Joanne Mulligan, Maurice Walker, Prue Anderson, Marion Meiers

2009 - 2019 ACER Research Conferences

Current research indicates that young children are capable of developing mathematical concepts and reasoning much earlier than previously considered. Moderated by Professor Collette Tayler, this symposium on assessing young children's literacy and mathematics understandings is in three parts. Firstly the authors explore the Pattern and Structure Assessment (PASA). PASA is an early mathematical assessment interview which focuses on a range of concepts and processes and is linked with mathematical attainment in the ACER Progressive Achievement Tests in Maths (PATMaths). Secondly, the authors report on the piloting of an early-years technology-based tool called the Digital Early Reading and Mathematics Assessment (DERMA). …


Acer Research Conference Proceedings (2015), Acer Aug 2015

Acer Research Conference Proceedings (2015), Acer

2009 - 2019 ACER Research Conferences

It is indeed timely that Research Conference 2015 addresses the theme Learning Assessments: Designing the future. It is six years since our Research Conference considered issues in assessment, and the landscape is being significantly transformed. Not only is Australia’s school curriculum changing, but related issues of teaching quality and assessment practice are hot topics here and in many other countries. This transforming landscape includes changes in thinking about the fundamental purposes of assessment; growing demands for the assessment of a broader range of student skills and capabilities; and new technologies that allow us to gather and visualise information about student …


“It’S The Best Idea Ever!”: Exam For The Byod Generation., Susan J. Main Mrs, Alistair Campbell Phd Jul 2015

“It’S The Best Idea Ever!”: Exam For The Byod Generation., Susan J. Main Mrs, Alistair Campbell Phd

eCULTURE

This research sought to investigate the feasibility of digitising exams to improve student outcomes and was based on research suggesting that the handwriting speed of undergraduate students limits their ability to demonstrate knowledge, while poor legibility makes it difficult for the assessor to accurately judge the quality of the response. Research found that the handwriting speed of undergraduate students was equivalent to fluency data on 11-year-old schoolchildren, which is a significant concern when we consider that handwriting fluency accounted for considerable variance in writing quality and tutor marks for examination answers. This generation of students typically relies on digital technologies …


Clinical Placement Before Or After Simulated Learning Environments? A Naturalistic Study Of Clinical Skills Acquisition Amongst Early-Stage Paramedicine Students, Brennen W. Mills Mr, Owen Carter A/Prof, Cobie Rudd Prof, Nathan Ross Mr, Louise Claxton Mrs Jul 2015

Clinical Placement Before Or After Simulated Learning Environments? A Naturalistic Study Of Clinical Skills Acquisition Amongst Early-Stage Paramedicine Students, Brennen W. Mills Mr, Owen Carter A/Prof, Cobie Rudd Prof, Nathan Ross Mr, Louise Claxton Mrs

eCULTURE

Background

There is conflicting evidence surrounding the merit of clinical placements (CP) for early-stage health-profession students. Some contend early-stage CPs facilitate contextualisation of subsequently learned theory. Others argue attending CP before attaining skills competency is problematic and should only occur after training in simulated-learning environments (SLE). The evidentiary basis surrounding the extent to which either is true remains limited.

Methods

First-year paramedicine students (n=85) undertook three days of CP and SLEs as part of course requirements. Students undertook CP either before or after participation in SLEs creating two groups (Clin→Sim/Sim→Clin). Clinical skills acquisition was measured via objectively-structured clinical examinations (OSCE) …


Using Eye Tracking, Time-To-Action, Heart-Rate And Perceived Task Difficulty To Assess Level Of Distraction And Performance Of Entry-Level Paramedicine Students In Low- Versus High-Fidelity Simulation, Owen Carter, Brennen W. Mills, Cobie Rudd, Natalie Strobel, Louise Claxton, Nathan Ross Jul 2015

Using Eye Tracking, Time-To-Action, Heart-Rate And Perceived Task Difficulty To Assess Level Of Distraction And Performance Of Entry-Level Paramedicine Students In Low- Versus High-Fidelity Simulation, Owen Carter, Brennen W. Mills, Cobie Rudd, Natalie Strobel, Louise Claxton, Nathan Ross

eCULTURE

Introduction

There is limited research investigating the usefulness of high-fidelity simulations (HFS) for early-stage students. Some argue the additional expense of HFS over low-fidelity simulation (LFS) is unnecessary as early-stage students are too easily distracted by non-relevant stimuli inhibiting student’s ability to focus on the core task. However, the extent to which this is true is yet to be empirically tested.

Methods

First-year paramedicine students were randomly assigned to complete either a LFS or HFS involving a collapsed patient with an obstructed airway. Level of distraction was measured via eye-tracking, arousal via heart-rate (HR), task difficulty via the NASA TLX, …


Stem Education Research: Useful Ideas For College Instructors Using Ballooning, Stacy A. Wenzel Jun 2015

Stem Education Research: Useful Ideas For College Instructors Using Ballooning, Stacy A. Wenzel

2017 Academic High Altitude Conference

Stratospheric ballooning is a tool of enormous promise to help STEM college faculty foster highly engaged learning of science for a wide range of students at a wide range of institutions. High altitude ballooning offers a platform for investigating science and engineering across many fields. Ballooning has been used in courses and experiences for not just undergraduate science majors, but also all undergraduates—including future teachers who, in turn, are the key to improving K-12 science education. Technological advances are lowering the cost of and expertise levels required to make launches and analyze data.

Ballooning offers a context within which faculty …


Characteristics Of Successful Nursing Students, Sergey G. Pugachov, David Maxwell, Jacob Youmans, Kurt Wahnschaff Jun 2015

Characteristics Of Successful Nursing Students, Sergey G. Pugachov, David Maxwell, Jacob Youmans, Kurt Wahnschaff

Phi Kappa Phi Research Symposium (2012-2016)

In an attempt to look into ways to reduce attrition rates in nursing programs, we did a study to look into what non-academic factors can be looked at in addition to the current standard admission data. The research question of interest was “What non-academic characteristics of students can lead to best chance of success in nursing school?” Our sample included 115 students at Georgia Southern University School of Nursing, who have already completed at least one semester of nursing school. Instrument of collection was an IRB approved 20-item self-reported questionnaire with anonymous and passive content. Data was analyzed using SPSS …


An Evaluation Of Behavioral Skills Training To Teach Assertiveness Skills To College Students, Savannah Warrington, Sadie Lovett May 2015

An Evaluation Of Behavioral Skills Training To Teach Assertiveness Skills To College Students, Savannah Warrington, Sadie Lovett

Symposium Of University Research and Creative Expression (SOURCE)

Assertiveness skills are related to a variety of life factors including stress levels, social relationships, social fears, and anxiety. Previous research has shown that engaging in nonassertive behavior can have negative effects, and assertive behaviors can lead to a healthier life (Eldeeb, Enstar, & Eldosoky, 2014; Elliot & Gramling, 1990; Morgan, 1974; Larijani, Aghajanie, Baheriraei, & Neiestanank, 2010). The purpose of the current research was to determine if behavioral skills training (BST) was effective in teaching assertiveness skills to college students and if the skills would generalize to novel situations. BST is a method for teaching skills that uses instructions, …