Educational Assessment, Evaluation, and Research Commons^™

Challenging Our Most Able Students, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Professor Geoff Masters AO discusses identifying and addressing the needs of individual learners in Australian schools.

The Cure For Early Grades Assessment Difficulties? Take A Tablet, Maurice Walker

International Developments

Monitoring educational development in the early years of schooling is vital if practitioners, and policy makers, are to support students’ learning, but the assessment of student achievement in developing countries can be a logistical headache. Maurice Walker reports on an innovative approach to assessment using tablets that is addressing that.

Using Dynamic Lndicators Of Basic Early Literacy Skills (Dibels) Oral Reading Fluency Data To Predict Michigan Educational Assessment Program Outcomes, Lisa Lockman

Dissertations

Schools are under legislative pressure to ensure students make adequate progress each year, and therefore, must identify students in need of intervention at early grade levels. Educators use diagnostic tools to measure student progress, attempting to determine which children may be most at risk for future reading failure. The Dynamic Indicators of Early Literacy Skills (DIBELS) is widely used for early identification of students who have risk factors. This study incorporated a quantitative, correlational, ex post facto design to examine the relationship between students’ third grade scores on the spring DIBELS Oral Reading Fluency (ORF) assessment and their fifth grade …

The Entrepreneurial University: A Unifying Theme For Tu4dublin, John Jameson, Patrick O'Donnell

Stream 1: Enterprise and Engagement

The paper is presented as a rationale for the adoption of an entrepreneurial university model as the guiding principle for the organisation of the Technological University for Dublin (TU4D)5. It is argued that the entrepreneurial university provides a coherent context in which the internal resources and capacities of the three organisations, within the alliance, can be aligned to the external environment and the needs of their stakeholders through agility, flexibility and responsiveness.The paper first considers a broad definition of what is understood as an entrepreneurial Higher Educational Institution (HEI). It then considers the entrepreneurial mind-set as a precursor to the …

An Exploration Of Rpl In Higher Education In Ireland With Particular Focus On Quality Assurance, Deirdre Goggin, Irene Sheridan, Phil O'Leary

Conference Papers

This paper focuses on examining the practice of Recognition of Prior Learning (RPL) a provision which allows a learner present previously acquired relevant learning for assessment for credit. In general all forms of learning are formally recognised within an RPL system which includes informal, non formal and formal learning. The key misconception within higher education can be that RPL requires a different quality assurance system than that of conventional assessment methods.

This paper explores current assessment policies and practices in Ireland with a particular focus on the structural realities required to deliver good practice with RPL provision for summative purposes. …

Isalt: A Campus-Wide Support System To Evaluate Technology-Based Instructional Innovations, Qijie (Vicky) Cai, Jude Higdon

iSALT Outcomes: Publications, Presentations, and Other Scholarly Works

The purpose of this presentation is to introduce a campus-wide support system called iSALT that we've created to promote evaluation research around technology and teaching innovations at Minnesota State University, Mankato. The system was successfully piloted in spring 2014 with eight participants who completed evaluations for their instructional innovations and disseminated their findings through at least five journal publications and/or conference presentations. We will discuss the steps we've gone through to develop iSALT and the strategies we've used to engage faculty participants. Additionally, we will present the evaluation projects completed by the iSALT participants and discuss their findings.

Measuring Teachers' Knowledge And Use Of Data And Assessments: Creating A Measure As A First Step Toward Effective Professional Development, Courtney Vidacovich

Electronic Theses and Dissertations

Current teaching standards and practices are dictated, at least in part, by state- and district-mandated standardized tests. Yet, despite being surrounded by data, teachers receive only basic trainings on how to use assessments. In reality, teachers use data and assessments daily--even minute by minute--through the assessment process, which uses multiple data sources to make informed decisions on student learning and teaching practices. A measure was needed to understand how the policies and expectations from schools, districts, and states compare with actual classroom practices. The teachers Knowledge and Use of Data and Assessment (tKUDA) measure was designed to do just that. …

The Tools That Matter: Assessing Online Resources, Valeriana Colon

Graduate Research Posters

In the age of technology, educators are encouraged to incorporate online resources into their teaching, but the impact of these resources on learning is rarely considered. To create a foundation for assessment, this poster reviews theories and research on how students learn across oral, written, and online modes of communication. It then reviews methods of assessing various elements of online resources. Lastly, this poster suggests an implementation approach to enhance the use of resources.

An Evaluation Of Math Assessment Policy Process In A Southwestern School District, Alicia O'Brien

Walden Dissertations and Doctoral Studies

An Evaluation of Math Assessment Policy Process in a Southwestern School District

by

Alicia Taber O'Brien

EdS, Walden University, 2011

MA, Western Governors University, 2004

BS, New Mexico State University, 1994

Doctoral Study Submitted in Partial Fulfillment

of the Requirements for the Degree of

Doctor of Education

Teacher Leadership

Walden University

September 2015

This project study addressed the lack of evaluation of a math assessment policy in a rural elementary school district in the southwestern United States. This district implemented a math assessment policy in the spring of 2005, yet no evaluation had been conducted to determine whether the policy …

The Sciences Of Learning, Instruction, And Assessment As Underpinnings Of The Morningside Model Of Generative Instruction, Elizabeth M. Street, Kent Johnson

All Faculty Scholarship for the College of the Sciences

This paper focuses on a subset of the practices that have created the powerful learning technology developed and disseminated by Morningside Academy in Seattle, Washington, U.S.A. We briefly describe this technology, known as the Morningside Model of Generative Instruction, and tell how it builds on the selectionist approach of B. F. Skinner and the pragmatic approach of John Dewey. We also describe the critical role Precision Teaching plays at Morningside Academy and its dependence on findings from the science of learning and the science of instruction, including placement of learners, task analysis, content analysis, instructional protocols, and principles of instructional …

Tech Edge Student Rubric Grades 2-3, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades 2-3.

Tech Edge Student Rubric K-1, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades K-1.

Tech Edge Student Rubric Grades 4-5, Laurie A. Friedrich, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

This rubric can be used to evaluate formative and summative assessments of technology integrated products across the curriculum for grades 4-5.

Perceptions Of General Education Deans And Department Chairs Of Their Colleges As Learning Organizations, May Charmayne Mulligan

Dissertations

Higher education institutions are being pushed towards increased assessment practices because of rising costs, mass access, new delivery methods, and rising competition on the national and global scale. Academic deans and department heads are at the center of these assessment efforts, and assessment should guide changes within the organization for improvement. Learning organization theory provides a framework for creating an environment favorable to assessment and improvement. Six learning organization principles – learning, communication, measurement, problem-solving, structure, and vision – were used for this study.

An online questionnaire was used to capture the perceptions of deans and department heads as to …

The 'Literacy' Idea, Ross Turner

Assessment GEMS

A central reason why researchers and practitioners refer to domain literacy is to draw attention to the kinds of things students learn in the domain. In a traditional learning domain the focus might be on the acquisition of discrete facts, skills and procedures that have little obvious connection or utility. In a learning domain with a literacy orientation, the focus is on applying the domain’s facts, skills and procedures to support creativity and inventiveness, to solve novel problems and to deal with the kinds of challenges that life presents outside the classroom. In the case of mathematics, for example, a …

The Effect Of Academic Coaches On Teachers' Effective Use Of Data For Instructional Decisions, Barbara Quillen Shoemaker

Online Theses and Dissertations

One of the common themes in education reform is the use of data-driven decision making. The data provides the information we use to improve our knowledge of classroom instruction. Teachers need professional development to improve their ability to enable data driven decision-making. What data are available? What information can be gleaned from the data? What instructional changes based on data occur? Professional development, the nature of coaching, and their effect on teacher use of data have not been adequately treated in educational literature. This study will be based on an evaluation of an academic coaching project in a large urban …

Exploring The Attitudes Of Criminal Justice And Homeland Security Students Regarding Assessment Techniques In Online Courses, Terry Allen Taylor

Online Theses and Dissertations

Substantial increases in online education since the start of the 21st century requires investigation in to how online courses differ from traditional face-to-face courses. It is particularly important to discover how online students learn and which assessment methods they prefer and see as most beneficial to online learning. Using online assessment techniques that correspond with those rated highly my online students can lead to better student experiences in online courses and improved persistence rates in online courses, which have traditionally be lower compared to face-to-face courses.

The participants for the study sample included online students majoring in Bachelor of Science …

Investigating The Literacy, Numeracy And Ict Demands Of Primary Teacher Education, Helen De Silva Joyce, Susan Feez, Eveline Chan, Stephen Tobias

Australian Journal of Teacher Education

The pre-service programs delivered in Australian teacher education institutions are expected to graduate students who meet externally determined standards, including standards in literacy, numeracy and information and communication technology. These programs are also expected to educate future teachers in professional knowledge and practice, as well as prepare them to engage in professional learning continuously throughout their careers. This paper reports on the first phase of a project that investigated the literacy, numeracy and ICT demands of assessment tasks across the four years of the Bachelor of Education (Primary) program at a regional university.

Experiential Project Presentation Using Story Sack, Geraldine French

Assessment & Feedback Cases

This use case describes how one assessment method was designed and implemented by a lecturer or a group of lecturers in DIT. The use case was compiled from an interview conducted as part of DIT’s RAFT project (2013‐14), the aim of which was to provide a database of assessment practices designed and implemented by academic staff across DIT.

Comprehensive Multi-Disciplinary Assessment Protocol For Autism Spectrum Disorder, Janet L. Dodd, Lauren K. Franke, Jeanette K. Grzesik, Jenna Stoskopf

Communication Sciences and Disorders Faculty Articles and Research

Legal mandates established under IDEA specify a student must be assessed in all areas of suspected disability. Never is this task more overwhelming than its application to the assessment of a student suspected of a diagnosis of autism. The assessment of an individual suspected of an autism spectrum disorder (ASD) diagnosis is a complex task and is dependent on the integration of information gleaned from assessments conducted by an array of professionals, each with their own distinct area of expertise. The purpose of this article is to introduce the Comprehensive Multidisciplinary Assessment Protocols-Autism Spectrum Disorder, referred to as the CMAPs, …

Learning To Retell Stories Through Comparative Teaching: Writing And Drawing, Rachel L. Lindle

Theses and Dissertations--Art and Visual Studies

Students who are emergent readers and writers are often difficult to assess, as they are unable to communicate understanding in writing. From my observations, these students communicate ideas best through concrete forms of expression, rather than the abstract formation of letters and writing that is unfamiliar to them. Drawing provides an alternate form of expression from writing. Based on information found in literature review and personal experiences from working with students who are emergent readers and writers, pictures and drawings are a bridge to communicate ideas with these students. This form of expression and communication may be a useful assessment …

Authentic Assessment Of Reflection In An Eportfolio: How To Make Reflection More Real For Students, Pauline Roberts, Helen Farley, Sue Gregory

Research outputs 2014 to 2021

In a doctoral study that focused on the enhancement of reflection through an ePortfolio-based learning environment, students’ indicated that they felt reflection was not real when it was used for assessment. This led to an examination of assessment practices linked to reflection and ways to make it authentic. The literature revealed that reflection is often a component of authentic assessment rather than being a focus of it. The practices associated with the assessment of reflection are examined in order to formulate 4 guiding principles. These principles aim to make the process of reflection more ‘real’ to students in higher education …

Title: How Do Preservice Teacher Education Students Move From Novice To Expert Assessors?, Peter R. Grainger, Lenore Adie

Australian Journal of Teacher Education

Despite the acknowledged importance of assessment in education, there has been minimal research into the preparation of preservice teachers for the important role of involving preservice teachers in marking, grading, moderating and providing feedback on student work. This article reports on a pilot project in which preservice teachers participated in an ongoing peer assessment and social moderation process in a dedicated course on assessment. The purpose of the project was to investigate specific ways in which key assessment processes can be effectively taught to preservice teachers. The research involved 96 preservice teachers who completed a Likert scale survey and free …

Assessment Practices Of Students With Learning Disabilities In Lebanese Private Schools: A National Survey, Rasha Elhage

Wayne State University Dissertations

Education is intended to provide diverse students with the skills and competencies needed to enhance their lives (Salvia, Ysseldyke & Bolt, 2011). This includes assessment practices that enable teachers to identify students' current level of skills, their strength and weaknesses, target instruction at student's personal level, monitor student learning and progress and plan and conduct adjustments in instruction, and evaluate the extent to which students have met instructional goals. This study intended to discover, describe, and evaluate the assessment practices of teachers and administrators working with students with learning disabilities in Lebanese private schools via the Context, Input, Process and …

Assessing Student Learning With Technology: A Descriptive Study Of Technology-Using Teacher Practice And Technological Pedagogical Content Knowledge (Tpack), Lara Elaine Ervin-Kassab

Doctoral Dissertations

In 2013, a majority of states in the US had adopted Common Core State Standards under the Race to the Top initiative. With this adoption came the opportunity to utilize computer-delivered and computer-adaptive testing. Although the computer-based assessments were intended to assist teachers in designing classroom assessments and using student data to inform instructional practice, teacher-reported data indicated that the areas in which teachers are most unprepared, lack confidence, or are in need of development were assessment (DeLuca, 2012; Wayman et al., 2007) and technology (Brush & Saye, 2009; Kramarski & Michalsky, 2010).

The Technology Assessment Practices Survey (TAPS) study …

Spring, Summer, Fall 2013 Graduation Survey Responses Master File Without Identifiers, Uno Office Of Institutional Effectiveness

Graduation

Spring, Summer, Fall 2013 Graduation survey responses.

Making The Most Of Existing Resources: An Online Rubric Database In University-Wide Writing Program Assessment, Jennifer M. Good, Kevin Osborne

Teaching/Writing: The Journal of Writing Teacher Education

When creating an assessment plan to measure writing outcomes for a university-wide writing across the curriculum (WAC) program, administrators considered multi-layered evaluation methods for benchmarking and measuring internal growth of students. Although assessment plans must address these needs, the actual assessment practices must be flexible, accessible to faculty, and feasible--based on existing technological structures and data systems at an institution. The writing assessment that is provided addresses all of these elements and is offered as a model for other programs.

For this particular study, the internal aspect of the assessment plan that tracks growth of students over time is the …

The Case Against Percentage Grades, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

It’s time to abandon grading scales that distort the accuracy, objectivity, and reliability of students’ grades.

Assessing Preservice Teachers’ Presentation Capabilities: Contrasting The Modes Of Communication With The Constructed Impression, Matt G. Bower, Robyn A. Moloney, Michael S. Cavanagh, Naomi Sweller

Australian Journal of Teacher Education

A research-based understanding of how to develop and assess classroom presentation skills is vital for the effective development of pre-service teacher communication capabilities. This paper identifies and compares two different models of assessing pre-service teachers’ presentation performance – one based on the Modes of Communication (voice, body language, words, and alignment between those elements) and another based on features of the Constructed Impression of the communication acts (confidence, clarity, engagement and appropriateness). The Modes of Communication and the Constructed Impression of 164 pre-service teacher presentations were rated. The Constructed Impression model provided a better fit to data, while averaging of …

Measure For Measure : A Review Of Outcomes Of School Education In Australia, John Ainley, Eveline Gebhardt

Assessment and Reporting

There have been a plethora of research reports providing information about the achievements of students in Australian schools and how those achievements differ among jurisdictions and among groups of students. However, each report has often been viewed in isolation from other similar studies. This report is intended to provide an integrated appraisal of the results of the international and national achievement surveys conducted since 1994 but with some references to earlier studies. In addition to limiting the task to manageable proportions, this time span corresponds to the widespread introduction of modern measurement methods so that there is a better basis …