Educational Assessment, Evaluation, and Research Commons^™

Accountability Model For Alternative Education Settings, Victoria Ford

Dissertations

Since 2001 professionals have worked to assist alternative education and juvenile court schools in navigating accountability connected to the 2001 reauthorization of the Elementary and Secondary Education Act, otherwise known as the No Child Left Behind Act. As alternative education programs struggle through the process of program improvement it seems as if there has to be a more accurate model to measure program effectiveness and student achievement in these settings. Under the current federal model, which is still aligned to the NCLB goals, a school could enter program improvement based on the proficiency of less than 15 students, out of …

Assessment Of Student Knowledge Of The Weak And Strong Nuclear Forces, Pramila Shakya

Dissertations

The purpose of this study was to determine if the use of active-learning activities to teach weak force and strong force to students enrolled in various courses at The University of Southern Mississippi, Hattiesburg campus and Gulf Park campus at different class times would increase their knowledge. There were eighty-six students that took part in this study. The study was conducted in the lab classes of an introductory astronomy survey course (AST 111), an introductory algebra-based physics course (PHY 112), and an introductory calculus-based physics course (PHY 202) during fall semester 2014. Each class was randomly assigned as active-learning or …

Using Dynamic Lndicators Of Basic Early Literacy Skills (Dibels) Oral Reading Fluency Data To Predict Michigan Educational Assessment Program Outcomes, Lisa Lockman

Dissertations

Schools are under legislative pressure to ensure students make adequate progress each year, and therefore, must identify students in need of intervention at early grade levels. Educators use diagnostic tools to measure student progress, attempting to determine which children may be most at risk for future reading failure. The Dynamic Indicators of Early Literacy Skills (DIBELS) is widely used for early identification of students who have risk factors. This study incorporated a quantitative, correlational, ex post facto design to examine the relationship between students’ third grade scores on the spring DIBELS Oral Reading Fluency (ORF) assessment and their fifth grade …

Assessing Vocabulary Of Children: Investigating The Evaluation And Instruction Of Basic Concepts, Rebecca Elizabeth Smith

Graduate Theses and Dissertations

Vocabulary knowledge of preschool children is a key factor in predicting literacy success in elementary school (Hammer, Farkas, & Maczuga, 2010). However, few deliberate attempts to teach basic concept vocabulary have been studied (Bowers & Schwarz, 2013; Wilson, 2004). The purpose of this research is to determine if large group explicit instruction with interactive activities of specific basic concept vocabulary will increase preschool children's understanding of basic concept terms when measured by a standardized basic concept assessment. This research will also assess the validity of a basic concept-curriculum based measure (BC-CBM) as an efficient tool to monitor a child's understanding …

The Relationship Between The Level Of Language Acquisition And Reading Achievement Among English Language Learners, Kathleen Barrett

Doctor of Education (EdD)

This study examined two research questions: How are reading proficiency and English language proficiency assessment scores in third and fourth grades associated with fifth grade reading proficiency? As well as: How are reading proficiency and English language proficiency assessment scores in third and fourth grades associated with fifth grade English language proficiency? The purpose of this study was to better understand the relationship between English language proficiency and reading achievement in English Language Learners. This study included one cohort of English Language Learners from a middle sized district in the Portland, Oregon metro area, enrolled from their third grade school …

The Entrepreneurial University: A Unifying Theme For Tu4dublin, John Jameson, Patrick O'Donnell

Stream 1: Enterprise and Engagement

The paper is presented as a rationale for the adoption of an entrepreneurial university model as the guiding principle for the organisation of the Technological University for Dublin (TU4D)5. It is argued that the entrepreneurial university provides a coherent context in which the internal resources and capacities of the three organisations, within the alliance, can be aligned to the external environment and the needs of their stakeholders through agility, flexibility and responsiveness.The paper first considers a broad definition of what is understood as an entrepreneurial Higher Educational Institution (HEI). It then considers the entrepreneurial mind-set as a precursor to the …

Assessing Student Learning: Growing The Culture, Cultivating Buy-In, Improving Quality, Paul Force-Emery Mackie

Social Work Department Publications

All institutions face the common challenge of developing, conducting, and maintaining high quality, purposeful, and relevant student learning assessment processes and protocols. In 2012 Minnesota State University, Mankato created the University Assessment Coordinator position as a reassigned faculty line. This position initially focused on strengthening linkages between institutional, academic, and co-curricular/service program assessment needs through the development of training opportunities, program assessment of learning model development, reporting assistance, data interpretation, and information integration. This presentation highlights how the process and position was structured, challenges identified and addressed, and successes that emerged from the process.

Rubrics For Easily And Accurately Assessing Speaking And Listening Proficiency From Novice Through Distinguished, Catherine T. Johnson

South East Coastal Conference on Languages & Literatures (SECCLL)

Accurately assessing student performance helps instructors develop more effective classroom materials to increase proficiency in the target language. In order to facilitate this process in my classroom, I have developed rubrics for Speaking and Listening that are based on ACTFL guidelines, and that can be easily modified to suit the specific needs of any language at all levels from Novice through Distinguished. Thus, these rubrics can be very useful not only for the individual instructor, but also for language departments that wish to use a common rubric for assessing student performance.

At the end of the session, participants will be …

An Exploration Of Rpl In Higher Education In Ireland With Particular Focus On Quality Assurance, Deirdre Goggin, Irene Sheridan, Phil O'Leary

Conference Papers

This paper focuses on examining the practice of Recognition of Prior Learning (RPL) a provision which allows a learner present previously acquired relevant learning for assessment for credit. In general all forms of learning are formally recognised within an RPL system which includes informal, non formal and formal learning. The key misconception within higher education can be that RPL requires a different quality assurance system than that of conventional assessment methods.

This paper explores current assessment policies and practices in Ireland with a particular focus on the structural realities required to deliver good practice with RPL provision for summative purposes. …

Plunging Beneath The Surface: Uncovering Internal Dispositions, Lori Piowlski, Karen Colum

Elementary and Literacy Education Department Publications

Teacher preparation programs face the challenge of measuring candidates’ competencies that can be considered internal dispositions; which impact the quality of their instruction. This study delves into candidate edTPA scores in correlation with their IDI mindsets to support program development.

Isalt: A Campus-Wide Support System To Evaluate Technology-Based Instructional Innovations, Qijie (Vicky) Cai, Jude Higdon

iSALT Outcomes: Publications, Presentations, and Other Scholarly Works

The purpose of this presentation is to introduce a campus-wide support system called iSALT that we've created to promote evaluation research around technology and teaching innovations at Minnesota State University, Mankato. The system was successfully piloted in spring 2014 with eight participants who completed evaluations for their instructional innovations and disseminated their findings through at least five journal publications and/or conference presentations. We will discuss the steps we've gone through to develop iSALT and the strategies we've used to engage faculty participants. Additionally, we will present the evaluation projects completed by the iSALT participants and discuss their findings.

Assessment For Improvement: Two Models For Assessing A Large Quantitative Reasoning Requirement, Mary C. Wright, Joseph E. Howard

Numeracy

We present two models for assessment of a large and diverse quantitative reasoning (QR) requirement at the University of Michigan. These approaches address two key challenges in assessment: (1) dissemination of findings for curricular improvement and (2) resource constraints associated with measurement of large programs. Approaches we present for data collection include convergent validation of self-report surveys, as well as use of mixed methods and learning analytics. Strategies we present for dissemination of findings include meetings with instructors to share data and best practices, sharing of results through social media, and use of easily accessible dashboards. These assessment approaches may …

Assessing Numeracy In The Upper Elementary And Middle School Years, Carol Ann Gittens

Numeracy

Numeracy is the ability or tendency to reason critically about quantitative information. The preponderance of published research on numeracy examines this construct among either pre-K or early elementary samples, students with developmental challenges, or is focused on post-secondary and adult cohorts. The numeracy skills of upper-elementary and middle school students is less documented and understood, most notably because of the lack of valid instruments that are developmentally appropriate for the age range. A numeracy scale for use among upper-elementary and middle school students is introduced in this paper. Scale validation was performed using a gender-balanced, racially / ethnically diverse sample …

Educational Assessment Is An Enduring Theme Of Numeracy, H. L. Vacher

Numeracy

The Assessment Theme Collection in this issue brings the count of papers on QL assessment to 22 out of the 136 papers (16.2%) in the journal’s first 15 issues. After the first ten issues (our first five years), the counts were 13 and 85 respectively (15.1%). A table in this editorial updates the list of our papers on the subject.

Teacher Capacity And Attitude Toward Data: An Examination Of The Association Between Teacher Beliefs And Student Performance On The Measures Of Academic Progress Assessment, Elizabeth C. Mitcham

Education Dissertations and Projects

Since the onset of No Child Left Behind legislation and federal funding for schools tied to summative assessment performance, educational leaders have sought to identify factors that are most influential on student learning outcomes. Research continues to link the use of formative data practices and teacher efficacy to improved student performance. The intent of this study was to explore associations between teacher capacity and attitude and student performance. In this embedded mixed-methods study, qualitative data from focus groups comprised of survey participants were collected within a larger quantitative study that examined associations between teacher beliefs and student performance. The study …

Measuring Teachers' Knowledge And Use Of Data And Assessments: Creating A Measure As A First Step Toward Effective Professional Development, Courtney Vidacovich

Electronic Theses and Dissertations

Current teaching standards and practices are dictated, at least in part, by state- and district-mandated standardized tests. Yet, despite being surrounded by data, teachers receive only basic trainings on how to use assessments. In reality, teachers use data and assessments daily--even minute by minute--through the assessment process, which uses multiple data sources to make informed decisions on student learning and teaching practices. A measure was needed to understand how the policies and expectations from schools, districts, and states compare with actual classroom practices. The teachers Knowledge and Use of Data and Assessment (tKUDA) measure was designed to do just that. …

Monitoring Trends In Educational Growth Class 6 Student Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan: Source Version - English, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This student context questionnaire for year 6 students in Afghanistan, is a product of ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the student, his/her family, schooling and interests.

Monitoring Trends In Educational Growth Class 6 School Principal Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan: Source Version - English, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This school context questionnaire for year 6 principals in Afghanistan, is produced by ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the principal and his/her school.

Monitoring Trends In Educational Growth Class 6 School Principal Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan : Translated Version - Pashto, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This school context questionnaire for year 6 principals in Afghanistan, is produced by ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the principal and his/her school. It has been translated into the Afghani language Pashto.

Monitoring Trends In Educational Growth Class 6 Student Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan : Translated Version - Pashto, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This student context questionnaire for year 6 students in Afghanistan, is a product of ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the student, his/her family, schooling and interests. The questionnaire has been translated into the Afghani language of Pashto.

Monitoring Trends In Educational Growth In Afghanistan : Class 6 2013, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This document is a brief summary of the reading, writing and mathematical proficiency of year 6 students from Afghanistan who took part in the Monitoring Trends in Educational Growth (MTEG) study.

Monitoring Trends In Educational Growth Class 6 Student Questionnaire Prepared In 2013 For The Ministry Of Education, Afghanistan : Translated Version - Dari, Australian Council For Educational Research (Acer)

Monitoring Trends in Educational Growth (MTEG)

This student context questionnaire for year 6 students in Afghanistan, is a product of ACER’s Monitoring Trends in Educational Growth (MTEG) service. The questionnaire covers questions about the student, his/her family, schooling and interests. It has been translated into the Afghani language of Dari.

Improving A Curriculum Through Incremental Changes Based On Programmatic Assessment Results, Batoul Senhaji-Tomza, Suzanne R. Soliman, Paramita Basu

Touro College of Pharmacy (New York) Publications and Research

Objectives: To describe implementation of incremental curriculum changes aimed at addressing identified gaps via subjective and objective programmatic assessment in a 2 + 2 curriculum.

Method: After low first-time NAPLEX pass rates for two consecutive class years, subjective and objective assessment of a 2 + 2 curriculum was conducted. The curriculum was benchmarked to the other existing 2 + 2 program. Other assessments that occurred include: intensive course content review, course credit number versus instructional time audit, vertical and horizontal topical sequence revision in the clinical, basic sciences and social and behavioral course sequences, faculty/student feedback and focus groups; outside …

Evaluate To Learn: Integrating Assessment Data To Improve Outcome Of A Didactic Biomedical Science Course, Paramita Basu, John Fisher, Batoul Senhaji-Tomza, Suzanne R. Soliman

Touro College of Pharmacy (New York) Publications and Research

Objectives: To describe the evaluation system used to identify curricular issues within a pre-clinical biomedical science course in a Pharm.D program and report the difference in outcome after implementation of the resulting changes.

Method: Course content, sequence of delivery and integration of topics with other courses in the relevant tracks were reviewed to identify discrepancies. Evaluation feedback from students and faculty were obtained from E-value online course evaluation system, and end of course discussion reports. Student performance in the course before and after implementing the recommended changes were compared to assess their effectiveness.

Results: Content duplications and …

Feedback, Iterative Processing And Academic Trust - Teacher Education Students' Perceptions Of Assessment Feedback, Susan E. Davis, Joanne M. Dargusch

Australian Journal of Teacher Education

Abstract: Feedback and reflective processes play an important role in learning with both teachers and students required to play active roles. The importance of feedback processes and practices takes on an added dimension in the field of teacher education as the assessment and feedback processes are also professional practices that students themselves will be enacting in their professional roles. To this end, feedback provides opportunities for students to develop their own professional assessment literacy but also draws attention to the role of the teacher-education lecturer or assessor and the roles and relationships involved. This article reports on a research study …

Fijian Teachers' Conceptions Of Assessment, Hem Chand Dayal, Govinda Ishwar Lingam

Australian Journal of Teacher Education

Abstract: Teacher’s conceptions are important as they have a strong influence on their professional practices. This study set out to explore Fijian teacher’s conceptions of assessment. Seventy teachers enrolled in an assessment course at a university in Fiji were involved in this study. Data was collected by asking teachers to write a reflection on assessment. The reflective exercise contained four open-ended items. Data was analyzed qualitatively. The results indicate that Fijian pre-service teachers generally held an assessment of learning view, while majority of in-service teachers see assessment as formative.

The Tools That Matter: Assessing Online Resources, Valeriana Colon

Graduate Research Posters

In the age of technology, educators are encouraged to incorporate online resources into their teaching, but the impact of these resources on learning is rarely considered. To create a foundation for assessment, this poster reviews theories and research on how students learn across oral, written, and online modes of communication. It then reviews methods of assessing various elements of online resources. Lastly, this poster suggests an implementation approach to enhance the use of resources.

An Evaluation Of Math Assessment Policy Process In A Southwestern School District, Alicia O'Brien

Walden Dissertations and Doctoral Studies

An Evaluation of Math Assessment Policy Process in a Southwestern School District

by

Alicia Taber O'Brien

EdS, Walden University, 2011

MA, Western Governors University, 2004

BS, New Mexico State University, 1994

Doctoral Study Submitted in Partial Fulfillment

of the Requirements for the Degree of

Doctor of Education

Teacher Leadership

Walden University

September 2015

This project study addressed the lack of evaluation of a math assessment policy in a rural elementary school district in the southwestern United States. This district implemented a math assessment policy in the spring of 2005, yet no evaluation had been conducted to determine whether the policy …

Pengembangan Konstruk Instrumen Hasil Pembelajaran Praktik Karawitan Jawa, Budi Raharja, Suminto A. Sayuti

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini mengembangkan instrumen hasil pembelajaran praktik karawitan Jawa dari perspektif keterampilan dan sikap. Perspektif keterampilan menilai kemampuan peserta didik menyelaraskan komponen pembelajaran (melodi, irama/tempo, dan bunyi/nada); sedangkan perspektif sikap menilai pemahaman, penghayatan, dan pengamalan komponen pembelajaran tersebut. Langkah-langkahnya meliputi pengembangan produk, validasi produk, implementasi produk, dan analisis data. Pengembangan produk meliputi pengembangan instrumen keterampilan dan pengembangan instrumen sikap; validasi produk menguji produk dalam diskusi kelompok terfokus, seminar instrumen, dan validasi ahli; implementasi produk adalah mengaplikasikan instrumen dalam uji coba skala kecil dan skala besar serta uji coba utama; sedangkan analisis datanya menggunakan uji kecocokan model. Hasil uji kecocokan model …

The Sciences Of Learning, Instruction, And Assessment As Underpinnings Of The Morningside Model Of Generative Instruction, Elizabeth M. Street, Kent Johnson

All Faculty Scholarship for the College of the Sciences

This paper focuses on a subset of the practices that have created the powerful learning technology developed and disseminated by Morningside Academy in Seattle, Washington, U.S.A. We briefly describe this technology, known as the Morningside Model of Generative Instruction, and tell how it builds on the selectionist approach of B. F. Skinner and the pragmatic approach of John Dewey. We also describe the critical role Precision Teaching plays at Morningside Academy and its dependence on findings from the science of learning and the science of instruction, including placement of learners, task analysis, content analysis, instructional protocols, and principles of instructional …