Educational Assessment, Evaluation, and Research Commons^™

Design Of Computer-Based Assessment Secondary Education For Understanding Of Mathematics, Mark Damian Lewis

Boise State University Theses and Dissertations

The purpose of this study was to evaluate the effectiveness of a computer-based assessment to reveal mathematical understanding. Relevant literature suggested that developments in cognitive science and computer-based assessments could allow the outcomes of cognitively guided instruction to be made explicit. An assessment instrument designed to make mathematical thinking explicit was developed and administered, consisting of 15 animations showing the solutions of one and two digit multiplication problems. A consistent set of five questions followed each animation. The assessment was administered to four classes of fourth grade students in two elementary schools participating in cognitively guided instruction professional development programs. …

Improving Irt Parameter Estimates With Small Sample Sizes: Evaluating The Efficacy Of A New Data Augmentation Technique, Brett P. Foley

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The 3PL model is a flexible and widely used tool in assessment. However, it suffers from limitations due to its need for large sample sizes. This study introduces and evaluates the efficacy of a new sample size augmentation technique called Duplicate, Erase, and Replace (DupER) Augmentation through a simulation study. Data are augmented using several variations of DupER Augmentation (based on different imputation methodologies, deletion rates, and duplication rates), analyzed in BILOG-MG 3, and results are compared to those obtained from analyzing the raw data. Additional manipulated variables include test length and sample size. Estimates are compared using seven different …

Single Point Rubric: A Tool For Responsible Student Self-Assessment, Jarene Fluckiger

Teacher Education Faculty Publications

Teachers who tap into the talents of each student involve students in goal setting and assessment of their own education. The single point rubric is an ethical tool to assist students with their responsibilities of goal setting and self-assessment of their own education. In this article, I describe key features of the single point rubric, how it is used, and how it is different from traditional multiple point rubrics. I also share some benefits of using single point rubrics along with suggestions of how to address concerns. Two sample, single point rubrics are provided.

Influence Of Ethnicity On English Vocabulary Measurement: Using The Montgomery Assessment Of Vocabulary Acquisition In One Rural Southeastern New Mexico School, Eileen M. Gatliffe

Electronic Theses and Dissertations

This study examined vocabulary acquisition of elementary students in grades kindergarten through fifth in one rural New Mexico school. The school had 277 students. Hispanic students comprised nearly 80% of the student body. All students received free lunch and breakfast. The 65 students who participated in the study were assessed using the Montgomery Assessment of Vocabulary Acquisition (MAVA). This new assessment, published in 2008, tests receptive and expressive vocabulary utilizing the three-tier vocabulary model introduced by Beck, McKeown and Kucan (2001). The study assessed each student for proficiency in identifying and using tier-I, tier-II and tier-III words. Hispanic and non-Hispanic …

The Relationship Between Formative Assessment And Student Engagement At Walters State Community College., Cary E. Jenkins

Electronic Theses and Dissertations

The purpose of this study was to determine whether there was a relationship between formative assessment and student engagement at Walters State Community College. Additionally, a secondary purpose examined differences in the in the dimensions of student engagement dimensions (skills engagement, emotional engagement, participation or interaction, performance) based on gender, school classification (freshman, sophomore), and age.

Two hundred thirty-nine Walters State Community College students taught with face-to-face pedagogy comprised the population for the study. The survey instruments included a 15-item formative assessment survey selected from the Walters State Community College Student Opinion of Teaching and Course (WSCCSOTC) and the Student …

Electronic Portfolios Across The Disciplines: Using Technology As An Authentic Assessment Tool, Linda Anstendig, Beth Klingner

Cornerstone 3 Reports : Interdisciplinary Informatics

No abstract provided.

Spring 2010 Itv Survey, Southwestern Oklahoma State University

Assessment Center Reports

Distance Education & eLearning ITV Survey reports produced by the SWOSU Assessment Center

Assessing Europe's University-Based Research, European Commission:Expert Group On Assessment Of University-Based Education, Ellen Hazelkorn

Reports

This report presents findings of the Expert Group on Assessment of University-Based Research set up by the European Commission, DG Research in 2008 to identify the framework for a new and more coherent methodology to assess the research produced by European universities.

Grading Exceptional Learners, Lee Ann Jung, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

This five-step model provides fair and accurate grades for students with disabilities and English language learners.

The Enhancement Of Student Learning Through Engagement And Feedback In The Assessment Process, Niall Delaney, Alan O'Donnell

Conference Papers

The Technological University Dublin is one of the largest multi-level higher education providers in Ireland, catering for over 22000 students annually. Under the 1999 Qualifications (Education and Training) Act, DIT became an awarding body in its own right. Programme provision covers apprenticeships, short continuous professional development courses, taught undergraduate and postgraduate, research MPhil and PhDs. The Institute’s traditional mission has always been focused on learning and teaching in the field of advanced technical vocational education and training (TVET), and one of its current agendas is to foster and encourage changes in teaching practice and methodology in order to enhance a …

Corporatization Of Higher Education: The Move For Greater Standardized Assessment Programs, Robert P. Engvall

Justice Studies Faculty Publications

This book addresses the on-going push for greater assessment in higher education, within the larger societal context in which a push for accountability and transparency has been rather selectively imposed. Addressing this context is done by means of addressing the specific higher education assessment literature, as well as such topics as unionization in higher education and the increase in “merit pay” schemes that diminish the collective power of union members and radically change the concept of academic freedom on college campuses. It addresses “dead weight” faculty that burden our institutions and drain our resources away from where they could be …

The Future Of Natural Selection Knowledge Measurement: A Reply To Anderson Et Al. (2010), Ross Nehm, Irvin Sam Schonfeld

Publications and Research

The development of rich, reliable, and robust measures of the composition, structure, and stability of student thinking about core scientific ideas (such as natural selection) remains a complex challenge facing science educators. In their recent article (Nehm & Schonfeld 2008), the authors explored the strengths, weaknesses, and insights provided by a detailed exploration of three commonly used measures of student thinking about natural selection in a large sample of underrepresented minority students. One of their core findings was that all of the tools they studied--including the CINS--have strengths and weaknesses that must be carefully taken into consideration by those …

The Human Journey: Embracing The Essential Learning Outcomes, Michelle Loris

English Faculty Publications

At the beginning of the second decade of the twenty-first century, a new vision for college learning is clearly in view. Through its Liberal Education and America's Promise (LEAP) initiative, the Association of American Colleges and Universities (AAC&U) has outlined what contemporary college students need to know and be able to do--in ever-changing economic, political, environmental, global, and cross-cultural contexts. The LEAP essential learning outcomes provide a framework to guide student learning in both general education and the major. The LEAP initiative calls upon college administrators and faculty members to give priority to these essential learning outcomes in order to …

What Do Graduates Say About Multicultural Teacher Education?, Anaida Colon-Muñiz, John Brady, Suzanne Soohoo

Education Faculty Articles and Research

"We wanted to assess the impact that our teacher preparation course on multicultural education has had on teachers’ self-perceptions and practices as multicultural educators. Lowenstein (2009) stated that not enough work has been done to determine the impact of multicultural education courses on teacher candidates once they are in the field. Although California assessments for teachers assess content background and instruction, there is a dearth of assessments on teachers’ capacity to work with culturally diverse learners."

Lessons Learned While Conducting Educational Program Assessment, Olivia Rivas, Irma S. Jones, Eli E. Pena

Teaching and Learning Faculty Publications

Assessment, accountability, and strategic planning are all processes that are included in accreditation for colleges and universities. For most colleges and universities, starting the reaffirmation process means identifying current assessment practices and reports from academic units and programs. This paper discusses the lessons learned during a successful completion of the reaffirmation process with a regional accreditation entity. The authors will present a model that includes an understanding of strategic planning, inclusion of faculty at all levels and affirms continuous learning and involvement in a dynamic process. Also included in the paper are additional tips and observations found useful by the …

Improving The Undergraduate Laboratory Learning Experience Through Redesigned Teaching And Assessment Strategies Integrating Transferable Skills And Focusing On Feedback., Julie Dunne, Barry Ryan

Teaching Fellowships

This project aimed to improve the laboratory learning experience for undergraduate science students, focusing initially on first and third year cohorts, through specific objectives. Firstly, to incorporate novel teaching and assessment methods, including student led laboratories, in- house produced instructional videos, “Clickers” audience response devices, and pre-practical on-line multiple choice questionnaires (MCQ) assessments. Secondly, to develop timely feedback mechanisms, including peer review, tutor face-to-face and audio feedback, online automatic feedback, and report checklists. Finally, to embed transferable skills into the laboratory including group work, communication skills (written and oral), organisation and project planning, health and safety, and preparedness for laboratories, …

The Assessment Cyberguide For Learning Goals And Outcomes, Thomas Pusateri, Jane S. Halonen, Bill Hill, Maureen Mccarthy

Faculty Articles

The CyberGuide serves as a companion resource for implementing the APA Guidelines for the Undergraduate Major in Psychology. These resources should aid psychology departments and their faculty to design the most appropriate and effective assessment plans. We have organized this Cyberguide into four parts that will assist departments in developing assessment plans: I. Understanding Assessment: Departmental, Institutional, Educational, and Societal Perspectives II. Designing Viable Assessment Plans III. Sustaining an Assessment Culture IV. Applying Assessment Strategies in Psychology

Delivering High Stakes Assessments In A Computerized Testing Center, Philip Wilhauk, Tim Doughty, Ron Knight, Tony Paolo

SIDLIT Conference Proceedings

In August 2005, the University of Kansas Medical Center launched its new 135 seat Computerized Testing Center (CTC). Since that time, the facility has successfully hosted over 30,000 individual high-stakes test sessions using LXR. This presentation will discuss the challenges involved in planning and managing such a facility including pilot testing, security, reliability, scalability, scheduling and support. It will also address the impact the CTC has had on paper/pencil testing.

Evaluating Professional Preparation In Professional Practice, Marcia Fetters, Cathe Springsteen

Assessment Grants

No abstract provided.

An Assessment Of The Evaluation Process For Teacher Education Students At Western Michigan University, Lynn Nations-Johnson

Assessment Grants

No abstract provided.

The Effect Of Technology Education On Student's State Standardized Test Scores, Maurice Torrez Frazier

STEMPS Theses & Dissertations

The intent of this dissertation was to determine if technology education program completers score higher on academic standards assessments than do students who do not enroll in technology education courses. Many states have developed academic standards for public school students to measure the quality of the educational system. States and local school systems adopted these standards and their accompanying tests to establish a level of academic competency for all of their students. One of the goals of technology education courses was to provide practical applications to reinforce the content of the core subject areas. The purpose of this study was …

Spring 2009 Itv Survey, Southwestern Oklahoma State University

Assessment Center Reports

Distance Education & eLearning ITV Survey reports produced by the SWOSU Assessment Center

The Relationship Between The Dynamic Indicators Of Basic Early Literacy Skills (Dibels) Oral Reading Fluency (Orf) And The Alaska Standards Based Assessment (Sba) For Proficiency In Reading, Polly Shuman Rowell

Doctoral Dissertations and Projects

The impact of No Child Left Behind and making Adequate Yearly Progress is influencing classroom instruction with Curriculum Based Measures such as the Dynamic Indicators of Basic Early Literacy Skills (DIBELS). The primary population of this study was from a small school in rural Alaska. The purpose of this study was to investigate the relationship between the first grade scores of the DIBELS Oral Reading Fluency (ORF) and the subsequent third grade scores of the Alaska Standards Based Assessments (SBAs) in reading. A Pearson's r statistical test was performed on the data from both scores. The results indicated that there …

A Peer Assisted Approach To Assessment And Evaluation In A Korean University, John Steere Wendel

MA TESOL Collection

This paper details collaborative professional development with a focus on classroom assessment and evaluation of Korean University students. The observations, opinions, and conclusions reported herein are based on committee work carried out by the author at Dongguk University during the fall semester of 2007. Members of the committee were first asked to define areas of assessment and evaluation of students that either interested them, or that they found problematic. Through methods described in this paper (journaling, committee meetings, materials sharing, observation and feedback), each team member had opportunities to actively reflect on their own practices, to both articulate and challenge …

Exploring Best Practices For Identification, Assessment, Course Placement, Support Services, And Academic Monitoring Of First Year Students Whose Act Writing Scores Indicate Needs For Skill Building, Kellian Clink, Amy Mukamuri

Library Services Publications

The authors share some of the research about Generation 1.5 students as well as other students whose academic writing skills may need development. We relate some data from MSU, from state of Minnesota reports, and from federal studies and discuss some of the reading and writing issues for these students. We describe the possible roles of Adult Basic Education (ABE), community colleges, and MSU in developmental writing coursework and explore assessment tools utilized. We describe some models of writing development around the state and the nation, and finally describe some consequences of doing nothing, piloting project(s), and implementing a program …

Analysis Of Factors Influencing West Virginia Secondary Biology And Science Teacher Attrition Rates, Seth Perry

Theses, Dissertations and Capstones

The high rate of attrition for beginning teachers has been blamed on many factors. Nationally these include low pay, urban versus rural school settings, age, with younger teachers leaving sooner, and other variables making a complex problem with no clear component responsible for the loss of teachers. This study examined the self reported variables that contribute to high school teachers in West Virginia leaving their profession. An electronic survey instrument was distributed to current secondary teachers across the state. Teachers were asked to respond to questions related to professional satisfaction, perceived value from students and parents, administrative support, content versus …

Mixing And Matching: Assessing Information Literacy, Carol Mcculley

Faculty & Staff Publications

Authentic assessment of student learning outcomes is much in demand. This paper reviews a variety of assessment methods that measure cognitive, behavioral, and affective levels of learning that can be used to design library class instruction and assessments to improve student learning and teaching of information literacy concepts. The intentional use of these methods to assess undergraduate student learning in many disciplines through working collaboratively with faculty and integrating the assessments in a learner-centered environment is discussed.

Grading Changes After A Writing Faculty Workshop, Glenna Andrade, Judith Platania

Arts & Sciences Faculty Publications

After a workshop on student outcomes for the first-year writing course, the 28 faculty participants discussed the implications of “Development” for critical thinking. This case study of one college’s participatory exercise in improving writing found that although the RWU faculty lacked consensus on the definition, simply discussing topic of “Development” may have had the unintended effect of fewer A grades in the following semester. Unfortunately, the percentage of A grades ascended in the subsequent semesters to suggest that without reinforcement, faculty returned to grade inflation.

Using A Longitudinal Data Mart To Examine The Effects Of Student Mobility On Test Performance Over Time, Richard F. Mooney, Barbara Q. Beaudin

NERA Conference Proceedings 2008

Our analysis shows how a longitudinal data mart can provide a simple and effective way to analyze student test performance over time. Our data mart in this case is a mega-table compiled from several years of archival student-level test data, where we have modified all of the fields so that they have a common meaning over time. Using this longitudinal data base we then compared the performance statistics and effect sizes of test results in math and reading on the Connecticut Mastery Test (CMT) series for grades 4, 6 and 8 and on the Connecticut Academic Performance Test (CAPT) in …

Rethinking Mathematics Assessment: Some Reflections On Solution Dynamics As A Way To Enhance Quality Indicators, Elliott Ostler, Neal Grandgenett, Carol Mitchell

Teacher Education Faculty Publications

This paper is intended to offer some reflections on the difficulties associated with the appropriate use of rubric assessment in mathematics at the secondary level, and to provide an overview of an assessment technique, hereafter referred to as solution dynamics, as a way to enhance popular rubric assessment techniques. Two primary aspects of solution dynamics are presented in this manuscript. The first aspect considers how the tasks assigned in mathematics classrooms might be better organized and developed to demonstrate an evolving student understanding of the subject. The second aspect illustrates how revised scoring parameters reduce the potential for scoring inconsistencies …