Educational Assessment, Evaluation, and Research Commons^™

Lessons Learned While Conducting Educational Program Assessment, Olivia Rivas, Irma S. Jones, Eli E. Pena

Teaching and Learning Faculty Publications

Assessment, accountability, and strategic planning are all processes that are included in accreditation for colleges and universities. For most colleges and universities, starting the reaffirmation process means identifying current assessment practices and reports from academic units and programs. This paper discusses the lessons learned during a successful completion of the reaffirmation process with a regional accreditation entity. The authors will present a model that includes an understanding of strategic planning, inclusion of faculty at all levels and affirms continuous learning and involvement in a dynamic process. Also included in the paper are additional tips and observations found useful by the …

What Do Graduates Say About Multicultural Teacher Education?, Anaida Colon-Muñiz, John Brady, Suzanne Soohoo

Education Faculty Articles and Research

"We wanted to assess the impact that our teacher preparation course on multicultural education has had on teachers’ self-perceptions and practices as multicultural educators. Lowenstein (2009) stated that not enough work has been done to determine the impact of multicultural education courses on teacher candidates once they are in the field. Although California assessments for teachers assess content background and instruction, there is a dearth of assessments on teachers’ capacity to work with culturally diverse learners."

Improving The Undergraduate Laboratory Learning Experience Through Redesigned Teaching And Assessment Strategies Integrating Transferable Skills And Focusing On Feedback., Julie Dunne, Barry Ryan

Teaching Fellowships

This project aimed to improve the laboratory learning experience for undergraduate science students, focusing initially on first and third year cohorts, through specific objectives. Firstly, to incorporate novel teaching and assessment methods, including student led laboratories, in- house produced instructional videos, “Clickers” audience response devices, and pre-practical on-line multiple choice questionnaires (MCQ) assessments. Secondly, to develop timely feedback mechanisms, including peer review, tutor face-to-face and audio feedback, online automatic feedback, and report checklists. Finally, to embed transferable skills into the laboratory including group work, communication skills (written and oral), organisation and project planning, health and safety, and preparedness for laboratories, …

The Assessment Cyberguide For Learning Goals And Outcomes, Thomas Pusateri, Jane S. Halonen, Bill Hill, Maureen Mccarthy

Faculty Articles

The CyberGuide serves as a companion resource for implementing the APA Guidelines for the Undergraduate Major in Psychology. These resources should aid psychology departments and their faculty to design the most appropriate and effective assessment plans. We have organized this Cyberguide into four parts that will assist departments in developing assessment plans: I. Understanding Assessment: Departmental, Institutional, Educational, and Societal Perspectives II. Designing Viable Assessment Plans III. Sustaining an Assessment Culture IV. Applying Assessment Strategies in Psychology

The Effect Of Technology Education On Student's State Standardized Test Scores, Maurice Torrez Frazier

STEMPS Theses & Dissertations

The intent of this dissertation was to determine if technology education program completers score higher on academic standards assessments than do students who do not enroll in technology education courses. Many states have developed academic standards for public school students to measure the quality of the educational system. States and local school systems adopted these standards and their accompanying tests to establish a level of academic competency for all of their students. One of the goals of technology education courses was to provide practical applications to reinforce the content of the core subject areas. The purpose of this study was …

The Relationship Between The Dynamic Indicators Of Basic Early Literacy Skills (Dibels) Oral Reading Fluency (Orf) And The Alaska Standards Based Assessment (Sba) For Proficiency In Reading, Polly Shuman Rowell

Doctoral Dissertations and Projects

The impact of No Child Left Behind and making Adequate Yearly Progress is influencing classroom instruction with Curriculum Based Measures such as the Dynamic Indicators of Basic Early Literacy Skills (DIBELS). The primary population of this study was from a small school in rural Alaska. The purpose of this study was to investigate the relationship between the first grade scores of the DIBELS Oral Reading Fluency (ORF) and the subsequent third grade scores of the Alaska Standards Based Assessments (SBAs) in reading. A Pearson's r statistical test was performed on the data from both scores. The results indicated that there …

Exploring Best Practices For Identification, Assessment, Course Placement, Support Services, And Academic Monitoring Of First Year Students Whose Act Writing Scores Indicate Needs For Skill Building, Kellian Clink, Amy Mukamuri

Library Services Publications

The authors share some of the research about Generation 1.5 students as well as other students whose academic writing skills may need development. We relate some data from MSU, from state of Minnesota reports, and from federal studies and discuss some of the reading and writing issues for these students. We describe the possible roles of Adult Basic Education (ABE), community colleges, and MSU in developmental writing coursework and explore assessment tools utilized. We describe some models of writing development around the state and the nation, and finally describe some consequences of doing nothing, piloting project(s), and implementing a program …

Analysis Of Factors Influencing West Virginia Secondary Biology And Science Teacher Attrition Rates, Seth Perry

Theses, Dissertations and Capstones

The high rate of attrition for beginning teachers has been blamed on many factors. Nationally these include low pay, urban versus rural school settings, age, with younger teachers leaving sooner, and other variables making a complex problem with no clear component responsible for the loss of teachers. This study examined the self reported variables that contribute to high school teachers in West Virginia leaving their profession. An electronic survey instrument was distributed to current secondary teachers across the state. Teachers were asked to respond to questions related to professional satisfaction, perceived value from students and parents, administrative support, content versus …

Rethinking Mathematics Assessment: Some Reflections On Solution Dynamics As A Way To Enhance Quality Indicators, Elliott Ostler, Neal Grandgenett, Carol Mitchell

Teacher Education Faculty Publications

This paper is intended to offer some reflections on the difficulties associated with the appropriate use of rubric assessment in mathematics at the secondary level, and to provide an overview of an assessment technique, hereafter referred to as solution dynamics, as a way to enhance popular rubric assessment techniques. Two primary aspects of solution dynamics are presented in this manuscript. The first aspect considers how the tasks assigned in mathematics classrooms might be better organized and developed to demonstrate an evolving student understanding of the subject. The second aspect illustrates how revised scoring parameters reduce the potential for scoring inconsistencies …

Investigation Of The Association Between Attendance In Preschool Programs And Achievement Of Elementary School Students In Greeneville, Tennessee., Anita Marie Conner

Electronic Theses and Dissertations

The purpose of this study was to determine if a difference in achievement test scores exists between students who attended preschool and those who did not as measured by standardized achievement test scores of students in the 3rd and 4th grades. The variables of grade level and gender were also considered. The population consisted of students who attended 4th and 5th grades during the 2007-2008 school year in the Greeneville City Schools. Data gathered were from Tennessee Comprehensive Assessment Program achievement test scores obtained from the 2006-2007 school year. Analysis of variance was used to identify any relationship between variables. …

Analysis Of A Pilot Implementation Of Problem Based Learning Strategy For A Logistics Undergraduate Education Programme, Margaret Farrell

Conference Papers

Research findings suggest that a supply chain manager's job is complex and multidimensional, requiring both general management and logistics/supply chain specific knowledge, competencies and skills. The challenge for logistics educators is to design and develop curricula, teaching and assessment methodologies that can support wide-ranging and integrative learning objectives, which include team, people, project management and technological skills. Problem based learning (PBL) draws heavily on andragogical principles, requiring the student to be self directed and responsible for their own learning as they seek to solve a ‘real life’ problem, within a group. The paper presents the analysis of the teachers experience …

The Digest Edition 2008/2 : Using Data To Improve Student Learning, Marion Meiers

Research Digest

This Digest is focused on studies that have investigated how data can be used in schools to examine teaching practices in order to improve student learning. A selection of relevant websites is listed, and a full reference list is provided. Links to those references for which full-text online access is freely available are also included. School systems, principals and teachers have access to an extensive range of data that can be used for a variety of purposes. Accountability processes and data have come to play a significant place in policy development and reform efforts. There is a large body of …

Nate And The One Sixty-Eight, Michael S. Mcmillan

MA TESOL Collection

This paper explores the fate of 168 students who failed the Level 4 test at the American University Alumni (AUA) Language Center in Bangkok, Thailand. It examines enrollment trends of all Level 4 students during a one-year study period spanning 2006 and 2007, and reveals what happened to the students – who dropped out (and when), and who continued to study. It also examines why students might have dropped out. It then takes a critical look at certain aspects of the Level 4 test, explores what makes a test a “good” test, and recommends a series of improvements to AUA’s …

Gender Differences In The Aviation Flight Science Program: A Study Of Performance, Lisa Whittaker

Assessment Grants

No abstract provided.

Perceived Effectiveness Of Assessments Used In Online Courses In Western North Carolina Community Colleges., Kim Marie Yates

Electronic Theses and Dissertations

The purpose of this study was to determine the most appropriate methods of assessment for online courses. Internet instructors were surveyed and asked which methods of assessment they use in the online courses that they teach and how effective they perceive those methods to be in determining if the learning objectives have been met for the course(s) that they teach online.

The findings of this study indicated that there is a difference between some academic disciplines in relation to the type of assessment methods being used in online courses. There is a difference in perceived effectiveness of assessment methods among …

Using Portfolios As Evidence Of Candidate Growth & Program Impact, Cynthia Carver, Paul Vellom, Katharine Cummings

Assessment Grants

Presentation on the use of portfolios for assessment in the Department of Teaching, Learning & Leadership.

What Do Freshmen Really Know About Research? Assess Before You Teach, Jean Caspers, Steven Mark Bernhisel

Faculty & Staff Publications

The article describes an effort to assess the information literacy skills of entering first-year college students. An instrument was developed and information was gathered on students' experience and comfort in conducting library research as well as their perceived competence with specific information literacy skills. In addition, students completed a skills test to assess specific knowledge and skills relating to information literacy. Entering first-year students generally self-reported their skills to be less than "excellent." This finding was supported by the results of the skills test. Strengths and weaknesses in information literacy skills are reported, as well as implications for librarians who …

A Study Of General Education Assessment., Debra Leonard Scott

Electronic Theses and Dissertations

This study was a correlational investigation of the effect of student demographic characteristics, prior academic performance, college academic performance, and college status on general education achievement at a rural community college in Tennessee. The criterion variable in this study was student performance on the Academic Profile examination, a nationally normed standardized test published by the Educational Testing Service that is designed to measure academic skills in general education subject areas.

The population for this study included students at Walters State Community College located in Morristown, Tennessee, who had completed or were nearing completion of a minimum of 60 semester hours …

Aligning Paper Tests With Multimedia Instruction, Scott L. Howell

Faculty Publications

Although the "click-and-point" virtual classrooms of today hardly resemble the brick-and-mortar classrooms of yesterday, one thing seems to not have changed: the prevalence of paper-based tests. Paper-based tests have been the staple of education for centuries and will most likely persist for many years to come. This article explores some of the issues surrounding the growing chasm between the way students are now taught and how they are still tested from three perspectives: researcher, student, and teacher.

Describing The Ball: Improve Teaching By Using Rubrics - Explicit Grading Criteria, Sophie M. Sparrow

Law Faculty Scholarship

Assessment is crucial to effective teaching and learning. Carnegie's Educating Lawyers and Roy Stuckey's Best Practices for Legal Education emphasize the importance of assessment. This article explains how detailed, written grading criteria describing what students should learn and how they will be evaluated should be a central part of law teachers' assessment plans. The article details how rubrics can improve law student learning, and contains both detailed, step-by-step directions on creating rubrics and examples of rubrics from many different law school courses.

Connecticut Blueprint For A Nclb “Housse” In Educational Technology, Antoinette P. Bruciati

Education Faculty Publications

According to the United States Department of Education, teacher quality is one of the most critical aspects of the teaching and learning process. The No Child Left Behind Act of 2001 (NCLB) has required that state agencies assume the responsibility for increasing student achievement and ensuring teacher quality by the end of the 2005-2006 school year. The NCLB outlines minimum qualifications that are needed by teachers who work on any facet of classroom instruction and authorizes state administrators to establish the criteria through which an experienced teacher will meet the subject matter competencies in a specific content area. This paper …

Brief 13: The Critical Connection: Department Chairs' And Associate Deans' Strategies For Involving Faculty In Outcomes Assessment, New England Resource Center For Higher Education, University Of Massachusetts Boston

New England Resource Center for Higher Education Publications

Assessment, with a capital “A”, has become in the academy a politically loaded buzzword that closes many more doors than it opens. Assessment, with a small “a”, however, is a necessary part of any attempt to find the best path forward in environments that change. At meetings this spring, Members of NERCHE’s Departments Chairs Think Tank and Associate Academic Deans Think Tank discussed this controversial issue, focusing on ways to foster climates in which faculty and administrators are collaborative partners in assessment with the intention of strengthening teaching and learning.

Helping Standards Make The Grade, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

When reporting on student work, educators need a clear, comprehensive grading system that shows how students are measuring up to standards.

Brief 3: Making Assessment Work, New England Resource Center For Higher Education, University Of Massachusetts Boston

New England Resource Center for Higher Education Publications

Assessment and accountability are embedded in the context in which most colleges and universities operate. In the current climate, one is deeply entwined with the other. Originally, assessment in higher education meant assessing students. The broader appeal of the concept quickly claimed the attention of a multitude of constituents within the academy, each with a different goal in mind – from program review to public relations. Those whose relationship to the academy was once or twice removed, such as trustees, accreditors, and legislators, saw assessment as a simple and cost effective means to report information about the effectiveness of complex …

A Process Model For Teacher Evaluation Of Education Administrators, Marla Caviness

All Graduate Projects

The purpose of this project was to design and develop a process model for teacher evaluation of administrators. To accomplish this purpose, a review of current literature regarding evaluation of school administrators was conducted. Additional information from randomly selected school districts regarding evaluation of administrators was obtained and analyzed. Information from selected school districts regarding involvement of teachers in the process of administrator evaluation was also obtained.

A Follow-Up Study To Determine Selected Characteristics And Perceptions Regarding The Academic Preparation Of Master Degree Graduates Who Majored In School Administration: Central Washington University 1976-1981, Richard P. Lynch

All Graduate Projects

The purposes of this study were (1) to determine selected demographic characteristics of master degree graduates, who majored in school administration, and who graduated from the Graduate Division of Education since the 1976 Summer quarter through the 1981 Summer quarter; (2) to ascertain the extent to which these graduates perceived the courses of instruction in their academic preparationas being relevant to subsequent educational administration functions; and (3) to determine additional courses of instruction, not in the present curriculum, that these selected graduates perceived would be professionally relevant to current educational administrative functions.