Educational Assessment, Evaluation, and Research Commons^™

Evidence-Based Teaching And Learning: From Theory To Practice, Sarah Grison

Psychology Faculty

Teachers and educational institutions are currently experiencing a perfect storm: We must teach more students in a wider variety of course formats, appropriately support student learning, and also document student progress towards reaching learning objectives. But often, we must achieve these goals with fewer resources, less support and little training. Importantly, a practical approach called Evidence-Based Teaching and Learning can help us address these new challenges. First, this session will provide information about several evidence-based pedagogical techniques shown to improve student learning, including low-stakes repeated testing. Then we will move beyond theoretical ideas to provide examples of how an Introductory …

Evidence-Based Teaching And Learning: From Theory To Practice, Sarah Grison

Psychology Faculty

Evidence-based teaching and learning provides theoretical and practical ways for teachers to use research-supported pedagogies to augment student educational experiences. This presentation provides guidelines and suggestions about how to implement evidence-based teaching techniques, conduct classroom research, and help improve teaching skills and student educational experience. Methods to support text reading, and multiple ways to learn material (student response systems, online homework tools and quizzes, etc.) are suggested.

Iq And Targeted Based Cognitive Tier Ii Interventions, James B. Justice

Theses, Dissertations and Capstones

The purpose of this study was to examine the relationship between IQ and response to intervention. Thirty six students were administered the Woodcock Johnson III tests of Cognitive Abilities (WJ-III) and assigned interventions based on the results. The IQ scores from the 'tested' group were grouped by highest and lowest and then compared to the students' outcomes on the standardized reading assessment after all students had received the intervention. Results indicated that students in the high IQ group performed significantly better on the standardized reading assessment. The results also indicated a moderate positive correlation between the students' IQ and performance …

Examination Of Consistency On The Ohio Achievement Assessments And Ohio Graduation Test, Adam R. Fox

Theses, Dissertations and Capstones

This study investigated a cohort of students’ performance on the Ohio Achievement Assessments (OAA) and Ohio Graduation Tests (OGT). The purpose of this study was to investigate the consistency of a cohort’s reported scores on the OAA over a four-year period (5th, 6th, 7th and 8th grades) and reported scores on their OGT assessment; this was accomplished through the examination of OAA and OGT data from a rural school district located in central Ohio. The data were analyzed using correlations, regressions, and repeated measures ANOVA. A Pearson product-moment correlation coefficient was computed indicating positive correlations between all OAA and OGT …

National Assessment Program : Civics And Citizenship Years 6 And 10 Report 2013, Julian Fraillon, Wolfram Schulz, Judy Nixon, Eveline Gebhardt

Civics and Citizenship Assessment

This report presents the findings of the 2013 National Assessment Program – Civics and Citizenship (NAP – CC) and is conducted under the auspices of the Standing Council on School Education and Early Childhood (SCSEEC) Education Council. Under the National Assessment Program, the Civics and Citizenship sample assessment is administered to a representative sample of Year 6 and Year 10 students on a triennial cycle. After three rounds of assessments – which were undertaken in 2004, 2007 and 2010 – this report looks at the 2013 assessment and examines emerging trends. The National Assessment Program – Civics and Citizenship measures …

National Assessment Program : Civics And Citizenship 2013 Year 6 And Year 10 : Technical Report, Kate O'Malley, Eveline Gebhardt, Renee Chow, Martin Murphy, Wolfram Schulz, Judy Nixon, Julian Fraillon

Civics and Citizenship Assessment

In 1999, the State, Territory and Commonwealth Ministers of Education, meeting as the tenth Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA), agreed to the National Goals for Schooling in the Twenty-first Century. Subsequently, MCEETYA agreed to report on progress toward the achievement of the National Goals on a nationally-comparable basis, via the National Assessment Program (NAP). As part of NAP, a three-yearly cycle of sample assessments in primary science, civics and citizenship and ICT was established. The three previous cycles of NAP – CC were conducted in 2004, 2007 and 2010. As a result of a 2010 …

Virtually There: Examining A Collaborative Online International Learning Pre-Departure Study Abroad Intervention, Carrie Wojenski

Global Engagement Publications

As more guided study abroad interventions move online and into a collaborative format, it is important to not only examine the influence of students’ social interactions as related to their intercultural development and experiences in the interventions, but also understand which variables influenced the success of an intervention. The purpose of this study was to identify factors that influenced students’ intercultural development and experiences in a collaborative online international learning pre-departure study abroad intervention. To explore these questions I designed a collaborative online international learning intervention for pre-departure study abroad students.

Pre-departure U.S. study abroad students and international students coming …

Validation Of The Item-Attribute Matrix In Timss-Mathematics Using Multiple Regression And The Lsdm, Lin Ma

Electronic Theses and Dissertations

For many cognitive diagnostic models, the item-attribute matrix (or Q-matrix) is an essential component which displays the relationship between items and their latent attributes or skills in knowledge and cognitive processes. However, it is a challenge to develop an effective Q-matrix.The purposes of this study were (1) to validate of the item-attribute matrix using two levels of attributes (Level 1 attributes and Level 2 sub-attributes), and (2) through retrofitting the diagnostic models to the mathematics test of the Trends in International Mathematics and Science Study (TIMSS), to evaluate the construct validity of TIMSS mathematics assessment by comparing the results of …

A Comprarison Of Scores On The Rias And Wisc-Iv In A Referred Sample, Racheal R. Gliniak

Theses, Dissertations and Capstones

The purpose of this study was to examine whether or not the Reynolds Intellectual Assessment Scales (RIAS) and the Wechsler Intelligence Scale for Children – Fourth Edition (WISC-IV) measure the same type of intellectual abilities and if the two tests yield similar scores when administered to the same student. Archived data from counterbalanced administrations of each assessment tool were examined for twenty-nine students who were referred for a multi-factored evaluation to determine special education eligibility. Significant positive correlations were found between similar composite score pairs. The t tests indicated that the RIAS Composite Memory Index was significantly higher than the …

The Impacts Of Public Charter Schools On Students And Traditional Public Schools: What Does The Empirical Evidence Tell Us?, David L. Silvernail Phd, Amy F. Johnson Phd

School Funding - Essential Programs and Services (EPS)

The goal of this BRIEF was to compile and analyze the available evidence of the impacts of public charter schools on students and schools. Using a series of five common claims made by proponents and opponents of public charter schools as an organizer, the existing empirical evidence was reviewed. The analysis revealed that student performance in charter schools is very mixed. In some cases studies have found positive effects in achievement, others negative effects, and still others no effects. The presence of charter schools has resulted in positive changes in some traditional public schools, while in other cases there appear …

A Validation Study Of The Colorado Department Of Education Response To Intervention Implementation Rubrics, Adena Sarnat Miller

Electronic Theses and Dissertations

Measuring the effectiveness of the Response to Intervention (RtI) framework has become a more urgent need in the broader context of educational policy and the high stakes associated with school improvement. In order to meet these needs, the systematic development of a series of RtI rubrics was initiated within the state of Colorado to support districts, schools, and educators with the implementation of the RtI framework. Although the staff of the Colorado Department of Education (CDE) invested significant time and resources into developing the RtI implementation rubrics, they did not conduct an evaluation of the internal validity of the tools. …

Evaluating An Instruction Program With Various Assessment Measures, Sarah Gewirtz

Libraries Staff Publications

Purpose: This paper demonstrates how the author’s library was able to enhance the collaborative learning and teaching environment, with secondary goals to improve teaching effectiveness and increase sharing among librarians of ideas and techniques used in First Year Student sessions.

Design/methodology/approach: This paper describes the various measures of assessment (peer-to-peer, student feedback and self-reflection) that the College of St. Benedict (CSB) and St. John’s University (SJU) Libraries implemented in 2011. The methods were used to improve teaching by listening to peers, getting feedback from students and by also doing self-reflection. Many librarians were able to make changes that were beneficial …

Aac Camp As An Alternative School-Based Service Delivery Model: A Retrospective Survey, Janet L. Dodd, Darla K. Hagge

Communication Sciences and Disorders Faculty Articles and Research

School-based speech-language pathologists are obligated to apply evidence-based practice and document progress of their students’ response to intervention in compliance with federal law. The purpose of this preliminary study was to explore the effects of an augmentative and alternative communication (AAC)–based intervention provided in a camp format and begin the exploration of examining strategies to monitor and document progress. Through the use of a survey, data were also collected regarding the demographics of camp attendees and their response to the camp-based intervention model. Results indicated children with autism and intellectual disability comprised a significant portion of the children referred for …

Implementation Of A Proficiency‐Based Diploma System In Maine: Phase Ii ‐ District Level Analysis, David L. Silvernail Phd, Erika K. Stump Phd, Anita Stewart Mccafferty, Kathryn M. Hawes

School Funding - Essential Programs and Services (EPS)

This report describes the findings from Phase II of a study of Maine's implementation of a proficiency‐based diploma system. At the request of the Joint Standing Committee on Education and Cultural Affairs of the Maine Legislature, the Maine Policy Research Institute (MEPRI) has conducted a two‐phased study of the implementation of Maine law LD 1422: An Act to Prepare Maine People for the Future Economy. Phase I of the study in 2012‐2013 reported on the preliminary development, costs and impacts of standards‐based school programs in Maine. Phase II of the study focused on examining school districts in Maine implementing a …

More Than Just Plain Old Technology Adoption: Understanding Variations In Teachers' Use Of An Online Planning Tool, Heather Leary, Victor R. Lee, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This paper examines variability in teachers’ usage patterns as they interacted with an online teacher support tool, the Curriculum Customization Service (CCS), as part of their professional work. The CCS is a web application that supports teachers in planning, adapting, sequencing, and enacting differentiated instruction in Earth science education. By mining the usage log files of over 40 teachers who used the CCS over a yearlong period, we analyzed for variability using a framework developed in marketing research to characterize appropriation of technology. This analysis helped reveal different kinds of teachers’ patterns along two dimensions: frequency and variability of use. …

Effectiveness Of The Language! Comprehensive Literacy Curriculum For 6th Graders, Laura N. Fields

Theses, Dissertations and Capstones

The purpose of this evaluation was to determine if the Language! Comprehensive Literacy Curriculum-Fourth Edition would have a positive impact on students’ Lexile scores. The participants included 86 sixth grade students from a rural middle school in the Mid-Atlantic region. A paired samples t-test revealed a significant difference (p < .001) between pre-test mean score 647.52 and post-test mean score 736.22. Further calculation indicated the program had a medium effect size. According to post-test scores, 12.5% more of the students were within the appropriate Lexile range making them on target with the Common Core Standards Initiative. When looking at pre and post test comparisons, students with the lost pre-test scores made the greatest gains while students with the highest pre-test scores made little or no gains.

Working With Traumatic Brain Injury In Schools: Transition, Assessment, And Intervention, Paul B. Jantz, Susan C. Davies, Erin D. Bigler

Counselor Education and Human Services Faculty Publications

Every day, children and adolescents worldwide return to the educational setting having sustained a traumatic brain injury (TBI). The possible negative consequences of TBI range from mild to severe and include neurological, cognitive, emotional, social, and behavioral difficulties. Within the school setting, the negative effects of TBI tend to persist or worsen over time, often resulting in academic and social difficulties that require formal and informal educational assistance and support. School psychologists and other educational professionals are well-positioned to help ensure students with TBI receive this assistance and support.

Where Schools Close In Chicago, Randall K. Johnson

Faculty Works

It is often assumed that schools close, disproportionately, in disadvantaged parts of Chicago. The assumption, however, has yet to be substantiated by research. As a result, this article tests the assumption in order to explain where schools close in Chicago. It does so by introducing a new Chicago Public School (CPS) closings dataset. The dataset sheds some light on the phenomenon by identifying 130 schools that closed, twenty-seven ZIP codes that experienced CPS closings and three demographic characteristics of these ZIP codes. In the process, this dataset helps to explain how CPS closings relate to race, income and location.

Discursive Leadership And Conceptual Fluency In Non-Native English Speakers' Online Task-Based Dialogues, Umit Boz

Legacy Theses & Dissertations (2009 - 2024)

Much research has examined how different patterns of social interaction shape language learners' interactional roles (e.g., collaborative, dominant, passive) in peer-to-peer conversations. However, little or no research has investigated the co-construction of such roles in multiparty, online task-based dialogues within the framework of discursive leadership. For the purpose of this study, discursive leadership is defined as the ability of the interlocutors to (a) shape the discourse via topic introductions and subsequent topic mentions and (b) manage the process of the task through the use of a series of task-oriented speech acts such as directives and assertions. Using a multi-method approach …

A Microgenetic Approach To Examining Set For Variability: An Exploration Of Early Reading Development, Phil R. Cave M.A.

Theses and Dissertations (Comprehensive)

Learning sight words is a process that involves forming connections between letters and their sounds in order to connect spellings of words with their pronunciations as well as their meanings. During the development of sight word reading, children will sound out (phonologically recode) words that they do not yet know by sight (Share, 1995). Because English lacks transparency, sounding out according to grapheme-phoneme correspondences often only results in an approximation to the target word. The process by which a child must match a word they have recoded phonologically with a word that exists in their vocabulary has been referred to …

Auditing The Office For Learning And Teaching Resource Library, Philip Hider, Barney Dalgarno, Sue Bennett, Ying-Hsang Liu, Carole Gerts, Carla Daws, Barbara Spiller, Robert Parkes, Pat Knight, Raylee Macaulay, Lauren Carlson

Information Management

The Australian government Office for Learning and Teaching’s (OLT) Resource Library was a key means of disseminating the outcomes from projects funded by itself and its predecessor organisations, the Australian Learning and Teaching Council (ALTC) and the Carrick Institute. In order to apply the recommendations and resources emanating from these projects, it is vital that educators and other stakeholders are aware of, and effectively able to use, the Resource Library. Based on anecdotal evidence indicating a lack of awareness of the Resource Library and problems with consistently being able to search for and retrieve relevant resources from the database, the …

Social And Psychological Factors Related To The Career Exploration Process Of Young Adults, Joanne N. Hellmann

Theses and Dissertations--Family Sciences

This study examined social and psychological factors influencing the career exploration process of young adults. The predictor variables of this study were parental attachment, peer attachment, and self-efficacy; the outcome variables were environmental/occupational exploration, self-exploration, and career indecision. Data for this study were collected using various measures that were compiled into one survey hosted on Qualtrics. Results indicated that secure maternal attachment predicted secure peer attachment and high self-efficacy in young adults. Greater peer attachment was negatively correlated with environmental exploration. A higher level of self-efficacy was positively correlated with environmental exploration and negatively correlated with career indecision. These results …

An Evaluation Of The Penn Resiliency Program For Disruptive Preadolescents In An Elementary School Setting, Mildred Howard

Doctoral Dissertations and Projects

The primary purpose of this study was to evaluate the effectiveness of the Penn Resiliency Program in decreasing disruptive behavior, modifying negative automatic thoughts and improving academic achievement. Forty-eight students from two Title I schools in Georgia participated in this study. The Behavior Assessment Scale for Children, Second Edition, Progress Monitor, The Children's Automatic Thoughts Scale and report card grades were used to evaluate program effectiveness. Research results suggest the program effectively reduced negative automatic thoughts and improved academic performance.

Becoming Reflective: Designing For Reflection On Physical Performances, Tom Moher, Cynthia Carter Ching, Sara Schaefer, Victor R. Lee, Noel Enyedy, Joshua Danish, Paulo Guerra, Alessandro Gnoli, Priscilla Jimenez, Brenda Lopez-Silva, Leilah Lyons, Anthony Perritano, Brian Slattery, Mike Tissenbaum, James Slotta, Rebecca Cober, Cresencia Fong

Instructional Technology and Learning Sciences Faculty Publications

Learners’ physical performances can serve as focal objects for reflection and insight across a variety of contexts and content areas. This session brings together a set of projects that leverage the physical performances of learners, construct concrete and abstract representations of those performances, and investigate how learners reflect on and understand the relationships between their performances and target content—physics, health and fitness, data literacy and navigation, animal foraging, and climate change. The session will share findings and design principles from each of the studies around constructing technological scaffolds for physical performance reflections. The symposium highlights the various ways performance can …

What's Happening In The "Quantified Self" Movement?, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Rapid adoption of wearable tracking devices and motion sensitive apps has led to the development of the “Quantified Self” movement (QS). Some in the learning sciences community have begun to take notice and incorporate ideas from QS into the research and design of new learning environments. Yet the QS movement is still new enough that very little is known about it, and there are many open questions about how QS might be of value to the learning sciences. This paper provides some history of the movement and through a qualitative analysis of a public video corpus of QS presentations, identifies …

Keeping Up: Shifting Access To Gateway Resources In A Cycling Community Of Practice, Joel Drake, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

While learning involves changes in one’s participation within a community of practice, changes in participants can also change access to resources key to newcomer participation. This poster presents a case study of a recreational cycling community illustrating how community changes diminished newcomers’ access to resources for drafting.

A Critical Assessment Of Spu’S Urban Plunge: A Proposal For The John Perkins Center, Scott D. Jackson

Honors Projects

This paper is written as an organizational report on the Urban Plunge Program for consideration by the John Perkins Center at Seattle Pacific University. I review Urban Plunge offering a critique and recommendations for re-imagining the program in its future development. I argue that the program needs to be clearly defined as an educational program, grounded in a conceptual framework, given a clarified and expanded mission, and guided by informed curriculum. Beyond critique, I create a proposal for programmatic content and organization to meet these identified needs.

Sex And Gender Identity: A New Perspective For College Student Development, Steven Ray Wise

Theses and Dissertations--Educational Policy Studies and Evaluation

One of the goals of college student development professionals is to help undergraduate students develop a meaningful sense of personal identity. Early in the history of the profession, practitioners borrowed freely from related fields such as sociology and psychology to guide their practice, but beginning around the 1960s, scholars began in earnest to develop their own unique body of literature. In this work I examine the development of that scholarly work as it relates to identity development—specifically the evolution of understanding around the issues of sex and gender identity development.

Beginning with William Perry, whose work has impacted so many …

Validity Of The Educator Evaluation Instrument In The State Of West Virginia, Carla Howe

Wayne State University Dissertations

In the state of West Virginia, the educator evaluation system was implemented in 2010 as part of a comprehensive system of support to increase teacher effectiveness and student learning. As part of the system, the Educator Evaluation Instrument was developed to measure teachers' effectiveness. This study was conducted to determine whether the Educator Evaluation Instrument was valid for use in measuring effectiveness.

A hierarchical confirmatory factor analysis (HCFA) was conducted on the scores from the demonstration year. The data were not normal, nor was good model fit established based on the current model. Because good model fit could not be …

Building An Assessment Program In The Liberal Arts College Library, Lucretia Mcculley

University Libraries Faculty and Staff Publications

Now in its fourth year, the Library Assessment Committee at the University of Richmond has made great strides in establishing a sustainable assessment program within Boatwright Library. Prior to 2008, limited staff, time, expertise, and commitment were barriers to establishing an ongoing assessment program. As with many other liberal arts college libraries, most of our assessment efforts had focused on information literacy, since instruction is integral to the library and the university's mission. Library surveys and other assessment methods had only received close attention when the university was embarking on its re-accreditation process. With the growing emphasis on assessment within …