Educational Assessment, Evaluation, and Research Commons^™

High School End-Of-Course Exams Show Proficiency Gains For 2010, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

In July, the ADE released results for the 2009-10 end-ofcourse (EOC) exams given in Algebra I, Geometry, and Biology administered in April 2010. These results followed the Grade 11 Literacy results released in June. First, we present statewide 2010 results compared to last year. Second, test scores are examined across the state by districts' region, poverty level, and size. Third, we consider the performance of Arkansas students on other assessments to see if these results are consistent with EOC results.

The State Of Latinos And Education In Massachusetts: 2010, Billie Gastic, Melissa Colón, Andrew Flannery Aguilar

Gastón Institute Publications

Schools are critical public institutions for Latino youth in the Commonwealth, who make up 15% of the public school enrollment in the state. Sadly, despite leading the nation in student achievement, Massachusetts is still leaving its Latino students behind. This is evident from several indicators of Latino students’ academic success. School attendance is a significant concern since Latino students lose an average of more than two and a half weeks of school each year due to absences. Latino students are also frequently disciplined for behavioral is- sues at school. Latinos account for 23% of the incidents that result in disciplinary …

Act 60: The Past, Present, And Future Of School Consolidation In Arkansas, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

Since its passage in 2004, Arkansas’ Act 60 has had a major impact on the smallest school districts in Arkansas. The law requires school districts to be consolidated if their enrollment drops below 350 for two consecutive years. This policy brief will report on the numbers and types of schools and districts that have closed since the passage of Act 60. Moreover, the brief will evaluate the enrollment trends to predict which school districts are “at-risk” of being consolidated for dropping below the 350 student threshold established by Act 60. The data for this policy brief is excerpted from a …

Academic Dishonesty In Online Education, Wren Allen Mills

Dissertations

This dissertation examined cheating attitudes and behaviors of undergraduates, especially those enrolled in online courses. While cheating is an established problem within the academy, it is also an issue on the job and has been in the spotlight in recent years, with ethics scandals in corporate America and plagiarism in the media. With this in mind, and the foundational philosophy of the Cardinal Principles of Secondary Education (Bureau of Education, 1928) and the American Council on Education’s (1937) Student Personnel Point of View, this study sought insight into students’ attitudes about cheating behaviors and practices of them in online courses …

Handle With Care, Ellen Hazelkorn

Articles

This article discusses the impact of rankings on higher education.

Why Magic Bullets Don't Work, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

We always tell our students that there are no shortcuts, that important ideas are nuanced, and that recognizing subtle distinctions is an essential critical-thinking skill. Mastery of a discipline, we know, requires careful study and necessarily slow, evolutionary changes in perspective. Then we look around for the latest promising trend in teaching and jump in with both feet, expecting it to transform our students, our courses, and our outcomes. Alternatively, we sniff disdainfully at the current educational fad and proudly stand by the instructional traditions of our disciplines or institutions, secure in our knowledge that the “tried and true” has …

Research Data Services At Singapore Management University: Engagement Summary Report, Terrence B. Bennett

Research Collection Library

In order for Singapore Management University to provide essential support to its researchers and remain competitive with peer institutions, the Li Ka Shing Library at SMU should initiate a distinct research data services function that provides, at minimum, identification and dissemination of data resources, instruction in finding and using data, and some technical assistance with the use of specialized software. In anticipation of emerging trends in data management, these base-level data services will enable SMU to be positioned for strategic growth—the progress of which is carefully aligned with limits to funding, staffing, and other resource allocations—in order to meet the …

Explaining Differences In Civic Knowledge Across 38 Countries, Wolfram Schulz, Julian Fraillon, John Ainley, Eva Van De Gaer

Civics and Citizenship Assessment

The IEA International Civic and Citizenship Education Study studied the ways in which young people in lower secondary schools are prepared to undertake their roles as citizens in a wide range of countries in Europe, Latin America, and the Asian-Pacific region. A central aspect of the study was the assessment of student knowledge about a wide range of civic and citizenship-related issues. This paper includes analyses that use a multi-level model to explain differences in civic knowledge on the basis of student characteristics, home background and school contexts. In addition, the analyses in this paper include a consideration of factors …

Preparedness For Active Citizenship Among Lower Secondary Students In International Comparison, Wolfram Schulz, John Ainley, Eva Van De Gaer

Civics and Citizenship Assessment

The IEA International Civic and Citizenship Education Study investigates the ways in which young people in lower secondary schools are prepared to undertake their roles as citizens in a wide range of countries from Europe, Latin America, and the Asian-Pacific region. A central aspect of students' preparedness to become citizens in a democracy is their disposition to actively participate in society. This paper contains an analysis of measures of students' intentions to participate as citizens in civic life and students' current participation in civic activities in their eighth year of schooling. It is based on data from approximately 140,000 students …

Improving Irt Parameter Estimates With Small Sample Sizes: Evaluating The Efficacy Of A New Data Augmentation Technique, Brett P. Foley

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The 3PL model is a flexible and widely used tool in assessment. However, it suffers from limitations due to its need for large sample sizes. This study introduces and evaluates the efficacy of a new sample size augmentation technique called Duplicate, Erase, and Replace (DupER) Augmentation through a simulation study. Data are augmented using several variations of DupER Augmentation (based on different imputation methodologies, deletion rates, and duplication rates), analyzed in BILOG-MG 3, and results are compared to those obtained from analyzing the raw data. Additional manipulated variables include test length and sample size. Estimates are compared using seven different …

Test Scores Show More Students Scoring Proficient Or Advanced In 2010, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

In mid-June, the ADE released the results of the 2009-10 standardized achievement tests, including the Arkansas Benchmark and SAT-10 exams for students in grades 3- 8 and the End-of-Course (EOC) Literacy exam for students in grade 11. The following policy brief will highlight the current performance of all Arkansas students, the performance for particular subgroups of students, and finally the changes in achievement over time.

What Explains The Gender Gap In Financial Literacy? The Role Of Household Decision-Making, Raquel Fonseca, Kathleen J. Mullen, Gema Zamarro, Julie Zissimopoulos

Education Reform Faculty and Graduate Students Publications

Research has shown that financial illiteracy is widespread among women, and that many women are unfamiliar with even the most basic economic concepts needed to make saving and investment decisions. This gender gap in financial literacy may contribute to the differential levels of retirement preparedness between women and men. However, little is known about the determinants of the gender gap in financial literacy. Using data from the RAND American Life Panel, we examined potential explanations for the gender gap including the role of marriage and division of financial decision-making among couples. We found that differences in the demographic characteristics of …

The Imperative For Achieving Diversity, Ellen Hazelkorn

Other resources

Diversity is seen as a basic norm of higher education policy because it best meets educational and labour market. This presentation examines the concept of diversity as it applies to institutional mission and differentiation, and to research. It argues that in response to rankings and the global financial crisis, policymakers are tending to make a simple correlation between rankings, elite higher education and global competitiveness. There is increasing emphasis on selective excellence and focusing on the 'economic value of research outputs'. However, pursuit of ‘world class’ is skewing policy and institutional priorities.

From Active Learning To Activity: Getting Beyond Busy Work And Into Deep Learning, Wendy Holliday

Library Faculty & Staff Presentations

This session will report on an ethnographic study of an English composition class. The researcher observed the class for an entire semester and conducted focus groups and interviews with students and the instructor. The session will describe key activities from the class, including reflections on motivation and learning by both instructors and students. It will conclude with a discussion of how the research findings can help librarians design instruction that engages learners more deeply.

The Relationship Between Formative Assessment And Student Engagement At Walters State Community College., Cary E. Jenkins

Electronic Theses and Dissertations

The purpose of this study was to determine whether there was a relationship between formative assessment and student engagement at Walters State Community College. Additionally, a secondary purpose examined differences in the in the dimensions of student engagement dimensions (skills engagement, emotional engagement, participation or interaction, performance) based on gender, school classification (freshman, sophomore), and age.

Two hundred thirty-nine Walters State Community College students taught with face-to-face pedagogy comprised the population for the study. The survey instruments included a 15-item formative assessment survey selected from the Walters State Community College Student Opinion of Teaching and Course (WSCCSOTC) and the Student …

2009 Northwest Arkansas Report Card, Gary Ritter

Education Report Card

Each year, the Office for Education Policy creates a state report card that highlights recent test scores, achievement gaps, graduation rates, teacher salary, and so on. In an attempt to provide more detailed information, we have created an edition of the report card specific to the Northwest Arkansas region. Here, we compare the most recent information for Arkansas, Northwest Arkansas, and the “Big 5” districts in Northwest Arkansas. For the purpose of this report, the following districts were used for calculating the Northwest Arkansas (NWA) average: Bentonville, Decatur, Elkins, Farmington, Fayetteville, Gentry, Gravette, Greenland, Lincoln, Pea Ridge, Prairie Grove, Rogers, …

The Effect Of An Overall Rating Item On Halo Error In Performance Evaluations, S. Elizabeth Hogue

Masters Theses & Specialist Projects

This study focuses on how the presence or absence of an overall rating item on a performance evaluation form affects levels of halo error and satisfaction with the form. Participants included undergraduate college students who were randomly assigned to groups receiving a form with or without an overall rating item at the beginning of the form. A satisfaction item was included on both forms. The analyses included a z-test for correlations from independent samples to determine the difference between the two evaluation forms and a t-test to determine the difference between the satisfaction scores of the two forms. The analyses …

A Situational Assessment Of Student Leadership: An Evaluation Of Alternate Forms Reliability And Convergent Validity, Patricia Slack

Masters Theses & Specialist Projects

The Situational Assessment of Leadership: Student Assessment (SALSA©) was developed in the spring of 2009 to be used as a measure of student leadership. Study 1 assessed alternate forms reliability of the SALSA using scores from 178 students. The overall scores on SALSA Form A and SALSA Form B showed a significant correlation (rAB = .906, p < .01). Dimension scores on the two forms ranged from rAB = .475 to rAB = .804. Study 2 evaluated the convergent validity between the SALSA and the Western Kentucky University Center for Leadership Excellence assessment center. SALSA scores as well as assessment scores from 53 students were analyzed. The overall scores on the SALSA and CLE assessment center had a significant yet moderate correlation (r = .513). Dimension correlations were significant but low, ranging from r = .310 to r = .392. The strong correlations in Study 1 indicate the two forms of the SALSA may be used as alternate measures such as in a pre and post-test of leadership. The convergent validities in Study 2 demonstrate that both the SALSA and assessment center may be used to assess leadership. However, the low convergent validities across dimensions indicate overall scores likely should be used rather than dimension scores.

Population Cross-Validity Estimation And Adjustment For Direct Range Restriction: A Monte Carlo Investigation Of Procedural Sequences To Achieve Optimal Cross-Validity, David Matthew Goins

Masters Theses & Specialist Projects

The current study employs Monte Carlo analyses to evaluate the effectiveness of various statistical procedures for determining specific values of interest within a population of 1,000,000 cases. Specifically, the proper procedures for addressing the opposing effects of direct range restriction and validity overestimation were assessed through a comparison of multiple correlation coefficients derived using various sequences of procedures in randomly drawn samples. A comparison of the average bias associated with these methods indicated that correction for range restriction prior to the application of a validity overestimation adjustment formula yielded the best estimate of population parameters over a number of conditions. …

Diagnostic Decision-Making: How Much Do Behavior Rating Scales Influence School Psychologists?, Lesley Ann Higgins

Masters Theses & Specialist Projects

Behavior rating scales are commonly used as part of the evaluation process throughout the field of psychology. Behavior rating scales help assess social, emotional, and/or behavioral problems in children, adolescents, and teens. Behavior rating scales indicate the severity of problem behaviors compared to a normative sample. Four scenarios were developed that varied scores on a behavior rating scale and the amount of other information that supported a specific diagnosis. A rating of the likelihood of a diagnosis was requested to see how much influence behavior rating scale scores have on diagnostic decision-making. Each of the four scenarios was sent to …

An Evaluation Of The Convergent Validity Of Multi-Source Feedback With Situational Assessment Of Leadership - Student Assessment (Salsa©), Heather Stroupe

Masters Theses & Specialist Projects

The current study assessed the convergent validity of the Situational Assessment of Leadership – Student Assessment (SALSA©), a situational judgment test (SJT), with multi-source ratings. The SALSA© was administered to ROTC cadets via Blackboard; multi-source ratings, which paralleled the leadership dimensions of the SALSA©, were administered via paper. Each cadet completed the SALSA© and was rated by 10 peers, his/herself, and at least one cadre (superior). SALSA© scores were not correlated with any of the corresponding dimensions on multi-source ratings, with one exception. Cadre ratings of Consideration/Team Skills were positively correlated with SALSA© scores on the same dimension. This finding …

Penyediaan Dan Penilaian Modul Asas Bahasa Arab Untuk Pelajar Universiti., Sainei Andamit

Student Works (2010-2019)

This thesis is primarily focused on a study conducted on “The Preparation and Evaluation of The Basic Arabic Language Module for University Students”. Subjects involved in this research do not cover all students from higher institutions in Malaysia but specifies the research demographic on a selected group of students from Universiti Malaysia Sabah (UMS). These students do not have the very basic level of Arabic, comes from different academic disciplines in UMS, and they are from various ethnic and religious groups in Malaysia. The module applied for this research experiment was produced by the researcher based on information gathered from …

Transformative Pedagogy In Conversation: The Role Of Instructor Interventions In Peer Feedback For Speech Outline Development, Michael J. Stasio

Communication & Leadership Dissertations and Theses

This study investigated the efficacy of written and oral peer feedback used as an instructional strategy to support student learning in speech outline development. One hundred seven students from a California Community College participated in a mixed-methods evaluative quasi-experimental study conducted in a two-fold process with both quantitative and qualitative measures. Existing literature on peer-centered learning has various gaps. These include four areas of uncertainty: implementation interventions, trust, self-perceived benefits, and contexts. Overall perceived learning benefits and four specific instructor intervention variables were measured in this study: (1) creation of a safe space for collaboration, (2) student training on the …

A Comparison Of Course Completion, Satisfaction, Achievement, And Performance Among Non-Profit Professionals Who Complete Andragogical Or Pedagogical Online Learning Modules On Grant Writing, Joe Bernard Bradley Jr.

Dissertations

The purpose of this study was to compare the outcomes among staff members of nonprofit social service agencies who participated in or completed an andragogicallyfacilitated or a pedagogically-conducted online learning module on foundation grant writing. The efficacy of andragogical methods is unknown and often debated due to scarce empirical research on the topic. Though most prior empirical studies revealed no significant differences in outcomes between the two methods, this is the first study of its kind to address each of the assumptions of andragogy in an online non-formal learning environment. Effectiveness was measured based on participants’ self-reported reaction to learning …

Generational Affiliation As A Component Of Culture: Focus Group Perspectives Of Three Generational Cohorts, Elisabeth Anne Nesbit

Graduate Theses and Dissertations

The purpose of this study was to explore the multicultural elements related to generational affiliation. Much of current generational literature is anecdotal and does not empirically explore the culture of each generation. A constructivist ground theory approach was applied to the study of three generational cohorts (Baby Boomers, Generation Xers, and Millennials) using focus groups to (a) explore the values, beliefs, and worldview inherent to each generation, and (b) extend theory on multiculturalism Data from nine focus groups, three for each generational cohort, were analyzed for key themes within each generational cohort. Results indicated that, in keeping with the American …

How Did Arkansas Fare In The Race To The Top?, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

In late March, the winners for Round 1 of the federal Race to the Top (RttT) were announced. The competitive grant funded under the American Recovery and Reinvestment (ARRA) was described in more detail in an OEP policy brief posted here . In January, Arkansas joined 40 other states in submitting an application. When the finalists were announced, Arkansas was ranked 17th and just missed the cut! In this policy brief, we provide a brief overview of how the Arkansas application fared and what our state leaders could do to increase our chances for Round Two.

National Standards: Following The Pendulum Of Debate, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

In March, the Common Core State Standards Initiative (CCSSI) released drafts of the proposed National Standards for K-12 education in English Language Arts and Literacy, History/Social Studies, Science, and Math. The draft standards were developed in collaboration with teachers, school administrators, and experts with the goal of providing a clear and consistent framework to develop “college or career ready” students. In this draft, the authors attempt to define knowledge and skills students that high school graduates need for entry-level, credit bearing academic college courses and workforce training programs.

Reauthorizing No Child Left Behind: The Obama Blueprint, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

Almost 45 years ago to this day, the federal government enacted the Elementary and Secondary Education Act (ESEA) on April 11, 1965. The Act, which provided funds for professional development, instructional materials, resources to support educational programs, and promoted parental involvement in primary and secondary education, has been reauthorized about every five years since its enactment. The current version, known more commonly as the No Child Left Behind Act, is now up for reauthorization. The following policy brief will describe the development of the Act into its current form, discuss the major components of No Child Left Behind, and highlight …

2009 Naep Reading Results, Nathan C. Jensen, Gary W. Ritter

Policy Briefs

The National Assessment of Educational Progress (NAEP), also known as “the Nation’s Report Card,” is a national assessment of what students in each state know in various subjects. The grade 4 and 8 mathematics and reading portions of the NAEP were administered in 2009. We highlighted the math results, which were released last fall, in the 2009 Arkansas Report Card (http://www.uark.edu/ua/oep/report_cards/2009_Report Card.pdf). The 2009 reading scores were released at the end of March, 2010. This policy brief highlights the recent NAEP reading results and demonstrates, bluntly, that growth has stagnated both in the U.S. and Arkansas.

Resegregation In Minneapolis Public Schools: Tipping Points For Academic Success, Collin Cousins

Sociology Honors Projects

What happens to achievement gaps in middle school test scores when the racial compositions of schools change? Existing research indicates that academic achievement on standardized tests is negatively related to high concentrations of non-white students in schools, and disproportionately affects non-white students. To explore this, I conducted a two-fold approach of analyzing school characteristics and student test scores from Minneapolis public schools between 1988 and 2004, and interviewing administrators from four different Minneapolis schools that used the MBST test between 1998-2004 in order to better understand the context of the processes that occurred to produce the results. I explored how …