Educational Assessment, Evaluation, and Research Commons^™

The Validity Of Validity In Debra P.: Judicial And Psychometric Perspectives On Test Consequences, Charles Olney, Brent Duckor

Faculty Publications

We explore the uses and functions of ‘validity’ as a boundary marker between legal theory and psychometrics. Standardized testing regimes rely on experts to articulate the limits of validity. When challenged in courts, these limits become the subject of contestation, requiring practitioners to litigate the validity of validity. This process generates significant discontinuities, resulting from different conceptual relationships to the idea of validity. Through a qualitative textual analysis of specific case law and a quantitative examination of Lexis-Nexis database archives, we trace how legal reasoning elides new developments in psychometric research that would broaden and enrich judicial treatments while showing …

Aligning To Extend Resource Capacities And Enhance Students' Acquisition Of Social And Cultural Capital, Michelle Maloney, Allison Dumas

Pacific's Annual Assessment Conference

No abstract provided.

Getting To Square One: Managing Cognitive Load, Eleanor Wittrup

Pacific's Annual Assessment Conference

No abstract provided.

Integrated Leadership And Critical Thinking Assessment Study, Tarianne Goteli Cotton, Sandra Mahoney

Pacific's Annual Assessment Conference

No abstract provided.

A Longitudinal Study Of Pacific Students' Alcohol And Other Drug Use: Using Data To Inform Prevention And Intervention Strategies, Heather Dunn Carlton

Pacific's Annual Assessment Conference

No abstract provided.

Tiger Pathways Creating A Cohort Experience To Support First Year Students, Anne Eastlick, Jesus Margarito

Pacific's Annual Assessment Conference

No abstract provided.

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

Pacific's Annual Assessment Conference

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

University Libraries Librarian and Staff Presentations

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …

1. Why Use Norm Referenced Standardized Tests To Answer: Did I Teach? Did They Learn?, John Hobe

National Youth Advocacy & Resilience Conference

1. : If it is state law that students must attend school or be home schooled until they are a certain age, then must the state protect them while at public schools? The answer seems self-evident. Indeed, the United States Constitution’s 14^th Amendment guarantees equal protection under the laws to its citizens. But do school practices unintentionally violate this protection?

Is Setting Higher Standards The Answer?, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Raising the expected performance standard in each year of school and holding all teachers and students accountable for achieving these higher standards may not be the most effective way to improve levels of performance in Australian schools.

Imls Sparks Ignite Il Framework Cooperative Project Final Performance Report, Appendix F: Outcomes & Indicators For Student Performance, Jessame Ferguson

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This document is an appendix to the Final Performance Report for the IMLS Sparks Ignite IL Framework Cooperative project. It contains the four outcomes and the performance indicators for each outcome.

Imls Sparks Ignite Il Framework Cooperative Project Final Performance Report, Jessame Ferguson

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This is the Final Performance Report for the SPARKS Ignite IL Framework Cooperative Project for At‐Risk Student Success in Smaller Colleges. Through a partnership of five institutions led by McDaniel College, we developed new best practices for ensuring information literacy education programs at smaller institutions support success and persistence of at‐risk students in their critical first‐year. We used the newly adopted Association of College & Research Libraries Framework for Information Literacy for Higher Education to develop and test new assessment methodologies and engaging educational experiences for first‐year students. The project took place in 2017. The report summarizes our successes, challenges …

A Different Way To Organise The School Curriculum, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

There are good reasons to rethink how we organise the school curriculum. An alternative would be to structure the curriculum as a sequence of proficiency levels unrelated to age or year level.

Does The Test Work? Evaluating A Web-Based Language Placement Test, Avizia Long, Sun-Young Shin, Kimberly Geeslin, Erik Willis

Faculty Publications

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman’s (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language placement test. The test, which consisted of 100 items distributed across five item types (sound discrimination, grammar, listening comprehension, reading comprehension, and vocabulary), was tested with 2,201 incoming first-year and transfer students at a large, Midwestern public university. Analyses of internal consistency and validity revealed the …

Using The Quantitative Literacy And Reasoning Assessment (Qlra) For Early Detection Of Students In Need Of Academic Support In Introductory Courses In A Quantitative Discipline: A Case Study, Nathan D. Grawe, Kristin O'Connell

Numeracy

As the number of young people attending college has increased, the diversity of college students’ educational backgrounds has also risen. Some students enter introductory courses with math anxiety or gaps in their quantitative training that impede their ability to master or even grasp relevant disciplinary content. Too often professors learn of these anxieties and gaps only during the post mortem of the first midterm. By that time, a good portion of a student’s grade is determined and successful recovery may be impossible. During the 2016-17 academic year, the Department of Economics at Carleton College ran a pilot project using the …

Building The Foundation: Initiating Assessment Practices For North Carolina Housing Officers, Marinda C. Bliss

Education Dissertations and Projects

Enrollment at institutions of higher education were tight markets with overlapping competition for the same customers in many areas. The typical undergraduate student market was an informed consumer who sought the amenities of home for their student housing. The shift for the student market placed residence hall programs in competition with one another, thus the need for timely assessment of the residence hall facilities, programs, staff, and customers to plan appropriately for the future is appropriate.

North Carolina Housing Officers, also known as NCHO, served 57 institutions in North Carolina that have residence hall programs for the promotion of idea …

Measuring Faculty Teaching Effectiveness Using Conditional Fixed Effects, Maia K. Linask, James Monks

Economics Faculty Publications

Using a dataset of 48 faculty members and 88 courses over 26 semesters, the authors estimate Student Evaluation of Teaching (SET) ratings that are conditional on a multitude of course, faculty, and student attributes. They find that ratings are lower for required courses and those where students report a lower prior level of interest. Controlling for these variables substantially alters the SET ratings for many instructors. The average absolute value of the difference between the faculty ratings controlling just for time effects and fully conditional ratings is nearly one-half of a standard deviation in the students’ rating of how much …

Empowering Students To Perform An Enhanced Role In The Assessment Process: Possibilities And Challenges, Paul Dervan

Articles

Assessment is key to student learning. This paper examines the case for increased participation by higher education students in the assessment process to deepen learning and improve learner motivation. While increased student participation may not solve all problems relating to assessment, a review of the literature dealing with enhancing the role of students in the assessment process, and original research conducted amongst academics and students at the author's institution, suggests improvements can be made leading to increased student satisfaction, motivation and competency. This paper therefore argues for change in the approach to assessment by empowering students to become partners in …

2017-2018 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2017-2018 Continuous Improvement report produced by the SWOSU Assessment Center

The Effects Of Professional Development And Formative Assessment Quality On Students' Self-Regulation In Primary School Mathematics, Oluwakemi Adewoye

Walden Dissertations and Doctoral Studies

Student self-regulation is associated with mathematics achievement in Nigerian primary schools, and formative assessment holds promise for increasing self-regulation. However, to date no research has explored teacher professional development (PD) for formative assessment and its effects on students' self-regulation in Nigerian primary schools. This quasi-experimental nonequivalent control group design used Desimone's teacher professional development conceptual framework, Popham's model for practicing formative assessment, and Zimmerman's concept of self-regulated learning. Research questions concerned whether differences existed in teachers' practice and students' self-regulation between two groups of Nigerian primary school mathematics teachers who received variations of professional development. The sample was 13 volunteer …

Spring, Summer, Fall 2018 Graduation Survey Responses, Uno Office Of Instituional Effectiveness

Graduation

Spring, Summer, Fall 2018 Graduation survey responses master file without identifiers.

Critical Skills For Special Educator Effectiveness: Which Ones Matter Most, And To Whom?, Sara B. Woolf

Publications and Research

Special education teachers are expected to fulfill diverse teaching and non-teaching tasks in comparison to their general education peers. However, their performance is evaluated with measures that were normed for use with general education teachers. These specialty teachers are also routinely evaluated by professionals who may lack formal special education training or experience. These conditions render special educators vulnerable for inaccurate performance evaluation. Explicit research is needed to clarify the professional skills that are most critical to special educators’ professional effectiveness and ensure continuity of focus on these skills in preservice teacher education and employment contexts. This qualitative study builds …

Listening To Our Graduate Students' Feedback: Graduate Student Exit And Alumni Surveys, Alison W. Hong-Novotney

Cal Poly Humboldt theses and projects

Student and alumni surveys have become some of the most widely-used methods of assessment of student learning in higher education. While the majority of literature on student surveys and assessment focuses on undergraduate students, this study looks specifically at why graduate student exit and alumni surveys can be valuable tools within a comprehensive assessment plan. Listening to the feedback of current and former graduate students, and then acting upon that feedback, is crucial for the engagement and success of this unique population of students who bring their particular strengths and needs to their educational experiences. This study examined how master’s …

The Concurrent Validity Of The Learning Component Of The Missouri Ability Scale, Nicholas Johnson

Murray State Theses and Dissertations

ABSTRACT

The present study was designed to determine the concurrent validity of the Missouri Ability Scale (MAS), a new measure of independent functioning and learning currently in development. The MAS consists of 10 subtests and is designed to be administered to the examinee and an informant. Fifty individuals (M = 13.1 years; SD = 5.8 years) were administered the MAS and a cognitive abilities test (i.e. WISC-V, KABC-II, WJ-IV). Overall, the Spearman correlations between the MAS learning component and the measures of intellectual ability were moderate-to-strong, indicating good validity. Consistent with the hypotheses, the MAS learning component and the Cattel-Horn-Carroll …

Improving Health Literacy Assessments In Pediatrics, Kristina Michelle Wright

Walden Dissertations and Doctoral Studies

Low health literacy (LHL)--when patients do not understand their treatment or medications--has been linked to poor healthcare outcomes. Nurses need to know how to assess health literacy (HL) and teach pediatric patients and their families to help ensure that patients and family members can understand and follow health education messages. Evidence-based HL tools were obtained from a literature search and used to create a nursing staff education program on pediatric patient HL assessment and education. The project answered the practice-focused question that asked whether a staff education program on HL assessment and management would improve nursing knowledge of HL for …

Developing Physics Problem-Solving Skill Test For Grade X Students Of Senior High School, Amipa Tri Yanti Nadapdap, Edi Istiyono

REID (Research and Evaluation in Education)

This research aimed to develop a physics problem-solving skill (PSS) test for grade X students of senior high school which met test instrument characteristics and feasibility. The development stages included: (a) test designing, (b) test trial, and (c) test revision and preparation. The designing stage included: (1) needs analysis, (2) mapping, (3) drawing conclusion, (4) determining test purpose, (5) determining competencies, (6) determining materials, (7) preparing answers, (8) writing items, (9) validating content, (10) improving and preparing the test, and (11) preparing the scoring guide with PCM. The trial stage consisted of: (1) determining trial subjects, (2) performing trial, and …

Coupling K-12 Music Education With Science, Technology, Engineering And Math (Stem) Curricula: Implementation Of A Stemusic Outreach Program, Mallory Maestri

Civil Engineering Undergraduate Honors Theses

Many studies have investigated the effects of music on evoking human emotions and diverse types of brain responses. One study by Juslin and Vastfjall indicates that hearing music can stimulate brain stem reflexes, create emotional contagion, recall episodic memories and provoke visual imagery. Due to the influence music has on human brain waves, researchers have been studying the effect of music on enhancing the spatial abilities of young students. Science, Technology, Engineering and Math (STEM) professions rely heavily on spatial skills. Research on the connection of music with spatial skills proposes that when the brain processes rhythm a “mental rotation” …

The Long-Term Impact Of First-Year Seminars, Qin Zhang, Suhua Dong

Institutional Research Staff Publications

This study examined the net effects of participating in a residential first-year seminar (FYS) program by comparing the outcomes of participants with those of non-participants at the point of graduation, while controlling for background and pre-college variables. Outcome variables focused on student academic performance and self-reported gains as a result of their undergraduate education; they included: cumulative GPA; intellectual development; development of problem solving; development of social and civic engagement; institutional preparation for career path, graduate school, and interpersonal relationships and family living/personal development; and participation in faculty-mentored research. The study was based on a sample of 853 graduating seniors …

Lifting Achievement Levels And Improving The Return On Australia’S Investment In Schooling : Submission To The Review To Achieve Educational Excellence In Australian Schools (Chair: Mr David Gonski), Australian Council For Educational Research (Acer)

Program monitoring and evaluation

Many students in our schools are not learning as well as they could because they are not being given learning opportunities at an appropriate level of challenge. Instead, students are grouped by year level (age) and teachers deliver curricula assumed to be appropriate for all students in the same year of school. However, the most advanced ten per cent of students in any year of school are five to six years ahead of the least advanced ten per cent. For less advanced students, the year-level curriculum is often too far ahead. Many are judged to be underperforming year after year, …

Future Goals And Actions Of Faculty Development, Catherine Haras, Margery Ginsberg, Eva Fernández, Emily Daniell Magruder

Publications and Research

No abstract provided.