Education Commons^™

Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The assessment of model fit in latent trait modelling, better known as item response theory (IRT), is an integral part of model testing if one is to make valid inferences about the estimated parameters and their properties based on the selected IRT model. Though important, the assessment of model fit has been less utilized in IRT research than it should. For example, there have been less research investigating fit for polytomous dominance models such the Graded Response Model (GRM), and to a lesser extent ideal point models such as the Generalized Graded Unfolding Models (GGUM), both in its dichotomous and …

Case Conceptualization As An Alternative To Educationally Related Mental Health Assessments, Michael R. Hass, Zack Maupin, Michael Doria

Education Faculty Articles and Research

School psychologists play an essential role in the provision of school-based mental health services yet continue to spend the majority of their time conducting psychoeducational assessments. In California, changes in law regarding the provision of mental health services have increased the tension around the role of school psychologists and led to models for determining the need for mental health services that are inefficient and present a potential barrier to students receiving services in a timely manner. The paper proposes case conceptualization as a more useful and efficient approach, than traditional assessment processes for determining students’ mental needs and writing goals.

When You Can’T R.I.O.T., R.I.O.: Tele-Assessment For School Psychologists, Michael R. Hass, Brian P. Leung

Education Faculty Articles and Research

The acronym R.I.O.T., record review, interview, observation, and test, is a well-known tool for conceptualizing a comprehensive assessment. With COVID-19 and the need to provide school psychological services virtually, it is important to reconsider R.I.O.T. in light of the limitations of virtual assessment. We describe the limitations of virtual assessment and argue that in spite of these barriers, the first three elements of R.I.O.T., record review, interviews, and observations, when used systematically, can provide useful comprehensive assessment data. Specific recommendations are provided for implementing assessment virtually.

Estimating School-Level Achievement In Belize, Betty Jean Usher-Tate

College of Education and Human Sciences: Dissertations, Theses, and Student Research

This dissertation consists of five chapters: introduction, literature review, methodology, results, and discussion with final thoughts. The research design of this dissertation study attended to structures, cultures, and characteristics associated with, and specific to, the Belize education system. The processes for data collection and types of analyses were appropriate, yielded meaningful results, and served as a segue for national application. The Belize Educator Survey was developed to capture the educators’ voices and illuminate their relationship to educational achievement in Belize. The Belize Educator Survey was piloted and revised with direct input from educators and experts who work in the Belize …

Rural High School Principals And The Challenge Of Standards-Based Grading, Tom Buckmiller, Matt Townsley, Robyn Cooper

Faculty Publications

The purpose of this study was to better understand how principals in rural schools are thinking about assessment and grading practices and if they anticipate implementing policy changes in the near future that may require increased support. Principals of schools in rural areas often face challenges that are significantly different from those of their urban and suburban counterparts. The researchers used a mixed-method survey to better understand if progressive grading policies were a part of the vision for principals of rural high schools, if they possessed conceptual underpinnings of such practices, and if they believed they had the capacity within …

A Psychometric Comparison Of Psychological Inflexibility Measures: Discriminant Validity And Item Performance, Clarissa W. Ong, Benjamin G. Pierce, Julie M. Petersen, Jennifer L. Barney, Jeremiah E. Fruge, Michael E. Levin, Michael P. Twohig

Psychology Faculty Publications

Psychological inflexibility is a rigid behavioral pattern that interferes with engagement in personally meaningful activities; it is the hypothesized root of suffering in acceptance and commitment therapy (ACT). Thus, the quality of its measurement affects the research, theory, and practice of ACT. The current study aimed to evaluate the discriminant validity and item performance of four measures of psychological inflexibility: the Acceptance and Action Questionnaire—II (AAQ-II), a revised version of the AAC-II (AAQ-3), the Brief Experiential Avoidance Questionnaire (BEAQ), and the Comprehensive assessment of Acceptance and Commitment Therapy processes (CompACT). We analyzed data from community (n = 253), student …

A Review Of Aaq Variants And Other Context-Specific Measures Of Psychological Flexibility, Clarissa W. Ong, Eric B. Lee, Michael E. Levin, Michael P. Twohig

Psychology Faculty Publications

Psychological flexibility refers to a way of interacting with internal experiences and the external environment that advances one toward chosen values whereas psychological inflexibility reflects rigid adherence to ineffective responses such that valued living is compromised. Psychological flexibility is a critical variable of interest in acceptance and commitment therapy, thus, accurate assessment of this construct is pertinent to professionals in the field. Numerous measures of psychological flexibility for specific conditions exist and the psychometric validation of each of these measures varies in breadth and depth. To orient professionals to the scope of available measures as well as their psychometric properties, …

Measuring Psychological Inflexibility In Adult And Child Hearing Loss., Clarissa W. Ong, John J. Whicker, Karen F. Muñoz, Michael P. Twohig

Psychology Faculty Publications

Objective: Hearing loss is a chronic condition that impacts functioning among individuals with hearing loss and caregivers of children with hearing loss. Even though treatments for hearing loss can alleviate functional impairment, psychological factors like psychological inflexibility may interfere with treatment engagement and adherence, undermining the benefits of treatment. Measuring psychological inflexibility may inform care providers’ case conceptualization, improving the quality and precision of audiological interventions. Thus, the current study aimed to develop and validate measures of psychological inflexibility in hearing loss for adults and caregivers of children with hearing loss.

Design: Participants were invited to complete an online survey. …

Culturally Responsive Interviewing Practices, Michael Hass, Annmary S. Abdou

Education Faculty Articles and Research

As communities and school populations continue to become more culturally, economically, and linguistically diverse, the need for comprehensive training and explicit guidelines for culturally responsive school mental health practices also grows. School Psychologists are both expected and ethically responsible to competently assess and serve diverse student and family populations, regardless of potential language or cultural barriers. The current article is focused on describing background and rationale for culturally responsive interviewing practices as they pertain to the roles and responsibilities of School Psychologists. Building on the guidelines and principles of the Cultural Formulation Interview (CFI), developed by the American Psychiatric Association, …

Empowering Students To Perform An Enhanced Role In The Assessment Process: Possibilities And Challenges, Paul Dervan

Articles

Assessment is key to student learning. This paper examines the case for increased participation by higher education students in the assessment process to deepen learning and improve learner motivation. While increased student participation may not solve all problems relating to assessment, a review of the literature dealing with enhancing the role of students in the assessment process, and original research conducted amongst academics and students at the author's institution, suggests improvements can be made leading to increased student satisfaction, motivation and competency. This paper therefore argues for change in the approach to assessment by empowering students to become partners in …

The Acceptance And Action Questionnaire – Ii: An Item Response Theory Analysis, Clarissa W. Ong, Benjamin G. Pierce, Douglas W. Woods, Michael P. Twohig, Michael E. Levin

Psychology Faculty Publications

Psychological flexibility is the act of being open to internal experiences while pursuing valued life directions and has been implicated in positive mental health. A lack of psychological flexibility has been implicated in a wide range of mental health problems. In most research, assessment of psychological (in)flexibility has been done with the Acceptance and Action Questionnaire – II (AAQ-II), yet researchers have noted that items on the AAQ-II may not adequately discriminate between responses to experiences and the experiences themselves. Furthermore, little research has examined whether items on the AAQ-II function as intended in terms of assessing psychological (in)flexibility, and …

Assessing Psychological Inflexibility In Hoarding: The Acceptance And Action Questionnaire For Hoarding (Aaqh), Jennifer Krafft, Clarissa W. Ong, Michael P. Twohig, Michael E. Levin

Psychology Faculty Publications

Psychological inflexibility is a psychopathological process referring to the tendency for behavior to be overly controlled by internal experiences to an extent that interferes with quality of life. Some studies indicate that psychological inflexibility is linked to hoarding, but findings have been mixed. This inconsistency may be due to reliance on general measures of psychological inflexibility in prior research as there was previously no validated measure to assess psychological inflexibility as it relates to hoarding. The present study developed and validated a measure of hoarding-related psychological inflexibility, the Acceptance and Action Questionnaire for Hoarding (AAQH) in a college student sample …

Introduction: History And Conceptual Basis Of Assessment In Higher Education, Peter Ewell, Tammie Cumming

Publications and Research

Assessment and accountability are now inescapable features of the landscape of higher education, and ensuring that these assessments are psychometrically sound has become a high priority for accrediting agencies and therefore also for higher education institutions. Bringing together the higher education assessment literature with the psychometric literature, this book focuses on how to practice sound assessment.

This volume provides comprehensive and detailed descriptions of tools for and approaches to assessing student learning outcomes in higher education. The book is guided by the core purpose of assessment, which is to enable faculty, administrators, and student affairs professionals with the information they …

Predicting Teacher Value-Added Results In Non-Tested Subjects Based On Confounding Variables: A Multinomial Logistic Regression, Nathan Street

Doctoral Dissertations and Projects

Teacher value-added measures (VAM) are designed to provide information regarding teachers’ causal impact on the academic growth of students while controlling for exogenous variables. While some researchers contend VAMs successfully and authentically measure teacher causality on learning, others suggest VAMs cannot adequately control for exogenous influences on the classroom. Furthermore, because VAMs are primarily connected to student performance on standardized, high-stakes exams and those exams are resoundingly considered to be inadequate measures of true student learning, educators and educational leaders assert VAM results are moot. The purpose of this study was to consider the potential for student background, teacher preparation, …

A Phenomenology Of Sixth Grade Students’ Perspectives On Their Experience Using A Rubric For Criterion-Referenced Assessment, Julie Quast

Doctoral Dissertations and Projects

The purpose of this phenomenological study was to examine sixth grade literacy students’ perspectives of rubric-referenced assessment at an inner-city school in central Arkansas. The theories guiding this study were Vygotsky’s zone of proximal development, as rubrics scaffold students learning (Reeves & Stanford, 2009) and social cognitive theory, as rubrics help students regulate their learning (Covill, 2012) and control their actions (Bandura, 1997). The sample size included 29 students completing a questionnaire, 12 students participating in a focus group session, and two students journaling their experience. The research questions focused on the experiences, perspectives, approach to assignments, and response to …

Academic Intervention: Acceleration And Remediation, Barbara Franklin

Doctoral Dissertations and Projects

Eighth grade math students must pass a standards based test to be promoted to the next grade. Students who were at risk of failing the state’s annual test faced impending retention. The purpose of this quasi-experimental study was to see if an intensive nine-week (55 min per day) remedial Math Connection (MC) class for 67 suburban, eighth grade students identified as at risk of failing, could significantly increase the scores; concurrently, at this Title I school, they were compared with 122 eighth grade students who were not identified as at risk of failing. The dependent variable was measured using the …

The Sciences Of Learning, Instruction, And Assessment As Underpinnings Of The Morningside Model Of Generative Instruction, Elizabeth M. Street, Kent Johnson

All Faculty Scholarship for the College of the Sciences

This paper focuses on a subset of the practices that have created the powerful learning technology developed and disseminated by Morningside Academy in Seattle, Washington, U.S.A. We briefly describe this technology, known as the Morningside Model of Generative Instruction, and tell how it builds on the selectionist approach of B. F. Skinner and the pragmatic approach of John Dewey. We also describe the critical role Precision Teaching plays at Morningside Academy and its dependence on findings from the science of learning and the science of instruction, including placement of learners, task analysis, content analysis, instructional protocols, and principles of instructional …

Comparability Of Online And Paper/Pencil Mathematics Performance Measures, John L. Moon

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The purpose of this study was to investigate the relationship between student mathematics performance of 4^th, 8^th, and 11^th grade students in Nebraska and the mode of test administration, online and paper-pencil. Schools were allowed to select the mode of test administration for their school with some exceptions for students needing accommodations. This resulted in four test groups, namely students taking the online tests in schools selecting paper or online assessments along with students taking the paper-pencil tests in schools selecting paper or online assessments. Since the students in the study were clustered within schools, …

Improving Irt Parameter Estimates With Small Sample Sizes: Evaluating The Efficacy Of A New Data Augmentation Technique, Brett P. Foley

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The 3PL model is a flexible and widely used tool in assessment. However, it suffers from limitations due to its need for large sample sizes. This study introduces and evaluates the efficacy of a new sample size augmentation technique called Duplicate, Erase, and Replace (DupER) Augmentation through a simulation study. Data are augmented using several variations of DupER Augmentation (based on different imputation methodologies, deletion rates, and duplication rates), analyzed in BILOG-MG 3, and results are compared to those obtained from analyzing the raw data. Additional manipulated variables include test length and sample size. Estimates are compared using seven different …

The Future Of Natural Selection Knowledge Measurement: A Reply To Anderson Et Al. (2010), Ross Nehm, Irvin Sam Schonfeld

Publications and Research

The development of rich, reliable, and robust measures of the composition, structure, and stability of student thinking about core scientific ideas (such as natural selection) remains a complex challenge facing science educators. In their recent article (Nehm & Schonfeld 2008), the authors explored the strengths, weaknesses, and insights provided by a detailed exploration of three commonly used measures of student thinking about natural selection in a large sample of underrepresented minority students. One of their core findings was that all of the tools they studied--including the CINS--have strengths and weaknesses that must be carefully taken into consideration by those …

Measuring Knowledge Of Natural Selection: A Comparison Of The C.I.N.S., An Open-Response Instrument, And An Oral Interview, Ross Nehm, Irvin Sam Schonfeld

Publications and Research

Growing recognition of the central importance of fostering an in-depth understanding of natural selection has, surprisingly, failed to stimulate work on the development and rigorous evaluation of instruments that measure knowledge of it. We used three different methodological tools, the Conceptual Inventory of Natural Selection (CINS), a modified version of Bishop and Anderson's (Bishop and Anderson [1990] Journal of Research in Science Teaching 27: 415-427) open-response test that we call the Open Response Instrument (ORI), and an oral interview derived from both instruments, to measure biology majors' understanding of and alternative conceptions about natural selection. We explored how these instruments …

Emergent Pedagogy: Learning To Enjoy The Uncontrollable—And Make It Productive, Anne Dalke, Kimberly Cassidy, Paul Grobstein, Doug Blank

Literatures in English Faculty Research and Scholarship

This essay reflects the shared experiences of four college faculty members (a biologist, a psychologist, a computer scientist, and a feminist literary scholar) working together with K-12 teachers to explore a new perspective on educational practice. It offers a novel rationale for independent thinking and learning, one that derives from rapidly developing interdisciplinary and transdisciplinary inquiries in the sciences and social sciences into what are known as “complex” or “emergent” systems. Using emergent systems as a model of teaching and learning makes at least three significant contributions to our thinking bout teaching, in three very different dimensions. It invites us …