Quantitative Psychology Commons^™

A Signal Detection Experiment With Limited Number Of Trials, Tadamasa Sawada

MODVIS Workshop

Signal detection theory has been well accepted in vision science to measure human sensitivity to stimuli in a Psychophysical experiment. The theory is formulated so that the measured sensitivity is independent from a response bias (criterion). The formulation is based on an assumption that number of trials in the experiment is infinite but this assumption cannot be satisfied in practice. The assumption came from two normal distributions used in the formulation. The distributions respectively represent a set of signal trial and that of noise trials in the experiment. In this study, I will show how the violation of the assumption …

Binocular 3d Motion Perception As Bayesian Inference, Martin Lages, Suzanne Heron

MODVIS Workshop

The human visual system encodes monocular motion and binocular disparity input before it is integrated into a single 3D percept. Here we propose a geometric-statistical model of human 3D motion perception that solves the aperture problem in 3D by assuming that (i) velocity constraints arise from inverse projection of local 2D velocity constraints in a binocular viewing geometry, (ii) noise from monocular motion and binocular disparity processing is independent, and (iii) slower motions are more likely to occur than faster ones. In two experiments we found that instantiation of this Bayesian model can explain perceived 3D line motion direction under …

The Effects Of Ordinal Data On Coefficient Alpha, Kathryn E. Pinder

Masters Theses, 2010-2019

Given coefficient alpha’s wide prevalence as a measure of internal reliability, it is important to know the conditions under which it is an appropriate estimate of reliability. The present paper explores alpha’s assumption of uncorrelated errors when used with ordinal data. Alpha overestimates true reliability when correlated errors are present. In this paper, I use a simulation study to recreate three mechanisms proposed to create correlated errors in ordinal data. The first mechanism, misclassification error, occurs when there are correlated measurement errors present in the data. The second mechanism, grouping error, occurs when there are not enough categories to represent …

Propensity Score Matching In Higher Education Assessment, Heather D. Harris

Masters Theses, 2010-2019

The applied nature of higher education assessment does not lend itself to rigorous experimental research designs. However, assessment practitioners would like to make claims about the influence of educational programs on student learning outcomes. Propensity score matching (PSM) methods are quasi-experimental techniques that allow researchers to control for known confounding variables. In the context of higher education, PSM techniques allow assessment practitioners to control for confounding variables related to students’ self-selected participation in university programs. Research and recommendations on how to apply PSM techniques are scattered throughout several disciplines. However, additional research is needed to evaluate how well PSM techniques …

Persons Can Speak Louder Than Variables: Person-Centered Analyses And The Prediction Of Student Success, Elisabeth M. Pyburn

Masters Theses, 2010-2019

In order to ensure that analyses are appropriate for one’s research question(s), it is important to consider whether a person-centered or variable-centered approach is needed. Person-centered approaches are often not considered in situations for which they would be appropriate. To that end, a description of the characteristics and procedures of two common person-centered analyses (cluster analysis and mixture modeling) are provided. Although both analyses accomplish the same general aim – to group persons based on their similarity on a series of variables, thus providing ease of interpretation – the methods employed for each analysis differ considerably. As illustration, both analyses …

The Effects Of A Planned Missingness Design On Examinee Motivation And Psychometric Quality, Matthew S. Swain

Dissertations, 2014-2019

Assessment practitioners in higher education face increasing demands to collect assessment and accountability data to make important inferences about student learning and institutional quality. The validity of these high-stakes decisions is jeopardized, particularly in low-stakes testing contexts, when examinees do not expend sufficient motivation to perform well on the test. This study introduced planned missingness as a potential solution. In planned missingness designs, data on all items are collected but each examinee only completes a subset of items, thus increasing data collection efficiency, reducing examinee burden, and potentially increasing data quality. The current scientific reasoning test served as the Long …

Extending An Irt Mixture Model To Detect Random Responders On Non-Cognitive Polytomously Scored Assessments, Mandalyn R. Swanson

Dissertations, 2014-2019

This study represents an attempt to distinguish two classes of examinees – random responders and valid responders – on non-cognitive assessments in low-stakes testing. The majority of existing literature regarding the detection of random responders in low-stakes settings exists in regard to cognitive tests that are dichotomously scored. However, evidence suggests that random responding occurs on non-cognitive assessments, and as with cognitive measures, the data derived from such measures are used to inform practice. Thus, a threat to test score validity exists if examinees’ response selections do not accurately reflect their underlying level on the construct being assessed. As with …

Examining The Performance Of The Metropolis-Hastings Robbins-Monro Algorithm In The Estimation Of Multilevel Multidimensional Irt Models, Bozhidar M. Bashkov

Dissertations, 2014-2019

The purpose of this study was to review the challenges that exist in the estimation of complex (multidimensional) models applied to complex (multilevel) data and to examine the performance of the recently developed Metropolis-Hastings Robbins-Monro (MH-RM) algorithm (Cai, 2010a, 2010b), designed to overcome these challenges and implemented in both commercial and open-source software programs. Unlike other methods, which either rely on high-dimensional numerical integration or approximation of the entire multidimensional response surface, MH-RM makes use of Fisher’s Identity to employ stochastic imputation (i.e., data augmentation) via the Metropolis-Hastings sampler and then apply the stochastic approximation method of Robbins and Monro …

Addressing Serial-Order And Negative-Keying Effects: A Mixed-Methods Study, Jerusha J. Gerstner

Dissertations, 2014-2019

Researchers have studied item serial-order effects on attitudinal instruments by considering how item-total correlations differ based on the item’s placement within a scale (e.g., Hamilton & Shuminsky, 1990). In addition, other researchers have focused on item negative-keying effects on attitudinal instruments (e.g., Marsh, 1996). Researchers consistently have found that negatively-keyed items relate to one another above and beyond their relationship to the construct intended to be measured. However, only one study (i.e., Bandalos & Coleman, 2012) investigated the combined effects of serial-order and negative-keying on attitudinal instruments. Their brief study found some improvements in fit when attitudinal items were presented …

A Review Of Court Cases Involving Discrimination In Physical Ability Testing: 1992-2015, Casey L. Biggs

Masters Theses & Specialist Projects

Organizations that employ physically demanding jobs want to ensure their selection procedures distinguish qualified applicants from unqualified applicants. However, such selection tools typically result in adverse impact against various protected groups and often lead to litigation. Various factors influence the court’s decision to rule in favor of the plaintiff or the defendant. The purpose of the present study is to identify those factors. The ADA (1990) created strict guidelines for plaintiffs and defendants to follow to be credible in a discrimination case. This study will specifically determine the impact of the ADA guidelines and three additional factors that influence court …

A Comparison Of Population-Averaged And Cluster-Specific Approaches In The Context Of Unequal Probabilities Of Selection, Natalie A. Koziol

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Sampling designs of large-scale, federally funded studies are typically complex, involving multiple design features (e.g., clustering, unequal probabilities of selection). Researchers must account for these features in order to obtain unbiased point estimators and make valid inferences about population parameters. Single-level (i.e., population-averaged) and multilevel (i.e., cluster-specific) methods provide two alternatives for modeling clustered data. Single-level methods rely on the use of adjusted variance estimators to account for dependency due to clustering, whereas multilevel methods incorporate the dependency into the specification of the model.

Although the literature comparing single-level and multilevel approaches is vast, comparisons have been limited to the …

Psychometric Investigation Of The Check-In, Check-Out Fidelity Of Implementation Measure, Erin Ann Sullivan

Electronic Theses and Dissertations

Suspension and expulsion are utilized frequently and disproportionality in schools in the United States. Many schools utilize Positive Behavioral Interventions and Supports (PBIS), a tiered framework to prevent problem behavior and reduce the use of discipline practices (Sugai et al., 2000). Check-In, Check-Out (CICO) is a targeted group behavioral intervention that is utilized within this framework in schools to prevent severe problem behavior in students that are beginning to exhibit externalizing and/or internalizing behavioral needs; thus, preventing the use of exclusionary discipline practices (Crone et al., 2010; Hawken & Horner, 2003). As the use of CICO in schools continues to …

An Examination Of The Psychometric Properties Of The Working Model Of The Child Interview Coding Scheme With Biological Mothers Who Have Maltreated, Brian D. Gustman

Theses and Dissertations--Educational, School, and Counseling Psychology

There are hundreds of thousands of children living in foster care in the United States on any given day. Mental health professionals may be called upon to assist with evaluating the parental capacity of these children’s parents in order to inform reunification decisions. One of the key parental capacity domains to be evaluated is the relationship between parent and child (Schmidt et al., 2007). The Working Model of the Child Interview coding scheme (WMCI; Zeanah et al., 1996) is one tool for evaluating this relationship. There is a significant practice-to-research gap with this measure. To date, no peer-reviewed studies have …

Naturalistic Clinical Decision Making By Emergency Department Staff And The Assignment Of Categorical Suicide Risk Ratings Within An Urban Veteran Population, Gerd R. Naydock

PCOM Psychology Dissertations

The ability to comprehensively and effectively identify those individuals who are at greatest risk to engage in self-directed violence (SDV) forms the cornerstone for all professional suicide prevention activities. To that end, mental health professionals have come to rely on the use of risk stratification to identify at-risk individuals as a way to inform and guide risk management and treatment, without having the benefit of empirical evidence to support such practices. The current program evaluation examined archival data comprised of suicide risk assessments conducted by mental health professionals on suicidal veterans (N = 1,560) in the emergency department of a …

The Relationship Between Adhd And Trait Facets Of The Five-Factor Model, Todd William Bennett

PCOM Psychology Dissertations

Facets of the Five-Factor Model (FFM) were examined in order to understand its interaction with Attention Deficit Hyperactivity Disorder (ADHD)-symptoms. By utilizing archival data, in a correlational design, adults between the ages of 18-66 were tested for the presence of ADHD, which was then compared with data gathered from the NEO-PI-R. Comorbid psychiatric conditions often associated with ADHD were accounted for in the design. Results partially supported the hypotheses, specifically, that altruism was inversely related to Impulsivity, as predicted. However, other findings largely did not support a relationship between other specific NEO-PI-R facets and ADHD. Other significant relationships that were …

Impacts Of Objective And Subjective Social Inclusion On The Quality Of Life Of Individuals With Schizophrenia Spectrum Disorders And Major Depressive Disorder, Katie A. Johanning-Gray

PCOM Psychology Dissertations

Increased social inclusion and enhanced quality of life for individuals with severe mental illnesses (SMIs) are goals of the recovery movement. The present study examined the differences in reported subjective social inclusion (SubSI) and objective social inclusion (ObjSI) between individuals diagnosed with schizophrenia spectrum disorders (SSDs) and those diagnosed with Major Depressive Disorder (MDD). Furthermore, the amount of variance in quality of life (QOL) which can be predicted by type of diagnosis, SSDs or MDD, symptom severity, and SubSI and ObjSi was determined. An archival data set was used. Participants were 337 individuals whose primary diagnosis was an SSD or …

The Relationship Between Parenting Style And The Level Of Emotional Intelligence In Preschool-Aged Children, Giselle Farrell

PCOM Psychology Dissertations

The purpose of this study is to examine the relationship between parenting style and the level of emotional intelligence in preschool-aged children. The sample consisted of eighty parent participants of preschool-aged children between the ages of 3 and 6 years old. Participants completed the Parenting Styles and Dimensions Questionnaire (PSDQ) in order to assess their views on behaviors that parents typically demonstrate towards their children. Based on each participant’s responses on the PSDQ they were determined to favor one of the following three parenting styles: authoritarian, authoritative, or permissive. Participants also completed the Children’s Behavior Questionnaire- Very Short Form (CBQ-VSF) …

The Frequency And Competency Of Executive Functions Assessment And Intervention Among Practicing School Psychologists, Meghan A. Garrett

PCOM Psychology Dissertations

This study surveyed school psychologists (N = 167) primarily from six different states about their perceptions, knowledge, frequency, and application of executive functions assessment and interventions. The purpose of this study was to explore school psychologists’ practices in executive functions assessment and interventions. Results of the study indicated that school psychologists vary in their knowledge of executive functions, but the majority of them do not include the assessment of and intervention in executive functions deficits in their regular practice. However, school psychologists tended to report executive functions assessment and intervention more frequently when presented with specific disability classifications (e.g. autism, …

An Exploration Of Social Connectedness As A Predictor Of Quality Of Life In Acquired Brain Injury Survivors, Jennifer Oyekanmi

PCOM Psychology Dissertations

Research on quality of life in ABI survivors has focused on four domains: psychological, physical, social, and cognitive (Upadhyay, 2007). Social relationships, in particular, can help ABI survivors more effectively cope with changes in their lives, help maintain a healthy outlook, and can help with seeking further understanding of the consequences of sustaining a ABI (Hibbard et al, 2002). The current study sought to examine if social connectedness is predictive of quality of life in ABI survivors. Participants were 71 individuals who have sustained a ABI and who currently or in the past participated in a long term rehabilitation program. …

Health, Wellbeing, And Academic Achievement Among Urban College Students, Elise Tanzini

Dissertations and Theses

The post-secondary educational environment is full of demands—both academically and outside of the direct college setting—and as a result, stress is a prevailing concern for college students. Chronic, high levels of stress have been linked to a number of negative health outcomes, such as anxiety and depression, and academic outcomes, such as lower academic achievement. Using a diverse sample of undergraduate and masters students [n=84; mean (SD) age = 22.89 (5.99) years] from an urban, public college, the current study measured students’ experiences of stress (Perceived Stress Scale) and the adaptive and maladaptive strategies they utilized to cope with stress, …