Psychology Commons^™

Finding The Ghost With The Machine: Breaking Through The Assessment Center Validity Ceiling By Exploring Decisional Processes Using New Sources Of Behavioral Data Within Virtual Assessments, Brett W. Guidry

Open Access Dissertations

Decades of assessment center (AC) research has resulted in an inevitable “validity ceiling” whereby increasing the validity of the AC method is becoming increasingly difficult. To overcome this challenge, new avenues for collecting and evaluating AC participant behaviors must be explored, with a particular focus on overcoming the inherent limitations of human observation—a hallmark of the AC method. This study examines detailed logs of AC participant behaviors captured automatically and unobtrusively during a computer-based simulation assessment. Using a decision making framework, basic characteristics of the new behavioral data are tested against existing theories of decisional efficacy. The construct-related validity of …

Detecting Candidate Preknowledge Of Items Using A Predictive Checking Method, Xi Wang

Doctoral Dissertations

In on-demand high-stakes testing programs such as GRE and TOEFL, some items are repeatedly used across test administrations to reduce the cost of developing new items constantly. Item exposure provides an opportunity for examinees to have knowledge of particular test items in advance of their administration. It poses a threat to test security and ultimately will result in invalid test scores. Therefore, many testing programs conduct quality control to monitor test compromise at individual and/or group level. A predictive checking method is proposed in this study to detect examinee preknowledge on exposed items. We consider a scenario where a test …

Identifying Examinees Who Possess Distinct And Reliable Subscores When Added Value Is Lacking For The Total Sample, Joseph A. Rios

Doctoral Dissertations

Research has demonstrated that although subdomain information may provide no added value beyond the total score, in some contexts such information is of utility to particular demographic subgroups (Sinharay & Haberman, 2014). However, it is argued that the utility of reporting subscores for an individual should not be based on one’s manifest characteristics (e.g., gender or ethnicity), but rather on individual needs for diagnostic information, which is driven by multidimensionality in subdomain scores. To improve the validity of diagnostic information, this study proposed the use of Mahalanobis Distance and H^T indices to assess whether an individual’s data significantly departs …

Individual Differences In Stress And Coping: Testing A Model Of Decisional Control, Bryan D. Grant

Electronic Thesis and Dissertation Repository

Quantifying the processes of coping is one way to make the concept both descriptive and testable. Decisional Control (DC) is a formal, mathematically-specified, normative model which prescribes that an individual faced with a variety of alternatives in a stressing situation will attempt to minimize objective and perceived threat of an adverse event inherent within their choices. In this study, a game-theoretic probability mixture model created for DC was evaluated using established indexes of model fit to empirical decision and choice data. Sources of empirical departure from the fully normative model predictions, notably individual and group cognitive mapping of choice linked …

Multiple Imputation Of Missing Data In Structural Equation Models With Mediators And Moderators Using Gradient Boosted Machine Learning, Robert J. Milletich Ii

Psychology Theses & Dissertations

Mediation and moderated mediation models are two commonly used models for indirect effects analysis. In practice, missing data is a pervasive problem in structural equation modeling with psychological data. Multiple imputation (MI) is one method used to estimate model parameters in the presence of missing data, while accounting for uncertainty due to the missing data. Unfortunately, commonly used MI methods are not equipped to handle categorical variables or nonlinear variables such as interactions. In this study, we introduce a general MI framework that uses the Bayesian bootstrap (BB) method to generate posterior inferences for indirect effects and gradient boosted machine …

An Item Response Theory Analysis Of Emotional Expressivity Measures, Melissa K. Matheys

Theses and Dissertations

The understanding of psychometric properties of emotional expressivity measures is often limited to rudimentary statistics. The present study investigated, in depth, the psychometric properties of four measures of emotional expressivity (the Self-Concealment Scale, the Distress Disclosure Index, the Emotional Expressivity Scale, and the Emotion Regulation Questionnaire – Suppression subscale). Item response theory (IRT) analyses suggested that recoded versions of the measures’ Likert scales may be beneficial in practice as well as the deletion of some measures’ items. IRT analyses of the four measures of emotional expressivity provide more information than classical test theory statistics about how to implement these measures …

Multilevel Modeling Issues And The Measurement Of Stress Is Multilevel Data, Tyler Stout

FIU Electronic Theses and Dissertations

Multilevel datasets are commonly used and increasingly popular in research in the organizational and other social sciences. These models are complex and have many elements beyond those found in more traditional linear models. However, research on how multilevel models perform is lacking.

The current paper examined the impact of common factors (average cluster size, cluster size distribution, average number of clusters, strength of the intraclass correlation coefficient, and effect sizes of individual and cluster level variables, and their interaction) in multilevel datasets. Monte Carlo data simulation was used across 6,144 factor-combination conditions. The results of study factors on observed intraclass …

Optimizing Cross-Battery Assessment Procedures For Reading-Based Specific Learning Disorder Diagnosis: A Monte Carlo Study, Zachary Joseph Roman

Theses and Dissertations

Specific Learning Disorder is a disorder in which deficits in academic skills are caused by specific cognitive deficits. Cross-Battery Assessment (Flanagan, Alfonso, & Ortiz, 2013), is a popular method of diagnosing specific learning disorders. A recent study using data simulation methods claimed that cross-battery assessment was insufficiently accurate for clinical use (Stuebing, Fletcher, Branum-Martin, & Francis, 2012). However, the study used the general population base rate for specific learning disorders, resulting in misleadingly low accuracy estimates. The current study attempted to accurately simulate the cross-battery assessment method with a referred population prevalence to provide a fair analysis of cross-battery assessment’s …

The Influence Of Discrete Emotional States On Preferential Choice, Andrea M. Cataldo

Masters Theses

Past research has shown that emotion affects preferential choice outcomes. The goal of the present study was to further research on emotion and preferential choice by using mathematical modeling to investigate the effects of specific dimensions of emotion on the underlying mechanisms of preferential choice. Specifically, we aimed to determine whether the concurrent effects of positive-negative valence and situational certainty on attention and information accumulation threshold, respectively, would influence the magnitude of the similarity effect, a robust phenomenon in preferential choice. Participants first underwent either an Anger (negative and certain), Fear (negative and uncertain), or no (Control) emotion manipulation. All …

The Psychometric Evaluation And Validation Of A Measure Assessing Pharmacological And Social Alcohol Expectancies In Adolescents, Megan Victoria Mcmurray

USF Tampa Graduate Theses and Dissertations

Extending prior alcohol expectancy measurement research, this researcher (McMurray, 2013) recently developed the Pharmacological and Social Alcohol Expectancy Scale (PSAES). The PSAES is the only alcohol expectancy measure to date that provides adequate coverage of both social expectancies and the anticipated positive pharmacological effects resulting from alcohol consumption, and was developed and validated in a sample of young adults (aged 18-23). Research has shown that adolescents at high risk for alcohol use disorder (AUD) hold higher expectations of reward from alcohol, suggesting that expectancy patterns may help distinguish at-risk youth. Building upon the previous PSAES validation study, the primary purpose …

The Nature And Structure Of Temperament In Early And Middle Childhood: A Multi-Method Approach, Yuliya Kotelnikova

Electronic Thesis and Dissertation Repository

Structural work on the nature of child temperament has lagged far behind parallel research with adults. Further, the structure of extant parent-report questionnaires has been examined only at the higher-order level, using small samples of children. This dissertation addresses this important gap in three studies, examining the lower- and higher-order structure of two widely used parent-reports of child temperament (Studies 1 and 2) and an observational battery of temperament (Study 3). The first study examined the lower- and higher-order structure of the Children’s Behavior Questionnaire (CBQ; Rothbart, Ahadi, Hershey, & Fisher, 2001) in a large community sample of children at …

Investigating Parameter Recovery And Item Information For Triplet Multidimensional Forced Choice Measure: An Application Of The Ggum-Rank Model, Philseok Lee

USF Tampa Graduate Theses and Dissertations

To control various response biases and rater errors in noncognitive assessment, multidimensional forced choice (MFC) measures have been proposed as an alternative to single-statement Likert-type scales. Historically, MFC measures have been criticized because conventional scoring methods can lead to ipsativity problems that render scores unsuitable for inter-individual comparisons. However, with the recent advent of classical test theory and item response theory scoring methods that yield normative information, MFC measures are surging in popularity and becoming important components of personnel and educational assessment systems. This dissertation presents developments concerning a GGUM-based MFC model henceforth referred to as the GGUM-RANK. Markov Chain …

Antenatal Stressful Life Events And Postpartum Depression In The United States: The Role Of Women’S Socioeconomic Status At The State Level, Soumyadeep Mukherjee

FIU Electronic Theses and Dissertations

The purpose of this dissertation was to examine patterns of antenatal stressful life events (SLEs) experienced by women in the United States (U.S.) and their association with postpartum depression (PPD). It further explored the role of women's state-level socio-economic status (SES) on PPD; the racial/ethnic dispartites in SLE-PPD relationship; and the role of provider communication on perinatal depression.

Data from 2009–11 Pregnancy Risk Assessment Monitoring System (PRAMS) and SES indicators published by the Institute of Women’s Policy Research (IWPR) were used. Latent class analysis (LCA) was performed to identify unobserved class membership based on antenatal SLEs. Multilevel generalized linear mixed …

Psychological Abuse, Mental Health, And Acceptance Of Dating Violence Among Adolescents, Jeff R. Temple, Hye Jeong Choi, Joanna Elmquist, Michael L. Hecht, Michelle Miller-Day, Gregory L. Stuart, Meagan Brem, Caitlin Wolford-Clevenger

Communication Faculty Articles and Research

Purpose

Existing literature indicates that acceptance of dating violence is a significant and robust risk factor for psychological dating abuse perpetration. Past work also indicates a significant relationship between psychological dating abuse perpetration and poor mental health. However, no known research has examined the relationship between acceptance of dating violence, perpetration of dating abuse, and mental health. In addition to exploring this complex relationship, the present study examines whether psychological abuse perpetration mediates the relationship between acceptance of dating violence and mental health (i.e., internalizing symptoms of depression, anxiety, and hostility).

Methods

Three waves of longitudinal data were obtained from …

Parametrically Constrained Lightness Model Incorporating Edge Classification And Increment-Decrement Neural Response Asymmetries, Michael E. Rudd

MODVIS Workshop

Lightness matching data from disk-annulus experiments has the form of a parabolic (2^nd-order polynomial) function when matches are plotted against annulus luminance on log-log axes. Rudd (2010) has proposed a computational cortical model to account for this fact and has subsequently (Rudd, 2013, 2014, 2015) extended the model to explain data from other lightness paradigms, including staircase-Gelb and luminance gradient illusions (Galmonte, Soranzo, Rudd, & Agostini, 2015). Here, I re-analyze parametric lightness matching data from disk-annulus experiments by Rudd and Zemach (2007) and Rudd (2010) for the purpose of further testing the model and to try to constrain …

An Image-Based Model For Early Visual Processing, Heiko H. Schütt, Felix A. Wichmann

MODVIS Workshop

No abstract provided.

A Learning Model For L/M Specificity In Ganglion Cells, Albert Ahumada

MODVIS Workshop

An unsupervised learning model for developing L/M specific wiring at the ganglion cell level would support the research indicating L/M specific wiring at the ganglion cell level (Reid and Shapley, 2002). Removing the contributions to the surround from cells of the same cone type improves the signal-to-noise ratio of the chromatic signals. The unsupervised learning model used is Hebbian associative learning, which strengthens the surround input connections according to the correlation of the output with the input. Since the surround units of the same cone type as the center are redundant with the center, their weights end up disappearing. This …

Applying Solution Behavior Thresholds To A Noncognitive Measure To Identify Rapid Responders: An Empirical Investigation, Mary M. Johnston

Dissertations, 2014-2019

Noncognitive measures are increasingly being used for accountability purposes in higher education (e.g., O. L. Liu, Frankel, & Roohr, 2014). Because these measures are often collected under low-stakes conditions, there is a concern students do not put forth their best effort when responding, which is problematic given previous research has found noneffortful responding can negatively impact the validity of results (e.g., Barry & Finney, 2009; Meade & Craig, 2012; Swerdzewski, Harmes, & Finney, 2011). Subsequently, there is a need to identify students displaying low effort on low-stakes noncognitive measures. One method, which is based on response time and can discreetly …

Examining Latent Change Classes: An Application Of Factor Mixture Modeling To Change Scores, Thai Q. Ong

Masters Theses, 2010-2019

Although change scores are used in a variety of statistical methods (e.g., analysis of variance and regression), there is a lack of application of latent variable modeling methods to change scores. This thesis provides a detailed description of two latent variable modeling methods applied to change scores: factor analysis of change scores and change score factor mixture modeling. To illustrate advantages of these methods, both were applied to change score data from undergraduates. Students responded to sense of identity items during a university-wide assessment day on two occasions, once as incoming freshmen and again as second-semester sophomores. Change scores were …

The Effect Of Anchoring Vignettes On Factor Structures: Student Effort As An Example, Carolyn A. Miesen

Masters Theses, 2010-2019

Anchoring vignettes are used as a methodological technique for removing differential interpretation of response categories (DIRC) from scores on subjective self-report measures (King, Murray, Slomon, & Tandon, 2004). This technique requires participants to read one or more short scenarios, or vignettes, designed to represent various levels of a construct. Vignette ratings are used as an indication of DIRC, which is a source of differential item functioning (DIF). Prior research primarily used indirect methods for evaluating vignette quality. In response, the present set of studies proposes using invariance testing as a more direct evaluation of how the use of anchoring vignettes …

Assessment Of Neurotensin Receptor Agonist Effects On Fear-Potentiated Startle, Mark Aaron Vanden Avond

All NMU Master's Theses

Systemic administration of the NTS₁ receptor agonist PD149163 has exhibited anxiolytic effects in male rats. The present study sought to further evaluate the potential anxiolytic effects of PD149163 by assessing this compound in both male and female C57BL/J6 mice using the fear-potentiated startle (FPS) paradigm. Startle chambers were equipped with a shock-grid floor, fluorescent light, and an acoustic startle speaker. Conditioning took place between the light and floor shock, and test sessions measured startle to a 90 dB noise burst while the light was on (FPS) or off. Startle magnitude did not differ between the male and female mice. …

Examining Internalizing Symptoms In Child And Youth Victims Of Emotional Abuse And Bullying: The Mediating Effects Of Individual And Family Strength Factors In Clinical Samples, Amani M. Elrofaie

Electronic Thesis and Dissertation Repository

Child and youth experiences of emotional abuse and bullying are harmful interactions by caregivers and peers, which produce adverse mental health and social outcomes (Glaser, 2011). This study examined the relationships between trauma exposure and internalizing outcomes through individual and parenting level strength factors. The study comprised 1,297 child and youth participants, aged 4 to 18, from inpatient and outpatient mental health facilities across Ontario, who were administered the interRAI Child and Youth Mental Health assessment (ChYMH; Stewart, Hirdes et al., 2015) with their parents/caregivers. Generalized linear modelling (Nelder & Wedderburn, 1972) was used to determine the relationships between trauma …

The Effects Of Styles Of Dress On First Impressions, Ashley Dibert, Ashley Laird, Di Wu

The Research and Scholarship Symposium (2013-2019)

Many factors influence our first impression. Previous research found that clothes may affect people’s perceptions and attitudes toward others. Even subtle changes in the style of dress would affect others’ perceptions on multiple characters such as success, trustworthiness and reliability (Howlett, Pine, & Orakcioglu, 2013). It has also been found that the amount of similarities between raters and the individuals rated were positively correlated with the rating scores of favorable characteristics (Michinov & Michinov, 2011).The current research aimed to investigate how a person’s own style of dress would influence their perception on attraction based on those individuals’ style of dress. …

Virginity And Guilt Differences Between Men And Women, Caitlin M. Lipman, Alexis J. Moore

Butler Journal of Undergraduate Research

In this research, the authors measured the levels of sexual guilt between two groups of people on multiple levels, virgins and nonvirgins, by gender. The differences between men and women when it comes to virginity will also be studied. Based on the sample size of college students, N = 364. College students (N=364) completed a 34-item online survey of questions that measure guilt levels. Ten out of the twenty questions are demographic questions, such as: age, ethnicity, religion, year, etc. The other questions were a combination of Likert scaled questions and open ended responses. We predicted that females will produce …

Birds Of A Feather Learn Together: Learning Community Outcomes Assessment Using Propensity Score Matching, Elisabeth M. Pyburn, Heather Dawn Harris

Showcase of Graduate Student Scholarship and Creative Activities

The goal of the study was to provide an example of propensity score matching techniques within the context of higher education assessment. At our institution, a select number of incoming first-year students participate in major-specific learning communities. Because the decision to join the communities is purely voluntary, one might expect that students who elect to join the program may differ from those who do not. Thus, important covariates related to self-selection into the learning community were identified. Two years of Arts learning community data were analyzed to compare the academic performance and civic-mindedness of learning community students to an arts …

Flesch-Kincaid Reading Grade Level Re-Examined: Creating A Uniform Method For Calculating Readability On A Certification Exam, Emily Neuhoff, Kristiana M. Feeser, Kayla Sutherland, Thomas Hovatter

Online Journal for Workforce Education and Development

Abstract

Objective: This study attempted to establish a consistent measurement technique of the readability of a state-wide Certified Nursing Assistant’s (CNA) certification exam. Background: Monitoring the readability level of an exam helps ensure all test versions do not exceed the maximum reading level of the exam, and that knowledge of the subject matter, rather than reading ability, is being assessed. Method: A two part approach was used to specify and evaluate readability. First, two methods (Microsoft Word^® (MSW) software and published readability formulae) were used to calculate Flesch Reading Ease (FRE) and Flesch-Kincaid Reading Grade Level (FKRGL) for multiple …

Team Interaction Dynamics During Collaborative Problem Solving, Travis J. Wiltshire, Stephen M. Fiore Ph.D.

Human Factors and Applied Psychology Student Conference

The need for better understanding collaborative problem solving (CPS) is rising in prominence as many organizations are increasingly addressing complex problems requiring the combination of diverse sets of individual expertise to address novel situations. This research draws from theoretical and empirical work that describes the knowledge coordination arising from team communications during CPS and builds from this by incorporating methods to study interaction dynamics. Interaction between team members in such contexts is inherently dynamic and exhibits nonlinear patterns not accounted for by extant research methods. To redress this gap, the present study draws from methods designed to study social and …

The Reliability Of Crowdsourcing: Latent Trait Modeling With Mechanical Turk, Matt Baucum, Steven Rouse Dr., Cindy Miller-Perrin, Elizabeth Mancuso Dr.

Seaver College Research And Scholarly Achievement Symposium

Mechanical Turk, an online crowdsourcing platform, has recently received increased attention in the social sciences as studies continue to suggest its viability as a source for reliable experimental data. Given the ease with which large samples can be quickly and inexpensively gathered, it is worth examining whether Mechanical Turk can provide accurate experimental data for methodologies requiring such large samples. One such methodology is Item Response Theory, a psychometric paradigm that defines test items by a mathematical relationship between a respondent’s ability and the probability of item endorsement. To test whether Mechanical Turk can serve as a reliable source of …

The Effects Of Scaling On Trends Of Development: Classical Test Theory And Item Response Theory, Weldon Z. Smith

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The scale metrics used in educational testing are often arbitrary, and this can impact interpretation of scores on measurements. Both classical test theory sum scores and item response theory estimates measure the same underlying dimension, but differences in the two scales may lead one to be more preferential than the other in interpreting data. Mismatch between individual ability and test difficulty can further result in difficulties in correctly interpreting trends of development in longitudinal data. A previous limited simulation by Embretson (2007) demonstrated that classical test theory sum scores result in misinterpretation of linear trends of development, and that item …

The Construct And Predictive Validity Of Psychosocial Correlates Of Television Viewing, Raheem Paxton, Pascal Jean-Pierre, Saehwan Park, Yong Gao Dr., Stephen Herrmann, G J. Norman

Journal of Health Disparities Research and Practice

Background: Many studies have examined the consequences of prolonged television viewing, but few studies have examined the psychological states that contribute to this behavior. In this study, we evaluated the construct and predictive validity of psychosocial correlates of television viewing in a population of African American (AA) breast cancer survivors (BCS).

Methods: AA BCS (N = 342, Mean age = 54 years) completed measures of decisional balance, self-efficacy, family support, and time spent watching television online. Exploratory structural equation modeling (ESEM) was used to examine the construct and predictive validity as well as the differential item functioning of the instruments …