Quantitative Psychology Commons^™

The Standards Will Never Be Enough: A Racial Justice Extension, Mya Poe, Maria Elena Oliveri, Norbert Elliot

Buros Center: Professional Staff Publications

Since 1952, the Standards for Educational and Psychological Testing has provided criteria for developing and evaluating educational and psychological tests and testing practice. Yet, we argue that the foundations, operations, and applications in the Standards are no longer sufficient to meet the current U.S. testing demands for fairness for all test takers. We propose racial justice extensions as principled ways to extend the Standards, through intentional actions focused on race and targeted at educational policies, processes, and outcomes in specific settings. To inform these extensions, we focus on four social-justice concepts: intersectionality derived from Black Feminist Theory; responsibility derived …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Applying Visual Methods To Document The History Of Psychological Testing: A Qualitative Approach, Analay Perez, Janet F. Carlson, Buros Center For Testing At The University Of Nebraska-Lincoln

Buros Center: Professional Staff Publications

The history of psychological testing is critical to many areas of applied psychology. Assessment forms a mainstay of clinical practice, second only to psychotherapy (Meyer et al., 2001). In industrial/organizational psychological practice, employee selection depends on testing to assess applicant qualifications. In educational contexts, testing is central to the evaluation of academic performance and college readiness, in addition to determining eligibility for various types of special educational services.

The history of testing is deeply rooted in myriad psychological specialties (Carlson & Geisinger, 2021). This fact prompted a qualitative examination and integration of three distinct historical threads identified by the proposal …

A Latent Class Analysis Of Personality Traits With Educational Attainment, Tyler Minter

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The five-factor model of personality (extraversion, agreeableness, conscientiousness, neuroticism, openness to experience) is an empirically based personality model that has been utilized in multiple psychological assessments. Recent works have found Block & Block’s (1980) three personality profiles (resilient, overcontrolled, undercontrolled) within the context of the five-factor model. This study performed a latent class analysis using a short FFM assessment from the SAPA project, a free online personality test. The intention of this study was to replicate the three personality profiles within the five-factor model. Four latent classes were included in the final solution. Two of the three personality profiles emerged …

Statistical Mediation Analysis In Regression Discontinuity Design For Causal Inference, Donna Chen

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Regression discontinuity designs (RDDs) are the most robust quasi-experimental design, but current statistical models are limited to estimates for the simple causal relationship between only two variables: the independent and dependent variables. In practice, intervening variables (or mediators) are often observed as part of the causal chain. Mediators explain the why and how a treatment or intervention works. Therefore, mediation and RDD analysis combined can be a useful tool in identifying key components or processes that make intervention programs effective while making causal inferences for improving student achievement, despite natural constraints, limitations, and ethical considerations. Without an integrated framework of …

Multiracial Individuals And Educational Testing, Karen Alexander

The Nebraska Educator: A Student-Led Journal

A literature review focused on quantitative measures and methods regarding multiracial individuals and educational testing revealed that multiracial individuals are uniquely different than monoracial individuals in terms of their racial identity and these unique identities interact with test scores. Until recently, this uniqueness has been ignored by institutions and within the field of educational testing. The uniqueness of multiracial identity should be taken into consideration when using test measures to make decisions for selection and when comparing group outcomes. The review provides a brief picture regarding the history of categorization of multiracial individuals and current research which connects the multiracial …

Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The assessment of model fit in latent trait modelling, better known as item response theory (IRT), is an integral part of model testing if one is to make valid inferences about the estimated parameters and their properties based on the selected IRT model. Though important, the assessment of model fit has been less utilized in IRT research than it should. For example, there have been less research investigating fit for polytomous dominance models such the Graded Response Model (GRM), and to a lesser extent ideal point models such as the Generalized Graded Unfolding Models (GGUM), both in its dichotomous and …

Evaluation Of Modern Missing Data Handling Methods For Coefficient Alpha, Katerina Matysova

College of Education and Human Sciences: Dissertations, Theses, and Student Research

When assessing a certain characteristic or trait using a multiple item measure, quality of that measure can be assessed by examining the reliability. To avoid multiple time points, reliability can be represented by internal consistency, which is most commonly calculated using Cronbach’s coefficient alpha. Almost every time human participants are involved in research, there is missing data involved. Missing data means that even though complete data were expected to be collected, some data are missing. Missing data can follow different patterns as well as be the result of different mechanisms. One traditional way to deal with missing data is listwise …

Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson

Buros Center: Professional Staff Publications

The article discusses salient factors that influence the current context within which homeschooling occurs. Individual states have applied various approaches to establish regulations that both preserve the rights of homeschooling parents and fulfill the state’s obligation to ensure that its residents receive the education to which they are constitutionally entitled. Case and ethnographic studies or research involving small and selected samples often appear in outlets associated with homeschool advocacy groups or in outlets that are not mainstream. The paucity of empirical evidence derived from methodologically strong research paradigms has led to little certainty about many aspects of homeschooling including its …

Using Bayesian Multilevel Models To Control For Multiplicity Among Means, Michael J. Zweifel

College of Education and Human Sciences: Dissertations, Theses, and Student Research

It is well known that the Type I error rate will exceed α when multiple hypothesis tests are conducted simultaneously. This is known as Type I error inflation. The probability of committing a Type I error grows monotonically as the number as the number of hypothesis being tested increases. A class of methods, known as multiple comparison procedures, has been developed to combat this issue. However, in turn for maintaining the Type I error rate below α, multiple comparison procedures sacrifice power to correctly reject false hypotheses. The loss of power is exacerbated when variance heterogeneity is present.

In …

A Comparison Of Alternative Bias-Corrections In The Bias-Corrected Bootstrap Test Of Mediation, Donna Chen

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Although the bias-corrected (BC) bootstrap is an oft recommended method for obtaining more powerful confidence intervals in mediation analysis, it has also been found to have elevated Type I error rates in conditions with small sample sizes. Given that the BC bootstrap is used most often in studies with low power due to small sample size, the focus of this study is to consider alternative measures of bias that will reduce the elevated Type I error rate without reducing power. The alternatives examined fall under two categories: bias correction and transformation. Although the bias correction methods did not significantly decrease …

An Evaluation And Revision Of The Children’S Behavior Questionnaire Effortful Control Scales, Scott R. Frohn

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The Children’s Behavior Questionnaire (CBQ; Rothbart, Ahadi, Hershey, & Fisher, 2001) is a popular parent report measure of children’s temperament. Effortful control, which refers to processes involved in regulating reactivity to internal and external stimuli, is one factor of temperament measured by the CBQ using five scales tapping multiple dimensions. Numerous studies examining the psychometric properties of the CBQ have shown some problems with the scales, including inconsistent factor structures and measurement noninvariance. Furthermore, the way effortful control is typically defined in the literature, and even according to the CBQ’s authors, is inconsistent with how it is actually measured with …

The Effects Of Scaling On Trends Of Development: Classical Test Theory And Item Response Theory, Weldon Z. Smith

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The scale metrics used in educational testing are often arbitrary, and this can impact interpretation of scores on measurements. Both classical test theory sum scores and item response theory estimates measure the same underlying dimension, but differences in the two scales may lead one to be more preferential than the other in interpreting data. Mismatch between individual ability and test difficulty can further result in difficulties in correctly interpreting trends of development in longitudinal data. A previous limited simulation by Embretson (2007) demonstrated that classical test theory sum scores result in misinterpretation of linear trends of development, and that item …

The Cyber Aggression In Relationships Scale: A New Multidimensional Measure Of Technology-Based Intimate Partner Aggression, Laura E. Watkins, Rosalita C. Maldonado, David Dilillo

Department of Psychology: Faculty Publications

The purpose of this study was to develop and provide initial validation for a measure of adult cyber intimate partner aggression (IPA): the Cyber Aggression in Relationships Scale (CARS). Drawing on recent conceptual models of cyber IPA, items from previous research exploring general cyber aggression and cyber IPA were modified and new items were generated for inclusion in the CARS. Two samples of adults 18 years or older were recruited online. We used item factor analysis to test the factor structure, model fit, and invariance of the measure structure across women and men. Results confirmed that three-factor models for both …

Strategies And Resources To Enhance Test Evaluation And Selection, Janet F. Carlson, Nancy Anderson

Buros Center: Professional Staff Publications

Testing serves an important function for SLPs in offering an evidence base that is useful in screening, diagnosing, monitoring progress, and documenting outcomes. Tests are used to measure diverse constructs such as communication, literacy, oral and written language, receptive and expressive vocabulary, articulation, phonological awareness and processing, and auditory perception and processing. In addition, specific impairments may require specialized measures to evaluate conditions such as stuttering and orthographic competence.

When using tests to diagnose language impairments, Betz, Eickhoff, and Sullivan (2013) suggest that SLPs consider carefully a test’s psychometric properties, particularly because of the “increasing emphasis on evidence-based practice, specifically, …

Development And Validation Of A State-Based Measure Of Emotion Dysregulation: The State Difficulties In Emotion Regulation Scale (S-Ders), Jason M. Lavender, Matthew T. Tull, David Dilillo, Terri Messman-Moore, Kim L. Gratz

Department of Psychology: Faculty Publications

Existing measures of emotion dysregulation typically assess dispositional tendencies and are therefore not well suited for study designs that require repeated assessments over brief intervals. The aim of this study was to develop and validate a state-based multidimensional measure of emotion dysregulation. Psychometric properties of the State Difficulties in Emotion Regulation Scale (S-DERS) were examined in a large representative community sample of young adult women drawn from four sites (N = 484). Exploratory factor analysis suggested a four-factor solution, with results supporting the internal consistency, construct validity, and predictive validity of the total scale and the four subscales: Nonacceptance (i.e., …

Mixed-Effects Location-Scale Models For Conditionally Normally Distributed Repeated-Measures Data, Ryan Walters

Department of Psychology: Dissertations, Theses, and Student Research

Hypotheses about psychological processes are most frequently dedicated to individual mean differences, but individual differences in variability are likely to be important as well. The mixed-effects location-scale model estimates individual differences in both mean level and variability in a single model, and represents an important advance in testing variability-related hypotheses. However, the mixed-effects location-scale model remains relatively novel to empirical scientists as statistical software is often handicapped by more complex models and a paucity of methodological studies exist examining the statistical properties of this model.

This dissertation investigates the mixed-effects location-scale model through the development of open-source software for its …

A Comparison Of Population-Averaged And Cluster-Specific Approaches In The Context Of Unequal Probabilities Of Selection, Natalie A. Koziol

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Sampling designs of large-scale, federally funded studies are typically complex, involving multiple design features (e.g., clustering, unequal probabilities of selection). Researchers must account for these features in order to obtain unbiased point estimators and make valid inferences about population parameters. Single-level (i.e., population-averaged) and multilevel (i.e., cluster-specific) methods provide two alternatives for modeling clustered data. Single-level methods rely on the use of adjusted variance estimators to account for dependency due to clustering, whereas multilevel methods incorporate the dependency into the specification of the model.

Although the literature comparing single-level and multilevel approaches is vast, comparisons have been limited to the …

A Micro-Level Analysis Of Behavioral Dynamics In Parent-Child Synchrony, Kadie L. Ausherman

College of Education and Human Sciences: Dissertations, Theses, and Student Research

This study investigates parent-child synchrony, a multilevel construct that has not been operationalized in a precise or standardized way. Synchrony is frequently discussed theoretically, yet there still lacks a clear means of measuring it, even on the behavioral level. When parent-child synchrony is operationalized in a study, it is rarely analyzed in such a way that reflects the dyadic dynamics that unfold as the parent and child are interacting. The aim of this study is to operationalize parent-child synchrony in terms of the dyadic behavior patterns. An overview of the current literature with regard to synchrony as a multilevel construct …

Evaluation Of The Psychometric Properties Of Two Short Forms Of The Social Interaction Anxiety Scale And The Social Phobia Scale, Allura L. Le Blanc, Laura C. Bruce, Richard G. Heimberg, Debra A. Hope, Carlos Blanco, Franklin R. Schneier, Michael R. Liebowitz

Department of Psychology: Faculty Publications

The Social Interaction Anxiety Scale and Social Phobia Scale are widely used measures of social anxiety. Using data from individuals with social anxiety disorder (n = 435) and nonanxious controls (n = 86), we assessed the psychometric properties of two independently developed short forms of these scales. Indices of convergent and discriminant validity, diagnostic specificity, sensitivity to treatment, and readability were examined. Comparisons of the two sets of short forms to each other and the original long forms were conducted. Both sets of scales demonstrated adequate internal consistency in the patient sample, showed expected patterns of correlation with measures of …

Teacher Support Mediates Concurrent And Longitudinal Associations Between Temperament And Mild Depressive Symptoms In Sixth Grade, Kathleen Moritz Rudasill, Patrick Pössel, Stephanie Winkeljohn Black, Kate Niehaus

Department of Educational Psychology: Faculty Publications

The combination of changes occurring at the transition to middle school may be a catalyst for the onset of depressive symptoms, yet teacher support at this transition is protective. Research points to certain temperamental traits as risk factors for developing depressive symptoms. This study examines student reports of teacher support and teacher reports of student–teacher relationship (STR) quality as mediators of associations between child temperament (i.e. negative emotionality at age 4½ : and emotional reactivity in elementary grades) and depressive symptoms in sixth grade. Results indicate (a) negative emotionality predicted emotional reactivity and depressive symptoms; (b) emotional reactivity predicted depressive …

Calendar Interviewing And The Use Of Landmark Events – Implications For Cross-Cultural Surveys, Tina Glasner, Wander Van Der Vaart, Robert F. Belli

Department of Psychology: Faculty Publications

This paper discusses potential methodological issues in the design and implementation of calendar recall aids such as the Life History Calendar for cross-cultural surveys. More specifically, it aims to provide insights into how the use of landmark events in calendar interviewing may be influenced by cross-cultural variability. As an example, we compare the landmark events reported by Dutch and American respondents in two studies in which calendar recall aids were used. The study discusses differences that were found between the two countries in the numbers and types of reported landmark events, as well as in the temporal distribution of those …

Self-Monitoring Personality At Work Revisited: A Comparative Meta-Analysis, Michael P. Wilmot

Department of Agricultural Leadership, Education and Communication: Dissertations, Theses, and Student Scholarship

The validity of self-monitoring personality in work and organizational settings was reexamined. Comparative meta-analyses using both random-effects and fixed-effects models were conducted (349 total samples; N = 75,811) to test the relationship between self-monitoring personality and work-related and demographic correlates, as well as the reliability of the self-monitoring measures. Contributions were made to the literatures of self-monitoring and meta-analysis. Self-monitoring: Results indicated that self-monitoring related to a number of relevant organizational outcomes, including job effectiveness and success, leadership, and ingratiation. Some results ran contrary to the prior meta-analysis (Day, Shleicher, Unckless, & Hiller, 2002). Meaningful differences were found between the …

Improving Irt Parameter Estimates With Small Sample Sizes: Evaluating The Efficacy Of A New Data Augmentation Technique, Brett P. Foley

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The 3PL model is a flexible and widely used tool in assessment. However, it suffers from limitations due to its need for large sample sizes. This study introduces and evaluates the efficacy of a new sample size augmentation technique called Duplicate, Erase, and Replace (DupER) Augmentation through a simulation study. Data are augmented using several variations of DupER Augmentation (based on different imputation methodologies, deletion rates, and duplication rates), analyzed in BILOG-MG 3, and results are compared to those obtained from analyzing the raw data. Additional manipulated variables include test length and sample size. Estimates are compared using seven different …

A Preliminary Study: Body Dysmorphic Disorder In Division I Women’S Collegiate Soccer Players, Tammy D. Jones

Department of Educational Administration: Dissertations, Theses, and Student Research

The prevalence of Body Dysmorphic Disorder (BDD) among collegiate athletes has not been clearly determined. The purpose of this study was to determine if there are symptoms of body dysmorphic disorder found in Division I women’s soccer players. The researcher hypothesized that there would be some symptoms found within the participants of sport and that there was a need to research this area further.

The study consisted of four participants who participated in semi-structured interviews. The subjects were asked a series of questions from the Yale-Brown Obsessive Compulsive Scale Modified for Body Dysmorphic Disorder (BDD-YBOCS) to determine if they indicated …

Agreement Answer Scale Design For Multilingual Surveys: Effects Of Translation-Related Changes In Verbal Labels On Response Styles And Response Distributions, Ana Villar

Survey Research and Methodology (SRAM) Program: Dissertations and Theses

Answer scales in survey instruments are widely used, but little is known about how to choose verbal descriptors as labels. In multilingual research, this matter is further complicated because answer scales must be appropriate for all languages and function comparatively. Comparing source questionnaires to translations of multinational projects (e.g., the World Values Survey, the European Social Survey), it was observed that certain verbal features differed across languages, countries, and modules. This dissertation empirically investigates the effect of such changes on response distributions. The verbal feature examined is the presence or absence of an intensity modifier in the second and fourth …

Nonlinear Dynamics Of Infant Sitting Postural Control, Joan E. Deffeyes

Department of Psychology: Dissertations, Theses, and Student Research

Sitting is one of the first developmental milestones that an infant achieves. Thus measurements of sitting posture present an opportunity to assess sensorimotor development at a young age, in order to identify infants who might benefit from therapeutic intervention, and to monitor the efficacy of the intervention. Sitting postural sway data was collected using a force plate from infants with typical development, and from infants with delayed development, where the delay in development was due to cerebral palsy in most of the infants in the study. The center of pressure time series from the infant sitting was subjected to a …

Affective Flexibility: Evaluative Processing Goals Shape Amygdala Activity, William A. Cunningham, Jay J. Van Bavel, Ingrid Johnsen Haas

Department of Political Science: Faculty Publications

Although early research implicated the amygdala in automatic processing of negative information, more recent research suggests that it plays a more general role in processing the motivational relevance of various stimuli, suggesting that the relation between valence and amygdala activation may depend on contextual goals. This study provides experimental evidence that the relation between valence and amygdala activity is dynamically modulated by evaluative goals. During functional magnetic resonance imaging, participants evaluated the positive, negative, or overall (positive plus negative) aspects of famous people. When participants were providing overall evaluations, both positive and negative names were associated with amygdala activation. When …