Quantitative Psychology Commons^™

A New Method To Determine The Posterior Distribution Of Coefficient Alpha, John Mart V. Delosreyes

Psychology Theses & Dissertations

There is a focus within the behavioral/social sciences on non-physical, psychological constructs (i.e., constructs). These constructs are indirectly measured using measurement instruments that consist of questions that capture the manifestations of these constructs. The indirect nature of measuring constructs results in a need of ensuring that measurement instruments are reliable. The most popular statistic used to estimate reliability is coefficient alpha as it is easy to compute and has properties that make it desirable to use. Coefficient alpha’s popularity has resulted in a wide breadth of research into its qualities. Notably, research about coefficient alpha’s distribution has led to developments …

Confidence Intervals For The Coefficient Alpha Difference From Two Independent Samples (Groups), Miguel Padilla

Psychology Faculty Publications

Four different bootstrap methods for estimating confidence intervals (CIs) for a coefficient alpha difference from two independent samples (groups) were examined. These four CIs were compared to the most promising non-bootstrap CI alternatives in the literature. All CIs were assessed with a Monte Carlo simulation with conditions similar to previous research. The results indicate that there is a clear order in coverage performance of the CIs. The bootstrapped highest density interval had the best coverage performance across all simulation conditions. Yet, it was impacted by unequal sample sizes when one of the groups had the smallest sample size investigated of …

Investigating The Quality Of Life For Children With Autism Spectrum Disorder Scale Using Rasch Methodology, Laura C. Chezan, Jin Liu, Ruiqin Gao, Erik Drasgow

Communication Disorders & Special Education Faculty Publications

Our purpose in this study was to provide additional psychometric evidence of the Quality of Life for Children with Autism Spectrum Disorder (QOLASD-C) scale. We used Rasch modeling to investigate the QOLASD-C functioning, the characteristics of the items comprising the scale, and the item functioning across subgroups of children with ASD based on gender and race/ethnicity. Results showed that QOLASD-C was unidimensional, met the local independence assumption, and measured quality of life (QOL). The items showed excellent fit to the model and good discriminating ability between low and high QOL. Most items showed a moderate difficulty level. No differential item …

Data Quality And Study Compliance Among College Students Across 2 Recruitment Sources: Two Study Investigation, Abby L. Braitman, Megan Strowger, Jennifer L. Shipley, Jordan Ortman, Rachel I. Macintyre, Elizabeth A. Bauer

Psychology Faculty Publications

Background: Models of satisficing suggest that study participants may not fully process survey items and provide accurate responses when survey burden is higher and when participant motivation is lower. Participants who do not fully process survey instructions can reduce a study’s power and hinder generalizability. Common concerns among researchers using self-report measures are data quality and participant compliance. Similarly, attrition can hurt the power and generalizability of a study.

Objective: Given that college students comprise most samples in psychological studies, especially examinations of student issues and psychological health, it is critical to understand how college student recruitment sources impact data …

A Meta-Analysis Of Associations Between Weight Bias Internalization And Conceptually-Related Correlates: A Step Towards Improving Construct Validity, Kelly A. Romano, Kristin E. Heron, Cassidy M. Sandoval, Lindsay M. Howard, Rachel I. Macintyre

Psychology Faculty Publications

Weight bias internalization (WBI), a process of weight-based self-devaluation, has been associated with adverse mental and physical health. However, there are limitations with the existing conceptualization and operationalization of WBI that raise questions about the implications of this evidence-base. To address these limitations, the present study investigated the construct validity of WBI by conducting a meta-analysis of associations between WBI (as currently operationalized) and conceptually-related correlates. Studies identified through October 2021 that provided zero-order correlations for associations between WBI and conceptually-related constructs were examined. Meta-regression determined whether these associations differed across WBI measures and demographic (age, sex/gender, race, BMI) and …

Assessment And Learning In Knowledge Spaces (Aleks) Adaptive System Impact On Students' Perception And Self-Regulated Learning Skills, Honda Harati, Laura Sujo-Montes, Chih-Hsiung Tu, Shadow J.W. Armfield, Cherng-Jyh Yen

Educational Foundations & Leadership Faculty Publications

Adaptive learning is an educational method that uses computer algorithms and artificial intelligence (AI) to customize learning materials and activities based on each user's model. Adaptive learning has been used for more than 20 years. However, it is still unique, and no other system could bring more or even similar capabilities than the ones adaptive technology offers, including the application of AI, psychology, psychometrics, machine learning, and providing a personalized learning environment. However, there are not many studies on its practicality, usefulness, improving students' learning skills, students' perception, etc., due to the limited number of institutes investing in this new …

Estimation Of Correlation Confidence Intervals Via The Bootstrap: Non-Normal Distributions, John Mart V. Delosreyes

Psychology Theses & Dissertations

Estimating confidence intervals (CIs) for the correlation has been a challenge. The challenge stems from the metamorphic nature of the sampling distribution of the correlation being bound by-1≤ρ≤1. The nonparametric nature of the bootstrap makes it a good option for estimating correlation CIs. However, there have been mixed results about the robustness of bootstrap CIs for the correlation with non normal data. This had led the literature to suggesting the use of transformation methods to estimate correlation CIs. However, transformation methods carry a risk of the original data being misrepresented. Thus, further investigation of bootstrap CIs for the correlation is …

Multiple Imputation Of Missing Data In Structural Equation Models With Mediators And Moderators Using Gradient Boosted Machine Learning, Robert J. Milletich Ii

Psychology Theses & Dissertations

Mediation and moderated mediation models are two commonly used models for indirect effects analysis. In practice, missing data is a pervasive problem in structural equation modeling with psychological data. Multiple imputation (MI) is one method used to estimate model parameters in the presence of missing data, while accounting for uncertainty due to the missing data. Unfortunately, commonly used MI methods are not equipped to handle categorical variables or nonlinear variables such as interactions. In this study, we introduce a general MI framework that uses the Bayesian bootstrap (BB) method to generate posterior inferences for indirect effects and gradient boosted machine …

The Effects Of Task Criticality And Target Modality On A Simulated Battlefield Search Task, Julie A. Hanson

Psychology Theses & Dissertations

Warfighters must rely on lengthy instruction manuals when asked to perform tasks in critical environments. These instruction manuals are predominantly written in text and rarely include images. Several theoretical frameworks, including the Pictorial Superiority Effect, posit images to be more effective forms of instruction for short-term memory recall tasks. It is unclear whether pictures are superior forms of instruction for use in tasks with potential life-threatening consequences. Recently, studies have attempted to define and manipulate task criticality to determine the effects a critical scenario may have on operator performance. Findings have been equivocal, perhaps because of the ambiguity associated with …

Examining The Measurement Invariance Of The Minnesota Multiphasic Personality Inventory-2-Restructured Form Internalizing Specific Problem Scales In African- American And Caucasian Men, Megan Anne Brokenbourgh

Psychology Theses & Dissertations

Test bias has long been an area of investigation in the personality assessment literature, including the MMPI-2-RF. Research on previous versions of the MMPI and MMPI-2-RF has pointed to mixed results. The current study aims to examine test bias on the MMPI-2-RF’s nine Internalizing Specific Problem Scales by examining measurement invariance using MIMIC modeling and investigating differential item functioning (DIF). After removal of invalid protocols, the first sample consisted of 2,980 protocols from various settings requested from Pearson (255 African American and 2,755 Caucasian protocols). The second sample consisted of 1,379 valid protocols from psychiatric inpatient settings (1,245 Caucasian and …

Effects Of Varying Degrees Of Fixed And Random Responding On The Validity Of Score Interpretation For The Sp And Psy-5 Scales Of The Mmpi-2-Rf, Joseph Brooks Minifie

Psychology Theses & Dissertations

The Minnesota Multiphasic Personality Inventory – 2 Restructured Form (MMPI-2- RF; Tellegen & Ben-Porath, 2008/2011) is a widely used self-report measure of psychopathology and personality. However, the self-report format of the MMPI-2-RF suggests that interpretation of its scales and the clinical recommendations that follow are vulnerable to invalid response styles. This dissertation builds upon previous research (Handel, Ben-Porath, Tellegen, & Archer, 2010) to examine the effect of random and fixed responding, as measured by the VRIN-r and TRIN-r Scales, on the 28 SP and PSY-5 Scales. A computer simulation procedure was used to insert increasing degrees of inconsistent responding into …

The Effects Of Religious Coping And Drinking To Cope On The Relationship Between Depressive Symptoms And Alcohol-Related Problems, Adrian J. Bravo

Psychology Theses & Dissertations

The present research examined the moderating effect of religious coping (positive or negative) on the relationship between depressive symptoms and alcohol-related problems. Furthermore, the current study examined the moderating effects of positive and negative religious coping in the context of the confirmed mediation of drinking to cope on depression and alcohol related problems (i.e., moderated-mediation). The study consisted of 294 religious undergraduate student drinkers from a large southeastern university. The majority of participants identified themselves as Christian (n = 257, 87.4%), were female (n = 218, 74.1%), and reported a mean age of 21.85 (SD = 5.57) …

The Effects Of Generative Strategies In Instructional Simulations On Learning, Cognitive Load, And Calibration Accuracy, Jennifer R. Morrison

STEMPS Theses & Dissertations

Instructional simulations can provide a powerful medium for learners to interact with a model representing underlying principles of content or phenomena. While a promising medium for developing a learner's own mental model, reviews of simulation learning have revealed less than promising results (Bangert-Drowns, Kulik, & Kulik, 1985; Kulik & Kulik, 1991), perhaps due to the lack of instructional supports inherent with a discovery-based approach. This study examined the use of generative strategies as an instructional support to promote learning from a physics simulation. Generative strategies, originally proposed by Wittrock (1974, 1989), strengthen understanding by prompting learners to create meaning between …

Investigating The Roles Of Time Perspective And Emerging Adulthood In Predicting Driving Behavior, Kristie L. Johnson

Psychology Theses & Dissertations

In the U.S., motor vehicle crashes are the leading cause of death for individuals 2 to 34 years of age (National Highway Traffic Safety Administration, 2009c). Of particular interest are 18 to 25 year olds or emerging adults because of their increased crash risk. The prevalence of crashes attributable to the combination of driving inexperience and risky behaviors creates the necessity to identify predictors of crash likelihoods. While there are known personality variables that predict risky driving, time perspective as an additional one was suggested. Time perspective pertains to how the past, present, and future influence an individual's actions. Zimbardo, …

The Effects Of Combat Exposure On Post-Deployment Coping Deficits In Oef/Oif/Ond Veterans, Alex Emerson Dryden

Psychology Theses & Dissertations

As members of the United States Military return stateside from the combat zones in Iraq and Afghanistan, an increasing number of veterans exposed to combat are reporting symptoms of posttraumatic stress disorder (PTSD) as well as other significant detrimental impacts on their ability to cope with the stressful situations they experienced in the combat arena. The purpose of the current study is to ascertain the presence of posttraumatic stress disorder in veterans returning from Operation Iraqi Freedom (OIF), Operation Enduring Freedom (OEF), and Operation New Dawn (OND), the potential impairment in their abilities to cope with the combat-related stress. The …

Psychometric Properties Of The Minnesota Multiphasic Personality Inventory-2-Restructured Form (Mmpi-2-Rf) Fbs-R, Fs, And Rbs Scales In A Neuropsychological Setting, Danielle M.E. Ransom

Psychology Theses & Dissertations

The Minnesota Multiphasic Personality Inventory-2 (MMPI-2) is the most widely used self-report measure of personality and psychopathology in the United States. The recently released MMPI-2-RF (Restructured Form), meanwhile, was designed to be a shorter and more efficient version of the MMPI-2. All MMPI-2-RF items are fully contained within the larger MMPI-2 and all IVIMPI-2-RE scales may be scored from a standard MMPI-2 administration. This study sought to examine the relationship between the RBS, Fs, and FBS-r over-reporting validity scales of the MMPI-2-RF, a stand-alone measure of symptom validity/cognitive effort, and neuropsychological indicators commonly used in assessment batteries. Results of this …

Using The Counseling Center Assessment Of Psychological Symptoms - 34 (Ccaps-34) To Predict Premature Termination In A College Counseling Sample, Sean B. Hall

Counseling & Human Services Theses & Dissertations

Swift and Greenberg (2012) observed that variables influencing the decision to drop out fluctuate according to the primary presenting problem, the amount of structure in therapy, the length of treatment, and the clinical setting. Due to these reports, researchers may focus on predictors of premature termination (PT) in treatment settings where the unique situational characteristics may have an idiosyncratic influence on the decision to withdraw from services (Phillips, 1985; Swift & Greenberg, 2012). The purpose of this exploratory study was to examine client characteristics that impact dropout in University Based Clinics (UBC). Results from the logistic regression analysis indicated higher …

Hierarchical Linear Modeling Of Drinking To Cope With Anxiety Among College Students, Bradley Wetzell, Matthew R. Pearson, James Henson

OUR Journal: ODU Undergraduate Research Journal

Previous research has assumed that drinking motives (reasons for drinking) remain fairly stable over time (traits). The current study examines how drinking motives of college students may vary over time (states). Weekly measures were completed by 125 undergraduates at Old Dominion University, which examined how average levels of anxiety interacted with anxiety coping motives to influence drinking. Using Hierarchical Linear Modeling, it was found that anxiety coping motives were less predictive for participants with elevated average anxiety levels, as opposed to participants with normal to low anxiety levels. Implications and possible explanations are discussed.

Research Mentor: Dr. James Henson, Department …

The Applicability Of The Megargee Classification System For The Mmpi-A, Joel Andrew Dillon

Psychology Theses & Dissertations

Megargee (1977) originally developed a classification system for MMPI profiles for male offenders, and eventually expanded this system to also accommodate the MMPI profiles of female offenders (Megargee, 1992). Recently Megargee expanded and modified this system for use with the MMPI-2 (Megargee, Carbonell, Bohn, and Sliger, 2001). The purpose of the current study was to examine the utility of Megargee's systems as applied to adolescents in correctional facilities based on MMPI-A results. The Megargee classification criteria were modified for the purposes of this study, generally based on quite limited modifications to accommodate the lower profile ratings typically found for adolescents …

Psychometric Properties Of The Mmpi-A Harris-Lingoes And Si Subscales In A Forensic Sample, Ashley K. Winkleman

Psychology Theses & Dissertations

The purpose of the current study was to examine the internal and external psychometric properties of the Harris-Lingoes subscales. This was accomplished by use of both self-report and caregiver-rated external criterion measures. The present study employed an archival data set consisting of 760 adolescents (470 boys and 290 girls) who completed the MMPI-A at an outpatient adolescent treatment facility as part of a court-ordered psychological evaluation. Overall, a number of subscales demonstrated good internal consistency reliability (e.g., D4 and Hy3) whereas other subscales (e.g., Pd2) demonstrated unacceptable internal consistency reliability for both genders. Correlations with external self-report scores and caregiver …

Development And Validation Of The Cultural Competence Of Program Evaluators (Ccpe) Scale, Krystall Dunaway

Psychology Theses & Dissertations

As part of its Guiding Principles for Evaluators, the American Evaluation Association (AEA) requires that evaluators develop cultural competencies, yet no measure of cultural competence currently exists in the field. Using items from cultural competence measures used in fields such as counseling and nursing, in conjunction with the creation of qualitative questions, the researcher developed the Cultural Competence of Program Evaluators (CCPE) scale. The main goal of this study was to validate the CCPE, and a subsidiary goal was to assess differences in level of cultural competence among program evaluators based on various demographic variables such as minority status, age, …

Massachusetts Youth Screening Instrument Long-Term Outcomes And Scale Stability, Elise Christina Simonds Bisbee

Psychology Theses & Dissertations

The Massachusetts Youth Screening Instrument-2 (MAYSI-2; Grisso & Barnum, 2006) was developed in 1998 to offer an efficient measure for identifying adolescents within the juvenile justice system in need of further psychiatric evaluation, treatment, or specialized care. Since the instrument's publication, several studies have evaluated the psychometric properties and clinical utility of the MAYSI-2. The current study adds to the literature examining the reliability and validity of this measure. Specifically, the current study sought to evaluate the long-term characteristics and predictive utility of the MAYSI-2 scale scores. This study utilized a sample of 8,929 boys (n = 6.780) and …

Organizational Justice Perceptions In China: Development Of The Chinese Organizational Justice Scale, Katherine M. Fodchuk

Psychology Theses & Dissertations

Research analyzing fairness perceptions within organizations has gained the attention of cross-cultural theorists as the criteria used to judge fairness varies across cultures. Review of the literature indicates that researchers use translated Western measures of organizational justice on Eastern samples despite evidence of cultural variation in justice criteria. This dissertation addresses some of the gaps in the current research by developing and validating an indigenous measure of Chinese organizational justice perceptions. A preliminary qualitative study revealed numerous justice rules used by Chinese employees to determine whether a workplace decision was fair. The qualitative results were used to develop the Chinese …

Wisc-Iv And Iva+Plus Pattern Analysis: Assessment Of Attention-Deficit /Hyperactivity Disorder, Kevin K. Tsang

Psychology Theses & Dissertations

Diagnosis of attention-deficit/hyperactivity disorder (ADHD) is a challenging practice with no definitive diagnostic test. This study sought to evaluate the use of a pattern of performance method of inference in ADHD assessment that examines an individual's general intellectual ability in comparison to his or her own attention skills. WISC-IV scores, IVA+Plus quotients, and basic demographic information were collected from patient files of children previously evaluated by the Eastern Virginia Medical School Neuropsychology Clinic. Children with and without ADHD were compared by analyzing the following difference or delta score discrepancies: (a) WISC-IV General Ability Index (GAI) minus WISC-IV Working Memory Index, …

Examination Of A Nomological Network Of Team Leadership: A Construct Validation Study, Kari R. Strobel

Psychology Theses & Dissertations

This study examined the construct-related validity evidence for team leadership measurement within the United States Navy. Drawing on literature from industrial/organizational, sport, and military psychology, the current research specified one nomological network for officer team leadership appraisal. The proposed model tested the idea that Naval team leaders engaging in transformational behaviors would be more likely to use and encourage the use of teamwork processes, increase cohesion among team members, and maintain superior mission readiness. The hypotheses were tested with performance appraisal data from 900 Commanders, Lieutenant Commanders, and Lieutenants from aviation, surface, and subsurface warfare communities. The relationships between the …

Methods Of Detecting Differential Item Functioning: A Comparison Of Confirmatory Factor Analysis Methods, Jenny Chia Yi Kuang

Psychology Theses & Dissertations

The present Monte Carlo study compared four confirmatory factor analysis (CFA) methods for detecting differential item functioning (DIF). The four methods were the noniterative and iterative mean and covariance structure analysis (MACS) methods, the modification index (MI) method, and the modification index-divided sample (MI-divided) method. Reference and focal groups responded to 12 items with 3 of the 12 items designed to exhibit DIF. Sample sizes of 250 and 500 were examined. In addition, three types of DIF were examined: DIF on loadings, DIF on thresholds, and DIF on both loadings and thresholds. Results indicated that for sample size 250, all …

The Effects Of Parcels And Latent Variable Scores On The Detection Of Interactions In Structural Equation Modeling, Thomas D. Fletcher

Psychology Theses & Dissertations

Numerous theories in the behavioral and organizational sciences involve the regression of an outcome variable on component terms and their product to evaluate interaction effects. There are numerous statistical difficulties with this multiple regression approach. The most serious is measurement error, requiring the use of structural equation modeling. Jöreskog and Yang (1996) described a nonlinear structural equation modeling procedure that incorporates mean structures in the covariance analysis. They demonstrated that only one indicator for the product term is necessary for model identification. Unfortunately, the Jöreskog-Yang procedure leads to biased estimates of the product coefficient. In this dissertation, I propose that …

The Relationship Of Mmpi-A Item Effectiveness To Item Content, Diagnostic Category, And Classification Accuracy, Kathleen D. Lynch

Psychology Theses & Dissertations

Archer, Handel, and Lynch (2001) recently compared the item endorsement frequencies for the MMPI-A normative sample against two adolescent clinical samples. Results showed that the MMPI-A contains a substantial number of items that do not show a significant difference in item endorsement frequency between normative and clinical samples. The current study extends Archer et al.'s (2001) research in three ways: (1) it examines the item endorsement frequencies of the Supplementary scales, Harris Lingoes subscales, and subtle-obvious items; (2) it examines the Basic, Content, and Supplementary scales, and Harris Lingoes subscales with two homogeneous diagnostic criterion groups (as suggested by Archer, …

Examining The Equivalence Of Rater Groups In 360-Degree Feedback For Use In Leadership Development, Amy Fitzgibbons

Psychology Theses & Dissertations

This study assessed the seldom-considered aspect of measurement equivalence across the three most common rater groups in 360-degree feedback systems. The graded response model for polytomous items was used to assess differential functioning of items and tests and applied to an archival data set of 664 ratees to determine the equivalence of peer, subordinate, and supervisor ratings of four leadership competencies. The results indicate that the leadership competencies were invariant across the three rater groups. The results and conclusions produced are discussed with practical implications in mind.

Using Latent Semantic Analysis To Assess Reader Strategies, Joseph P. Magliano, Katja Wiemer-Hastings, Keith K. Millis, Brenton D.. Muñoz, Danielle Ncnamara

Psychology Faculty Publications

We tested a computer-based procedure for assessing reader strategies that was based on verbal protocols that utilized latent semantic analysis (LSA). Students were given self-explanation-reading training (SERT), which teaches strategies that facilitate self-explanation during reading, such as elaboration based on world knowledge and bridging between text sentences. During a computerized version of SERT practice, students read texts and typed self-explanations into a computer after each sentence. The use of SERT strategies during this practice was assessed by determining the extent to which students used the information in the current sentence versus the prior text or world knowledge in their self-explanations. …