Psychology Commons^™

Assessment Of Simultaneous Alcohol And Cannabis Use And Its Related Consequences And Cognitions In College Students: A Narrative Review, Jennifer L. Shipley, Abby L. Braitman

Psychology Faculty Publications

As rates of students using cannabis continue to rise, simultaneous use of alcohol and cannabis (such that their effects overlap; commonly referred to as simultaneous alcohol and marijuana [SAM] use) is prevalent among college students who use both substances. Although research focusing on SAM use and related cognitions and consequences continues to grow, there are no common established measures, as approaches vary across studies. This narrative review identifies current methods for assessing SAM use and measures of SAM-related consequences and cognitions (motives and expectancies) among college students, evaluates how they were developed, identifies gaps in the literature, and provides recommendations …

Assessing Alexithymia In Adolescents: Psychometric Properties Of The Perth Alexithymia Questionnaire In High School Students, Annette C. Trimble, Ken Robinson, David A. Preece

Research outputs 2022 to 2026

Conceptually, alexithymia is a key transdiagnostic risk factor for the development of numerous psychopathologies across the lifespan. However, to date, most alexithymia research has focused on adults, with adolescent work limited by a lack of validated age-appropriate assessment tools. Recently, the Perth Alexithymia Questionnaire (PAQ) was introduced to enhance the comprehensiveness of alexithymia assessments, but its psychometric properties have only been tested in adults. In this study, we address this by examining the psychometric properties of the PAQ in a sample of English-speaking high school students (N = 225, aged 11 to 18), and use the PAQ to further establish …

Body Appreciation Around The World: Measurement Invariance Of The Body Appreciation Scale-2 (Bas-2) Across 65 Nations, 40 Languages, Gender Identities, And Age, Viren Swami, Ulrich S. Tran, Stefan Stieger, Toivo Aavik, Hamed Abdollahpour Ranjbar, Sulaiman Olanrewaju Adebayo, Reza Ahfami, Oli Ahmed, Annie Aimé, Marwan Akel, Hussam Al Halbusi, George Alexias, Khawla F. Ali, Nursel Alp-Dal, Anas B. Alsalhani, Sara Álvares-Solas, Ana Carolina Soares Almaral, Sonny Andrianto, Trefor Aspden, David A. Frederick

Psychology Faculty Articles and Research

The Body Appreciation Scale-2 (BAS-2) is a widely used measure of a core facet of the positive body image construct. However, extant research concerning measurement invariance of the BAS-2 across a large number of nations remains limited. Here, we utilised the Body Image in Nature (BINS) dataset – with data collected between 2020 and 2022 – to assess measurement invariance of the BAS-2 across 65 nations, 40 languages, gender identities, and age groups. Multi-group confirmatory factor analysis indicated that full scalar invariance was upheld across all nations, languages, gender identities, and age groups, suggesting that the unidimensional BAS-2 model has …

The Potential And Peculiarities Of Perma: A Meta-Analysis Of Two Well-Being Measures With Working Samples, William P. Jimenez, Xiaoxiao Hu, Rebecca Garden, Asiye Zeytonli

Psychology Faculty Publications

In the first meta-analysis of the PERMA well-being framework (i.e., positive emotions, engagement, positive relationships, meaning, accomplishment), we cumulated 692 effect sizes (k = 33 independent samples, N = 10,050 workers). Average reliability did not meet the conventional ɑ = .70 threshold for engagement measured with the PERMA-Profiler or the Workplace PERMA Profiler or for negative emotions measured with the former. Overall, PERMA dimensions were strongly intercorrelated, and model comparisons suggested multidimensionality. We also summarized PERMA’s relationships with some conceptual antecedents (conscientiousness, loneliness); correlates (happiness, negative emotions); and outcomes (physical health, depressive symptoms, overall …

Measuring What Matters In Healthcare: A Practical Guide To Psychometric Principles And Instrument Development, Katina Swan, Renee Speyer, Martina Scharitzer, Daniele Farneti, Ted Brown, Virginie Woisard, Reinie Cordier

Research outputs 2022 to 2026

The provision of quality healthcare relies on scales and measures with robust evidence of their psychometric properties. Using measurement instruments with poor reliability, validity, or feasibility, or those that are not appropriate for the target diagnostic group or construct/dimension under consideration, may be unfavorable for patients, unproductive, and hinder empirical advancement. Resources from the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) group can assist in identifying and developing psychometrically sound measures. The COSMIN initiative is the only international, research-based practice taxonomy and methodological guidelines for measurement in healthcare. This manuscript aims to provide an accessible introduction …

Commentaries On “Scale Use And Abuse: Toward Best Practices In The Deployment Of Scales”, Constantine S. Katsikeas, Shilpa Madan, C. Miguel Brendl, Bobby J. Calder, Donald R. Lehmann, Hans Baumgartner, Bert Weijters, Mo Wang, Chengquan Huang, Joel Huber

Research Collection Lee Kong Chian School Of Business

Five comments below provide strong and interesting perspectives on multi-item scale use. They define contexts and research areas where developed scales are valuable and where they are vulnerable. Katsikeas and Madan begin by taking a global perspective on scale use, demonstrating how the use and transferability of scales become even more problematic as researchers move across languages and cultures. They provide guidance for scale use that is particularly relevant to international marketing and marketing strategy research. Brendl and Calder acknowledge the use of well-formed scales as measured variables in psychological experiments, both as independent and dependent variables, but critique the …

University Inclusion Index: Inclusion At Brigham Young University, Rachel Zierenberg, Brigit Cooper, Amanda Foltz

Student Works

In order to investigate inclusion specifically at Brigham Young University (BYU), we measured students’ perception of belonging and representation through the use of our University Inclusion Index (UII). The UII is a measure of belonging and representation with 16 items on a 5-point Likert scale. This measure was distributed to a total sample of 171 BYU students, 60 of whom were self-identified minority students. The UII had high reliability (α = .92), high validity, and high internal consistency (≥ .55). The UII reports high face validity with 97% of respondents identifying inclusion at BYU. Factor analysis revealed one primary factor, …

Accountability: Construct Definition And Measurement Of A Virtue Vital To Flourishing, Charlotte Vanoyen-Witvliet, Sung Joon Jang, Byron R. Johnson, C. Stephen Evans, Jack W. Berry, Joseph Leman, Robert C. Roberts, John Peteet, Andrew B. Torrance, Ashley N. Hayden

Faculty Publications

Embracing accountability to others for one’s responsibilities within relationships is important for flourishing, yet underexamined. An interdisciplinary team defined the construct of accountability and developed an 11-item single-factor Accountability Scale. In national samples with US census demographic representation (total N = 1257), we conducted psychometric analyses using methods from classical test theory (exploratory and confirmatory factor analyses) and item response theory. The Accountability Scale demonstrated internal consistency, construct validity, test-retest reliability, and incremental validity. Accountability correlated positively with relational variables (agreeableness, empathy) responsibility-oriented variables (conscientiousness, self-regulation), virtues (gratitude, forgiveness, limitations-owning humility), relational repair, perceived meaning presence, and flourishing, inversely with …

Test–Retest Reliability And Sensitivity Of A Brief Clinical Monitoring Measure For Transgender And Gender Diverse Adults: The Trans Collaborations Clinical Check-In (Tc3), T. Zachary Huit, Natalie R. Holt, Alexander Farquhar-Leicester, Rebecca L. Brock, Richard Mocarski, Nathan Woodruff, Debra Hope

Trans Collaborations Academic Papers

The current study aimed to examine the test–retest reliability and sensitivity of the Trans Collaborations Clinical Check-In (TC³) in a 3-month period with four assessment points at baseline, 1, 2, and 3 months to examine its utility as a clinical progress monitoring measure. This study builds on the initial validation study conducted by Holt et al. (2019). The sample of 32 transgender and gender diverse (TGD) participants were chosen who met screening for at least modest depression and anxiety, and did not have other significant risk factors (e.g., mania, self-harm). Participants completed a battery of measures that assessed …

Development Of An Explainability Scale To Evaluate Explainable Artificial Intelligence (Xai) Methods, Stephen Mccarthy

Dissertations

Explainable Artificial Intelligence (XAI) is an area of research that develops methods and techniques to make the results of artificial intelligence understood by humans. In recent years, there has been an increased demand for XAI methods to be developed due to model architectures getting more complicated and government regulations requiring transparency in machine learning models. With this increased demand has come an increased need for instruments to evaluate XAI methods. However, there are few, if none, valid and reliable instruments that take into account human opinion and cover all aspects of explainability. Therefore, this study developed an objective, human-centred questionnaire …

Assessment Of The Mate Retention Inventory-Short Form Using Item Response Theory, Patrick J. Nebl, Mark G. Mccoy, Garett C. Foster, Michael J. Zickar

Psychology Faculty Publications

The mate retention inventory (MRI) has been a valuable tool in the field of evolutionary psychology for the past 30 years. The goal of the current research is to subject the MRI to rigorous psychometric analysis using item response theory to answer three broad questions. Do the individual items of the MRI fit the scale well? Does the overall function of the MRI match what is predicted? Finally, do men and women respond similarly to the MRI? Using a graded response model, it was found that all but two of the items fit acceptable model patterns. Test information function analysis …

Multiracial Individuals And Educational Testing, Karen Alexander

The Nebraska Educator: A Student-Led Journal

A literature review focused on quantitative measures and methods regarding multiracial individuals and educational testing revealed that multiracial individuals are uniquely different than monoracial individuals in terms of their racial identity and these unique identities interact with test scores. Until recently, this uniqueness has been ignored by institutions and within the field of educational testing. The uniqueness of multiracial identity should be taken into consideration when using test measures to make decisions for selection and when comparing group outcomes. The review provides a brief picture regarding the history of categorization of multiracial individuals and current research which connects the multiracial …

Improving The Methodology For Identifying Mild Cognitive Impairment In Intellectually High-Functioning Adults Using The Nih Toolbox Cognition Battery, Grant L. Iverson, Justin E. Karr

Psychology Faculty Publications

Objective: Low scores on neuropsychological tests are considered objective evidence of mild cognitive impairment. In clinical practice and research, it can be challenging to identify a cognitive deficit or mild cognitive impairment in high-functioning people because they are much less likely to obtain low test scores. This study was designed to improve the methodology for identifying mild cognitive impairment in adults who have above average or superior intellectual abilities.

Method: Participants completed the National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function Cognition Battery (NIHTB-CB). The sample included 384 adults between the ages of 20 and …

The Study On Stress, Spirituality, And Health (Sssh): Psychometric Evaluation And Initial Validation Of The Sssh Baseline Spirituality Survey, Erica T. Warner, Blake Victor Kent, Ying Zhang, M. Austin Argentieri, Wade C. Rowatt, Kenneth Pargament, Harold G. Koenig, Lynn Underwood, Shelley A. Cole, Martha L. Daviglus, Alka M. Kanaya, Julie R. Palmer, Tianyi Huang, Mark A. Blais, Alexandra E. Shields

Psychology Faculty Publications

This paper describes the development and initial psychometric testing of the baseline Spirituality Survey (SS-1) from the Study on Stress, Spirituality, and Health (SSSH) which contained a mixture of items selected from validated existing scales and new items generated to measure important constructs not captured by existing instruments. The purpose was to establish the validity of new and existing measures in our racially/ethnically diverse sample. Psychometric properties of the SS-1 were evaluated using standard psychometric analyses in 4,634 SSSH participants. Predictive validity of SS-1 scales was assessed in relation to the physical and mental health component scores from the Short-Form …

Psychometric Evaluation Of The Transgender Congruence Scale, T. Zachary Huit, Allura L. Ralston, J, Kyle Haws, Natalie Holt, Debra A. Hope, Jae Puckett, Richard Mocarski, Nathan Woodruff

Trans Collaborations Academic Papers

Introduction Despite increased attention to transgender and gender diverse (TGD) issues in psychological literature during the past decade, gaps remain for psychometric validation of TGD-specific measures. Kozee et al. (Psychology of Women Quarterly 36(2):179–196, 2012) addressed such gaps by creating the Transgender Congruence Scale (TCS), measuring gender acceptance and feelings of gender congruence between internal and external attributes across a broad range of gender identities. The current study extended Kozee and colleagues’ work by further examining the psychometric properties of the TCS.

Methods Between October and November of 2017, 210 transmasculine, transfeminine, and gender diverse adults between ages 19 …

Psychometric Development Of The Autism Trait Survey, Gwendolyn S. Barnhart

Antioch University Full-Text Dissertations & Theses

There are limited tools for professionals who work with individuals with autism to ascertain individuals’ strengths and challenges within the various facets of symptomology after diagnosis. Professionals can currently use personal interviews and psychological reports to determine individuals’ strengths and challenges to determine the types of services that would benefit them following initial diagnosis. The limitations of this practice are that the levels of understanding, accuracy, and use of these measures vary in the field. Furthermore, the norms of diagnostic measures are the entire population rather than solely individuals on the autistic spectrum/autistics (IOS/A). A new measure is necessary: one …

Does The Cognitive Fusion Questionnaire Measure More Than Frequency Of Negative Thoughts?, Jennifer Krafft, Michael E. Levin

Psychology Student Research

Cognitive fusion is a psychopathological process that appears to be relevant to a wide range of disorders. This process is frequently measured with the Cognitive Fusion Questionnaire (CFQ). However, the construct validity of similar measures has been criticized for substantial overlap with distress. It is possible the CFQ may excessively measure the presence of unwanted thoughts, rather than fusion per se. Therefore, this study examined the discriminant validity of the CFQ relative to a measure of automatic negative thoughts (the Automatic Thoughts Questionnaire) in a college student sample (n = 389). While the two measures were highly correlated (ρ …

Development And Psychometrics Of The English Version Of The Itch Cognitions Questionnaire, Carolyn J. Heckman, Christina Schut, Mary Riley, Anke Ehlers, Rodrigo Valdes-Rodriguez, Jörg Kupfer, Uwe Gieler, Jerod L. Stapleton

Health, Behavior & Society Faculty Publications

BACKGROUND: The aim of this study was to validate the English version of the Itch Cognition Questionnaire in a sample of patients with chronic itch due to psoriasis or atopic dermatitis. An English-language version of an instrument assessing itch-related cognitions is needed since cognitions can contribute to a worsening of itch, and chronic itch is prevalent in English-speaking counties and internationally.

METHODS: The German Itch Cognitions Questionnaire was translated into English, and cognitive interviewing was conducted to finalize item wording. Internal and test-retest reliability, item discrimination, responsiveness to change, and construct, convergent, and discriminant validity were assessed in a national …

Assessing Meaningful Within-Person Variability In Likert-Scale Rated Personality Descriptions: An Irt Tree Approach, Jonas W. B. Lang, Filip Lievens, Filip De Fruyt, Ingo Zettler, Jennifer L. Tackett

Research Collection Lee Kong Chian School Of Business

Personality researchers and clinical psychologists have long been interested in withinperson variability in a given personality trait. Two critical methodological challenges that stymie current research on within-person variability are separating meaningful within-person variability from 1) true differences in trait level and 2) careless responding (or person unreliability). To partly avoid these issues, personality researchers commonly only study within-person variability in personality states over time using the standard deviation (SD) across repeated measurements of the same items (typically across days)—a relatively resource-intensive approach. In this article, we detail an approach that allows researchers to measure another type of within-person variability. The …

Assessing Sexual Orientation Symptoms In Obsessive-Compulsive Disorder: Development And Validation Of The Sexual Orientation Obsessions And Reactions Test (Sort), M. T. Williams, T. H. W. Ching, G. Tellawi, Jedidiah Siev, J. Dowell, V. Schauldt, J. C. Slimowicz, C. T. Wetterneck

Psychology Faculty Works

Obsessive-compulsive disorder (OCD) includes many symptom presentations, which creates unique diagnostic challenges. Fears surrounding one’s sexual orientation are common within OCD (also called SO-OCD), but SO-OCD is consistently misdiagnosed by physicians and psychologists. To address this issue, we describe the development of a self-report measure for assessing SO-OCD to help distinguish OCD from distress caused by a sexual orientation identity crisis. The current paper details two studies that established the psychometric properties and clinical utility of this measure. In Study 1, the factor structure, validity, and reliability were examined for the measure’s 12 items in a sample of 1,673 university …

Emotional Intelligence And Leader Development: Measuring Trait Emotional Intelligence Scores Of Mid- Career Commissioned U.S. Army Officers, Stephan Lorentz Walters

Dissertations

The United States Army is preparing for the ambiguous and consistently changing realities of the modern world by developing leaders who are adaptive, mentally agile, and open to change. However, without instruments or tools that purposefully measure adaptability within each individual leader, it is challenging to determine the U.S. Army’s effectiveness at the strategic goal to develop adaptive and self-aware leaders.

The dependent variables of interest are the trait emotional intelligence scores of commissioned U.S. Army leaders who have at least 10 years of military experience. This quantitative survey based study samples (N = 28) mid-career U.S. Army Majors using …

Psychometric Properties Of The Difficulties In Emotion Regulation Scale (Ders) And Its Short Forms In Adults With Emotional Disorders, Lauren S. Hallion, Shari A. Steinmann, David F. Tolin, Gretchen J. Diefenbach

Faculty & Staff Scholarship

Objective: The Difficulties in Emotion Regulation Scale (DERS) is a widely used self- report measure of subjective emotion ability, as defined by a prominent clinically derived model of emotion regulation (Gratz and Roemer, 2004). Although the DERS is often used in treatment and research settings for adults with emotional (i.e., anxiety, mood, obsessive-compulsive, or trauma-related) disorders, its psychometric properties are not well-characterized in this population.

Method: We examined the psychometric properties of the DERS and three popular short forms (DERS-16; DERS-18; and DERS-SF) in a large (N = 427) sample of treatment-seeking adults with one or more DSM-5 emotional disorders. …

Benchmarking Treatment Response In Tourette’S Disorder: A Psychometric Evaluation And Signal Detection Analysis Of The Parent Tic Questionnaire, Madeline M. Rasch, Douglas W. Woods, Matthew W. Specht, John T. Walkup, Lawrence Scahill, Sabine Wilhelm, Alan L. Peterson, John Piacentini

Psychology Faculty Research and Publications

This study assessed the psychometric properties of a parent-reported tic severity measure, the Parent Tic Questionnaire (PTQ), and used the scale to establish guidelines for delineating clinically significant tic treatment response. Participants were 126 children ages 9 to 17 who participated in a randomized controlled trial of Comprehensive Behavioral Intervention for Tics (CBIT). Tic severity was assessed using the Yale Global Tic Severity Scale (YGTSS), Hopkins Motor/Vocal Tic Scale (HMVTS) and PTQ; positive treatment response was defined by a score of 1 (very much improved) or 2 (much improved) on the Clinical Global Impressions – Improvement …

Psychometric Properties Of A Modified Moral Injury Questionnaire In A Military Population, Abby L. Braitman, Allison R. Battles, Michelle L. Kelley, Hannah C. Hamrick, Robert J. Cramer, Sarah Ehlke, Adrian J. Bravo

Psychology Faculty Publications

Moral injury (MI) results from perpetration of or exposure to distressing events, known as morally injurious events (MIEs), that challenge moral beliefs and values. Due to the type of involvement in recent military conflicts, many veterans report MIEs that may cause dissonance and, in turn, MI. Although 2 existing measures assess MIEs, neither currently assesses the defining characteristics of MI (i.e., guilt, shame, difficulty forgiving self and others, and withdrawal). The present study reports the initial psychometric test of a modified version (Robbins, Kelley, Hamrick, Bravo, & White, 2017) of the Moral Injury Questionnaire—Military version (MIQ-M; Currier, Holland, Drescher, & …

Higher And Lower Order Factor Analyses Of The Temperament In Middle Childhood Questionnaire., Yuliya Kotelnikova, Thomas M Olino, Daniel N Klein, Sarah V M Mackrell, Elizabeth P Hayden

Brain and Mind Institute Researchers' Publications

The Temperament in Middle Childhood Questionnaire (TMCQ) is a widely used parent-report measure of temperament. However, neither its lower nor higher order structures has been tested via a bottom-up, empirically based approach. We conducted higher and lower order exploratory factor analyses (EFAs) of the TMCQ in a large ( N = 654) sample of 9-year-olds. Item-level EFAs identified 92 items as suitable (i.e., with loadings ≥.40) for constructing lower order factors, only half of which resembled a TMCQ scale posited by the measure's authors. Higher order EFAs of the lower order factors showed that a three-factor structure (Impulsivity/Negative Affectivity, Negative …

Integrating Item Accuracy And Reaction Time To Improve The Measurement Of Inhibitory Control Abilities In Early Childhood, Brooke E. Magnus, Michael T. Willoughby, Clancy B. Blair, Laura J. Kuhn

Psychology Faculty Research and Publications

Efforts to improve children’s executive function are often hampered by the lack of measures that are optimized for use during the transition from preschool to elementary school. Whereas preschool-based measures often emphasize response accuracy, elementary school-based measures emphasize reaction time (RT)—especially for measures inhibitory control (IC) tasks that typically have a speeded component. The primary objective of this study was to test in a preschool-aged sample whether the joint use of item-level accuracy and RT data resulted in improved scoring for three IC tasks relative to scores derived from accuracy data alone. Generally, the joint use of item-level accuracy and …

Psychometric Evaluation And Design Of Patient-Centered Communication Measures For Cancer Care Settings, Bryce B. Reeve, David M. Thissen, Carla M. Bann, Nicole Mack, Katherine Treiman, Hanna K. Sanoff, Nancy Roach, Brooke E. Magnus, Jason He, Laura K. Wagner, Rebecca Moultrie, Kathryn D. Jackson, Courtney Mann, Lauren A. Mccormack

Psychology Faculty Research and Publications

Objective

To evaluate the psychometric properties of questions that assess patient perceptions of patient-provider communication and design measures of patient-centered communication (PCC).

Methods

Participants (adults with colon or rectal cancer living in North Carolina) completed a survey at 2 to 3 months post-diagnosis. The survey included 87 questions in six PCC Functions: Exchanging Information, Fostering Health Relationships, Making Decisions, Responding to Emotions, Enabling Patient Self-Management, and Managing Uncertainty. For each Function we conducted factor analyses, item response theory modeling, and tests for differential item functioning, and assessed reliability and construct validity.

Results

Participants included 501 respondents; 46% had a high …

Initial Evidence For The Reliability And Validity Of The Sexual Experiences Survey-Short Form Perpetration (Ses-Sfp) In College Men, Raeann E. Anderson, Shawn P. Cahill, Douglas L. Delahanty

Psychology Faculty Publications

This study provides psychometric data on the Sexual Experiences Survey—Short Form Perpetration (SES-SFP), a revision of one of the most widely used measures of sexual perpetration, in a sample of college men. Participants (n = 402) completed a web survey containing the study measures; a subset of 66 participants completed the SES-SFP again 2 weeks later. Our results provide initial evidence of internal consistency and convergent evidence of validity for the SES-SFP in college men but question the measure’s test-retest reliability. The severity of tactics used to coerce sexually aggressive behaviors was more strongly associated with rape empathy than …

The K-Sf-42: A New Short Form Of The Arizona Life History Battery, Aurelio José Figueredo, Rafael Antonio Garcia, J Michael Menke, Norman P. Li

Research Collection School of Social Sciences

The purpose of the present article is to propose an alternative short form for the 199-item Arizona Life History Battery (ALHB), which we are calling the K-SF-42, as it contains 42 items as compared with the 20 items of the Mini-K, the short form that has been in greatest use for the past decade. These 42 items were selected from the ALHB, unlike those of the Mini-K, making direct comparisons of the relative psychometric performance of the two alternative short forms a valid and instructive exercise. A series of secondary data analyses were performed upon a recently completed five-nation cross- …

Invariant Two-Component Structure Of The Repeatable Battery For The Assessment Of Neuropsychological Status (Rbans), Elisabeth M. Vogt, Gregory D. Prichett, James Hoelzle

Psychology Faculty Research and Publications

The Repeatable Battery for the Assessment of Neuropsychological Status is a brief neurocognitive instrument used to evaluate cognitive functioning in clinical settings. Prior investigations of the factor structure have revealed subtle differences across samples. It was hypothesized that these differences are primarily the result of methodological decisions made by researchers. The present study utilized empirically supported extraction criteria (parallel analysis; minimum average partial procedure) and uniformly investigated 5 samples. RBANS data from 4 previously published studies (Carlozzi, Horner, Yang, & Tilley, 2008; Duff, Hobson, Beglinger, & O'Bryant, 2010; Duff et al., 2006; Wilde, 2006) were reanalyzed, and a new clinical …