Quantitative Psychology Commons^™

An Investigation Of The Effectiveness Of Student’S T-Test Under Heterogeneity Of Variance, Hayden Nelson

Masters Theses & Specialist Projects

Within the field of psychology, few tests have been as thoroughly investigated as Student’s t-test. One area of criticism is the use of the test when the assumption for heterogeneity of variance between two samples is violated, such as when sample sizes and observed sample variances are unequal. The current study proposes a Monte Carlo analysis to observe a broad range of conditions in efforts to identify the resulting fluctuations in the proportion obtained significant results for two conditions: no mean difference (𝜇􀬵 = 𝜇􀬶) compared to the set level of alpha, and small-to-moderate mean differences (𝜇􀬵 ≠ 𝜇􀬶) compared …

Consistent Across Situations? A Person Specific Approach To Examining A Long-Standing Paradox., Muchen Xi

Arts & Sciences Electronic Theses and Dissertations

Bem and Allen (1974) address the person situation debate by proposing that there are some people behave more consistently, which can be better “explained” try personality traits, than others who are more influenced by situations. However, with failures to directly replicate Bem and Allen’s study, the existence of individual difference in cross situation consistency of behaviors remaining unclear. The current study addressed open questions that arose from the personality consistency debate by employing Mixed Effect Location Scale Model (MELSM) in an intensive longitudinal study. We found 1) there are individual difference in the overall behavioral consistency across situations; 2) there …

Recentering Psych Stats, Lynette Bikos

Faculty Open Access Books

To center a variable in regression means to set its value at zero and interpret all other values in relation to this reference point. Regarding race and gender, researchers often center male and White at zero. Further, it is typical that research vignettes in statistics textbooks are similarly seated in a White, Western (frequently U.S.), heteronormative, framework. ReCentering Psych Stats seeks to provide statistics training for psychology students (undergraduate, graduate, and post-doctoral) in a socially and culturally responsive way. All lessons use the open-source statistics program, R (and its associated packages). Each chapter includes a screencast lesson, features a workflow …

The Standards Will Never Be Enough: A Racial Justice Extension, Mya Poe, Maria Elena Oliveri, Norbert Elliot

Buros Center: Professional Staff Publications

Since 1952, the Standards for Educational and Psychological Testing has provided criteria for developing and evaluating educational and psychological tests and testing practice. Yet, we argue that the foundations, operations, and applications in the Standards are no longer sufficient to meet the current U.S. testing demands for fairness for all test takers. We propose racial justice extensions as principled ways to extend the Standards, through intentional actions focused on race and targeted at educational policies, processes, and outcomes in specific settings. To inform these extensions, we focus on four social-justice concepts: intersectionality derived from Black Feminist Theory; responsibility derived …

A Qualitative Analysis Of Construct Measurement Techniques Used In Industrial/Organizational Research, Benjamin Michael, Andrea F. Snell, Katie Rosneck

Williams Honors College, Honors Research Projects

This project aims to challenge the appropriateness of the methodological strategies and tools utilized within psychological research. We will look at the types of statistical modeling used and the context in which they are used, such as measurement modeling, confirmatory factor analysis, and bifactor analysis within survey development, as well as the use of psychological constructs such as extraversion and leadership. The objective of this research is to search for and recognize patterns from the content of some of the top journal articles in the field of industrial and organizational psychology. The information gained from analyzing the content of the …

Applying Visual Methods To Document The History Of Psychological Testing: A Qualitative Approach, Analay Perez, Janet F. Carlson, Buros Center For Testing At The University Of Nebraska-Lincoln

Buros Center: Professional Staff Publications

The history of psychological testing is critical to many areas of applied psychology. Assessment forms a mainstay of clinical practice, second only to psychotherapy (Meyer et al., 2001). In industrial/organizational psychological practice, employee selection depends on testing to assess applicant qualifications. In educational contexts, testing is central to the evaluation of academic performance and college readiness, in addition to determining eligibility for various types of special educational services.

The history of testing is deeply rooted in myriad psychological specialties (Carlson & Geisinger, 2021). This fact prompted a qualitative examination and integration of three distinct historical threads identified by the proposal …

The Role Of Sociocultural Factors On The Relationship Between (Un)Employment And Well-Being Of Latinx Emerging Adults During Covid-19, Chantal Nichole Martinez

FIU Electronic Theses and Dissertations

The coronavirus (COVID-19) pandemic and resulting recession have brought significant challenges for organizations and revealed deep-seated inequalities for employees of color. LatinX individuals, in particular, have experienced high rates of unemployment compared to their White and Black American counterparts and returned to work at a slower rate (BLS, 2020; 2021). As a result, organizational psychologists have been called to action to help understand the economic and psychological impacts of the recession on worker outcomes (e.g., unemployment, mental well-being). The objective of this collected papers dissertation is to a) take a culturally humble and strength-based approach to examine how the emerging …

Emotion And Judgment In Young Women Of A Society In Transition, Maura A. E. Pilotti, Khadija El Alaoui

International Journal of Transpersonal Studies

The present study asked whether emotional responses to narratives of moral transgressions are shaped by the reader’s assumed relationship with the injured party (i.e., oneself, familiar other, and unfamiliar other). Its goal was to test a cultural, religious, and individualistic account of such responses in young females of a traditional society in transition towards a sustainable integration into the global economy. To this end, female college students from the Kingdom of Saudi Arabia were asked to identify their emotional reaction to each of several moral transgressions, report its intensity and then judge the severity of the transgression. In agreement with …

Comparison Of Schedules, Stress, Sleep Problems, Fatigue, Mental Health And Well-Being Of Low Cost And Network Carrier Pilots, Marion Venus

International Journal of Aviation, Aeronautics, and Aerospace

Objective

This research investigates and compares working-conditions, duty rosters, stress, sleep problems, fatigue levels, mental health, and well-being of pilots working for network (NWCs), and low-cost carriers (LCCs). This study extends previous research by investigating working conditions, pilots’ actual rosters, fatigue and mental health of two groups of pilots flying for LCC or NWC.

Method

A comprehensive cross-sectional online survey was completed by N=338 pilots (185 NWC, 153 LCC pilots). All pilots reported their roster data of the last 2 months during peak flight season, psychosocial and work-related stress (e.g., high job insecurity, less total flight-experience, lower income, more time …

The Development Of The Adaptable Self-Disclosure Scale (Asds): A Multidimensional Approach To Disclosure Assessment, Brandon Mcintyre

All Dissertations

Understanding how individuals share or conceal parts of their identity has long been a topic of research with little consistency of measurement validation. The present study had three main goals: (1) define and conceptualize a multidimensional model of identity disclosure that can apply to any concealable identity, (2) generate a validated and adaptable scale for assessing any concealable identity, and (3) demonstrate the adaptability of this scale for a specific concealable identity. In Study 1, the proposed disclosure model was used to generate 72 items which were narrowed down using factor analysis to form the Adaptable Self-Disclosure Scale (ASDS). The …

Measuring Intelligence With The Sandia Matrices: Psychometric Review And Recommendations For Free Raven-Like Item Sets, Alexandra M. Harris, Jeremiah T. Mcmillan, Benjamin Listyg, Laura E. Matzen, Nathan Carter

Personnel Assessment and Decisions

The Sandia Matrices are a free alternative to the Raven’s Progressive Matrices (RPMs). This study offers a psychometric review of Sandia Matrices items focused on two of the most commonly investigated issues regarding the RPMs: (a) dimensionality and (b) sex differences. Model-data fit of three alternative factor structures are compared using confirmatory multidimensional item response theory (IRT) analyses, and measurement equivalence analyses are conducted to evaluate potential sex bias. Although results are somewhat inconclusive regarding factor structure, results do not show evidence of bias or mean differences by sex. Finally, although the Sandia Matrices software can generate infinite items, editing …

Can Ratings Of Item Location Enhance Statistical Item Parameter Estimation? Extending The Feasibility Of Unfolding Irt Models, Michael Mckenna

Dissertations

Research and development of modern psychometric methods such as item response theory have drastically changed the way we understand and carry out the measurement of psychological constructs. Despite this, there has been relatively little adoption by psychological researchers to incorporate these methods into their research. While multiple explanations are surely valid, one oft stated reason is the large sample size requirements of these methods. The sample size requirements of item response theory are needed so that effective estimation of item parameters can be carried out. In an attempt to make these modern measurement methods more accessible and feasible to psychological …

A New Perspective To Measuring Employee Growth: Developing A Successful Aging At Work Scale, Stanimira K. Taneva, Georgi P. Yankov

Personnel Assessment and Decisions

The aging of the world’s population has become a grand societal challenge, which requires an urgent response from researchers, professionals, and the wider society. One way to respond to this challenge is by supporting individuals in sustaining longer and healthier working lives, that is, age successfully. Although the advantages of promoting and enabling successful aging at work have been widely acknowledged, no single instrument for measuring this construct has been published so far. We develop and test in three consecutive samples a two-dimensional successful aging at work scale. This novel instrument is rooted conceptually in the most recent theoretical developments …

知的生産性を飛躍させる録音システム, Yoshihiko Ariizumi

Learning, Teaching, & Researching Optimization

This article explains the benefits of using a recording system, what it is, and why it works. Our intelligence has many unexplored potentials, and by using this recording system, such latent abilities can be utilized for intellectual productivity.

Recording System That Dramatically Increases Intellectual Productivity, Yoshihiko Ariizumi

Learning, Teaching, & Researching Optimization

この記事は、録音システムを使う利点、それが具体的にはどのような活動であり、なぜそのような効果が出るのかについて説明されている。私たちの知性にはまだ多くの研究されていない潜在的な能力があり、この録音システムを使うことによって、そのように眠っている能力を知的生産性のために利用することができる。

The Development And Validation Of An Ideal Point Measure Of Work Engagement, Michael M. Denunzio

Dissertations, Theses, and Capstone Projects

Work engagement has been an extremely popular area of research and practice over the past two decades. However, organizational scholars have yet to thoughtfully consider alternative and potentially more appropriate ways of modeling how individuals report their work engagement and, relatedly, measuring the construct. This dissertation seeks to establish and support the position that (1) individuals use an ideal point (vs. dominance) process to identify how engaged they are and respond to work engagement items, and (2) an ideal point framework can be used to develop a construct valid work engagement scale with good psychometric properties. Since no such scale …

Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson

Buros Center: Professional Staff Publications

The article discusses salient factors that influence the current context within which homeschooling occurs. Individual states have applied various approaches to establish regulations that both preserve the rights of homeschooling parents and fulfill the state’s obligation to ensure that its residents receive the education to which they are constitutionally entitled. Case and ethnographic studies or research involving small and selected samples often appear in outlets associated with homeschool advocacy groups or in outlets that are not mainstream. The paucity of empirical evidence derived from methodologically strong research paradigms has led to little certainty about many aspects of homeschooling including its …

Supervisor-Subordinate Conflict Negotiation: Examining The Core Concerns In Light Of Communication Accommodation And Gender Roles, Piyawan Charoensap-Kelly

Dissertations

This quasi-experimental study examined a supervisor-subordinate negotiation of an emotion-laden conflict from the lens of the core concerns framework, communication accommodation theory, and gender roles research. Results empirically support CCF that, by accommodating or attending to the employees’ core concerns, managers can stimulate employees’ positive emotion and integrative intention. However, under- and overaccommodating the core concerns can lead to distributive intention. Additionally, the employees’ perception of manager goodwill can strengthen or attenuate the positive effect of core concerns accommodativeness on outcome variables especially for male managers. Thus, moderate accommodation is recommended for male managers. For female managers, the results show …

Restructured Frame-Of-Reference Training Improves Rating Accuracy, Ming-Hong Tsai, Serena Wee, Brandon Koh

Research Collection School of Social Sciences

The use of heuristic judgments is prevalent in organizations and negatively impacts accurate employee assessments. To minimize the negative impact of heuristic judgments (i.e., anchoring and adjustment), we aim to improve rating accuracy by restructuring frame‐of‐reference (FOR) training. We conducted five studies (N = 1,143) using different samples (three including participants with hiring experience), training environments (onsite and online), and rating contexts (evaluations of sales representatives, teachers, contract negotiation specialists, and retail store managers). Across the five studies, the average improvement in rating accuracy was at least twice as large for restructured FOR (vs. control) training as it was for …

Employee Perceptions Of Well-Being Programs, Alice V. Edwards, Susan Marcus

Journal of Social, Behavioral, and Health Sciences

Measuring the effectiveness of well-being programs in the workplace is important for optimizing the return on investment and selection of programs that meet organizational objectives. A pilot study was performed to assess employee well-being using the Happiness Mini-Survey and a one-sample pre–post study design intended to quickly allow employees to subjectively rate their well-being before and after participating in various classes as part of a well-being program. The findings demonstrated statistical significance in employee subjective ratings; they reported feeling better emotionally, physically, and mentally after participating in the classes. The employees’ self-rating for stress level also had statistically significant improvement …

The Influence Of A Proposed Margin Criterion On The Accuracy Of Parallel Analysis In Conditions Engendering Underextraction, Justin M. Jones

Masters Theses & Specialist Projects

One of the most important decisions to make when performing an exploratory factor or principal component analysis regards the number of factors to retain. Parallel analysis is considered to be the best course of action in these circumstances as it consistently outperforms other factor extraction methods (Zwick & Velicer, 1986). Even so, parallel analysis could benefit from further research and refinement to improve its accuracy. Characteristics such as factor loadings, correlations between factors, and number of variables per factor all have been shown to adversely impact the effectiveness of parallel analysis as a means of identifying the number of factors …

Communicating Criterion-Related Validity Using Expectancy Charts: A New Approach, Jeffrey M. Cucina, Julia L. Berger, Henry H. Busciglio

Personnel Assessment and Decisions

Often, personnel selection practitioners present the results of their criterion-related validity studies to their senior leaders and other stakeholders when trying to either implement a new test or validate an existing test. It is sometimes challenging to present complex, statistical results to non-statistical audiences in a way that enables intuitive decision making. Therefore, practitioners often turn to expectancy charts to depict criterion-related validity. There are two main approaches for constructing expectancy charts (i.e., use of Taylor-Russell tables or splitting a raw dataset), both of which have considerable limitations. We propose a new approach for creating expectancy charts based on the …

Multilevel Modeling Issues And The Measurement Of Stress Is Multilevel Data, Tyler Stout

FIU Electronic Theses and Dissertations

Multilevel datasets are commonly used and increasingly popular in research in the organizational and other social sciences. These models are complex and have many elements beyond those found in more traditional linear models. However, research on how multilevel models perform is lacking.

The current paper examined the impact of common factors (average cluster size, cluster size distribution, average number of clusters, strength of the intraclass correlation coefficient, and effect sizes of individual and cluster level variables, and their interaction) in multilevel datasets. Monte Carlo data simulation was used across 6,144 factor-combination conditions. The results of study factors on observed intraclass …

Flesch-Kincaid Reading Grade Level Re-Examined: Creating A Uniform Method For Calculating Readability On A Certification Exam, Emily Neuhoff, Kristiana M. Feeser, Kayla Sutherland, Thomas Hovatter

Online Journal for Workforce Education and Development

Abstract

Objective: This study attempted to establish a consistent measurement technique of the readability of a state-wide Certified Nursing Assistant’s (CNA) certification exam. Background: Monitoring the readability level of an exam helps ensure all test versions do not exceed the maximum reading level of the exam, and that knowledge of the subject matter, rather than reading ability, is being assessed. Method: A two part approach was used to specify and evaluate readability. First, two methods (Microsoft Word^® (MSW) software and published readability formulae) were used to calculate Flesch Reading Ease (FRE) and Flesch-Kincaid Reading Grade Level (FKRGL) for multiple …

Strategies And Resources To Enhance Test Evaluation And Selection, Janet F. Carlson, Nancy Anderson

Buros Center: Professional Staff Publications

Testing serves an important function for SLPs in offering an evidence base that is useful in screening, diagnosing, monitoring progress, and documenting outcomes. Tests are used to measure diverse constructs such as communication, literacy, oral and written language, receptive and expressive vocabulary, articulation, phonological awareness and processing, and auditory perception and processing. In addition, specific impairments may require specialized measures to evaluate conditions such as stuttering and orthographic competence.

When using tests to diagnose language impairments, Betz, Eickhoff, and Sullivan (2013) suggest that SLPs consider carefully a test’s psychometric properties, particularly because of the “increasing emphasis on evidence-based practice, specifically, …

A Review Of Court Cases Involving Discrimination In Physical Ability Testing: 1992-2015, Casey L. Biggs

Masters Theses & Specialist Projects

Organizations that employ physically demanding jobs want to ensure their selection procedures distinguish qualified applicants from unqualified applicants. However, such selection tools typically result in adverse impact against various protected groups and often lead to litigation. Various factors influence the court’s decision to rule in favor of the plaintiff or the defendant. The purpose of the present study is to identify those factors. The ADA (1990) created strict guidelines for plaintiffs and defendants to follow to be credible in a discrimination case. This study will specifically determine the impact of the ADA guidelines and three additional factors that influence court …

Engaging Youth In Bullying Prevention Through Community-Based Participatory Research, Jen Gibson, Paul D. Flaspohler, Vanessa Watts

Faculty Scholarship

Few studies that engage youth in community-based participatory research (CBPR) focus on issues of safety/violence, include elementary school-aged youth, or quantitatively assess outcomes of the CBPR process. This article expands understanding of CBPR with youth by describing and evaluating the outcomes of a project that engaged fifth-grade students at 3 schools in bullying-focused CBPR. Results suggest that the project was associated with decreases in fear of bullying and increases in peer and teacher intervention to stop bullying. We conclude with implications for the engagement of elementary school-aged youth in CBPR to address bullying and other youth issues.

School Mental Health Early Interventions And Academic Outcomes For At-Risk High School Students: A Review Of The Research, Aidyn L. Iachini, Elizabeth Levine Brown, Annahita Ball, Jen Gibson, Steven E. Lize

Faculty Scholarship

The current educational policy context in the United States necessitates that school-based programs prioritize students’ academic outcomes. This review examined the quantitative research on school mental health (SMH) early interventions and academic outcomes for at risk high school students. Seven articles met the inclusion criteria for this review. All articles were examined according to study design and demographics, early intervention characteristics, and outcomes. Of the studies included, most were conducted in urban settings, involved the implementation of group-based early intervention strategies, and monitored GPA as a distal academic outcome. Counselors were frequent implementers of these early interventions. A meta-analysis found …

Evaluating An Abbreviated Version Of The Paths Curriculum Implemented By School Mental Health Clinicians, Jen Gibson, Shelby Werner, Andrew Sweeny

Faculty Scholarship

When evidence-based prevention programs are implemented in schools, adaptations are common. It is important to understand which adaptations can be made while maintaining positive outcomes for students. This preliminary study evaluated an abbreviated version of the Promoting Alternative Thinking Strategies (PATHS) Curriculum implemented by school-based mental health clinicians in preschool/kindergarten classrooms. Results suggest that students (N = 80) demonstrated increases in emotional understanding and prosocial behavior. Children with low initial levels of problem behavior demonstrated large and continual increases in prosocial behavior over the entire course of the intervention, whereas children with high initial levels of problem behavior only demonstrated …

Improving Data Quality With Four Short Sentences: How An Honor Code Can Make The Difference During Data Collection, Alexander Scott Mckay

Electronic Theses, Projects, and Dissertations

Careless responders have a large impact on a study by causing issues such as Type II errors (failing to reject a false null hypothesis), which then waste researchers’ time and money. Research on careless responding has focused primarily on detecting and removing careless responders rather than on reducing careless responding before data collection begins. The purpose of the present study was to test the use of honor codes with or without the presentation of a picture of watchful eyes to increase self-awareness thereby reducing careless responding. Participants (N = 305) were randomly assigned to one of five honor code …