Quantitative Psychology Commons^™

The Development Of The Mindful Parenting Scale For Indonesian Parents, Carrenina Prilly Juaninda, Khairunnisa Fahira Dumbi, Dewi Maulina, Aliyya Amanda

Psychological Research on Urban Society

Mindful parenting benefits both parents and children; however, Indonesia lacks a valid and reliable tool for it. This study aims to develop a mindful parenting scale (MPS) as an effective tool for parents of children aged 3–6 years. The MPS is a multidimensional scale comprising five dimensions based on the theories of previous researchers (Kabat-Zinn and Kabat-Zinn and Duncan et al.). The study involved 326 participants with marriage durations of 2–32 years (M = 8.4, SD = 4.53). The results demonstrate that the final version of the MPS exhibits high internal consistency for the total score and each dimension. …

A Psychometric Analysis Of Natural Language Inference Using Transformer Language Models, Antonio Laverghetta Jr.

USF Tampa Graduate Theses and Dissertations

Large language models (LLMs) are poised to transform both academia and industry. But the excitement around these generative AIs has also been met with concern for the true extent of their capabilities. This dissertation helps to address these questions by examining the capabilities of LLMs using the tools of psychometrics. We focus on analyzing the capabilities of LLMs on the task of natural language inference (NLI), a foundational benchmark often used to evaluate new models. We demonstrate that LLMs can reliably predict the psychometric properties of NLI items were those items administered to humans. Through a series of experiments, we …

A New Method To Determine The Posterior Distribution Of Coefficient Alpha, John Mart V. Delosreyes

Psychology Theses & Dissertations

There is a focus within the behavioral/social sciences on non-physical, psychological constructs (i.e., constructs). These constructs are indirectly measured using measurement instruments that consist of questions that capture the manifestations of these constructs. The indirect nature of measuring constructs results in a need of ensuring that measurement instruments are reliable. The most popular statistic used to estimate reliability is coefficient alpha as it is easy to compute and has properties that make it desirable to use. Coefficient alpha’s popularity has resulted in a wide breadth of research into its qualities. Notably, research about coefficient alpha’s distribution has led to developments …

Confidence Intervals For The Coefficient Alpha Difference From Two Independent Samples (Groups), Miguel Padilla

Psychology Faculty Publications

Four different bootstrap methods for estimating confidence intervals (CIs) for a coefficient alpha difference from two independent samples (groups) were examined. These four CIs were compared to the most promising non-bootstrap CI alternatives in the literature. All CIs were assessed with a Monte Carlo simulation with conditions similar to previous research. The results indicate that there is a clear order in coverage performance of the CIs. The bootstrapped highest density interval had the best coverage performance across all simulation conditions. Yet, it was impacted by unequal sample sizes when one of the groups had the smallest sample size investigated of …

Evaluation Of Modern Missing Data Handling Methods For Coefficient Alpha, Katerina Matysova

College of Education and Human Sciences: Dissertations, Theses, and Student Research

When assessing a certain characteristic or trait using a multiple item measure, quality of that measure can be assessed by examining the reliability. To avoid multiple time points, reliability can be represented by internal consistency, which is most commonly calculated using Cronbach’s coefficient alpha. Almost every time human participants are involved in research, there is missing data involved. Missing data means that even though complete data were expected to be collected, some data are missing. Missing data can follow different patterns as well as be the result of different mechanisms. One traditional way to deal with missing data is listwise …

Measuring Numeracy In A Community College Context: Assessing The Reliability Of The Subjective Numeracy Scale, Kate S. Wolfe, Sarah L. Hoiland

Numeracy

In this paper, our goals were to assess the suitability of the Subjective Numeracy Scale (SNS), developed for health-care use, in a new context with predominantly minority students at a South Bronx community college and to identify any race/ ethnicity, gender, and ESL enrollment effects. The scale assesses perceptions of quantitative reasoning skills and preferences for data presentation. This scale was given to a convenience sample of students in behavioral sciences classes. Results show that the SNS scale was reliable with our sample using the full thirteen-question scale or the shorter eight-item version. Gender, race/ ethnicity, and English as a …

The Construct And Predictive Validity Of Psychosocial Correlates Of Television Viewing, Raheem Paxton, Pascal Jean-Pierre, Saehwan Park, Yong Gao Dr., Stephen Herrmann, G J. Norman

Journal of Health Disparities Research and Practice

Background: Many studies have examined the consequences of prolonged television viewing, but few studies have examined the psychological states that contribute to this behavior. In this study, we evaluated the construct and predictive validity of psychosocial correlates of television viewing in a population of African American (AA) breast cancer survivors (BCS).

Methods: AA BCS (N = 342, Mean age = 54 years) completed measures of decisional balance, self-efficacy, family support, and time spent watching television online. Exploratory structural equation modeling (ESEM) was used to examine the construct and predictive validity as well as the differential item functioning of the instruments …

The Reliability And Validity Of The Thin Slice Technique: Observational Research On Video Recorded Medical Interactions, Tanina Suzanne Foster

Wayne State University Dissertations

The Reliability and Validity of the Thin Slice Technique: Observational Research on Video Recorded Medical Interactions

Introduction: Observational research using the thin slice technique has been routinely incorporated in observational research methods, however there is limited evidence supporting use of this technique compared to full interaction coding. The purpose of this study was to determine if this technique could be reliability coded, if ratings are consistent between the first, second and third slice, and if they are indeed representative of full interactions.

Methods: Three 30-second thin slices were sampled from the beginning, middle and end of a full-length video-recorded …

Assessing The Psychometric Properties Of A Self-Efficacy Measure Within A Patient Navigation Research Program, Mariana Arevalo

USF Tampa Graduate Theses and Dissertations

There is a dearth of validated self-efficacy (SE) measures in the field of preventive oncology. The objective of this study is to describe the development and validation of a measure to assess patients' perceived ability to obtain the recommended care following an abnormality suspicious for breast cancer. Guided by a social cognitive theory framework, a 51-item measure was developed to explore perceived capability to obtain follow up care under a number of barriers. A multi-step process was utilized to assess the instrument's psychometric properties. First, cognitive validity assessments with experts were conducted, and these aided in the wording refinement of …

Internal Consistency Of The Self-Perception Profile For Children: Using Covariance Structure Modeling To Overcome The Limitations Of Cronbach's Α, Ian Cero

All Graduate Theses, Dissertations, and Other Capstone Projects

Self-perception is linked to a variety of psychosocial outcomes and its measurement has become a priority across a several disciplines. The Self-Perception Profile for Children (SPP-C) is commonly utilized to measure both global self worth and several important sub-domains of self-perception. Although much research has suggested this instrument possesses good internal consistency, previous investigations have primarily employed Cronbach's α; to estimate the stability of responding across items. This represents an important limitation, as α; is vulnerable to mis-estimation in the presence of correlated errors and non-τ-equivalent indicators, neither of which have been ruled out for the SPP-C. The present investigation …

When Does Fidelity Matter? An Evaluation Of Two Medical Simulation Methods, Nneka Joseph

USF Tampa Graduate Theses and Dissertations

Job or task simulations are used in training when the use of the real task is dangerous or expensive, such as flying aircraft or surgery. This study focused on comparing two types of simulations used in assessments during a Clinical Performance Examination of third-year medical students: computer enhanced mannequins and standardized patients. Each type of simulation has advantages, but little empirical work exists to guide the use of different types of simulation for training and evaluating different aspects of performance. This study analyzed performance scores for different competencies as well as the reliability and validity of the different simulation types. …

Development And Validation Of The Cultural Competence Of Program Evaluators (Ccpe) Scale, Krystall Dunaway

Psychology Theses & Dissertations

As part of its Guiding Principles for Evaluators, the American Evaluation Association (AEA) requires that evaluators develop cultural competencies, yet no measure of cultural competence currently exists in the field. Using items from cultural competence measures used in fields such as counseling and nursing, in conjunction with the creation of qualitative questions, the researcher developed the Cultural Competence of Program Evaluators (CCPE) scale. The main goal of this study was to validate the CCPE, and a subsidiary goal was to assess differences in level of cultural competence among program evaluators based on various demographic variables such as minority status, age, …