Social and Behavioral Sciences Commons^™

A Psychometric Analysis Of Natural Language Inference Using Transformer Language Models, Antonio Laverghetta Jr.

USF Tampa Graduate Theses and Dissertations

Large language models (LLMs) are poised to transform both academia and industry. But the excitement around these generative AIs has also been met with concern for the true extent of their capabilities. This dissertation helps to address these questions by examining the capabilities of LLMs using the tools of psychometrics. We focus on analyzing the capabilities of LLMs on the task of natural language inference (NLI), a foundational benchmark often used to evaluate new models. We demonstrate that LLMs can reliably predict the psychometric properties of NLI items were those items administered to humans. Through a series of experiments, we …

Validating The Construct Of Resiliency In The Health Literacy And Resiliency Scale (Hlrs-Y) With The Child And Youth Resiliency Measure (Cyrm-28), Mercedes N. Cambric

USF Tampa Graduate Theses and Dissertations

Chronic health conditions in youth have increased over the last several decades. It is estimated that within the United States there are between 15% to 18% of youth who are living with a chronic health condition (Centers for Disease Control and Prevention [CDC], 2010). The CDC defines a chronic health condition as an illness that lasts for three months or longer that can be managed, but not cured (CDC, 2010). Although there is some research on youth living with chronic illnesses, there are minimal studies that assess the constructs of health literacy, resiliency, and support/advocacy within this population. The current …

The Structure Of Resilience: An Empirical Examination Of Resilience Factors, Matthew R. Grossman

USF Tampa Graduate Theses and Dissertations

Although most researchers agree that resilience is defined as the extent to which an individual bounces back and recovers from stress and adversity, the field has not yet settled on the underlying structure of the resilience construct; its lower-order factors remain in dispute and undefined. In this study, five of the most prominent resilience measures (i.e., Ego Resilience, Block & Kremen, 1996; The Resilience Scale, Wagnild & Young, 1993; The Connor-Davidson Resilience Scale, Connor & Davidson, 2003; The Resilience Scale for Adults, Friborg, Hjemdal, Rosenvinge, & Martinussen, 2003; The Brief Resilience Scale, Smith, Dalen, Wiggins, & Tooley, 2008) were administered …

Can Selection Tests Administered Via Video Games Reduce Faking?, Philip Scott Ramsay

USF Tampa Graduate Theses and Dissertations

One of the fundamental underlying assumptions of selection procedures is that the information gathered from applicants is accurate, and thus, will predict performance on the job (Donovan, Dwight, & Schneider, 2014; Schmitt & Sinha, 2011). As self-report instruments such as paper-and-pencil tests and unsupervised online surveys become more prevalent in organizational selection contexts (Truxillo & Bauer, 2011) due to ease of use and cost efficiency, the concern of applicants faking responses to inaccurately portray themselves as more highly desirable is increasingly critical (Hough, Oswald, & Ployhart, 2001). Depending on the exact magnitude of the particular selection event, this compromise of …

Family Accommodation In Adults With Obsessive-Compulsive Disorder: Psychometric Properties Of The Family Accommodation Scale - Patient Version, Monica S. Wu

USF Tampa Graduate Theses and Dissertations

Family accommodation is a salient construct within the context of obsessive-compulsive disorder (OCD) and occurs in a large majority of affected individuals and their families. Accommodating behaviors can manifest in various ways, including participation in the patient's rituals, modifying everyday routines, facilitating compulsive behaviors, or providing reassurance. It has been repeatedly linked to negative outcomes, such as attenuated treatment response, increased obsessive-compulsive symptom severity, higher levels of family distress, and lower levels of functioning. As such, it is of significant clinical importance to have a standardized measure that is able to be used in research and clinical practice.

The Family …

Assessing The Psychometric Properties Of A Self-Efficacy Measure Within A Patient Navigation Research Program, Mariana Arevalo

USF Tampa Graduate Theses and Dissertations

There is a dearth of validated self-efficacy (SE) measures in the field of preventive oncology. The objective of this study is to describe the development and validation of a measure to assess patients' perceived ability to obtain the recommended care following an abnormality suspicious for breast cancer. Guided by a social cognitive theory framework, a 51-item measure was developed to explore perceived capability to obtain follow up care under a number of barriers. A multi-step process was utilized to assess the instrument's psychometric properties. First, cognitive validity assessments with experts were conducted, and these aided in the wording refinement of …

When Does Fidelity Matter? An Evaluation Of Two Medical Simulation Methods, Nneka Joseph

USF Tampa Graduate Theses and Dissertations

Job or task simulations are used in training when the use of the real task is dangerous or expensive, such as flying aircraft or surgery. This study focused on comparing two types of simulations used in assessments during a Clinical Performance Examination of third-year medical students: computer enhanced mannequins and standardized patients. Each type of simulation has advantages, but little empirical work exists to guide the use of different types of simulation for training and evaluating different aspects of performance. This study analyzed performance scores for different competencies as well as the reliability and validity of the different simulation types. …