Open Access. Powered by Scholars. Published by Universities.®

Social and Behavioral Sciences Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 4 of 4

Full-Text Articles in Social and Behavioral Sciences

Towards Interpretable Machine Reading Comprehension With Mixed Effects Regression And Exploratory Prompt Analysis, Luca Del Signore Sep 2023

Towards Interpretable Machine Reading Comprehension With Mixed Effects Regression And Exploratory Prompt Analysis, Luca Del Signore

Dissertations, Theses, and Capstone Projects

We investigate the properties of natural language prompts that determine their difficulty in machine reading comprehension tasks. While much work has been done benchmarking language model performance at the task level, there is considerably less literature focused on how individual task items can contribute to interpretable evaluations of natural language understanding. Such work is essential to deepening our understanding of language models and ensuring their responsible use as a key tool in human machine communication. We perform an in depth mixed effects analysis on the behavior of three major generative language models, comparing their performance on a large reading comprehension …


Vietnam’S Gdp: Re-Assessing Growth Rate And Identifying An Alternative Indicator, My Linh D. Nguyen Apr 2023

Vietnam’S Gdp: Re-Assessing Growth Rate And Identifying An Alternative Indicator, My Linh D. Nguyen

Honors Theses

Since the economic reform known as Doi Moi (Renovation) in 1986, Vietnam has changed from one of the world’s poorest to a middle-income country in one generation (USAID, 2022). The country has consistently registered high and stable economic growth since the reform, averaging 6.3% from 1985 to 2021 (World Bank, 2022). High growth rate of gross domestic product (GDP) is good news, but it has also raised questions that go both ways. On one side, there is much speculation that the government of Vietnam has manipulated economic statistics, compared to the case of China and India. As quoted in Kinh …


Towards Scalable Mental Health: Leveraging Digital Tools In Combination With Computational Modeling To Aid In Treatment And Assessment Of Major Depressive Disorder, Matthew D. Nemesure Mar 2023

Towards Scalable Mental Health: Leveraging Digital Tools In Combination With Computational Modeling To Aid In Treatment And Assessment Of Major Depressive Disorder, Matthew D. Nemesure

Dartmouth College Ph.D Dissertations

Major depressive disorder (MDD) is a debilitating disorder that impacts the lives of nearly 280 million individuals worldwide, representing 5% of the overall adult population. Unfortunately, these statistics have been both trending upward and are also likely an underestimate. This can be primarily attributed to lack of screening paired with a lack of providers. Worldwide, there are roughly 450 individuals living with MDD per mental health care provider. Adding to this burden, approximately half of affected individuals that do receive care of any kind will fail to remain in remission. The goal of this thesis work is to leverage statistical …


Establishing Roots Before Branching Out: Parameter Recovery In Item Response Tree Models, Tyler Ryan Jan 2023

Establishing Roots Before Branching Out: Parameter Recovery In Item Response Tree Models, Tyler Ryan

Browse all Theses and Dissertations

Item Response Trees are a type of item response model that incorporates information about conditional responding to items using a rooted tree graph structure. Researchers have used item response trees for common measurement tasks and for testing novel hypotheses. Previous simulation studies investigating item response trees either lack generalizability to the broad domain of their use or lack thorough investigation and reporting of the results. I conducted a simulation study to explore how sample size, test length, item characteristics, and tree structure affect both item and person parameter recovery for 1PL and 2PL models. The results suggested that, as with …