Social and Behavioral Sciences | Open Access Articles

Towards Interpretable Machine Reading Comprehension With Mixed Effects Regression And Exploratory Prompt Analysis, Luca Del Signore Sep 2023

Towards Interpretable Machine Reading Comprehension With Mixed Effects Regression And Exploratory Prompt Analysis, Luca Del Signore

Dissertations, Theses, and Capstone Projects

We investigate the properties of natural language prompts that determine their difficulty in machine reading comprehension tasks. While much work has been done benchmarking language model performance at the task level, there is considerably less literature focused on how individual task items can contribute to interpretable evaluations of natural language understanding. Such work is essential to deepening our understanding of language models and ensuring their responsible use as a key tool in human machine communication. We perform an in depth mixed effects analysis on the behavior of three major generative language models, comparing their performance on a large reading comprehension …

Go to article

Quantitative Analysis Of Sociological Data, Joanna Dressel Oct 2021

Quantitative Analysis Of Sociological Data, Joanna Dressel

Open Educational Resources

No abstract provided.

Go to article

Zero Textbook Cost Syllabus For Psy 2100 (Statistics For Social Science), Adam Shavit Oct 2020

Zero Textbook Cost Syllabus For Psy 2100 (Statistics For Social Science), Adam Shavit

Open Educational Resources

You will learn to summarize, make sense of, and base decisions on real life data. You will learn to read and create verbal and graphical summaries from measurements, for example from randomized experiments and correlational surveys. You will also learn to estimate your confidence in a pattern of results. This will be applied to inferring from limited observations to more general phenomenon, and to compare differences between groups. We will also learn to describe and quantify co-variation between measurements. In addition, you will get experience in conducting statistical analyses using software, working on real datasets from psychological experiments.

Go to article

A 3d Characteristics Database Of Land Engraved Areas With Known Subclass, Entni Lin Jun 2018

A 3d Characteristics Database Of Land Engraved Areas With Known Subclass, Entni Lin

Student Theses

Subclass characteristics on bullets may mislead firearm examiners when they rely on traditional 2D images. In order to provide indelible examples for training and help avoid identification errors, 3D topography surface maps and statistical methods of pattern recognition are applied to toolmarks on bullets containing known subclass characteristics. This research was conducted by collecting 3D topography surface map data from land engraved areas of bullets fired through known barrels. This data was processed and used to train the statistical algorithms to predict their origin. The results from the algorithm are compared with the “right answers” (i.e. correct IDs) of the …

Go to article

Bayesian Approach To Toolmark Analysis, Antonio W. Del Valle May 2017

Bayesian Approach To Toolmark Analysis, Antonio W. Del Valle

Student Theses

Statistical analysis of toolmarks using frequentist methods can be problematic for assorted reasons. Thus, in order to analyze toolmarks whilst avoiding these issues, a Bayesian approach is taken. Specifically for this thesis we discuss the computation of a specific Likelihood Ratio for toolmark comparisons. This Bayesian based approach involves using data already at hand in conjunction with a probability model in order to establish an estimate for its “value”, i.e. the “weight of evidence”. Making the calculations to obtain a Likelihood Ratio is very cumbersome and time consuming. Also many commercial software packages hide the process and underlying assumptions that …

Go to article

Correlation Analysis With Excel Handout, Kelly A. Rodgers Jan 2016