Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 10 of 10
Full-Text Articles in Physical Sciences and Mathematics
Humans Against Large Language Models On Hard Paraphrase Detection Tasks, Jamie C. Macbeth, Ella Chang, Jingyu Gin Chen, Yining Hua, Sandra Grandic, Winnie X. Zheng
Humans Against Large Language Models On Hard Paraphrase Detection Tasks, Jamie C. Macbeth, Ella Chang, Jingyu Gin Chen, Yining Hua, Sandra Grandic, Winnie X. Zheng
Computer Science: Faculty Publications
The ability to recognize that pairs or sets of language expressions “mean the same thing” is a cognitive task for which meaning representation is clearly a central issue. This paper uses the task of paraphrasing to study meaning representation in a cognitive system. The main claim is that a consequential part of the meaning representation for a natural language expression is a set of language-free structures that are not part of the expression in question. To support this claim, we construct a corpus of paraphrase pairs using a system that has a non-linguistic meaning represen- tation decoupled from the linguistic …
Repytah: An Open-Source Python Package For Building Aligned Hierarchies For Sequential Data, Chenhui Jia, Lizette Carpenter, Thu Tran, Amanda Y. Liu, Sasha Yeutseyva, Mariun Tapal, Yingke Wang, Zoie Kexin Zhou, Jordan Moody, Denise Nava, Eleanor Donaher, Lillian Yusha Jiang, Ben Bruncati, Katherine M. Kinnaird
Repytah: An Open-Source Python Package For Building Aligned Hierarchies For Sequential Data, Chenhui Jia, Lizette Carpenter, Thu Tran, Amanda Y. Liu, Sasha Yeutseyva, Mariun Tapal, Yingke Wang, Zoie Kexin Zhou, Jordan Moody, Denise Nava, Eleanor Donaher, Lillian Yusha Jiang, Ben Bruncati, Katherine M. Kinnaird
Computer Science: Faculty Publications
We introduce repytah, a Python package that constructs the aligned hierarchies representation that contains all possible structure-based hierarchical decompositions for a finite length piece of sequential data aligned on a common time axis. In particular, this representation–introduced by Kinnaird (2016) with music-based data (like musical recordings or scores) as the primary motivation–is intended for sequential data where repetitions have particular meaning (such as a verse, chorus, motif, or theme). Although the original motivation for the aligned hierarchies representation was finding structure for music-based data streams, there is nothing inherent in the construction of these representations that limits repytah to only …
Visualizations For User-Supported State Space Exploration Of Requirements Models, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
Visualizations For User-Supported State Space Exploration Of Requirements Models, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
Computer Science: Faculty Publications
Automated analysis has been used in goal-oriented requirements engineering (GORE) to evaluate scenarios and make trade-off decisions. For higher complexity problems (e.g., backwards analysis), using a search-based solver may be more efficient than custom algorithms. When these black-box solvers produce a single solution, users may be suspicious about whether the given answer is ideal or believable. Users would like to explore the potential solutions but are prevented from doing so because these inquiries often suffer from a state explosion problem. In this RE@Next! paper, we introduce the use of valuation-based filtering and coloring to assist users in understanding a solution …
An Experiment On The Effects Of Using Color To Visualize Requirements Analysis Tasks: Supplemental Material, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
An Experiment On The Effects Of Using Color To Visualize Requirements Analysis Tasks: Supplemental Material, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
Computer Science: Faculty Publications
Supplemental material for the paper: "An Experiment on the Effects of using Color to Visualize Requirements Analysis Tasks".
This paper is a scientific evaluation of the effectiveness and usability of EVO. We conduct an experiment to measure any effect of using colors to represent evidence pairs.
Visualizations For User-Supported State Space Exploration Of Goal Models: Supplemental Material, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
Visualizations For User-Supported State Space Exploration Of Goal Models: Supplemental Material, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
Computer Science: Faculty Publications
Supplemental material for the research paper entitled, "Visualizations for User-supported State Space Exploration of Goal Models". This paper presents a technique for valuation-based filtering and coloring to assist users in understanding a solution space and selecting custom states from it. This supplement contains the data from our initial evaluation and associated models.
An Experiment On The Effects Of Using Color To Visualize Requirements Analysis Tasks, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
An Experiment On The Effects Of Using Color To Visualize Requirements Analysis Tasks, Yesugen Baatartogtokh, Irene Foster, Alicia M. Grubb
Computer Science: Faculty Publications
Recent approaches have investigated assisting users in making early trade-off decisions when the future evolution of project elements is uncertain. These approaches have demon-strated promise in their analytical capabilities; yet, stakeholders have expressed concerns about the readability of the models and resulting analysis, which builds upon Tropos. Tropos is based on formal semantics enabling automated analysis; however, this creates a problem of interpreting evidence pairs. The aim of our broader research project is to improve the process of model comprehension and decision making by improving how analysts interpret and make decisions. We extend and evaluate a prior approach, called EVO, …
Coming Out While Going Fast: Queer Conviviality In Speedrunning Live Streams, Johanna Brewer
Coming Out While Going Fast: Queer Conviviality In Speedrunning Live Streams, Johanna Brewer
Computer Science: Faculty Publications
Drawing on ethnographic research of LGBTQIA+ live streaming speedrunners, this article demonstrates how by centering queer perspectives, we can catalyze meaningful social changes for all. Though for most people, beating the original Super Mario Bros. in under five minutes would seem unfathomably difficult, LGBTQIA+ speedrunning live streamers regularly accomplish this superhuman feat, while coming out to an audience of thousands at the same time. For queer and trans folks, broadcasting such a transgressive, transformational form of play is defiant demonstration of vulnerability; one that creates a comfortable space for a community to thrive, by cultivating a culture of queer conviviality. …
Image Schema Decompositions Of The Conceptual Dependency Ingest Primitive: A Study Of Paraphrases, Jamie C. Macbeth, Alexis Kilayko, Zoie Zhao, Sophie Song, Winniw X. Zheng
Image Schema Decompositions Of The Conceptual Dependency Ingest Primitive: A Study Of Paraphrases, Jamie C. Macbeth, Alexis Kilayko, Zoie Zhao, Sophie Song, Winniw X. Zheng
Computer Science: Faculty Publications
One of the hallmarks of the Schank-Minsky Conceptual Dependency Trans-Frames meaning representation system is that it attempts to express complex meanings by building large and complex conceptual structures using a relatively small number of primitives. Recently comparisons of image schemas with Conceptual Dependency primitives revealed ways of possibly reducing the number of primitives while maintaining the expressiveness of the set—an important research goal because it increases the flexibility and richness of the primitive-decomposed structures in a way that better approximates human cognition. Inspired by this prior work, we employ a paraphrase generation system to explore the replacement of the Conceptual …
A Proposal For Primitive Decomposition Of Spatial Orientation Relationships, Jamie C. Macbeth, Mackie Zhou, Zoie Zhao
A Proposal For Primitive Decomposition Of Spatial Orientation Relationships, Jamie C. Macbeth, Mackie Zhou, Zoie Zhao
Computer Science: Faculty Publications
This short paper continues work on primitive decomposition systems for meaning representation which combine image schemas and conceptual dependency primitive systems. An important thread of this research seeks small abstract sets of conceptual primitives so that decompositions of imagery evoked by language give rise to rich sets of mappings between language and the language-free representations, reflecting the linguistic variation of human language behavior. In this brief paper, we present a proposal for novel primitive decompositions of positions, spatial relationships, and orientations of objects in space in a conceptual representation framework. As an abstract first approximation, we introduce a spatial primitive …
More Human Than Human: Llm-Generated Narratives Outperform Human-Llm Interleaved Narratives, Zoie Zhao, Sophie Song, Bridget Duah, Jamie C. Macbeth, Scott Carter, Monica Van, Nayeli Bravo, Matthew Klenk, Katherine Sieck, Alexandre Filipowicz
More Human Than Human: Llm-Generated Narratives Outperform Human-Llm Interleaved Narratives, Zoie Zhao, Sophie Song, Bridget Duah, Jamie C. Macbeth, Scott Carter, Monica Van, Nayeli Bravo, Matthew Klenk, Katherine Sieck, Alexandre Filipowicz
Computer Science: Faculty Publications
Narrative story generation has gained emerging interest in the field of large language models. The present paper aims to compare stories generated by an LLM only (non-interleaved) with those generated by interleaving human-generated and LLM-generated text (interleaved). The study’s hypothesis is that interleaved stories would perform better than non-interleaved stories. To verify this hypothesis, we conducted two tests with roughly 500 participants each. Participants were asked to rate stories of each type, including an overall score or preference and four facets—logical soundness, plausibility, understandability, and novelty. Our findings indicate that interleaved stories were in fact less preferred than non-interleaved stories. …