Digital Commons Network^™

Neural Tabula Rasa: Foundations For Realistic Memories And Learning, Patrick R. Perrine

Master's Theses

Understanding how neural systems perform memorization and inductive learning tasks are of key interest in the field of computational neuroscience. Similarly, inductive learning tasks are the focus within the field of machine learning, which has seen rapid growth and innovation utilizing feedforward neural networks. However, there have also been concerns regarding the precipitous nature of such efforts, specifically in the area of deep learning. As a result, we revisit the foundation of the artificial neural network to better incorporate current knowledge of the brain from computational neuroscience. More specifically, a random graph was chosen to model a neural system. This …

Position-Guided Text Prompt For Vision-Language Pre-Training, Alex Jinpeng Wang, Pan Zhou, Mike Zheng Shou, Yan Shuicheng

Research Collection School Of Computing and Information Systems

Vision-Language Pre-Training (VLP) has shown promising capabilities to align image and text pairs, facilitating a broad variety of cross-modal learning tasks. However, we observe that VLP models often lack the visual grounding/localization capability which is critical for many downstream tasks such as visual reasoning. In this work, we propose a novel Position-guided Text Prompt (PTP) paradigm to enhance the visual grounding ability of cross-modal models trained with VLP. Specifically, in the VLP phase, PTP divides the image into N x N blocks, and identifies the objects in each block through the widely used object detector in VLP. It then reformulates …

Multi-Head Attention Graph Convolutional Network Model: End-To-End Entity And Relation Joint Extraction Based On Multi-Head Attention Graph Convolutional Network, Zhihua Tao, Chunping Ouyang, Yongbin Liu, Tonglee Chung, Yixin Cao

Research Collection School Of Computing and Information Systems

At present, the entity and relation joint extraction task has attracted more and more scholars' attention in the field of natural language processing (NLP). However, most of their methods rely on NLP tools to construct dependency trees to obtain sentence structure information. The adjacency matrix constructed by the dependency tree can convey syntactic information. Dependency trees obtained through NLP tools are too dependent on the tools and may not be very accurate in contextual semantic description. At the same time, a large amount of irrelevant information will cause redundancy. This paper presents a novel end-to-end entity and relation joint extraction …

Evaluating Neural Networks As Cognitive Models For Learning Quasi-Regularities In Language, Xiaomeng Ma

Dissertations, Theses, and Capstone Projects

Many aspects of language can be categorized as quasi-regular: the relationship between the inputs and outputs is systematic but allows many exceptions. Common domains that contain quasi-regularity include morphological inflection and grapheme-phoneme mapping. How humans process quasi-regularity has been debated for decades. This thesis implemented modern neural network models, transformer models, on two tasks: English past tense inflection and Chinese character naming, to investigate how transformer models perform quasi-regularity tasks. This thesis focuses on investigating to what extent the models' performances can represent human behavior. The results show that the transformers' performance is very similar to human behavior in many …

Stream-Evolving Bot Detection Framework Using Graph-Based And Feature-Based Approaches For Identifying Social Bots On Twitter, Eiman Alothali

Dissertations

This dissertation focuses on the problem of evolving social bots in online social networks, particularly Twitter. Such accounts spread misinformation and inflate social network content to mislead the masses. The main objective of this dissertation is to propose a stream-based evolving bot detection framework (SEBD), which was constructed using both graph- and feature-based models. It was built using Python, a real-time streaming engine (Apache Kafka version 3.2), and our pretrained model (bot multi-view graph attention network (Bot-MGAT)). The feature-based model was used to identify predictive features for bot detection and evaluate the SEBD predictions. The graph-based model was used to …

The Sociolinguistics Of Code-Switching In Hong Kong’S Digital Landscape: A Mixed-Methods Exploration Of Cantonese-English Alternation Patterns On Whatsapp, Wilkinson Daniel Wong Gonzales, Yuen Man Tsang

Journal of English and Applied Linguistics

This paper examines the prevalence of Cantonese-English code mixing in Hong Kong through an under-researched digital medium. Prior research on this code-alternation practice has often been limited to exploring either the social or linguistic constraints of code-switching in spoken or written communication. Our study takes a holistic approach to analyzing code-switching in a hybrid medium that exhibits features of both spoken and written discourse. We specifically analyze the code-switching patterns of 24 undergraduates from a Hong Kong university on WhatsApp and examine how both social and linguistic factors potentially constrain these patterns. Utilizing a self-compiled sociolinguistic corpus as well as …

Automatic Scoring Of Speeded Interpersonal Assessment Center Exercises Via Machine Learning: Initial Psychometric Evidence And Practical Guidelines, Louis Hickman, Christoph N. Herde, Filip Lievens, Louis Tay

Research Collection Lee Kong Chian School Of Business

Assessment center (AC) exercises such as role-plays have established themselves as valuable approaches for obtaining insights into interpersonal behavior, but they are often considered the “Rolls Royce” of personnel assessment due to their high costs. The observation and rating process comprises a substantial part of these costs. In an exploratory case study, we capitalize on recent advances in natural language processing (NLP) by developing NLP-based machine learning (ML) models to investigate the possibility of automatically scoring AC exercises. First, we compared the convergent-related validity and contamination with word count of ML scores based on models that used different NLP methods …

Ai Approaches To Understand Human Deceptions, Perceptions, And Perspectives In Social Media, Chih-Yuan Li

Dissertations

Social media platforms have created virtual space for sharing user generated information, connecting, and interacting among users. However, there are research and societal challenges: 1) The users are generating and sharing the disinformation 2) It is difficult to understand citizens' perceptions or opinions expressed on wide variety of topics; and 3) There are overloaded information and echo chamber problems without overall understanding of the different perspectives taken by different people or groups.

This dissertation addresses these three research challenges with advanced AI and Machine Learning approaches. To address the fake news, as deceptions on the facts, this dissertation presents Machine …

Mapping Programs To Equations, Hessamaldin Mohammadi

Dissertations

Extracting the function of a program from a static analysis of its source code is a valuable capability in software engineering; at a time when there is increasing talk of using AI (Artificial Intelligence) to generate software from natural language specifications, it becomes increasingly important to determine the exact function of software as written, to figure out what AI has understood the natural language specification to mean. For all its criticality, the ability to derive the domain-to-range function of a program has proved to be an elusive goal, due primarily to the difficulty of deriving the function of iterative statements. …

Deep Hybrid Modeling Of Neuronal Dynamics Using Generative Adversarial Networks, Soheil Saghafi

Dissertations

Mechanistic modeling and machine learning methods are powerful techniques for approximating biological systems and making accurate predictions from data. However, when used in isolation these approaches suffer from distinct shortcomings: model and parameter uncertainty limit mechanistic modeling, whereas machine learning methods disregard the underlying biophysical mechanisms. This dissertation constructs Deep Hybrid Models that address these shortcomings by combining deep learning with mechanistic modeling. In particular, this dissertation uses Generative Adversarial Networks (GANs) to provide an inverse mapping of data to mechanistic models and identifies the distributions of mechanistic model parameters coherent to the data.

Chapter 1 provides background information on …

Connecting Linguistic Expressions And Pain Relief Through Transformer Model Construction And Analysis, Sarah M. Chacko

Computer Science Senior Theses

Chronic pain is a widespread problem that significantly impacts quality of life. Overprescription and abuse of pain medication continues to be a major public health issue and can further burden patients due to a fragmented health care system. Previous research has suggested a possible psychological basis to pain and the potential for safer, non-pharmacological alternatives for pain relief. This project leverages language models to study chronic pain development and relief through psychological treatments, which will be assessed through responses to post-treatment interviews. A transformer-based natural language processing model is employed to identify connections between language expressions and pain on a …

Investigating English-Language Dialect-Adjusted Models, Samiha Datta

Computer Science Senior Theses

This thesis describes several approaches to better understand how large language models interpret different dialects of the English language. Our goal is to consider multiple contexts of textual data and to analyze how English-language dialects are realized in them, as well as how a variety of machine learning techniques handle these differences. We focus on two genres of text data: news and social media. In the news context, we establish a dataset covering news articles from five countries and four US states and consider language modeling analysis, topic and sentiment distributions, and manual analysis before performing nine experiments and evaluating …

Neutrosophic Mcdm Methodology For Risk Assessment Of Autonomous Underwater Vehicles, Shimaa S. Mohamed, Ahmed Abdel-Monem, Alshaimaa A. Tantawy

Neutrosophic Systems with Applications

Due to its usefulness in several industries and the military, researchers have concentrated on developing autonomous underwater vehicles (AUVs). However, AUV navigation continues to be a difficult challenge to solve owing to the variety of underwater settings. The usage of AUVs, or autonomous underwater vehicles, is not without dangers like malfunction, ecological risks, loss of communications, cybersecurity risks, collisions, and others. There are many criteria to assess these risks technical, operational, economic, and regulatory. So, the methods of multi-criteria decision-making (MCDM) is used to deal with these various criteria. The analytical hierarchy process (AHP) method is an MCDM methodology, that …

A Machine Learning Model To Predict The Asd Traits And Challenging Behaviors In Children, Biswaranjan Senapati

Theses and Dissertations

A neurological disorder, along with several behavioral issues, may be to blame for a child's subpar performance in the academic journey (such as anxiety, depression, learning disorders, and irritability). These symptoms can be used to diagnose children with ASD, and supervised machine learning models can help differentiate between ASD traits and other behavioral traits in children, so that a correct diagnosis can be made. Autism usually shows up in a child within the first two years of life, but it can happen at any time. This research aims to create a model for predicting ASD traits and challenging behaviors in …

Progress In A New Visualization Strategy For Ml Models, Alex Wissing, Brian Ricks, Robin Gandhi, Yonas Kassa, Akshay Kale

Information Systems and Quantitative Analysis Faculty Proceedings & Presentations

No abstract provided.

Handling Realistic Label Noise In Bert Text Classification, Maha Tufail Agro, Hanan Al Darmaki

Natural Language Processing Faculty Publications

Label noise refers to errors in training labels caused by cheap data annotation methods, such as web scraping or crowd-sourcing, which can be detrimental to the performance of supervised classifiers. Several methods have been proposed to counteract the effect of random label noise in supervised classification, and some studies have shown that BERT is already robust against high rates of randomly injected label noise. However, real label noise is not random; rather, it is often correlated with input features or other annotator-specific factors. In this paper, we evaluate BERT in the presence of two types of realistic label noise: feature-dependent …

Algorithmic Fidelity And The Use Of Large Language Models In Social Science Research, Christopher Michael Rytting

Theses and Dissertations

In this dissertation, we argue that large language models (LLMs) exhibit a considerable amount of \textit{algorithmic fidelity}, a property where they have modeled ideas, behaviors, and attitudes of the population who generated their training data. This has important implications for social science, as this fidelity theoretically allows for the use of LLMs as effective proxies for human beings in experiments and research. We demonstrate this empirically in various social science domains (political partisanship, demographic surveying, voting behavior, hot-button policy issues, news media, populism, congressional summaries), in various applications (replicating social science survey findings, assisting in coding of text datasets, inferring …

Interactions Between Marine Megafauna And Plastic Pollution In Southeast Asia, Lucy C.M. Omeyer, Emily Duncan, Neil Angelo S. Abreo, Jo Marie V. Acebes, Lea A. Angsinco-Jimenez, Sabiqah T. Anuar, Lemnuel V. Aragones, Gonzalo Araujo, Luis R. Carrasco, Emilyn Q. Espiritu

Environmental Science Faculty Publications

Southeast (SE) Asia is a highly biodiverse region, yet it is also estimated to cumulatively contribute a third of the total global marine plastic pollution. This threat is known to have adverse impacts on marine megafauna, however, understanding of its impacts has recently been highlighted as a priority for research in the region. To address this knowledge gap, a structured literature review was conducted for species of cartilaginous fishes, marine mammals, marine reptiles, and seabirds present in SE Asia, collating cases on a global scale to allow for comparison, coupled with a regional expert elicitation to gather additional published and …

Detecting Ai Generated Text Using Neural Networks, Jesus Guerrero

Masters Theses (Archived)

For humans, distinguishing machine generated text from human written text is men- tally taxing and slow. NLP models have been created to do this more effectively and faster. But, what if some adversarial changes have been added to the machine generated text? This thesis discusses this issue and text detectors in general.
/="/">
/="/">The primary goal of this thesis is to describe the current state of text detectors in research and to discuss a key adversarial issue in modern NLP transformers. To describe the current state of text detectors a Systematic Literature Review was done on 50 relevant papers …

Quehry: A Question Answering System To Query Electronic Health Records, Sarvesh Soni, Surabhi Datta, Kirk Roberts

Faculty, Staff and Student Publications

OBJECTIVE: We propose a system, quEHRy, to retrieve precise, interpretable answers to natural language questions from structured data in electronic health records (EHRs).

MATERIALS AND METHODS: We develop/synthesize the main components of quEHRy: concept normalization (MetaMap), time frame classification (new), semantic parsing (existing), visualization with question understanding (new), and query module for FHIR mapping/processing (new). We evaluate quEHRy on 2 clinical question answering (QA) datasets. We evaluate each component separately as well as holistically to gain deeper insights. We also conduct a thorough error analysis for a crucial subcomponent, medical concept normalization.

RESULTS: Using gold concepts, the precision of quEHRy …

Integrating Data Science With Reliability Engineering: A Study Of Crucial Knowledge And Skills, Altricia Jordan

Theses and Dissertations

Data science, as a discipline can be used in any area. However, in order to utilize data science techniques, data scientist must be taught domain knowledge, referred to as a partner discipline, in the area with which the techniques are to be utilized. Using a quantitative analysis of publicly available information and survey methodology, this research developed recommendations for training data scientist in the partner discipline of reliability engineering. A text analysis was performed on reliability engineering job requisitions resulting in a set of knowledge and skills topics that organizations desire in reliability engineering hires. Using the results of the …

Ptmtorrent: A Dataset For Mining Open-Source Pre-Trained Model Packages, Wenxin Jiang, Nicholas Synovic, Purvish Jajal, Taylor R. Schorlemmer, Arav Tewari, Bhavesh Pareek, George K. Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Due to the cost of developing and training deep learning models from scratch, machine learning engineers have begun to reuse pre-trained models (PTMs) and fine-tune them for downstream tasks. PTM registries known as “model hubs” support engineers in distributing and reusing deep learning models. PTM packages include pre-trained weights, documentation, model architectures, datasets, and metadata. Mining the information in PTM packages will enable the discovery of engineering phenomena and tools to support software engineers. However, accessing this information is difficult — there are many PTM registries, and both the registries and the individual packages may have rate limiting for accessing …

How To Be An Anti-Racist Educator: A Book Review Through An Educational Perspective, Maria Cristina F. Soares, Melanie Morales

Journal of Multicultural Affairs

The authors reviewed the book How to be an Antiracist by Ibram X. Kendi (2019) while reflecting on how Kendi’s brilliant dismantlement of racism and discrimination would help educators become conscious of how racism operates in our society, their schools, and their communities. Kendi’s book could motivate teachers to self-reflect on intrinsic feelings and misconceptions about race and culture built over time, allowing them to adopt new attitudes towards their students and school community. The authors considered the need to reevaluate systemic racism in schools as research has, for instance, found evidence of discriminatory practices towards African American boys (Gregory …

Generative And Pseudo-Relevant Feedback For Sparse, Dense And Learned Sparse Retrieval, Iain Mackie, Shubham Chatterjee, Jeffrey Dalton

Computer Science Faculty Research & Creative Works

Pseudo-relevance feedback (PRF) is a classical approach to address lexical mismatch by enriching the query using first-pass retrieval. Moreover, recent work on generative-relevance feedback (GRF) shows that query expansion models using text generated from large language models can improve sparse retrieval without depending on first-pass retrieval effectiveness. This work extends GRF to dense and learned sparse retrieval paradigms with experiments over six standard document ranking benchmarks. We find that GRF improves over comparable PRF techniques by around 10% on both precision and recall-oriented measures. Nonetheless, query analysis shows that GRF and PRF have contrasting benefits, with GRF providing external context …

Celebrating Native Chemists And Encouraging More Native Talent In Stem, Lisa Villa

Staff publications

This editorial was written to accompany cover art submitted to the American Chemical Society's 2023 ACS Diversity & Inclusion Cover Art Series, and selected as the July cover for Environmental Science & Technology Letters. The artwork design features several prominent chemists who are also strong advocates for increasing the number of Native American/First Nation scientists. They recognize how cultural beliefs may often be in conflict with scientific conversations, but have been working to attract and encourage Native American talent in the STEM fields.

The published cover art is included as a supplemental file.

Du Undergraduate Showcase: Research, Scholarship, And Creative Works, Caitlyn Aldersea, Justin Bravo, Sam Allen, Anna Block, Connor Block, Emma Buechler, Maria De Los Angeles Bustillos, Arianna Carlson, William Christensen, Olivia Kachulis, Noah Craver, Kate Dillon, Muskan Fatima, Angel Fernandes, Emma Finch, Colleen Cassidy, Amy Fishman, Andrea Francis, Stacia Fritz, Simran Gill, Emma Gries, Rylie Hansen, Shannon Powers, Jacqueline Martinez, Zachary Harker, Ashley Hasty, Mykaela Tanino-Springsteen, Kathleen Hopps, Adelaide Kerenick, Colin Kleckner, Ci Koehring, Elijah Kruger, Braden Krumholz, Maddie Leake, Lyneé Alves, Seraphina Loukas, Yatzari Lozano Vazquez, Haley Maki, Emily Martinez, Sierra Mckinney, Audrey Mitchell, Kipling Newman, Audrey Ng, Megan Lucyshyn, Andrew Nguyen, Stevie Ostman, Casandra Pearson, Alexandra Penney, Julia Gielczynski, Tyler Ball, Anna Rini, Christina Rorres, Simon Ruland, Helayna Schafer, Emma Sellers, Sarah Schuller, Claire Shaver, Kevin Summers, Isabella Shaw, Madison Sinar, Claudia Pena, Apshara Siwakoti, Carter Sorensen, Madi Sousa, Anna Sparling, Alexandra Revier, Brandon Thierry, Dylan Tyree, Maggie Williams, Lauren Wols

DU Undergraduate Research Journal Archive

DU Undergraduate Showcase: Research, Scholarship, and Creative Works

Topic Modeling And Future Prediction Of Aid Data In Development Studies Using Lda And Bert, Uttamasha Anjally Oyshi

Theses and Dissertations

This thesis presents a study on topic modeling and future prediction of aid data in development studies using LDA and BERT. The goal of this study is to explore the aid data from four sectors: Government and civil society, Government and civil society general, Conflict prevention and resolution, peace and security, and Women, and to identify the latent topics that are present in the data. The LDA and BERT algorithms were used for the topic modeling, and coherence scores were computed to evaluate the quality of the models. The results of the study show that the LDA and BERT models …

Fair Enough: Standardizing Evaluation And Model Selection For Fairness Research In Nlp, Xudong Han, Timothy Baldwin, Trevor Cohn

Natural Language Processing Faculty Publications

Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However, current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague relation between debiasing algorithms and theoretical measures of bias. This paper seeks to clarify the current situation and plot a course for meaningful progress in fair learning, with two key contributions: (1) making clear inter-relations among the current gamut of methods, and their relation to fairness theory; and (2) addressing the practical problem of model selection, which involves a trade-off between fairness and accuracy …

Music Mentor, Jacob Webb

Honors College Theses

Extra-curricular learning is on the rise, and many are interested in expanding their current knowledge by utilizing the recent increase in educational technology. While many forms of educational technology exist, there are few interactive and engaging platforms that teach music theory. Apps such as Perfect Ear and MyMusicTheory are great for becoming familiar with reading music and recognizing pitches, however, they often become dry with repetition and repeated tasks. By combining existing technologies that can complete real time conversions from raw audio to MIDI, our goal was to gather information such as harmonies, key and compatible chords from the user’s …

Enhancing Health Tweet Classification: An Evaluation Of Transformer-Based Models For Comprehensive Analysis, Foram Pankajbhai Patel

Computer Science and Engineering Theses - Archive

The task of health tweet classification entails identifying whether a given tweet is health-related or not. While existing research in this area has made significant progress in classifying tweets into specific sub-domains of health, such as mental health, COVID-19, or specific diseases, there is a need for a more comprehensive approach that considers a broader range of health-related topics. This thesis addresses this need by proposing a diverse and comprehensive dataset that includes various existing health-related datasets, data collected through a keyword-based approach, and manually annotated data. However, the use of health-related keywords in a figurative or non-health context poses …