Artificial Intelligence and Robotics Commons^™

Trace: Temporal Rhetorical Analysis And Consistency Evaluation For Legislative Speech, David Hernandez

Master's Theses

Legislators frequently discuss the same policy issues across multiple hearings and legislative sessions, sometimes maintaining consistent positions and other times modifying or reframing their stance over time. Understanding how these positions evolve is important for analyzing political discourse and democratic accountability, yet identifying such shifts at scale remains difficult.

We introduce TRACE (Temporal Rhetorical Analysis and Consistency Evaluation), a system built on the Digital Democracy Database (DDDB) for detecting rhetorical inconsistency in California legislative hearing testimony. TRACE organizes utterances into speaker-anchored timelines indexed by bill and session, then applies hybrid semantic retrieval — combining dense BGE embeddings with BM25 lexical …

Optimizing Gated Rnns, Joshua Paul Fechete

Honors Projects

Gated recurrent neural networks such as Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU) help fix instability present in normal recurrent neural networks. This allows them to be used for various real-world tasks, and due to their architecture, they are uniquely qualified to handle variable sized input such as text. However, even before training can begin on a machine learning model, various hyperparameters must be chosen to decide how the model will be architectured. Choosing good hyperparameters is vital for creating a model that performs well but is not larger and more computationally expensive to run than it needs …

You Can’T Spell Audit Without Ai: The Current Uses Of Artificial Intelligence In Audit, Jena Perkins

Senior Honors Theses

The accounting profession continuously adapts to the innovations provided by the broader context in which it exists. Artificial intelligence (AI) is a forerunner among tools used to enhance and optimize auditing services within the accounting profession. The realm of AI offers advancements to procedures used within an audit to detect misstatements. Based on the proprietary platforms developed by Big 4 accounting firms, AI is a key component in maintaining an advanced approach towards auditing.

The Application Of Natural Language Processing Towards Auditing Of Unstructured Data: A Design Science Approach, Dennis K. Amoatey

Electronic Theses and Dissertations

Financial auditors must manually review large volumes of unstructured text that may include contracts, internal policies, footnotes, and journal entry descriptions. This time-intensive process introduces risk of human error and inconsistency. Despite advances in automation, no systematic approach exists for applying Natural Language Processing (NLP) to this problem at scale. Using a design science approach, this study develops a framework that demonstrates how NLP techniques can be incorporated across key phases in the audit process, including planning, internal controls evaluation, evidence gathering, and reporting. Initial evaluation through expert feedback had a mix of responses. While some argued difficulty with data …

Dementia Detection In Low-Resource Languages: Evaluating Translation-Assisted Transfer Learning For Multilingual Clinical Assessment, Kylar A. Deloach

Honors Theses

Alzheimer's disease (AD) is a growing global health concern, with millions of people affected worldwide and cases expected to rise significantly in the coming decades. Early detection is critical for patient treatment and care, and recent advances in natural language processing (NLP) have shown promise in identifying linguistic markers associated with AD. However, most existing work has focused on English, leaving speakers of other languages with limited access to such tools. This study investigates how effective AD detection models trained on English data are at transferring to Greek, a low-resource language with limited dementia-related speech data available. We propose a …

Previsit Ai: A Retrieval-Augmented Generation For Patient Readiness In Clinical Encounters, Rolande Umuhoza

All Graduate Theses, Dissertations, and Other Capstone Projects

With healthcare systems under growing pressure from rising patient volumes and shrinking consultation windows, improving how patients communicate with physicians has become essential to delivering quality care. Yet patients routinely arrive at appointments unable to clearly describe their symptoms, recall their medical history, or articulate concerns, contributing to miscommunication, diagnostic inefficiency, and pre-visit anxiety. This study introduces PreVisit AI, a conversational system designed to address this gap through structured, knowledge-based patient preparation. The system is built on a Retrieval-Augmented Generation (RAG) architecture combining HuggingFace sentence embeddings (all-MiniLM-L6-v2), a Chroma vector store, and Google’s Gemini language model over a curated seven-document …

Advancing Hate Speech Detection: Binary And Multiclass Approaches From Traditional Methods To Parameter-Efficient And Ontology-Guided Language Models, Mahmoud Abusaqer

Graduate Theses/Dissertations

The widespread proliferation of hate speech on social media platforms poses significant challenges for content moderation and user safety, requiring automated systems that are simultaneously accurate, efficient, and capable of fine-grained distinctions. This thesis investigates hate speech detection through five published manuscripts organized into two complementary threads: binary detection (hateful vs. non-hateful) and multiclass detection across demographic targeting categories. The binary thread progresses from a broad 38-model baseline spanning traditional machine learning, deep learning, and transformer architectures (where RoBERTa reaches 91.48% accuracy and CatBoost remains competitive at 88.60%) to parameter-efficient adaptation, in which Low-Rank Adaptation (LoRA) of large language models …

A Comprehensive Survey Of Prompt Engineering Techniques In Large Language Models, Tonmoy Debnath, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Prosenjit Das, Antu Kumar Guha, Muhammad Rezaur Rahman, H. M. Dipu Kabir

Electrical & Computer Engineering Faculty Publications

Prompt engineering has arisen as a pivotal discipline in optimizing the performance of Large Language Models (LLMs) by structuring inputs to enhance coherence, accuracy, and task alignment. This paper comprehensively surveys various prompting techniques, systematically categorizing them according to their application domains and methodological foundations. Fundamental approaches like zero-shot and few-shot prompting are examined along with advanced strategies, including chain-of-thought reasoning, retrieval-augmented generation, and self-consistency mechanisms. A rigorous qualitative analysis is conducted to evaluate each technique's strengths, limitations, and optimal use cases, offering a structured framework for selecting the most effective prompting strategies. Theoretical insights and empirical findings are consolidated …

Large Language Models (Llms) For Clinical Note Generation: International Classification Of Disease (Icd) Code, Knowledge Graph (Kg) And Prompt Evaluation, Ivan P. Makohon

Computer Science Theses & Dissertations

In the past decade, a surge in the amount of electronic health record (EHR) data in the United States occurred, driven by a favorable policy environment created by the Health Information Technology for Economic and Clinical Health (HITECH) Act of 2009 and the 21st Century Cures Act of 2016. Clinical notes for patients’ assessments, diagnoses, and treatments are captured in these EHRs in free-form text by physicians, who spend a considerable amount of time entering them. Manually writing these notes is time-consuming, increasing patient waiting times and potentially delaying diagnoses. Large language models (LLMs), such as GPT-4o, possess the ability …

Research On Cgf-Oriented Natural Language Interaction Framework, Xinmeng Li, Kai Xu, Yue Hu, Hesong Huang, Quanjun Yin

Journal of System Simulation

Abstract: To address the mismatch between existing natural language interaction frameworks and training tasks in simulation-based military training, which limits smooth interaction between trainees and Computer Generated Forces (CGF), this paper proposes a Natural Language Interaction framework for Computer Generated Forces (NLI4CGF). The framework analyzes the logic and functional requirements of natural language interaction between trainees and CGF, and establishes an interaction architecture tailored for military simulation training scenarios. It supports semantic parsing and knowledge query tasks within a prototype system developed for infantry squad simulation training. Experimental results demonstrate that the proposed model performs effectively, meets the requirements of …

The Challenge Of Achieving Attributability In Multilingual Table-To-Text Generation With Question-Answer Blueprints, Aden Haussmann

International Journal of Undergraduate Research and Creative Activities

Generating faithful text descriptions from data tables is a significant challenge in Natural Language Processing (NLP), especially for the world’s many low-resource languages. This paper investigates whether Question-Answer (QA) blueprints—an intermediate planning step where a model first asks and answers questions about the data—can improve the factual accuracy of multilingual table-to-text generation. This novel approach is tested on the TaTA dataset, which includes several African languages, by finetuning models with and without these blueprints.

The results show a key distinction: while the QA blueprint method improves performance for English-only models, these gains disappear in the multilingual setting. This paper’s analysis …

Sugar: A Sequence Unfolding Based Transformer Model For Group Activity Recognition, Yash U. Gondkar

Graduate Masters Theses

Large Language Models have improved significantly in the past couple of years due to the adoption of transformers. However, transformers still find it challenging to process videos due to limited context size caused by their quadratic computing cost. Therefore, we studied a booming field in machine learning which powers applications like social scene analysis and video surveillance systems called Group Activity Recognition (GAR). We found that recent models were able to achieve more than 90% accuracy on popular datasets like the Volleyball dataset, however, it turned out that even they relied on transformers.

Therefore, in this work, we developed a …

Development And Validation Of Venous Thromboembolism-Bidirectional Encoder Representations From Transformers (Vte-Bert) Natural Language Processing Model, Omid Jafari, Shengling Ma, Barbara D Lam, Jun Y Jiang, Emily Zhou, Mrinal Ranjan, Justine Ryu, Raka Bandyo, Arash Maghsoudi, Bo Peng, Christopher I Amos, Abiodun Oluyomi, Nathanael R Fillmore, Jennifer La, Ang Li

Faculty, Staff and Students Publications

Background: Accurate and rapid phenotyping of venous thromboembolism (VTE) in longitudinal studies is important. A natural language processing (NLP) tool externally validated in representative patients is lacking.

Objectives: To train and validate an efficient NLP model to detect incident VTE event.

Methods: We designed a novel NLP platform, NLPMed, to assist thrombosis researchers with data preprocessing, phenotype annotation, language model finetuning, and NLP application. Using clinical notes, discharge summaries, and radiology reports from patients with cancer at 2 healthcare institutions, we finetuned Bio_Clinical Bidirectional Encoder Representations from Transformers (BERT) to develop VTE-BERT. The new model was trained to detect acute …

Ai Model For Predicting Asthma Prognosis In Children, Elham Sagheb, Chung-Il Wi, Katherine S King, Bhavani Singh Agnikula Kshatriya, Euijung Ryu, Hongfang Liu, Miguel A Park, Hee Yun Seol, Shauna M Overgaard, Deepak K Sharma, Young J Juhn, Sunghwan Sohn

Faculty, Staff and Student Publications

BACKGROUND: Childhood asthma often continues into adulthood, but some children experience remission. Utilizing electronic health records (EHRs) to predict asthma prognosis can aid health care providers and patients in developing effective prioritized care plans.

OBJECTIVE: We aimed to develop artificial intelligence (AI) models using various clinical variables extracted from EHRs to predict childhood asthma prognosis (remission vs no remission) in different age groups.

METHODS: We developed AI models utilizing patients' EHRs during the first 6, 9, or 12 years of their lives to predict their asthma prognosis status at ages 6 to 9, 9 to 12, or 12 to 15 …

Creating Talking Points For Client Advisers At Banks To Promote Sustainable Investing, Wewe Zi Yi, Pradeep Varakantham, Alan Megargel

Research Collection School Of Computing and Information Systems

Environmental, social and governance (ESG) factors have become key nonfinancial factors for investors to evaluate companies with respect to understanding material risks and growth opportunities. While not mandatory, companies are providing ESG reports that outline progress in different ESG metrics (six broad metrics and 15 specific ones). Client advisers (CAs) read these reports to identify key metrics of interest to investors. Given the number of companies and investment products, however, it is not feasible for CAs to read all the reports, which can sometimes run into tens or hundreds of pages). The authors have developed multiple frameworks building on leading …

Ai Foundations And Applications: Summary Of A Panel Discussion At Loyola University Chicago, George K. Thiruvathukal, Dmitry Dligach, Shilpika, Michael B. Burns, Joseph Vukov, Fraser Turner, Mary Usher

Computer Science: Faculty Publications and Other Works

This document summarizes the panel discussion titled "AI Foundations and Applications," held at Loyola University Chicago as part of the "Forum on Global Affairs: Artificial Intelligence in a Globalized World" series. The panel brought together interdisciplinary experts to discuss the foundational aspects of artificial intelligence (AI), its applications, ethical considerations, and implications for education and society.

If You Were A Sesame Street Character, Which One Would You Be? Natural Language Processing And Personality With Big Bird And Friends, Joseph Uran Meyer

Doctoral Dissertations

This paper examined and compared several natural language processing and machine learning techniques in predicting self-reported Big Five personality traits from text responses. The models were validated on the open-source 2019 SIOP Machine Learning Competition dataset (N = 1,689). The techniques evaluated included bag-of-words, Empath dictionary, LSTM networks, fine-tuning Transformer models, and stacked generalization. Results indicated that the present study’s models had lower error in four of the five constructs analyzed. Limitations of the study include use of an MTurk sample and small sample size. Future research should explore similar techniques on larger applicant samples. Practical implications and contributions to …

A Spine-Specific Lexicon For The Sentiment Analysis Of Interviews With Adult Spinal Deformity Patients Correlate With Sf-36, Sf-36, And Odi Scores: A Pilot Study Of 25 Patients, Ross Gore, Michael M. Safaee, Christopher J. Lynch, Christopher P. Ames

VMASC Publications

Classic health-related quality of life (HRQOL) metrics are cumbersome, time-intensive, and subject to biases based on the patient’s native language, educational level, and cultural values. Natural language processing (NLP) converts text into quantitative metrics. Sentiment analysis enables subject matter experts to construct domain-specific lexicons that assign a value of either negative (−1) or positive (1) to certain words. The growth of telehealth provides opportunities to apply sentiment analysis to transcripts of adult spinal deformity patients’ visits to derive a novel and less biased HRQOL metric. In this study, we demonstrate the feasibility of constructing a spine-specific lexicon for sentiment analysis …

An Integrated Machine Learning Approach For Identifying Emergency Rescue Messages On Social Media During Natural Disasters, Wael Khallouli, Jiang Li, Jingwei Huang, Ghaith Rabadi, Samuel Kovacic

School of Cybersecurity Faculty Publications

During large-scale disasters, emergency call centers are often overwhelmed by the large volume of rescue requests and calls for help. Consequently, people are turning to social media platforms to seek assistance. Rescue information posted on these platforms is extremely valuable for first responders to make informed rescue decisions. Therefore, the automatic identification of these requests from the vast amount of data posted on social media during crises is critical yet challenging. This work presents our ongoing research on applying deep learning techniques to extract actionable rescue information from social media during crises. We proposed a novel deep learning model that …

Ai-Generated Messaging For Life Events Using Structured Prompts: A Comparative Study Of Gpt With Human Experts And Machine Learning, Christopher Lynch, Erik Jensen, Ross Gore, Virginia Zamponi, Kevin O'Brien, Brandon Feldhaus, Katherine Smith, Joseph Martínez, Madison H. Munro, Timur E. Ozkose, Tugce B. Gundogdu, Ann Marie Reinhold, Hamdi Kavak, Barry Ezell

VMASC Publications

Large Language Models (LLMs) play an increasingly integrated and pivotal role in generating diverse types of texts, such as social media messages, emails, narratives, and technical reports, among other textual communication forms. As AI-generated messaging filters into human communication, a systematic exploration of their effectiveness for mimicking human-like communication of life events is needed. In this study, we employ a zero-shot structured narrative prompt to generate 24,000 life event messages for birth, death, hiring, and firing events using OpenAI's GPT-4. From this dataset, we manually classify 2880 messages and evaluate their validity in conveying these life events through the form …

From Philosophy To Nlu: Evolving Definitions With Research Hypotheses, Jian Wu, Sarah Rajtmajer

Computer Science Faculty Publications

Over the past decades, alongside advancements in natural language processing, significant attention has been paid to training models to automatically extract, understand, test, and generate hypotheses in open and scientific domains. However, interpretations of the term hypothesis for various natural language understanding (NLU) tasks have migrated from traditional definitions in the natural, social, and formal sciences. Even within NLU, we observe differences defining hypotheses across literature. In this paper, we overview and delineate various definitions of hypothesis. Especially, we discern the nuances of definitions across recently published NLU tasks. We highlight the importance of well-structured and well-defined hypotheses, particularly as …

From Philosophy To Nlu: Evolving Definitions Of Research Hypotheses, Jian Wu, Sarah Rajtmajer

Computer Science Faculty Publications

Over the past decades, alongside advancements in natural language processing, significant attention has been paid to training models to automatically extract, understand, test, and generate hypotheses in open and scientific domains. However, interpretations of the term hypothesis for various natural language understanding (NLU) tasks have migrated from traditional definitions in the natural, social, and formal sciences. Even within NLU, we observe differences defining hypotheses across literature. In this paper, we overview and delineate various definitions of hypothesis. Especially, we discern the nuances of definitions across recently published NLU tasks. We highlight the importance of well-structured and well-defined hypotheses, particularly as …

Optimizing Ai Language Models: A Study Of Chatgpt-4 Vs. Chatgpt-4o, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Md Fayaz Bin Hossen, Muhammad Rezaur Rahman, Md. Shahadat Jaman

Electrical & Computer Engineering Faculty Publications

This paper presents a comparative analysis of OpenAI's GPT-4 and its optimized variant, GPT-4o, focusing on their architectural differences, performance, and real-world applications. GPT-4, built upon the Transformer architecture, has set new standards in natural language processing (NLP) with its capacity to generate coherent and contextually relevant text across a wide range of tasks. However, its computational demands, requiring substantial hardware resources, make it less accessible for smaller organizations and real-time applications. In contrast, GPT-4o addresses these challenges by incorporating optimizations such as model compression, parameter pruning, and memory-efficient computation, allowing it to deliver similar performance with significantly lower computational …

An Analytical Review Of Preprocessing Techniques In Bengali Natural Language Processing, Sovon Chakraborty, Protiva Das, Shakib Mahmud Dipto, Md Aktaruzzaman Pramanik, Jannatun Noor

Computer Science Faculty Publications

Research in Bengali Natural Language Processing (BNLP) is rapidly expanding. Despite being one of the most widely spoken languages in the world, BNLP research remains insufficient, particularly in Bengali speech recognition. The languages rich morphology, agglutinative structure, and diverse dialects make text and speech processing especially challenging. However, these challenges can be addressed with effective preprocessing techniques. Various organizations in Bangladesh and West Bengal are integrating Natural Language Processing (NLP) into their services, but without a thorough understanding of preprocessing, these implementations remain incomplete. Applying proper preprocessing techniques to the Bengali language will serve as a foundation for developing robust …

Toward Embodied Navigation Through Vision And Language, Muraleekrishna Gopinathan

Theses: Doctorates and Masters

Embodied AI is a challenging but exciting field in which a robot learns to interact with human-living spaces to perform various tasks. This thesis studies the embodied navigation problem in which a robotic agent navigates in a previously unseen indoor environment based on a challenging task. In particular, the Vision-and-Language Navigation (VLN) task requires a robot to navigate based on a descriptive human-language instruction. This thesis aims to improve VLN agents on four key aspects - their understanding of the environment, training via additional data, correcting navigational errors, and predicting the layout of the environment for better planning.

First, we …

Pushing The Boundaries Of Large Language Models: Innovations And Limitations In Nlp, Finance, And Mathematics, A M Muntasir Rahman

Dissertations

Large Language Models (LLMs) have emerged as transformative tools across a spectrum of domains, yet their practical deployment reveals a blend of remarkable potential and notable limitations. This research explores innovative methodologies to extend the capabilities of LLMs while addressing critical challenges in their evaluation and application. By leveraging rule-based approaches, the in-context learning capabilities of LLMs, and human-in-the-loop validation across three focused studies, this research introduces robust strategies for dataset synthesis, model enhancement, and model assessment in three distinct domains: natural language processing, financial sentiment analysis, and mathematical reasoning

The first study proposes an efficient data augmentation framework, EASE, …

Sd-Weat: Towards Robustly Measuring Bias In Input Embeddings For Artificial Intelligence Language Models, Magnus Gray

Theses and Dissertations

Artificial intelligence (AI) is rapidly transforming industries and markets, from healthcare to entertainment, revolutionizing decision-making processes. However, as AI grow more influential, they also risk amplifying existing biases, potentially leading to harmful consequences. Recent advancements in large language models (LLMs), such as GPT-4 and Llama, have heightened concerns about bias in natural language processing (NLP) tasks, driving the need for robust methods to detect and mitigate bias. Current approaches, such as the Word Embedding Association Test (WEAT) and its sentence-level extension the Sentence Encoder Association Test (SEAT) often fall short in capturing the nuances of biases in the input embeddings …

Converting Vocal Performances Into Sheet Music Leveraging Large Language Models, Jinjing Jiang, Nicole Teo, Haibo Pen, Seng-Beng Ho, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Advanced natural language processing (NLP) models are increasingly applied in music composition and performance, particularly for generating vocal melodies and simulating singing voices. While NLP techniques have been effective in analyzing vocal performance data to assess quality and style, the automatic transcription of vocal performances into sheet music remains a significant challenge. Manual transcription tools often fall short due to the intricate dynamics of vocal expression. This study tackles the automation of vocal performance transcription into sheet music using innovative techniques, including large language models (LLMs). We propose a method to translate vocal audio input into display-ready sheet music effectively. …

Lova3 : Learning To Visual Question Answering, Asking And Assessment, Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Bai Shou, Mike Zheng Shou

Research Collection School Of Computing and Information Systems

Question answering, asking, and assessment are three innate human traits crucial for understanding the world and acquiring knowledge. By enhancing these capabilities, humans can more effectively utilize data, leading to better comprehension and learning outcomes. Current Multimodal Large Language Models (MLLMs) primarily focus on question answering, often neglecting the full potential of questioning and assessment skills. Inspired by the human learning mechanism, we introduce LOVA3 , an innovative framework named “Learning tO Visual question Answering, Asking and Assessment,” designed to equip MLLMs with these additional capabilities. Our approach involves the creation of two supplementary training tasks GenQA and EvalQA, aiming …

Self-Supervised Fine-Tuning For Neural Expert Finding, Budhitama Subagdja, Dan Sanchari, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Expert finding systems allow ones to find individuals who have expertise in specific fields or domains. Traditional expert finding are mostly based on topic modeling or keyword search methods that are limited in their capability to encode contextual knowledge from natural language. To address the limitation, this paper presents Neural Expert Finder (NEF), a novel method that takes a transfer learning approach based on transformer encoder networks to leverage the rich seman-tic and syntactic patterns of language encoded in pre-trained language models (PLMs). We propose a self-supervised learning approach utilizing contrastive training using both positive and automatically generated negative samples …