Computer Sciences Commons^™

Fact-Checker: A Web Application For Leveraging Large Language Models For Fact-Checking Youtube Videos, Andrew R. Craig

Electronic Theses, Projects, and Dissertations

Fact-Checker is a web application that allows users to fact-check YouTube videos. It feeds YouTube’s closed captioning transcript to a large language model (LLM) to extract claims. It then uses multiple LLMs, such as Gemini, Llama, and Claude, to verify these claims. The modular design makes it easy to change to a different LLM or model if needed. The application is built using Python for access to Application Programming Interfaces (APIs) and Streamlit as the front-end framework. The utilization of Docker and Dockerfiles enables easy distribution and deployment. It enables the application to be deployed on almost any hardware platform …

Automated Chick Sexing Using Computer Vision, Marta Veganzones Rodriguez

Graduate Theses and Dissertations

This thesis presents two complementary approaches to chick sexing, a critical task in poultry production that demands accurate and early gender identification. By investigating both facial and vent-based modalities, we present two complementary methods that aim to improve the efficiency, scalability, and ethical standards of gender classification in day-old chicks through the use of computer vision and deep learning. The first approach draws inspiration from human facial gender recognition to introduce facial chick sexing, a minimally invasive technique that eliminates the need for expert knowledge. This system encompasses a complete pipeline that includes image acquisition, facial detection and alignment, keypoint …

Machine Learning Based Medical Ultrasound Image Classification And Grad-Cam Interpretation, Victoria C. Hemphill

All Theses

This work takes a step in creating a diagnostic tool for the classification decision process of Achilles tendinopathy using ultrasound images. An attention-based multiple instance learning model is developed to classify the images. Typically, doctors capture multiple ultrasound images of the Achilles tendon during a study to determine a complete diagnosis. Multiple instance models adopt this behavior by providing a single label for a set of instances (images). The images are grouped into ”bags” at the study level and passed into the model. The MIL model then uses its attention property to assign an importance score to each image to …

Evaluating And Mitigating Linguistic Discrimination In Large Language Models: Perspectives On Safety Equity And Knowledge Equity, Guoliang Dong, Haoyu Wang, Jun Sun, Xinyu Wang

Research Collection School Of Computing and Information Systems

By training on text in various languages, large language models (LLMs) typically possess multilingual support and demonstrate remarkable capabilities in solving tasks described in different languages. However, LLMs can exhibit linguistic discrimination due to the uneven distribution of training data across languages. That is, LLMs are hard to keep the consistency of responses when faced with the same task but depicted in different languages. In this study, we first explore the consistency in the LLMs’ outputs responding to queries in various languages from two aspects: safety and quality. We conduct this analysis with two datasets (AdvBench and NQ) based on …

Towards Context-Aware Traffic Classification Via Time-Wavelet Fusion Network, Ziming Zhao, Zhuoxue Song, Xiaofei Xie, Zhaoxuan Li, Jiongchi Yu, Fan Terry Zhang, Tingting Li

Research Collection School Of Computing and Information Systems

Encrypted traffic classification occupies a significant role in cybersecurity and network management. The existing encrypted traffic classification technology mostly relies on intra-flow semantics for extracting features. However, considering that some attack behaviors inherently have similar patterns to legitimate behaviors, and powerful adversaries could simulate benign users to conceal their attack intentions, intra-flow features may be similar between different categories. In this paper, we propose TrafficScope, a time-wavelet fusion network based on Transformer to enhance the performance of encrypted traffic classification. Specifically, in addition to using intra-flow semantics, TrafficScope also extracts contextual information to construct more comprehensive representations. Moreover, to cope …

Mpo: Multilingual Safety Alignment Via Reward Gap Optimization, Weixiang Zhao, Yulin Hu, Yang Deng, Tongtong Wu, Wenxuan Zhang, Jiahe Guo, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu

Research Collection School Of Computing and Information Systems

Large language models (LLMs) have become increasingly central to AI applications worldwide, necessitating robust multilingual safety alignment to ensure secure deployment across diverse linguistic contexts. Existing preference learning methods for safety alignment, such as RLHF and DPO, are primarily monolingual and struggle with noisy multilingual data. To address these limitations, we introduce Multilingual reward gaP Optimization (MPO), a novel approach that leverages the well-aligned safety capabilities of the dominant language (e.g., English) to improve safety alignment across multiple languages. MPO directly minimizes the reward gap difference between the dominant language and target languages, effectively transferring safety capabilities while preserving the …

Leveraging Reviewer Experience In Code Review Comment Generation, Hong Yi Lin, Patanamon Thongtanunam, Christoph Treude, Michael W. Godfrey, Chunhua Liu, Wachiraphan Charoenwet

Research Collection School Of Computing and Information Systems

Modern code review is a ubiquitous software quality assurance process aimed at identifying and resolving potential issues (e.g., functional, evolvability) within newly written code. Despite its effectiveness, the process demands large amounts of effort from the human reviewers involved. To help alleviate this workload, researchers have trained various deep learning based language models to imitate human reviewers in providing natural language code reviews for submitted code. Formally, this automation task is known as code review comment generation. Prior work has demonstrated improvements in code review comment generation by leveraging machine learning techniques and neural models, such as transfer learning and …

Gcot: Chain-Of-Thought Prompt Learning For Graphs, Xingtong Yu, Chang Zhou, Zhongwei Kuai, Xinming Zhang, Yuan Fang

Research Collection School Of Computing and Information Systems

Chain-of-thought (CoT) prompting has achieved remarkable success in natural language processing (NLP). However, its vast potential remains largely unexplored for graphs. This raises an interesting question: How can we design CoT prompting for graphs to guide graph models to learn step by step? On one hand, unlike natural languages, graphs are non-linear and characterized by complex topological structures. On the other hand, many graphs lack textual data, making it difficult to formulate language-based CoT prompting. %Therefore we cannot directly adopt the CoT prompting methods used in the language domain. In this work, we propose the first CoT prompt learning framework …

Quantizing Text-Attributed Graphs For Semantic-Structural Integration, Jianyuan Bo, Hao Wu, Yuan Fang

Research Collection School Of Computing and Information Systems

Text-attributed graphs (TAGs) have emerged as a powerful representation for modeling complex relationships across diverse domains. With the rise of large language models (LLMs), there is growing interest in leveraging their capabilities for graph learning. However, current approaches face significant challenges in embedding structural information into LLM-compatible formats, requiring either computationally expensive alignment mechanisms or manual graph verbalization techniques that often lose critical structural details. Moreover, these methods typically require labeled data from source domains for effective transfer learning, significantly constraining their adaptability. We propose STAG, a novel self-supervised framework that directly quantizes graph structural information into discrete tokens using …

Ai-Assisted Triage And Decision Support Of Head And Neck Cancer Screening And Diagnosis In Low-Resourced Settings, Min Hun Lee, Sean Shao Wei Lam, Shaun Xin Hong Liew, Michael Dorosan, Nicholas Graves, Jonas Karlström, Hiang Khoon Tan, Walter Tsong Lee

Research Collection School Of Computing and Information Systems

The mortality burden of head and neck cancer (HNC) is increasing globally and disproportionately affects people in low-and middle-income countries with limited medical workforce. To address this issue, artificial intelligence (AI) algorithms are increasingly being explored to process medical imaging data, demonstrating competitive performance. However, the clinical adoption of AI remains challenging as clinicians struggle to understand how complex AI works and trust it to use in practice. In addition, AI may not perform well on varying data qualities of endoscopy videos for HNC screening and diagnosis from multiple sites.In this project, our international and interdisciplinary team will collaborate with …

Causalabstain: Enhancing Multilingual Llms With Causal Reasoning For Trustworthy Abstention, Yuxi Sun, Aoqi Zuo, Wei Gao, Jing Ma

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) often exhibit knowledge disparities across languages. Encouraging LLMs to abstain when faced with knowledge gaps is a promising strategy to reduce hallucinations in multilingual settings. Current abstention strategies for multilingual scenarios primarily rely on generating feedback in various languages using LLMs and performing self-reflection. However, these methods can be adversely impacted by inaccuracies and biases in the generated feedback. To address this, from a causal perspective, we introduce CausalAbstain, a method that helps LLMs determine whether to utilize multiple generated feedback responses and how to identify the most useful ones. Extensive experiments demonstrate that CausalAbstain effectively …

Connecting Giants: Synergistic Knowledge Transfer Of Large Multimodal Models For Few-Shot Learning, Hao Tang, Shengfeng He, Jing Qin

Research Collection School Of Computing and Information Systems

Few-shot learning (FSL) addresses the challenge of classifying novel classes with limited training samples. While some methods leverage semantic knowledge from smaller-scale models to mitigate data scarcity, these approaches often introduce noise and bias due to the data's inherent simplicity. In this paper, we propose a novel framework, Synergistic Knowledge Transfer (SYNTRANS), which effectively transfers diverse and complementary knowledge from large multimodal models to empower the off-the-shelf few-shot learner. Specifically, SYNTRANS employs CLIP as a robust teacher and uses a few-shot vision encoder as a weak student, distilling semantic-aligned visual knowledge via an unsupervised proxy task. Subsequently, a training-free synergistic …

Fine‑Tuning Multimodal Large Language Models For Product Bundling, Xiaohao Liu, Jie Wu, Zhulin Tao, Yunshan Ma, Yinwei Wei, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context Learning (ICL) to explore the potential of large language models (LLMs) for their extensive knowledge and complex reasoning abilities. However, these efforts are inadequate in understanding mulitmodal data and exploiting LLMs' knowledge for product bundling. To bridge the gap, we introduce Bundle-MLLM, a novel framework that fine-tunes LLMs through a hybrid item tokenization approach within a well-designed optimization strategy. Specifically, we integrate textual, media, and relational data into a unified …

Affinitytune: A Prompt-Tuning Framework For Few-Shot Anomaly Detection On Graphs, Jingyan Chen, Guanghui Zhu, Guansong Pang, Chunfeng Yuan, Yihua Huang

Research Collection School Of Computing and Information Systems

Graph anomaly detection (GAD) is a critical task with applications in domains such as networking, finance, and bioinformatics. % However, the scarcity of labeled anomalies and the limitations of unsupervised methods hinder effective detection. % While semi-supervised and few-shot learning approaches offer improvements, they struggle with knowledge transfer and rely heavily on labeled data. % Recent advancements in prompt tuning on graphs provide a promising direction, but their application to heterophilous graphs in anomaly detection remains underexplored. % In this work, we propose AffinityTune, a novel framework for few-shot graph anomaly detection based on prompt tuning. % Our approach introduces …

Computational Fact-Checking With Limited Resources, Fengzhu Zeng

Dissertations and Theses Collection (Open Access)

The rapid dissemination of information through online platforms has sparked widespread concern about the propagation of misinformation. Manual fact-checking by pro- fessional fact-checkers is time-consuming and lacks scalability to address the vast volume of daily information. Consequently, computational fact-checking, driven by automated techniques in natural language processing (NLP), has garnered interest as
a potential solution. However, computational fact-checking faces critical challenges limited resources, particularly due to the issues of data scarcity and computing resource constraints. One key challenge is data scarcity, which arises from the constant generation of new information and emerging events on social media. This scarcity manifests in …

Evometric: An Interactive Framework For Scalable Visual Analytics Of Time Series Data With Dynamic Changes., Jiahang Huang

Electronic Theses and Dissertations

In today's data-intensive landscape, rapid advances in digital sensing and recording technologies have enabled the acquisition of high-resolution multimodal time series data, capturing intricate real-world dynamics across various domains such as healthcare, behavioral science, and environmental monitoring. However, the complexity and scale of these datasets present significant analytical challenges, particularly in understanding dynamic changes at both individual and cohort levels. This dissertation introduces EvoMetric, a novel visual analytics framework designed to support scalable exploration and analysis of large-scale multimodal time series data with dynamic changes. EvoMetric seamlessly integrates individual-level temporal dynamics with population-level comparative insights, enabling users to visually …

Revolutionizing Digital Privacy Education For Older Adults: Enhanced Interventions And Ai-Assisted Learning Strategies, Heba Aly

All Dissertations

As older adults increasingly engage with digital platforms, they face unique privacy risks stemming from limited digital literacy, reduced trust in AI technologies, and constrained access—especially in rural or underserved communities. While digital tools offer benefits like social connection and information access, current privacy education efforts often neglect the needs of older adults. This dissertation addresses this gap by developing, testing, and refining digital privacy education interventions tailored for older adults, with a focus on trust, personalization, and AI-assisted learning.

Study 1 evaluates multiple instructional modalities across age groups, revealing older adults prefer structured videos and interactive tutorials, while younger …

Towards Securing Ai Systems: Investigating Threats In Multimodal Autonomous Driving & Rag Systems, Saket Sanjeev Chaturvedi

All Dissertations

Artificial Intelligence (AI) systems have become central to high-stakes applications such as autonomous driving and language-based decision support. As their deployment accelerates, ensuring the security and trustworthiness of these systems becomes paramount. Among the most stealthy and potent threats are backdoor attacks, where models behave as expected under normal conditions but exhibit malicious behavior when triggered by specific inputs, either digital or physical.

This thesis investigates novel backdoor and adversarial vulnerabilities across two emerging classes of AI architectures: (1) multimodal 3D object detection systems that fuse LiDAR and camera data, and (2) Retrieval-Augmented Generation (RAG) systems that pair large language …

Three Essays In The Economics Of Disagreements: Incentives, Measurement And Persistence, Mustafa W. Alam

All Dissertations

This dissertation presents three chapters that contribute to the study of economic forces shaping disagreements in society.

In Chapter 1, I demonstrate that political polarization can intensify due to innovations in the information market even if a population's ideological distribution is fixed. Viewership-maximizing news firms cater to a diverse audience who assess source accuracy using noisy private signals that vary in precision and ideological bias. If better-informed consumers disproportionately migrate to newer platforms for news (e.g., the Internet), traditional media firms increase news slant to appeal more to less-informed partisans on both sides of the ideological spectrum. This leads to …

Reimagining Education With Ai, Margherita Pagani, Steven M. Miller, Jerry Wind

Research Collection School Of Computing and Information Systems

This chapter examines AI’s transformative potential in education, focusing on Generative AI (GenAI) and Large Language Models (LLMs) while at the same time emphasizing the importance of grounding and guiding AI efforts with learning science and education research findings. It synthesizes analyses and expert recommendations, highlighting opportunities like personalized learning and enhanced teacher productivity, alongside challenges such as over-reliance on AI. Practical steps for instructors include adopting a question-first approach, utilizing AI for personalized feedback, designing AI-enhanced learning experiences, fostering critical thinking, and ensuring ethical AI use. The chapter concludes with strategic recommendations for leveraging AI to sustainably improve educational …

L2m2: A Hierarchical Framework Integrating Large Language Model And Multi‑Agent Reinforcement Learning, Minghong Geng, Shubham Pateria, Budhitama Subagdja, Lin Li, Xin Zhao, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Multi-agent reinforcement learning (MARL) has demonstrated remarkable success in collaborative tasks, yet faces significant challenges in scaling to complex scenarios requiring sustained planning and coordination across long horizons. While hierarchical approaches help decompose these tasks, they typically rely on hand-crafted subtasks and domain-specific knowledge, limiting their generalizability. We present L2M2, a novel hierarchical framework that leverages large language models (LLMs) for high-level strategic planning and MARL for low-level execution. L2M2 enables zero-shot planning that supports both end-to-end training and direct integration with pre-trained MARL models. Experiments in the VMAS environment demonstrate that L2M2's LLM-guided MARL achieves superior performance while requiring …

Collisionrepair: First‑Aid And Automated Patching For Storage Collision Vulnerabilities In Smart Contracts, Yu Pan, Wanjing Han, Yue Duan, Mu Zhang

Research Collection School Of Computing and Information Systems

Storage collision vulnerabilities, a significant security risk in upgradeable smart contracts, often arise when a user-facing proxy contract and a backend logic contract share storage space. While static analysis techniques can detect such issues, they often over-approximate program states, leading to false positives and requiring developers to manually verify each issue, giving attackers time to exploit any overlooked vulnerabilities. To address this, we propose COLLISIONREPAIR, an automated patching technique for mitigating storage collision risks. COLLISIONREPAIR monitors storage access sequences between proxy and logic contracts by defining an "ownership" property for storage locations. It then replays historical transactions to recover existing …

L3net: Localized And Layered Reparameterization For Incremental Learning, Xuandi Luo, Huaidong Zhang, Yi Xie, Hongrui Zhang, Xuemiao Xu, Shengfeng He

Research Collection School Of Computing and Information Systems

Model-based class incremental learning (CIL) methods aim to address the challenge of catastrophic forgetting by retaining certain parameters and expanding the model architecture. However, retaining too many parameters can lead to an overly complex model, increasing inference overhead. Additionally, compressing these parameters to reduce the model size can result in performance degradation. To tackle these challenges, we propose a novel three-stage CIL framework called Localized and Layered Reparameterization for Incremental Learning (L3Net). The rationale behind our approach is to balance model complexity and performance by selectively expanding and optimizing critical components. Specifically, the framework introduces a Localized Dual-path Expansion structure, …

Wildfires Classification In Canadian Boreal Forest: A Comparative Study Of Logistic Regression And Xgboost Models, Brandon Tran, Elijah James Duran, Mike Luu, Hesham Morgan, Surendra Maharjan, Wenzhao Li, Hesham El-Askary

Mathematics, Physics, and Computer Science Faculty Articles and Research

In recent years, Canada has faced a growing number of wildfires. These events have devastated ecosystems, displaced communities, and posed severe health risks. To minimize the damage caused by such disasters, this study aims to develop an early warning system that predicts wildfire occurrences. Two machine learning models for binary classification of wildfire occurrence in Canadian wild forests, Logistic regression and XGBoost, will be compared and evaluated. The models are used to predict the likelihood of wildfire events based on various environmental and climatic factors. The models are evaluated using a 70-30 split validation approach and their performance is assessed …

Out-Of-Band Anomaly Detection For Real Time Operating Systems, Jeffrey K. Holifield

Graduate Theses and Dissertations (2019 - present)

Real Time Operating Systems (RTOS) are increasing present throughout the industrial, business, defense, and healthcare spaces. These lightweight and efficient operating systems are designed to run on embedded, resource constrained devices, often within cyber-physical systems (CPS). A defining characteristic ofRTOSs is that they are deterministic. Tasks are scheduled to run on fixed timelines within guaranteed execution windows. In Industry 4.0 applications for example, sensors must receive and process inputs within a fixed schedule to ensure products are properly manufactured. This requires guaranteed service at fixed time periods. To accomplish this, RTOSs must conform to worst case execution times (WCETs) as …

Greening The Virtual: An Interdisciplinary Narrative Review On The Environmental Sustainability Of The Metaverse, Mousa Al-Kfairy

All Works

As the Metaverse continues to evolve as a transformative digital ecosystem, its environmental implications remain insufficiently examined within academic discourse. Despite growing interest in its technological and societal impacts, there is a lack of comprehensive evaluations that synthesize existing knowledge on its sustainability potential. This interdisciplinary narrative review addresses this gap by critically exploring how Metaverse technologies intersect with environmental sustainability across key sectors, including education, healthcare, tourism, e-commerce, manufacturing, and urban development. Employing a narrative review methodology informed by a systematic selection of scholarly and industry sources, the study consolidates current practices, emerging opportunities, and notable trade-offs. While the …

Algorithmic Recourse In Sequential Decision-Making For Long-Term Fairness, Francisco Gumucio

Graduate Theses and Dissertations

Algorithmic decision-making systems are increasingly being deployed in high-stakes domains such as criminal justice, education, and financial services. While machine learning models have demonstrated significant utility in automating complex decisions, they have also raised substantial concerns regarding fairness and equity. Much of the existing work in algorithmic fairness has focused on static, one-shot settings, where interventions are aimed at miti- gating bias in a single decision. However, many real-world systems operate sequentially, where decisions made at one point in time can influence future outcomes through dynamic feedback loops. In such scenarios, addressing fairness at only one decision point can be …

Evaluating The Effects Of 3d User Interactions And Virtual Displays On Human Cognition And Perception For Immersive Analytics, Dongyun Han

All Graduate Theses and Dissertations, Fall 2023 to Present

This research investigates how virtual reality (VR) can be utilized effectively for users to explore data. Traditional data analysis typically takes place on flat, two-dimensional computer screens. In contrast, immersive technologies like VR offer a three-dimensional environment where users can engage with data more naturally and intuitively. Such immersive experiences have the potential to improve comprehension, memory, and insight during data analysis tasks. Despite this potential, several challenges remain in making immersive analytics practical and effective. Key questions include which types of 3D interaction techniques are most helpful and how accurately people perceive visual information in immersive environments. To address …

From Supercomputers To Desktops: An Interactive And Portable System For Particle In Cell Simulation And Visualization Using Commodity Hardware, Kim Peterson

All Graduate Theses and Dissertations, Fall 2023 to Present

Generating and analyzing visual representations of simulation data in real time (i.e., during execution), has become increasingly important for handling the complexity and scale of modern computational models. Traditionally, this approach has been limited to High-Performance Computing (HPC) environments, leaving some researchers, students and educators without resources to explore cutting-edge simulations and analyses. This work attempts to show that powerful scientific simulations and real-time analysis can be made available by using more easily obtained commodity hardware. This approach may enable a broader participation in the scientific computing discovery process.

In this paper, we explore how advanced simulation and visualization frameworks …

A Focus On Student Education: Determining Student Attitudes Towards Transparent Autograding And Developing Artificially Intelligent Tools To Help Students Succeed, Andra Rice

All Graduate Theses and Dissertations, Fall 2023 to Present

This thesis is composed of two parts both relating to helping students succeed. First, the focus is on determining how we can help students feel more comfortable using an AI tool that can provide them immediate feedback. Second, machine learning algorithms are explored in relation to tracking student tasks to encourage healthy study habits.

The development of effective autograders is key for scaling assessment and feedback. While AI based autograding systems for open-ended response questions have been found to be beneficial for providing immediate feedback, autograders are not always liked, understood, or trusted by students. Our research tested the effect …