Digital Commons Network^™

Assessing The Robustness Of Test Selection Methods For Deep Neural Networks, Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Wei Ma, Mike Papadakis, Lei Ma, Yves Le Traon

Research Collection School Of Computing and Information Systems

Regularly testing deep learning-powered systems on newly collected data is critical to ensure their reliability, robustness, and efficacy in real-world applications. This process is demanding due to the significant time and human effort required for labeling new data. While test selection methods alleviate manual labor by labeling and evaluating only a subset of data while meeting testing criteria, we observe that such methods with reported promising results are simply evaluated, e.g., testing on original test data. The question arises: are they always reliable? In this article, we explore when and to what extent test selection methods fail. First, we identify …

How To Enable Effective Cooperation Between Humans And Nlp Models: A Survey Of Principles, Formalizations, And Beyond, Chen Huang, Yang Deng, Wenqiang Lei, Jiancheng Lv, Tat-Seng Chua, Jimmy Huang

Research Collection School Of Computing and Information Systems

With the advancement of large language models (LLMs), intelligent models have evolved from mere tools to autonomous agents with their own goals and strategies for cooperating with humans. This evolution has birthed a novel paradigm in NLP, i.e., human-model cooperation, that has yielded remarkable progress in numerous NLP tasks in recent years. In this paper, we take the first step to present a thorough review of human-model cooperation, exploring its principles, formalizations, and open challenges. In particular, we introduce a new taxonomy that provides a unified perspective to summarize existing approaches. Also, we discuss potential frontier areas and their corresponding …

Fact-Audit: An Adaptive Multi-Agent Framework For Dynamic Fact-Checking Evaluation Of Large Language Models, Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See-Kiong Ng, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have significantly advanced the fact-checking studies. However, existing automated fact-checking evaluation methods rely on static datasets and classification metrics, which fail to automatically evaluate the justification production and uncover the nuanced limitations of LLMs in fact-checking. In this work, we introduce FACT-AUDIT, an agent-driven framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities. Leveraging importance sampling principles and multi-agent collaboration, FACT-AUDIT generates adaptive and scalable datasets, performs iterative model-centric evaluations, and updates assessments based on model-specific responses. By incorporating justification production alongside verdict prediction, this framework provides a comprehensive and evolving audit of LLMs’ factual reasoning …

Beware Of Your Po! Measuring And Mitigating Ai Safety Risks In Role-Play Fine-Tuning Of Llms, Weixiang Zhao, Yulin Hu, Yang Deng, Jiahe Guo, Xingyu Sui, Xinyang Han, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu

Research Collection School Of Computing and Information Systems

Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and inaccurate responses. This highlights the critical need to understand the knowledge boundary of LLMs, a concept that remains inadequately defined in existing research. In this survey, we propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. Using this foundation, we systematically review the field through three key lenses: the motivation for studying LLM knowledge boundaries, …

Browsing Like Human: A Multimodal Web Agent With Experiential Fast-And-Slow Thinking, Haohao Luo, Jiayi Kuang, Wei Liu, Ying Shen, Jian Luan, Yang Deng

Research Collection School Of Computing and Information Systems

Automating web navigation which aims to build a web agent that follows user instructions to complete tasks like booking flights by interacting with websites, has received increasing attention due to its practical value. Although existing web agents are mostly equipped with visual perception, planning, and memory abilities, their reasoning process are still deviate from human cognition. In this work, we study the human thought pattern to empower agent with more human-like abilities in web navigation. To tackle this problem, we propose a novel multimodal web agent framework called WebExperT, which is designed to emulate the human planning process of “thinking …

A Review: The Beauty Of Serendipity Between Integrated Circuit Security And Artificial Intelligence, Chen Dong, Decheng Qiu, Bolun Li, Yang Yang, Chenxi Lyu, Dong Cheng, Hao Zhang, Zhenyi. Chen

Research Collection School Of Computing and Information Systems

Integrated circuits are the core of a cyber-physical system, where tens of billions of components are integrated into a tiny silicon chip to conduct complex functions. To maximize utilities, the design and manufacturing life cycle of integrated circuits rely on numerous untrustworthy third parties, forming a global supply chain model. At the same time, this model produces unpredictable and catastrophic issues, threatening the security of individuals and countries. As for guaranteeing the security of ultra-highly integrated chips, detecting slight abnormalities caused by malicious behavior in the current and voltage is challenging, as is achieving computability within a reasonable time and …

Causalabstain: Enhancing Multilingual Llms With Causal Reasoning For Trustworthy Abstention, Yuxi Sun, Aoqi Zuo, Wei Gao, Jing Ma

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) often exhibit knowledge disparities across languages. Encouraging LLMs to abstain when faced with knowledge gaps is a promising strategy to reduce hallucinations in multilingual settings. Current abstention strategies for multilingual scenarios primarily rely on generating feedback in various languages using LLMs and performing self-reflection. However, these methods can be adversely impacted by inaccuracies and biases in the generated feedback. To address this, from a causal perspective, we introduce CausalAbstain, a method that helps LLMs determine whether to utilize multiple generated feedback responses and how to identify the most useful ones. Extensive experiments demonstrate that CausalAbstain effectively …

Advancing Molecular Graph-Text Pre-Training Via Fine-Grained Alignment, Yibo Li, Yuan Fang, Mengmei Zhang, Chuan Shi

Research Collection School Of Computing and Information Systems

Understanding molecular structure and related knowledge is crucialfor scientific research. Recent studies integrate molecular graphswith their textual descriptions to enhance molecular representationlearning. However, they focus on the whole molecular graph andneglect frequently occurring subgraphs, known as motifs, whichare essential for determining molecular properties. Without suchfine-grained knowledge, these models struggle to generalize to un-seen molecules and tasks that require motif-level insights. To bridgethis gap, we propose FineMolTex, a novel Fine-grained Moleculargraph-Text pre-training framework to jointly learn coarse-grainedmolecule-level knowledge and fine-grained motif-level knowledge.Specifically, FineMolTex consists of two pre-training tasks: a con-trastive alignment task for coarse-grained matching and a maskedmulti-modal modeling task for …

Equivalence And Similarity Refutation For Probabilistic Programs, Krishnendu Chatterjee, Ehsan Kafshdar Goharshady, Petr Novotný, Dorde Zikelic

Research Collection School Of Computing and Information Systems

We consider the problems of statically refuting equivalence and similarity of output distributions defined by a pair of probabilistic programs. Equivalence and similarity are two fundamental relational properties of probabilistic programs that are essential for their correctness both in implementation and in compilation. In this work, we present a new method for static equivalence and similarity refutation. Our method refutes equivalence and similarity by computing a function over program outputs whose expected value with respect to the output distributions of two programs is different. The function is computed simultaneously with an upper expectation supermartingale and a lower expectation submartingale for …

L2m2: A Hierarchical Framework Integrating Large Language Model And Multi‑Agent Reinforcement Learning, Minghong Geng, Shubham Pateria, Budhitama Subagdja, Lin Li, Xin Zhao, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Multi-agent reinforcement learning (MARL) has demonstrated remarkable success in collaborative tasks, yet faces significant challenges in scaling to complex scenarios requiring sustained planning and coordination across long horizons. While hierarchical approaches help decompose these tasks, they typically rely on hand-crafted subtasks and domain-specific knowledge, limiting their generalizability. We present L2M2, a novel hierarchical framework that leverages large language models (LLMs) for high-level strategic planning and MARL for low-level execution. L2M2 enables zero-shot planning that supports both end-to-end training and direct integration with pre-trained MARL models. Experiments in the VMAS environment demonstrate that L2M2's LLM-guided MARL achieves superior performance while requiring …

Unfolding Particle Detector Effects And Solving Qcd Inverse Problem With Generative Ai, Tareq Saeed Alghamdi

Computer Science Theses & Dissertations

Advancements in artificial intelligence (AI) have revolutionized high-energy physics by enabling generative models to address key detector-related Challenges. This work explores the generative model to mitigate smearing, acceptance, and inefficiency in particle detectors, enhancing experimental precision.

We present a generative model-based framework to model and correct detector distortions. Using the Jefferson Lab CLAS g11 experiment as a case study, our approach successfully unfolds detector effects in multi-particle final states while preserving multidimensional correlations despite complex reaction mechanisms. A key focus is addressing the acceptance problem—accurately modeling detector acceptance without computationally expensive simulations. By training generative model-based framework on simulated detector …

Advancing Real-World Implementation Of The Well Optimized Linear Finder (Wolf) High-Speed Atmospheric Turbulence Compensation Method, Timothy Evan Coon

Theses and Dissertations

This dissertation advances the real-world implementation of the Well Optimized Linear Finder (WOLF) method for high-speed Atmospheric Turbulence Compensation (ATC). Atmospheric turbulence introduces phase aberrations into optical wavefronts and degrades image quality in terrestrial imaging systems. Traditional phase diversity methods are computationally intensive and poorly suited to real-time operation. The WOLF method addresses these limitations through a novel, point-wise formulation of the optical transfer function (OTF) as a structured autocorrelation of the generalized pupil function (GPF). This formulation enables the estimation of phase aberrations at individual spatial coordinates with distributed computational complexity.

The research begins by developing a MATLAB-based simulation …

Roadside Asset Extraction From Mobile Lidar Point Cloud, Yushin Ahn, Riadh Munjy, Stephen Choi

Mineta Transportation Institute

Mobile LiDAR systems are powerful tools that help us map roads and their surroundings in 3D with great speed and precision. The data provided by these systems support urban planning efforts, digital mapping, transportation infrastructure maintenance, and more. This report presents a comprehensive workflow for roadside asset extraction using Mobile Terrestrial Laser Scanning (MTLS) data, focusing on road lane detection, cross-section slope analysis, and point cloud classification. Roadside asset extraction is the identification and classification of roadside features like signs and poles. The dataset, acquired using a high-resolution mobile LiDAR system, contains over 5.7 billion points (pieces of data) across …

An Optimized Generalized Multi-Color Point Implicit Solver For Intel Gpus Using Intel Oneapis Esimd, Joseph Wassell

Computer Science Theses & Dissertations

The growing popularity of Computational Fluid Dynamics (CFD) simulations among engineers necessitates the use of GPU acceleration for increased efficiency. NASA FUN3D offers GPU accelerated CFD simulations using unstructured grids across the speed regime from incompressible to hypersonic flows involving reentry. This work focuses on the generalized multi-color point implicit solver used in FUN3D, accounting for roughly half of the run time. Specifically, this work focuses on developing three optimized multi-color linear-solver kernels for the Intel Data Center Max 1550 GPU that is available on the Argonne Leadership Computing Facility’s (ALCF) exascale machine, Aurora. These optimized kernels work for a …

Human Activity Recognition And Identification Driven Automated Deep Learning For Time-Series Classification, Justin Alan Gamble

Engineering Management & Systems Engineering Theses & Dissertations

The growing emphasis on Digital Engineering (DE) within the U.S. Department of Defense (DoD) demands advanced methods for leveraging vast time-series data generated by sensor-rich environments. Deep learning models offer promising solutions for complex timeseries classification tasks, however their design and optimization remain highly resource intensive, requiring specialized expertise. This dissertation addresses this challenge by developing and evaluating an Automated Machine Learning (AutoML) framework specifically tailored for the time-series classification task of Human Activity Recognition and Identification (HARI).

A systematic investigation was conducted using the Design Science Research Methodology (DSRM) comparing traditional search strategies of grid search and random search …

Input Structure Based Optimization For Privacy Preserving Ai Systems, Feng Yizhou

Electrical & Computer Engineering Theses & Dissertations

As Artificial Intelligence (AI) systems become increasingly integrated into critical domains, ensuring privacy-preserving model design and system deployment has become a pressing priority. Safeguarding both sensitive user data and proprietary model parameters is critical throughout the AI model and system, from data acquisition and pre-processing to model inference and deployment. However, existing privacy-preserving frameworks face several limitations, including fragmented data ownership, incomplete protection across system stages, substantial computational overhead, and poor scalability to modern architectures such as large language models. This dissertation explores a unifying optimization strategy centered on input structure design to address these challenges. The core idea is …

A Focus On Student Education: Determining Student Attitudes Towards Transparent Autograding And Developing Artificially Intelligent Tools To Help Students Succeed, Andra Rice

All Graduate Theses and Dissertations, Fall 2023 to Present

This thesis is composed of two parts both relating to helping students succeed. First, the focus is on determining how we can help students feel more comfortable using an AI tool that can provide them immediate feedback. Second, machine learning algorithms are explored in relation to tracking student tasks to encourage healthy study habits.

The development of effective autograders is key for scaling assessment and feedback. While AI based autograding systems for open-ended response questions have been found to be beneficial for providing immediate feedback, autograders are not always liked, understood, or trusted by students. Our research tested the effect …

Evaluating The Effects Of 3d User Interactions And Virtual Displays On Human Cognition And Perception For Immersive Analytics, Dongyun Han

All Graduate Theses and Dissertations, Fall 2023 to Present

This research investigates how virtual reality (VR) can be utilized effectively for users to explore data. Traditional data analysis typically takes place on flat, two-dimensional computer screens. In contrast, immersive technologies like VR offer a three-dimensional environment where users can engage with data more naturally and intuitively. Such immersive experiences have the potential to improve comprehension, memory, and insight during data analysis tasks. Despite this potential, several challenges remain in making immersive analytics practical and effective. Key questions include which types of 3D interaction techniques are most helpful and how accurately people perceive visual information in immersive environments. To address …

Ai In The Judiciary: The Singapore Case, Nydia Remolina Leon

Research Collection Yong Pung How School Of Law

This paper examines the integration of Artificial Intelligence (AI) within the judicial system of Singapore. Singapore's judiciary has embraced AI not as a tool for adjudication, but as an augmentative instrument for legal research, procedural efficiency, and access to justice. It provides a detailed account of AI use cases in the courts, including case summarization, evidence review, assistance for selfrepresented litigants, and tools like the Divorce Assets Informative Division Estimator. The discussion then turns to the legal profession, exploring how law firms in Singapore are adopting AI technologies. The paper also addresses how AI implementation in the judicial system is …

Beyond The Click: Investigating Mental Models, Targeted Attacks, And Behavioral Interventions Against Clickbait, Ankit Shrestha

All Graduate Theses and Dissertations, Fall 2023 to Present

Clickbait is misleading or exaggerated content on social media that tricks people into clicking on links by making them curious. For instance, posts that use headlines such as “This is the worst day to visit a restaurant”. These clickbait posts can lead to fake news, wrong information, and even harmful websites. Even though many people know clickbait can be risky, they often still fall for it. Existing tools to stop clickbait don’t always consider how people think, the situations they are in, or their different needs. This research looks at how people understand and react to clickbait, and develops different …

Low-Level Memory Attacks On Edge Assisted Robotic Applications, William Arnold

Master of Engineering Theses

This thesis investigates how low-level memory faults can undermine edge-assisted robotic systems that rely on memory optimization. As robots are utilized in real world applications, the ability to operate safely and successfully in mission critical deployment becomes important. To help achieve these goals, developers are increasingly starting to place computation nodes at network edges to meet latency and reliability requirements. Edge nodes, however, are resource-constrained and resources conservation techniques such as Kernel Same-page Merging (KSM) are enabled to deduplicate identical pages across processes or virtual machines. This thesis shows that this optimization technique quietly widens the attack surface and can …

Algebraic Multigrid Methods For Nonsymmetric And Indefinite Problems: Theory And Applications, Ahsan Ali

Mathematics & Statistics ETDs

Algebraic multigrid (AMG) is a well-established and highly efficient solver for symmetric positive definite (SPD) systems arising from elliptic and parabolic PDEs, while nonsymmetric systems from hyperbolic PDEs remain a significant challenge. This dissertation develops AMG methods and theory for nonsymmetric problems. First, we develop a novel approach combining mode constraints from energy-minimization AMG with local approximations of ideal restriction in $\ell$AIR, resulting in constrained $\ell$AIR (C$\ell$AIR), which demonstrates scalable convergence across advective and diffusive problems. Second, we extend optimal AMG theory by deriving spectral radius estimates for the two-grid error transfer operator using matrix-induced orthogonality, enabling convergence predictions for …

Learning From Conditional Data Distributions, Jizhou Huang

McKelvey School of Engineering Graduate Student Theses & Dissertations

Traditional machine learning paradigms often rely on a single global model trained on an entire dataset, aiming for broad generalization across all instances. However, in many real-world applications, the underlying data distribution is heterogeneous, and meaningful predictions often require models that focus on specific subpopulations rather than treating the data as a whole. This motivates the study of learning from conditional distributions, a framework where predictive models are designed to capture the structure and properties of restricted subsets of the data, leading to improved accuracy, fairness, and interpretability. This dissertation explores three key subproblems that exemplify different aspects of learning …

Gene Regulatory Network Prediction Using Machine Learning, Deep Learning, And Hybrid Approaches, Sai Teja Mummadi, Md Khairul Islam, Victor Busov, Hairong Wei

Michigan Tech Publications

Construction of gene regulatory networks (GRNs) is essential for elucidating the regulatory mechanisms underlying metabolic pathways, biological processes, and complex traits. In this study, we developed and evaluated machine learning, deep learning, and hybrid approaches for constructing GRNs by integrating prior knowledge and large-scale transcriptomic data from Arabidopsis thaliana, poplar, and maize. Among these, hybrid models that combined convolutional neural networks and machine learning consistently outperformed traditional machine learning and statistical methods, achieving over 95% accuracy on the holdout test datasets. These models not only identified a greater number of known transcription factors regulating the lignin biosynthesis pathway but also …

Comparative Study Of Machine Learning Models For Predicting The Market Value Of Professional Football Players, Álvaro Salvador López

Master's Theses or Doctor of Nursing Practice

The market value of professional football players is a critical factor in decision-making for clubs, agents, and analysts. Accurate player valuation impacts transfers, contract negotiations, and financial planning. In recent years, data-driven approaches have emerged to support traditional scouting with predictive analytics. This thesis presents a comparative study of machine learning models to estimate the market value of football players based on historical performance and personal attributes.

This thesis presents a comparative study of two independently developed machine learning systems designed to predict the market value of football players for the 2020–2021 season. Both systems were trained using real data …

Exploring Adversarial Threats To Neuralhash: A Perceptual Hashing Algorithm, Gurleen Kaur

Student Theses

Perceptual hashing algorithms are algorithms that generate content-based image hashes by extracting perceptual features from the images. Unlike cryptographic hashes, which exhibit significant changes with even slight input alterations, perceptual hashes do not change when modifications like compression, color correction and brightness are applied to the images. These hashes are designed to remain similar for inputs that are visually or perceptually alike, which has led to their widespread application in detecting duplicate images, finding similar images for reverse image search and to detecting inappropriate content of Child sexual abuse (CSAM) images by comparing image hashes with dataset of known perceptual …

Optimizing Distributed Boundary Exchanges For Benchmarks, Solvers And Sparse Matrix Operations, Gerald Collom

Computer Science ETDs

Boundary exchanges dominate the cost of both stenciled codes and those that rely on sparse matrix operations. The performance of large boundary exchanges is limited by synchronization overheads and injection bandwidth limitations. Irregular boundary exchanges incur additional overheads due to the large number of required messages. This thesis investigates multiple methods for improving the performance and scalability of both Cartesian and irregular boundary exchanges. Since boundary exchanges are typically performed iteratively, persistent communication presents an opportunity for optimization by sharing and amortizing setup costs. Partitioned communication is also explored to increase asynchrony, reducing bottlenecks from synchronization overheads and data congestion. …

Optimization And Model Averaging Of Histogram-Based Place Cell Firing Rate Maps Using The Point Process Framework, Murat Okatan

Turkish Journal of Electrical Engineering and Computer Sciences

The firing rate of hippocampal place cells depends on the spatial position of the organism in an environment. This position dependence is often quantified by constructing spike-in-location and time-in-location histograms, the ratio of which yields a firing rate map. The purpose of this study is to present a new method for optimizing the spatial resolution of histogram-based firing rate maps. It is pointed out that histogram-based firing rate maps are conditional intensity functions of inhomogeneous Poisson process models of neural spike trains, and, as such, they can be optimized through model selection within the point process framework. The point process …

Isar Imaging Of Drone Swarms At 77 Ghz, Remzi̇ye Büşra Çoruk, Ali̇ Kara, Eli̇f Aydin

Turkish Journal of Electrical Engineering and Computer Sciences

The proliferation of easily available, internet-purchased drones, coupled with the emergence of coordinated drone swarms, poses a significant security threat for airspace. Detecting these swarms is crucial to prevent potential accidents, criminal misuse, and airspace disruptions. This paper proposes a novel inverse synthetic aperture radar (ISAR) imaging technique for high-resolution reconstruction of drone swarms at 77 GHz millimeter wave (mmWave) frequency, offering a valuable tool for military and defense anti-drone systems. The key parameters affecting down-range and cross-range resolution (0.05 m), ultimately enabling the generation of detailed ISAR images are discussed. Here, we create diverse scenarios encompassing various swarm formations, …

Rescon: Residual Consistency For Real-World Super-Resolution, Erdi̇ Saritaş, Hazim Kemal Ekenel

Turkish Journal of Electrical Engineering and Computer Sciences

Real-world super-resolution is a highly challenging problem in the field of computer vision. Besides enhancing image resolution and improving visual details, information loss due to complex real-world degradations is desired to be restored. One of the primary hardness of this problem is finding sufficiently large paired datasets for training. Researchers have developed techniques that generate synthetic low-resolution pairs using high-resolution images with a generative adversarial network-based degradation generator to address this issue. In these approaches, the degradation generator is trained by utilizing real-world low-resolution images as the target domain, generating a degraded low-resolution counterpart of the high-resolution input. However, in …