Digital Commons Network^™

Building Narratives And Probing Concepts: Preparing Materials For Co-Design With Autistic Livestreamers, Terrance Mok, Tyson Hartley, Anthony Tang, Adam Mccrimmon, Lora Oehlberg

Research Collection School Of Computing and Information Systems

Based on ten semi-structured interviews with autistic Twitch streamers, we introduce a series of scenario-based design narratives coupled with technology design concepts as a starting point for co-design discussion about autistic streaming. This work builds on prior thematic analysis of the unique intersection between autism and livestreaming. Our user-centered scenarios highlight the needs, goals, and challenges of autistic individuals in livestreaming contexts. By using evocative narratives, the scenarios serve to facilitate empathy and deeper engagement with the needs of autistic users, and help facilitate and support co-creative dialogues and discussions about new technology designs. We contribute this starting point for …

Chatgpt’S Performance Evaluation In Spreadsheets Modeling To Inform Assessments Redesign, Michelle L. F. Cheong

Research Collection School Of Computing and Information Systems

Background: Increasingly, students are using ChatGPT to assist them in learning and even completing their assessments, raising concerns of academic integrity and loss of critical thinking skills. Many articles suggested educators to redesign assessments which are more “Generative-AI-resistant” and to focus on assessing students on higher order thinking skills. However, there is a lack of articles that attempt to quantify assessments at different cognitive levels to provide empirical study insights on ChatGPT’s performance at different levels, which will affect how educators redesign their assessments.Objectives: Educators need new information on how well ChatGPT performs to redesign future assessments to assess their …

Outperforming The Best With Minimal Effort: Algorithm Selection For Constrained Multi-Objective Optimization, Mustafa Misir, Aldy Gunawan

Research Collection School Of Computing and Information Systems

The present study performs algorithm selection on a suite of optimization algorithms targeting the constrained multi-objective optimization problems. The idea is to utilize the existing, relevant algorithmic experience in the literature to deliver an improved solver with limited effort. The reason being that algorithm development, in general, is a challenging and time-consuming process, especially with the goal of outperforming the existing methods from varying perspectives such as performance, speed, and robustness. Concerning the multi-objective optimization problems, the required development efforts happen to be even harder than addressing the single-objective ones. Furthermore, referring to the fact that the number of candidate …

Contested: Consistency-Aided Tested Code Generation With Llm, Jinhao Dong, Jun Sun, Wenjie Zhang, Jinsong Dong, Dan Hao

Research Collection School Of Computing and Information Systems

Recent advancements in large language models (LLMs) have significantly improved code generation, which generates code snippets automatically based on natural language requirements. Despite achieving state-of-the-art performance, LLMs often struggle to generate accurate and reliable code, requiring developers to spend substantial effort debugging and evaluating the generated output. Researchers have proposed leveraging Consistency to select code that passes more tests (inter-consistency) and demonstrates consistent behavior across more counterparts (intra-consistency). However, since the tests themselves are also generated by LLMs, relying on majority voting based on incorrect tests leads to unreliable results. To address this, we propose a lightweight interaction framework that …

Alayadb: The Data Foundation For Efficient And Effective Long-Context Llm Inference, Yangshen Deng, Zhengxin You, Long Xiang, Qilong Li, Peiqi Yuan, Zhaoyang Hong, Yitao Zheng, Wanting Li, Runzhong Li, Haotian Liu, Kyriakos Mouratidis, Man Lung Yiu, Huan Li, Qiaomu Shen, Rui Mao, Bo Tang

Research Collection School Of Computing and Information Systems

AlayaDB is a cutting-edge vector database system natively architected for efficient and effective long-context inference for Large Language Models (LLMs) at AlayaDB AI. Specifically, it decouples the KV cache and attention computation from the LLM inference systems, and encapsulates them into a novel vector database system. For the Model as a Service providers (MaaS), AlayaDB consumes fewer hardware resources and offers higher generation quality for various workloads with different kinds of Service Level Objectives (SLOs), when compared with the existing alternative solutions (e.g., KV cache disaggregation, retrieval-based sparse attention). The crux of AlayaDB is that it abstracts the attention computation …

De-Duplicating Silent Compiler Bugs Via Deep Semantic Representation, Junjie Chen, Xingyu Fan, Chen Yang, Shuang Liu, Jun Sun

Research Collection School Of Computing and Information Systems

The compiler bug duplication problem (where many test failures are caused by the same compiler bug) can lead to huge waste of time and resource in diagnosing test failures produced by compiler testing. It is particularly challenging with regard to the silent compiler bugs that do not produce any error messages. To address this problem, multiple white-box techniques were proposed, but they are inapplicable in many practical scenarios. Black-box techniques are more practical, but the existing ones are less effective as they often rely on irrelevant syntactic information. To bridge this gap, we propose a novel black-box technique (BLADE), which …

Lessons Learned From Sandboxing, Piloting And Policy Experimentation With Ai And Other Digital Initiatives: Part 2, Ten In-Depth Interviews, Steven M. Miller

Research Collection School Of Computing and Information Systems

This report, "Lessons Learned from Sandboxing, Piloting and Policy Experimentation with AI and Other Digital Initiatives," captures insights and experiences from project experts involved in recent digital innovation initiatives with the governments of Bangladesh, Maldives, and Kazakhstan, and from project experts actively involved with the use of AI for delivering government digital services in the EU, New Zealand, Rwanda, Singapore, United States, and Uzbekistan. The ten in-depth interview write-ups produced from these nine different country settings provide a small but highly informative sample of rich descriptions of some of the important realities, approaches, nuances, issues and challenges related to testing …

On-Demand Scenario Generation For Testing Automated Driving Systems, Songyang Yan, Xiaodong Zhang, Kunkun Hao, Haojie Xin, Yonggang Luo, Jucheng Yang, Ming Fan, Chao Yang, Jun Sun, Zijiang Yang

Research Collection School Of Computing and Information Systems

The safety and reliability of Automated Driving Systems (ADS) are paramount, necessitating rigorous testing methodologies to uncover potential failures before deployment. Traditional testing approaches often prioritize either natural scenario sampling or safety-critical scenario generation, resulting in overly simplistic or unrealistic hazardous tests. In practice, the demand for natural scenarios (e.g., when evaluating the ADS's reliability in real-world conditions), critical scenarios (e.g., when evaluating safety in critical situations), or somewhere in between (e.g., when testing the ADS in regions with less civilized drivers) varies depending on the testing objectives. To address this issue, we propose the On-demand Scenario Generation (OSG) Framework, …

A Comprehensive Study Of Oop-Related Bugs In C++ Compilers, Bo Wang, Chong Chen, Junjie Chen, Bowen Xu, Chen Ye, Youfang Lin, Guoliang Dong, Jun Sun

Research Collection School Of Computing and Information Systems

Modern C++, a programming language characterized by its extensive use of object-oriented programming (OOP) features, is widely used for system programming. However, C++ compilers often struggle to correctly handle these sophisticated OOP features, resulting in numerous high-profile compiler bugs that can lead to crashes or miscompilation. Despite the significance of OOP-related bugs, existing studies largely overlook OOP features, hindering their ability to discover such bugs. To assist both compiler fuzzer designers and compiler developers, we conduct a comprehensive study of the compiler bugs caused by incorrectly handling C++ OOP-related features. First, we systematically extract 788 OOP-related C++ compiler bugs from …

Reaccept: Automated Co-Evolution Of Production And Test Code Based On Dynamic Validation And Large Language Models, Jianlei Chi, Xiaotian Wang, Yuhan Huang, Lechen Yu, Di Cui, Jianguo Sun, Jun Sun

Research Collection School Of Computing and Information Systems

Synchronizing production and test code, known as PT co-evolution, is critical for software quality. Given the significant manual effort involved, researchers have tried automating PT co-evolution using predefined heuristics and machine learning models. However, existing solutions are still incomplete. Most approaches only detect and flag obsolete test cases, leaving developers to manually update them. Meanwhile, existing solutions may suffer from low accuracy, especially when applied to real-world software projects. In this paper, we propose ReAccept, a novel approach leveraging large language models (LLMs), retrievalaugmented generation (RAG), and dynamic validation to fully automate PT co-evolution with high accuracy. ReAccept employs an …

Lessons Learned From Sandboxing, Piloting And Policy Experimentation With Ai And Other Digital Initiatives: Part 1, Summary Report, Steven M. Miller

Research Collection School Of Computing and Information Systems

This report, "Lessons Learned from Sandboxing, Piloting and Policy Experimentation with AI and Other Digital Initiatives," captures insights and experiences from project experts involved in recent digital innovation initiatives with the governments of Bangladesh, Maldives, and Kazakhstan, and from project experts actively involved with the use of AI for delivering government digital services in the EU, New Zealand, Rwanda, Singapore, United States, and Uzbekistan. The ten in-depth interview write-ups produced from these nine different country settings provide a small but highly informative sample of rich descriptions of some of the important realities, approaches, nuances, issues and challenges related to testing …

Moditector: Module-Directed Testing For Autonomous Driving Systems, Renzhi Wang, Mingfei Cheng, Xiaofei Xie, Yuan Zhou, Lei Ma

Research Collection School Of Computing and Information Systems

Testing Autonomous Driving Systems (ADSs) is crucial for ensuring their safety, reliability, and performance. Despite numerous testing methods available that can generate diverse and challenging scenarios to uncover potential vulnerabilities, these methods often treat ADS as a black-box, primarily focusing on identifying system-level failures like collisions or near-misses without pinpointing the specific modules responsible for these failures. This lack of root causes understanding for the failures hinders effective debugging and subsequent system repair. Furthermore, current approaches often fall short in generating violations that adequately test the individual modules of an ADS from a system-level perspective, such as perception, prediction, planning, …

Cashift: Benchmarking Log-Based Cloud Attack Detection Under Normality Shift, Jiongchi Yu, Xiaofei Xie, Qiang Hu, Bowen Zhang, Ziming Zhao, Yun Lin, Lei Ma, Ruitao Feng, Frank Liau

Research Collection School Of Computing and Information Systems

With the rapid advancement of cloud-native computing, securing cloud environments has become an important task. Log-based Anomaly Detection (LAD) is the most representative technique used in different systems for attack detection and safety guarantee, where multiple LAD methods and relevant datasets have been proposed. However, even though some of these datasets are specifically prepared for cloud systems, they only cover limited cloud behaviors and lack information from a whole-system perspective. Another critical issue to consider is normality shift, which implies that the test distribution could differ from the training distribution and highly affect the performance of LAD. Unfortunately, existing works …

Regtrieve: Reducing System-Level Regression Errors For Machine Learning Systems Via Retrieval-Enhanced Ensemble, Junming Cao, Xuwen Xiang, Mingfei Cheng, Bihuan Chen, Xinyan Wang, You Lu, Chaofeng Sha, Xiaofei Xie, Xin Peng

Research Collection School Of Computing and Information Systems

Multiple machine learning (ML) models are often incorporated into real-world ML systems. However, updating an individual model in these ML systems frequently results in regression errors, where the new model performs worse than the old model for some inputs. While model-level regression errors have been widely studied, little is known about how regression errors propagate at system level. To address this gap, we propose RegTrieve, a novel retrieval-enhanced ensemble approach to reduce regression errors at both model and system level. Our evaluation across various model update scenarios shows that RegTrieve reduces system-level regression errors with almost no impact on system …

Hd-Epic: A Highly-Detailed Egocentric Video Dataset, Toby Perrett, Ahmad Darkhalil, Saptarshi Sinha, Omar Emara, Sam Pollard, Kranti Kumar Parida, Kaiting Liu, Prajwal Gatti, Siddhant Bansal, Kevin Flanagan, Jacob Chalk, Zhifan Zhu, Rhodri Guerrier, Fahd Abdelazim, Bin Zhu, Davide Moltisanti, Michael Wray, Hazel Doughty, Dima Damen

Research Collection School Of Computing and Information Systems

We present a validation dataset of newly-collected kitchenbased egocentric videos, manually annotated with highly detailed and interconnected ground-truth labels covering: recipe steps, fine-grained actions, ingredients with nutritional values, moving objects, and audio annotations. Importantly, all annotations are grounded in 3D through digital twinning of the scene, fixtures, object locations, and primed with gaze. Footage is collected from unscripted recordings in diverse home environments, making HDEPIC the first dataset collected in-the-wild but with detailed annotations matching those in controlled lab environments. We show the potential of our highly-detailed annotations through a challenging VQA benchmark of 26K questions assessing the capability to …

Human-Computer Interaction And Artificial Intelligence For Ageing Population, Keng Siau, Hailiang Wang, Fiona Fui-Hoon Nah, Runyu Wang, Ruitong Che, Can Liu

Research Collection School Of Computing and Information Systems

As the global population ages rapidly, the field of human-computer interaction (HCI) is in urgent need of innovation, redesign, and reengineering to meet the evolving needs of older adults. The older demographic faces a range of challenges—including physical limitations, cognitive decline, reduced social in-tegration, and varying levels of technological literacy—that can hinder effective engagement with digital technologies. In response to these challenges, research-ers and designers are using inclusive and adaptive approaches to enhance acces-sibility, usability, and emotional well-being. This paper reviews key design prin-ciples in HCI for the ageing population and discusses how artificial intelligence (AI) tools, such as voice …

Unlocking The Power Of Socio-Knowledge Association For Enterprise Risk Identification In Stock Market, Zhenghao Liu, Keng Siau, Shaochen Yang, Feicheng Ma

Research Collection School Of Computing and Information Systems

Potential risk signals reflected in supply chain and equity connections between enterprises and social connections between investors are becoming crucial to identifying enterprise risks in addition to basic financial indicators. Traditional risk management systems face challenges in adapting to these complexities, highlighting the need for a proactive paradigm shift in risk management. Leveraging graph models such as social networks and knowledge graphs offers a promising approach to identifying and managing potential associated risks effectively. To bridge existing research gaps, a novel risk identification framework driven by social-knowledge graphs has been proposed, integrating graph deep learning and reinforcement learning techniques guided …

Hvi: A New Color Space For Low-Light Image Enhancement, Qingsen Yan, Yixu Feng, Cheng Zhang, Guansong Pang, Kangbiao Shi, Peng Wu, Wei Dong, Jinqiu Sun, Yanning Zhang

Research Collection School Of Computing and Information Systems

Low-Light Image Enhancement (LLIE) is a crucial computer vision task that aims to restore detailed visual information from corrupted low-light images. Many existing LLIE methods are based on standard RGB (sRGB) space, which often produce color bias and brightness artifacts due to inherent high color sensitivity in sRGB. While converting the images using Hue, Saturation and Value (HSV) color space helps resolve the brightness issue, it introduces significant red and black noise artifacts. To address this issue, we propose a new color space for LLIE, namely Horizontal/Vertical-Intensity (HVI), defined by polarized HS maps and learnable inten sity. The former enforces …

Why Does My Transaction Fail? A First Look At Failed Transactions On The Solana Blockchain, Xiaoye Zheng, Zhiyuan Wan, David Lo, Difan Xie, Xiaohu Yang

Research Collection School Of Computing and Information Systems

Solana is an emerging blockchain platform, recognized for its high throughput and low transaction costs, positioning it as a preferred infrastructure for Decentralized Finance (DeFi), Non-Fungible Tokens (NFTs), and other Web 3.0 applications. In the Solana ecosystem, transaction initiators submit various instructions to interact with a diverse range of Solana smart contracts, among which are decentralized exchanges (DEXs) that utilize automated market makers (AMMs), allowing users to trade cryptocurrencies directly on the blockchain without the need for intermediaries. Despite the high throughput and low transaction costs of Solana, the advantages have exposed Solana to bot spamming for financial exploitation, resulting …

Deepvec: State-Vector Aware Test Case Selection For Enhancing Recurrent Neural Network, Zhonghao Jiang, Meng Yan, Li Huang, Weifeng Sun, Chao Liu, Song Sun, David Lo

Research Collection School Of Computing and Information Systems

Deep Neural Networks (DNN) have realized significant achievements across various application domains. There is no doubt that testing and enhancing a pre-trained DNN that has been deployed in an application scenario is crucial, because it can reduce the failures of the DNN. DNN-driven software testing and enhancement require large amounts of labeled data. The high cost and inefficiency caused by the large volume of data of manual labeling, and the time consumption of testing all cases in real scenarios are unacceptable. Therefore, test case selection technologies are proposed to reduce the time cost by selecting and only labeling representative test …

Ef21 With Bells & Whistles: Six Algorithmic Extensions Of Modern Error Feedback, Ilyas Fatkhullin, Igor Sokolov, Eduard Gorbunov, Zhize Li, Peter Richtarik

Research Collection School Of Computing and Information Systems

First proposed by Seide (2014) as a heuristic, error feedback (EF) is a very popular mechanism for enforcing convergence of distributed gradient-based optimization methods enhanced with communication compression strategies based on the application of contractive compression operators. However, existing theory of EF relies on very strong assumptions (e.g., bounded gradients), and provides pessimistic convergence rates (e.g., while the best known rate for EF in the smooth nonconvex regime, and when full gradients are compressed, is O(1/T2/3), the rate of gradient descent in the same regime is O(1/T)). Recently, Richtàrik et al. (2021) proposed a new error feedback mechanism, EF21, based …

Less Is More: On The Importance Of Data Quality For Unit Test Generation, Junwei Zhang, Xing Hu, Shan Gao, Xin Xia, David Lo, Shanping Li

Research Collection School Of Computing and Information Systems

Unit testing is crucial for software development and maintenance. Effective unit testing ensures and improves software quality, but writing unit tests is time-consuming and labor-intensive. Recent studies have proposed deep learning (DL) techniques or large language models (LLMs) to automate unit test generation. These models are usually trained or fine-tuned on large-scale datasets. Despite growing awareness of the importance of data quality, there has been limited research on the quality of datasets used for test generation. To bridge this gap, we systematically examine the impact of noise on the performance of learning-based test generation models. We first apply the open …

Adapting Large Language Models For Parameter-Efficient Log Anomaly Detection, Ying Fu Lim, Jiawen Zhu, Guansong Pang

Research Collection School Of Computing and Information Systems

Log Anomaly Detection (LAD) seeks to identify atypical patterns in log data that are crucial to assessing the security and condition of systems. Although Large Language Models (LLMs) have shown tremendous success in various fields, the use of LLMs in enabling the detection of log anomalies is largely unexplored. This work aims to fill this gap. Due to the prohibitive costs involved in fully fine-tuning LLMs,we explore the use of parameter-efficient fine-tuning techniques (PEFTs) for adapting LLMs to LAD.To have an in-depth exploration of the potential of LLM-driven LAD, we present a comprehensive investigation of leveraging two of the most …

Large Language Models For Logical Fallacy Detection, Nicole Anne Hui-Ying Teo, Donghao Huang, Erik Cambria, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Identifying logical fallacies is essential for maintaining log-ical reasoning and reducing false information in a variety of domains, such as the media, law, and education. We present an extensive study on the use of large language models (LLMs) for logical fallacy detection and provide a comparative overview of model performance across various fallacy classes. We evaluate the logical fallacy detection capabilities of multiple state-of-the-art models (LLaMA, Qwen, Gemma, Phi) utilizing accuracy, precision, recall, and F1-score as assessment measures. Accord-ing to our findings, our models do well on simple fallacies like “circular reasoning,” but they have trouble with more interpretive reasoning …

A Stacking Ensemble Model For Food Demand Forecasting: A Preventative Approach To Food Waste Reduction, Asmaa Seyam, Sujith Samuel Mathew, Bo Du, May El Barachi, Jun Shen

All Works

Building effective demand forecasting is crucial for better planning and ensuring sustainability within food supply chain systems. The food industry has received the least attention for building demand forecasting approaches, with a noticeable lack of utilizing ensemble stacking models. Additionally, while some models have achieved accurate predictions, they do not consider freshness variables and are not assessed for their impact on waste reduction. This paper develops a demand forecasting framework that is considered as a preventative approach to reduce food waste by enabling food retailers to better manage inventory and balance supply with demand. The paper first develops an ensemble …

Application Of Deep Learning In Analysis Of Stellar Spectra, Piyush Yayati

Master’s Dissertations

In recent years, the analysis of high-resolution stellar spectra has become increasingly important for estimating key stellar parameters such as effective temperature (Teff ), surface gravity (log g), metallicity ([M/H]), and rotational velocity (v sin i). Traditional methods often rely on manual calibration or spectrum synthesis, which can be time-consuming and error-prone, especially for M dwarfs whose spectra are dense with molecular features. In this study, we investigate the use of convolutional neural networks (CNNs) to automate the estimation of stellar parameters using synthetic and observed data.We adopt a StarNet-like CNN architecture trained on synthetic spectra generated from the PHOENIX-ACES …

Causal Explanations In Deep Learning Systems, Dhruv Vansraj Rathore

Master’s Dissertations

Deep learning models often deliver high predictive accuracy; however, their lack of interpretability can hinder their adoption in critical fields such as healthcare and finance. This thesis explores the concept of Intrinsic Causal Contribution (ICC), a novel method for explaining neural network predictions by quantifying each input feature’s intrinsic causal influence on the output, independent of correlated effects. ICC models the network as a Structural Causal Model and employs Causal Normalizing Flows to handle complex dependencies, with efficient estimation via the Jansen Estimator. Analysis on both synthetic and real data sets provides evidence that ICC produces faithful, interpretable attributions, often …

Cutting Through The Infodemic Efficiently: News Claims Surveillance And Llm-Based Lightweight Fact Verification, Xuan Zhang

Dissertations and Theses Collection (Open Access)

In the context of the current infodemic, the rapid spread of misinformation poses a severe threat to social stability and public health. Recently, the rise of deep learning technologies has offered the potential for accelerating the development of automated misinformation detection and verification. However, current technological capabilities and computational resources often prove inadequate for the exhaustive scrutiny required, rendering the enhancement of processing efficiency a critical imperative. Given the vast amount of data on the internet, current technology and computational power often fall short in timely and accurate scrutiny of each piece of information, making the improvement of processing efficiency …

The Weaving Of Machine Learning And Artificial Intelligence Into The Fabric Of Cybersecurity Curriculum: From Degree Plan To Capstone Projects, Mahmoud K. Quweider, Liyu Zhang, Jorge Castillo, Ala Qubbaj

Informatics and Engineering Systems Faculty Publications

As our newly designed degree in Cybersecurity enters its fourth year, students in the program are starting to take courses beyond the basic ones, including senior courses, technical electives, and capstone projects. While Cybersecurity is at the heart of our degree that addresses the national need for cybersecurity specialists, how we approach the education and pedagogy of cybersecurity in the era of Big Data and AI/ML (Artificial Intelligence/Machine Learning) is a question that we are addressing in real-time as techniques and measures and countermeasures of cybersecurity attacks keep evolving and taking advantages of the rapid advancements in computing, memory, storage, …

Sla Evaluation And Composition In Reconfigurable Cloud-Based Services, Michael Iannelli

Dissertations, Theses, and Capstone Projects

Given the business model of offering data and computing services in a cloud setting, a major question arises: How do the services of one cloud provider compare to those of others? With the ubiquitous use of smartphones and tablets, the ability of a cloud provider to support QoS and client mobility becomes paramount. This research proposes a methodology for evaluating service-level agreements (SLAs) between cloud providers and their consumers, with a particular focus on dynamic SLA composition to adapt to changes in the application requirements and the external environment—such as traffic surges, security threats, or evolving business models.

In one …