Computer Sciences Commons^™

Ml Playground: Data Modification/Preprocessing And Model Simulation Tool, Marco D. Cerrato

Electronic Theses, Projects, and Dissertations

There is a heavy reliance on programming when it comes to learning machine learning (ML). This often creates barriers for students and newcomers unfamiliar with coding. While the lessons you learn in the classroom provide essential foundational understanding, some technical or practical aspects of ML—such as data preprocessing, feature engineering, and model tuning—are best learned through hands-on interaction. ML Playground was developed to act as a proof-of-concept application to address this gap by offering a browser-based, graphical user interface that lets users engage with core ML workflows without writing code. Designed with educational accessibility in mind, the application allows users …

Tailoring Transformer-Based Deep Learning For Code Generation And Translation, Imam Nur Bani Yusuf

Dissertations and Theses Collection (Open Access)

Software is increasingly pervasive in modern society, making the effective translation of human intent into code essential. Novice programmers often struggle with domain-specific code due to limited background knowledge, while experienced developers face challenges in maintaining evolving largescale codebases. Traditional pattern-based approaches address these issues, but such approaches are task-specific and require significant adaptation for different tasks. Transformer-based models offer a more flexible alternative, as the same architecture can be tailored for diverse programming tasks.

This dissertation investigates how Transformer-based models can be customized for various code generation and translation tasks. First, it introduces Transformer-based approaches that assist end-users with …

Towards Visual Inertial Navigation With Fixed Tetrahedral Targets, Joao Leonardo Silva Cotta

Theses and Dissertations

This dissertation presents a robust method for 6DoF position estimation under impaired visual conditions utilizing a minimum 4-point Perspective-n-Point (P4P) solver designed for tetrahedral targets. Using SO(3) × R 3 instead of SE(3), the method uses a Lie group-based formulation to discriminate between rotation and translation, thereby enabling computationally efficient, resource-conscious op- optimization while preserving correct geometric behavior. Designed using the contemporary C++17 library ShomerTarget, the solver is analytically formulated and assessed under pragmatic robotic conditions. Particularly in low-light and high-dynamic environments, experiments on embedded systems, UAVs, and NASA’s Astrobee show that the proposed solver attains enhanced accuracy compared to …

Building Bridges Across Papua New Guinea’S Digital Divide In Growing The Ict Industry, Marc Cheong, Sankwi Abuzo, Hideaki Hata, Priscilla Kevin, Winifred Kula, Benson Mirou, Christoph Treude, Dong Wang, Raula Gaikovina Kula

Research Collection School Of Computing and Information Systems

Papua New Guinea (PNG) is an emerging tech society with an opportunity to overcome geographic and social boundaries, in order to engage with the global market. However, the current tech landscape, dominated by Big Tech in Silicon Valley and other multinational companies in the Global North, tends to overlook the requirements of emerging economies such as PNG. This is becoming more obvious as issues such as algorithmic bias (in tech product deployments) and the digital divide (as in the case of non-affordable commercial software) are affecting PNG users. The Open Source Software (OSS) movement, based on extant research, is seen …

Learning Through Online Participation: From Breakout Rooms To Discord, Makayla Moster

All Dissertations

For software development teams, teamwork is an essential part of their day-to-day lives. However, due to the aftermath of the COVID-19 pandemic, more companies have allowed employees to have more hybrid and remote work options than before. As more companies are adopting hybrid and remote workstyles, we need to ensure that we are preparing the next batch of young software developers to conduct teamwork in remote and hybrid settings. In this dissertation, I address the tools students use for teamwork and how to improve their teamwork inside and outside of the classroom. I present my research on improving student experiences …

Specgen: Automated Generation Of Formal Program Specifications Via Large Language Models, Lezhi Ma, Shangqing Liu, Yi Li, Xiaofei Xie, Lei Bu

Research Collection School Of Computing and Information Systems

In the software development process, formal program specifications play a crucial role in various stages, including requirement analysis, software testing, and verification. However, manually crafting formal program specifications is rather difficult, making the job time-consuming and labor-intensive. Moreover, it is even more challenging to write specifications that correctly and comprehensively describe the semantics of complex programs. To reduce the burden on software developers, automated specification generation methods have emerged. However, existing methods usually rely on predefined templates or grammar, making them struggle to accurately describe the behavior and functionality of complex real-world programs. To tackle this challenge, we introduce SpecGen, …

Quantitative Runtime Monitoring Of Ethereum Transaction Attacks, Xinyao Xu, Ziyu Mao, Jianzhong Su, Xingwei Lin, David Basin, Jun Sun, Jingyi Wang

Research Collection School Of Computing and Information Systems

The rapid growth of decentralized applications, while revolutionizing financial transactions, has created an attractive target for malicious attacks. Existing approaches to detecting attacks often rely on predefined rules or simplistic and overly-specialized models, which lack the flexibility to handle the wide spectrum of diverse and dynamically changing attack types. To address this challenge, we present a general and extensible framework, MoE (Monitoring Ethereum), that leverages runtime verification to detect a wide range of attacks on Ethereum. MoE features an expressive attack modeling language, based on Metric First-order Temporal Logic (MFOTL), that can formalize a wide range of attacks. We integrate …

Integrating Path Selection For Symbolic Execution And Variable Selection For Constraint Solving, Shunkai Zhu, Jun Sun, Jingyi Wang, Zhenbang Chen, Peng Cheng

Research Collection School Of Computing and Information Systems

Symbolic execution is a powerful technique that can accurately synthesize program inputs for program testing through constraint solving. Applying symbolic execution effectively means that we must solve two searching problems efficiently. One is to search through the many program paths and the other is, given a particular path condition, to search through the numerous variable assignments to identify one satisfying solution. With few exceptions, existing symbolic execution engines treat constraint solvers as black boxes. As a result, the two searches are completely separated, which results in much redundancy (i.e., the same variable assignments may be tried for solving many program …

Intention Is All You Need: Refining Your Code From Your Intention, Qi Guo, Xiaofei Xie, Shangqing Liu, Ming Hu, Xiaohong Li, Lei Bu

Research Collection School Of Computing and Information Systems

Code refinement aims to enhance existing code by addressing issues, refactoring, and optimizing to improve quality and meet specific requirements. As software projects scale in size and complexity, the traditional iterative exchange between reviewers and developers becomes increasingly burdensome. While recent deep learning techniques have been explored to accelerate this process, their performance remains limited, primarily due to challenges in accurately understanding reviewers’ intents. This paper proposes an intention-based code refinement technique that enhances the conventional comment-to-code process by explicitly extracting reviewer intentions from the comments. Our approach consists of two key phases: Intention Extraction and Intention Guided Revision Generation. …

Tensorjsfuzz: Effective Testing Of Web-Based Deep Learning Frameworks Via Input-Constraint Extraction, Lili Quan, Xiaofei Xie, Qianyu Guo, Lingxiao Jiang, Sen Chen, Junjie Wang, Xiaohong Li

Research Collection School Of Computing and Information Systems

The 2025 ACM Web Conference (WWW '25) took place from April 28 to May 2, 2025, in the Sydney Convention & Exhibition Centre, Australia. Its logo, featuring the Sydney Harbour Bridge, symbolizes the core "connecting" function of the Web. Formerly known as the International World Wide Web Conference (WWW), this event originated at CERN in 1994 and has long served as the premier venue for presenting and discussing research, development, standards, and applications related to the Web.The 2025 ACM Web Conference (WWW'25) took place from April 28 to May 2, 2025, in the Sydney Convention & Exhibition Centre, Australia. Its …

Scenario-Driven And Context-Aware Automated Accessibility Testing For Android Apps, Yuxin Zhang, Sen Chen, Xiaofei Xie, Zibo Liu, Lingling Fan

Research Collection School Of Computing and Information Systems

Mobile accessibility is increasingly important nowadays as it enables people with disabilities to use mobile applications to perform daily tasks. Ensuring mobile accessibility not only benefits those with disabilities but also enhances the user experience for all users, making applications more intuitive and user-friendly. Although numerous tools are available for testing and detecting accessibility issues in Android applications, a large number of false negatives and false positives persist due to limitations in the existing approaches, i.e., low coverage of UI scenarios and lack of consideration of runtime context. To address these problems, in this paper, we propose a scenario-driven exploration …

“I Can Run At Night!”: Using Augmented Reality To Support Nighttime Guided Running For Low-Vision Runners, Yuki Abe, Keisuke Matsushima, Kotaro Hara, Daisuke Sakamoto, Tetsuo Ono

Research Collection School Of Computing and Information Systems

Dark environment challenges low-vision (LV) individuals to engage in running by following sighted guide—a Caller-style guided running—due to insufficient illumination, because it prevents them from using their residual vision to follow the guide and be aware about their environment. We design, develop, and evaluate RunSight, an augmented reality (AR)-based assistive tool to support LV individuals to run at night. RunSight combines see-through HMD and image processing to enhance one’s visual awareness of the surrounding environment (e.g., potential hazard) and visualize the guide’s position with AR-based visualization. To demonstrate RunSight’s efficacy, we conducted a user study with 8 LV runners. The …

Toward Better Comprehension Of Breaking Changes In The Npm Ecosystem, Dezhen Kong, Jiakun Liu, Lingfeng Bao, David Lo

Research Collection School Of Computing and Information Systems

Code evolution is prevalent in software ecosystems, which can provide many benefits, such as new features, bug fixes, security patches, while still introducing breaking changes that make downstream projects fail to work. Breaking changes cause a lot of effort to both downstream and upstream developers: downstream developers need to adapt to breaking changes and upstream developers are responsible for identifying and documenting them. In the NPM ecosystem, characterized by frequent code changes and a high tolerance for making breaking changes, the effort is larger.For better comprehension of breaking changes in the NPM ecosystem and to enhance breaking change detection tools, …

Enriching Automatic Test Case Generation By Extracting Relevant Test Inputs From Bug Reports, Wendkuuni C. Ouedraogo, Laura Plein, Kader Kabore, Andrew Habib, Jacques Klein, David Lo, Tegawende F. Bissyande

Research Collection School Of Computing and Information Systems

The quality of software is closely tied to the effectiveness of the tests it undergoes. Manual test writing, though crucial for bug detection, is time-consuming, which has driven significant research into automated test case generation. However, current methods often struggle to generate relevant inputs, limiting the effectiveness of the tests produced. To address this, we introduce BRMiner, a novel approach that leverages Large Language Models (LLMs) in combination with traditional techniques to extract relevant inputs from bug reports, thereby enhancing automated test generation tools. In this study, we evaluate BRMiner using the Defects4J benchmark and test generation tools such as …

Prompting An Embodied Ai Agent: How Embodiment And Multimodal Signaling Affects Prompting Behaviour, Tianyi Zhang, Colin Au Yeung, Emily Aurelia, Yuki Onishi, Neil Chulpongsatorn, Jiannan Li, Anthony Tang

Research Collection School Of Computing and Information Systems

Current voice agents wait for a user to complete their verbal instruction before responding; yet, this is misaligned with how humans engage in everyday conversational interaction, where interlocutors use multimodal signaling (e.g. nodding, grunting, or looking at referred to objects) to ensure conversational grounding. We designed an embodied VR agent that exhibits multimodal signaling behaviors in response to situated prompts, by turning its head, or by visually highlighting objects being discussed or referred to. We explore how people prompt this agent to design and manipulate the objects in a VR scene. Through a Wizard of Oz study, we found that …

Enhancing Deliberativeness: Evaluating The Impact Of Multimodal Reflection Nudges, Shun Yi Yeo, Zhuoqun Jiang, Anthony Tang, Simon Tangi Perrault

Research Collection School Of Computing and Information Systems

Nudging participants with text-based reflective nudges enhances deliberation quality on online deliberation platforms. The effectiveness of multimodal reflective nudges, however, remains largely unexplored. Given the multi-sensory nature of human perception, incorporating diverse modalities into self-reflection mechanisms has the potential to better support various reflective styles. This paper explores how presenting reflective nudges of different types (direct: persona and indirect: storytelling) in different modalities (text, image, video and audio) affects deliberation quality. We conducted two user studies with 20 and 200 participants respectively. The first study identifies the preferred modality for each type of reflective nudges, revealing that text is most …

Flexfl: Flexible And Effective Fault Localization With Open-Source Large Language Models, Chuyang Xu, Zhongxin Liu, Xiaoxue Ren, Gehao Zhang, Ming Liang, David Lo

Research Collection School Of Computing and Information Systems

Fault localization (FL) targets identifying bug locations within a software system, which can enhance debugging efficiency and improve software quality. Due to the impressive code comprehension ability of Large Language Models (LLMs), a few studies have proposed to leverage LLMs to locate bugs, i.e., LLM-based FL, and demonstrated promising performance. However, first, these methods are limited in flexibility. They rely on bug-triggering test cases to perform FL and cannot make use of other available bug-related information, e.g., bug reports. Second, they are built upon proprietary LLMs, which are, although powerful, confronted with risks in data privacy. To address these limitations, …

Real-Time Rectifying Flight Control Misconfiguration Using Intelligent Agent, Ruidong Han, Shangzhi Xu, Juanru Li, Elisa Bertino, David Lo, Jianfeng Ma, Siqi Ma

Research Collection School Of Computing and Information Systems

Configurations are supported by most flight control systems, allowing users to control a flying drone adapted to complexities such as environmental changes or mission alterations. Such an advanced functionality also introduces a significant problem—misconfiguration settings. It may cause drone instability, threaten drone safety, and potentially lead to substantial financial loss. However, detecting and rectifying misconfigurations across different flight control systems is challenging because (1) (mis)configuration-related code snippets might be syntactically correct and thus hard to identify through traditional code analysis; (2) the response to each configuration varies under different flying scenarios.In this article, we propose and implement a novel rectification …

Development Of Fuzzy Ontology For Explainable Artificial Intelligence For Decision-Making In Fuzzy Environment, Pavel Kosov

Chemical Technology, Control and Management

In modern artificial intelligence systems, there is an acute need to understand the decision-making logic of "black box" algorithms. Our research proposes an innovative method for increasing the transparency of such systems through the formalization of fuzzy explanatory mechanisms. We have developed an extension of existing ontological approaches by introducing the concept of fuzziness into the structure of explanatory properties, which allows overcoming the fundamental limitations of traditional XAI methods. The proposed formalization is based on the theory of collective mental models and principles of fuzzy logic, providing a more accurate reflection of uncertainty and subjectivity in expert knowledge. Our …

Cascading Effects: Analyzing Project Failure Impact In The Maven Central Ecosystem, Mina Shehata

SPARK Symposium Presentations

Abstract—This study examines failure propagation patterns within the Maven Central ecosystem, a critical software de- pendency repository, through comprehensive analysis of dependency networks using the Goblin framework. Our dual-sampling methodology, investigating both top dependencies and random libraries, revealed two distinct failure propagation patterns that pose significant risks to ecosystem stability. Core infrastructure failures, particularly evident in cases like the AWS SDK family with 429,800 total dependencies, create immediate and widespread disruption, affecting an average of 20,402 dependent projects and propagating through dependency chains averaging 90.80 levels deep.

Our analysis of peripheral projects reveals their significant cascading effects, with higher average …

Simplifying 3d Printing Using Natural Language Processing, Jared E. Rosenberger

Undergraduate Theses

3D printing is a crucial technology with many applications in different fields. To be able to use this technology to its full extent, expertise in computer aided design (CAD) technology and 3D modeling is required. Many people interested in 3D printing do not have this expertise and thus cannot build custom models, and are consequently forced to buy them instead. Natural language processing (NLP) is one tool that can vastly simplify 3D modeling for those lacking CAD experience. Using NLP, someone can simply dictate what they want to be able to print, and a computer can then build a 3D …

Towards Testing, Detecting, And Debloating Insecure Components In Android Applications, Zicheng Zhang

Dissertations and Theses Collection (Open Access)

The Android ecosystem’s openness and extensibility have fueled its dominance in the mobile market, but they also broaden the attack surface of applications by introducing insecure or redundant methods. Vulnerabilities arise from various sources, including insecure API usage, code cloning, and feature bloat, especially from unneeded components introduced during development. To address these challenges, this dissertation presents a systematic, three-phase pipeline that transitions seamlessly from vulnerability discovery to clone-based detection and, ultimately, to dynamic mitigation through runtime debloating. Each phase builds upon the insights and limitations of the previous, collectively forming a practical approach to improving Android app security.

In …

A Data-Driven Recommendation System For Selecting The Appropriate Mode Of Learning And Instructional Tools Based On Course Characteristics, Ayisha Manzoor

Theses

The rapid transformation of educational delivery methods during the COVID-19 pandemic required institutions to transition between online, hybrid, and offline learning approaches, creating both challenges and opportunities for educators and students. While online and hybrid learning modes ensured continuity, their effectiveness across different course types remained uncertain. This thesis addresses this gap by developing a datadriven recommendation framework that predicts Course Learning Outcome (CLO) achievement scores using regression, and recommends the most appropriate learning mode (online, hybrid, or offline) along with instructional tools based on course characteristics. This study analyzed 100 undergraduate and postgraduate courses from the College of Information …

How Developers Interact With Ai: A Taxonomy Of Human-Ai Collaboration In Software Engineering, Christoph Treude, Marco A. Gerosa

Research Collection School Of Computing and Information Systems

Artificial intelligence (AI), including large language models and generative AI, is emerging as a significant force in software development, offering developers powerful tools that span the entire development lifecycle. Although software engineering research has extensively studied AI tools in software development, the specific types of interactions between developers and these AI-powered tools have only recently begun to receive attention. Understanding and improving these interactions has the potential to enhance productivity, trust, and efficiency in AI-driven workflows. In this paper, we propose a taxonomy of interaction types between developers and AI tools, identifying eleven distinct interaction types, such as auto-complete code …

Bigcodebench: Benchmarking Code Generation With Diverse Function Calls And Complex Instructions, T.Y. Zhuo, M.C. Vu, J. Chim, ..., David Lo

Research Collection School Of Computing and Information Systems

Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have shown that LLMs can solve tasks using programs like human developers, the majority of their evaluations are limited to short and self-contained algorithmic tasks or standalone function calls. Solving challenging and practical tasks requires the capability of utilizing diverse function calls as tools to efficiently implement functionalities like data analysis and web development. In addition, using multiple tools to solve a task needs compositional reasoning by accurately …

Overcoming Motor Imagery Bci Illiteracy: Adaptive Decoding And Knowledge Transfer In Eeg-Based Brain-Computer Interfaces, Zaid Shuqfa

Dissertations

Brain–computer interfaces (BCIs), also known as brain–machine interfaces (BMIs), enable direct communication between the brain and external devices without the involvement of peripheral nerves or muscles. Among various BCI paradigms, motor imagery (MI)–based BCIs are particularly appealing due to their intuitive, cue-independent nature, allowing users to issue control commands at will. MI–BCIs hold substantial promise for improving the quality of life of individuals with motor impairments, as well as enhancing hands-free control for healthy users. However, their widespread adoption remains limited by challenges such as low signal-to-noise ratio, inter- and intra-subject variability, and the need for frequent calibration. These challenges …

The Use Of Call Graphs And Deep Learning To Improve Software Testing, Ziad A. Al-Sharif, Hemanth G. Chintala, Safwan Omari

Engineering, Computing and Mathematical Sciences Faculty Conferences

Software testing is a critical part of software development, it is essential for preventing failures and enhancing software quality attributes. However, the testing process can be costly and time-consuming, often involving a large number of test cases. Over time, the accumulation of redundant and overlapping test cases can complicate and lengthen the testing time. To address these challenges, this paper utilizes graph similarity and deep learning techniques to optimize test suites. It uses call graphs from test cases to identify redundant and similar test cases. A machine learning model is used to calculate and predict the similarity scores between these …

A Study Of Preconditions And Postconditions As Design Constraints For Llm Code Generation, Luke Newcomb

Doctoral Dissertations and Master's Theses

Large Language Models (LLMs) have significantly advanced automated code generation, but current methods predominantly rely on natural language descriptions. This approach encounters challenges when handling complex, class-level software generation tasks due to inherent ambiguity and under-specification. Few studies have investigated how more formal software engineering constraints, such as explicit preconditions and postconditions, influence class-level generation tasks. This work addresses this gap through a structured evaluation of six state-of-the-art LLMs generating software implementations from systematically designed class-level specifications. Results demonstrate that incorporating explicit design constraints significantly boosts initial generation accuracy (measured via the pass@k metric), particularly in Python but also in …

Advancing Devsecops In Smes: Challenges And Best Practices For Secure Ci/Cd Pipelines, Jayaprakashreddy Cheenepalli, John Hastings, Khandaker Mamun Ahmed, Chad Fenner

Research & Publications

This study evaluates the adoption of DevSecOps among small and medium-sized enterprises (SMEs), identifying key challenges, best practices, and future trends. Through a mixed methods approach backed by the Technology Acceptance Model (TAM) and Diffusion of Innovations (DOI) theory, we analyzed survey data from 405 SME professionals, revealing that while 68% have implemented DevSecOps, adoption is hindered by technical complexity (41%), resource constraints (35%), and cultural resistance (38%). Despite strong leadership prioritization of security (73%), automation gaps persist, with only 12% of organizations conducting security scans per commit. Our findings highlight a growing integration of security tools, particularly API security …

One-For-All: Towards Universal Domain Translation With A Single Stylegan, Yong Du, Jiahui Zhan, Xinzhe Li, Junyu Dong, Sheng Chen, Ming-Hsuan Yang, Shengfeng He

Research Collection School Of Computing and Information Systems

In this paper, we propose a novel translation model, UniTranslator, for transforming representations between visually distinct domains under conditions of limited training data and significant visual differences. The main idea behind our approach is leveraging the domain-neutral capabilities of CLIP as a bridging mechanism, while utilizing a separate module to extract abstract, domain-agnostic semantics from the embeddings of both the source and target realms. Fusing these abstract semantics with target-specific semantics results in a transformed embedding within the CLIP space. To bridge the gap between the disparate worlds of CLIP and StyleGAN, we introduce a new non-linear mapper, the CLIP2P …