Software Engineering Commons^™

Penforge: On-The-Fly Expert Agent Construction For Automated Penetration Testing, Huihui Huang, Jieke Shi, Junkai Chen, Ting Zhang, Yikun Li, Chengran Yang, Eng Lieh Ouh, Lwin Khin Shar, David Lo

Research Collection School Of Computing and Information Systems

Penetration testing is essential for identifying vulnerabilities in web applications before real adversaries can exploit them. Recent work has explored automating this process with Large Language Model (LLM)-powered agents, but existing approaches either rely on a single generic agent that struggles in complex scenarios or narrowly specialized agents that cannot adapt to diverse vulnerability types. We therefore introduce PenForge, a framework that dynamically constructs expert agents during testing rather than relying on those prepared beforehand. By integrating automated reconnaissance of potential attack surfaces with agents instantiated on the fly for context-aware exploitation, PenForge achieves a 30.0% exploit success rate (12/40) …

Prompting Frameworks For Large Language Models: A Survey, Xiaoxia Liu, Jingyi Wang, Jun Sun, Xiaohan Yuan, Guoliang Dong, Peng Di, Wenhai Wang, Dongxia Wang

Research Collection School Of Computing and Information Systems

Since the launch of ChatGPT, a powerful AI Chatbot developed by OpenAI, large language models (LLMs) have made significant advancements in both academia and industry, bringing about a fundamental engineering paradigm shift in many areas. While LLMs are powerful, it is also crucial to best use their power where “prompt” plays a core role. However, the booming LLMs themselves, including excellent APIs like ChatGPT, have several inherent limitations: (1) temporal lag of training data, and (2) the lack of physical capabilities to perform external actions. Recently, we have observed the trend of utilizing prompt-based tools to better utilize the power …

Bridging Bug Localization And Issue Fixing: A Hierarchical Localization Framework Leveraging Large Language Models, Jianming Chang, Xin Zhou, Lulu Wang, David Lo, Bixin Li

Research Collection School Of Computing and Information Systems

Automated issue fixing is a critical task in software debugging and has recently garnered significant attention from academia and industry. However, existing fixing techniques predominantly focus on the repair phase, often overlooking the importance of improving the preceding bug localization phase. As a foundational step in issue fixing, bug localization plays a pivotal role in determining the overall effectiveness of the entire process. To enhance the precision of issue fixing by accurately identifying bug locations in large-scale projects, this paper presents BugCerberus, the first hierarchical bug localization framework powered by three customized large language models. First, BugCerberus analyzes intermediate representations …

Patchgpt: Multi-Agent Patch Backporting Without Model Fine-Tuning, Ye Liu, Ruidong Han, Chengyan Ma, Yuqing Niu, David Lo

Research Collection School Of Computing and Information Systems

Patch backporting is crucial and prevalent in the maintenance of modern open-source software such as Linux kernels and forked repositories. However, porting patches across program versions remains a challenging problem due to the complexity of synergizing diverse patches with divergent program versions. In this paper, we propose PatchGPT, an agentic patch backporting framework for fine-grained patch generation. PatchGPT encompasses three agents: Miner for decomposing a sequence of atomic change steps as the original patch plan, Adapter for adapting the patch plan, and Executor for executing the adapted patch plan according to predefined change semantics. We conduct experiments on the PPatHF’s …

Visual Loop: Bridging The Cognitive Gap In Software Development Through Visual-Ai Collaboration, Luis Filipe Fernandes Gomes, Xin Zhou, David Lo, Rui Abreu

Research Collection School Of Computing and Information Systems

Software development remains predominantly text-centric, despite decades of evidence showing that developers think and communicate visually. While sketches and diagrams externalize developers’ mental models, they remain disconnected from source code and quickly become outdated. Recent advances in foundation models, capable of both code and visual reasoning, create an opportunity to unify these representations. In this vision paper, we introduce Visual Loop, a continuous visual development environment that keeps code and informal sketches in bidirectional synchronization. Our prototype connects a code editor with a tablet-based visualization workspace, allowing developers to explore, annotate, and modify systems through freehand sketches interpreted by multimodal …

Understanding Codebase Like A Professional! Human-Ai Collaboration For Code Comprehension, Jie Gao, Yue Xue, Xiaofei Xie, Junming Cao, Soemin Thant, Erika Lee, Bowen Xu

Research Collection School Of Computing and Information Systems

Understanding an unfamiliar codebase is an essential task for developers in various scenarios, such as during the onboarding process. Especially when the codebase is large and time is limited, achieving a decent level of comprehension remains challenging for both experienced and novice developers, even with the assistance of large language models (LLMs). Existing studies have shown that LLMs often fail to support users in understanding code structures or to provide user-centered, adaptive, and dynamic assistance in real-world settings.To address this, we propose learning from the perspective of a unique role, code auditors, whose work often requires them to quickly familiarize …

Rethinking Artifact Evaluation For Software Engineering In The Age Of Generative Ai, Christoph Treude, Christopher M. Poskitt, Rashina Hoda

Research Collection School Of Computing and Information Systems

Peer review in software engineering research operates under tight time constraints, while generative AI has substantially reduced the human effort required to produce polished research narratives. Reviewer attention is often spent on aspects of submissions such as writing quality or literature positioning that have become relatively less effort-intensive to address, rather than on evaluating the scientific substance of a paper. At the same time, assessing whether methods are implemented correctly, analyses are sound, and claims are supported by evidence remains effort-intensive and dependent on human expertise. In software engineering research, this substance is frequently embodied in artifacts, including code, data, …

Software Engineering In The Age Of Coding Agents: Failure Modes And Rejection Patterns, Mahd Mohd Hindi

Thesis/ Dissertation Defenses

This thesis investigates the real-world behavior of LLM-driven coding agents that generate code changes and submit pull requests (PRs) to public software repositories. As these tools evolve from autocomplete-style assistants into more autonomous agents, their contributions increasingly interact with socio-technical review processes (human reviewers, bots, CI/CD gates, and project norms). This thesis focuses on understanding why agent-generated PRs are accepted or rejected and what these outcomes reveal about current agent limitations in practical development workflows. The main objective of this thesis is to systematically characterize rejection patterns and failure modes of agent-generated pull requests in real repositories. Specifically, the thesis …

Software Engineering In The Age Of Coding Agents: Failure Modes And Rejection Patterns, Mahd Mohd Taysir Hindi

Thesis/ Dissertation Defenses

This thesis investigates the real-world behavior of LLM-driven coding agents that generate code changes and submit pull requests (PRs) to public software repositories. As these tools evolve from autocomplete-style assistants into more autonomous agents, their contributions increasingly interact with socio-technical review processes (human reviewers, bots, CI/CD gates, and project norms). This thesis focuses on understanding why agent-generated PRs are accepted or rejected and what these outcomes reveal about current agent limitations in practical development workflows. The main objective of this thesis is to systematically characterize rejection patterns and failure modes of agent-generated pull requests in real repositories. Specifically, the thesis …

Learning To Refine Gesture-Derived Voxel-To-Loop For Generative 3d Modeling In Vr, Kallen Lonbom, Trudi Di Qi

Engineering Faculty Articles and Research

We present a generative modeling pipeline for refining and denoising coarse 3D shapes created through freehand interaction in virtual reality (VR). While recent loop-based generative models focus on shape synthesis from clean inputs, our work addresses the challenge of reconstructing coherent geometry from noisy, coarse volumetric data. To this end, we introduce a hybrid voxel-to-loop representation that captures the topology of rough voxel shapes and converts them into sequential cross-sectional loops for generative refinement. We develop two transformer architectures and evaluate their efficacy primarily on synthetically perturbed datasets with additional examples from VR. Our results demonstrate that this representation is …

Pong Revised: Network-Based Competitions Through Secure Socket Services, Noah T. Jennings, Destiny D. Hale, Jared D. Williams, Michael J. Lively-Scholz

The Knowledge and Creativity Expo

We aim to provide a safe, thrilling, locally hosted, and educational multiplayer experience that can be quickly replicated in modern Capture The Flag (CTF) events.

Large-Scale File Fragment Classification Via Multi-View Learning, Samuel Hildebrand

LSU Master's Theses

File reassembly is one of the most fundamental tasks in digital forensics, enabling recovery of data from potentially damaged storage media even when file system metadata is unavailable. This thesis reviews more than two decades of work in the realm of file carving, with a particular focus on fragmented file carving, which remains a focus of research, and file fragment classification, a principal component of fragmented file carving. This thesis serves a literature review of both file carving and fragmented file carving, surveys the massive amounts of data needed for the task of fragment classification and the datasets that serve …

Anomaly Detection For Multi-System Bug Triage, Gibran Miguel Zavala Gamero, Hayoung Cheon, Mustafa Iqbal

SMU Data Science Review

Large-scale software systems produce vast volumes of logs and telemetry, making manual incident triage slow and error prone. This study presents an unsupervised anomaly detection pipeline that fuses logs, metrics, and traces through late fusion. Using Hybrid Ensemble modeling with Isolation Forest, and Long Short-Term Memory (LSTM) Deep Learning model, the system detects cross-service anomalies producing and assigning a composite triage score reflecting severity and impact. Ranked alerts are categorized into Critical, High, or Medium priorities for review. A retrieval-augmented generation (RAG) layer enriches results with contextual summaries for explainable triage. Evaluated on synthetic multi-service datasets, the pipeline …

Exploring Neural Network Structure Code Reuse In The Open-Source Community For Improving Maintenance, Xiaoning Ren, Yuekun Wang, Chongyang Liu, Yueming Wu, Qiang Hu, Lijun Zhang, Yinxing Xue

Research Collection School Of Computing and Information Systems

Neural networks (NNs) have rapidly advanced, demonstrating exceptional performance across various fields, leading to a surge in open-source NN projects. The complexity and rapid growth of these projects pose significant challenges for maintenance within the open-source community. Given that NN architecture code is the core asset of NN projects, understanding its reuse in the open-source community is essential for effective maintenance, such as reducing redundancy and identifying potential intellectual property violations. While prior studies have examined code reuse in open-source projects, they have two key limitations: They do not specifically address NN structure code, and they rely on manually selected …

How Agile Became The Design Philosophy Of Ai Fishbowl Under Real-World Constraints, Jad Saad

University Honors Theses

This capstone review examines the development of AI Fishbowl, a public-facing, interactive artificial intelligence system, as a case study in how Agile methods evolve from a project management tool into a design philosophy under real-world constraints. Although the project adopted an Agile workflow early on through a Kanban-style task management approach, the initial system design and architecture were still shaped by a largely plan-first mindset. This created a mismatch between flexible process and rigid design assumptions, which became increasingly apparent as the team moved from high-level architecture into implementation.

A critical turning point occurred when early architectural plans proved difficult …

Designing For Trust In Chat-Based Question Answering Systems: An Exchange-Based Retrieval Approach, Nathan Mccutchen

Master's Theses

Community chat platforms such as Discord and Slack support spontaneous, collaborative communication but make it difficult to retrieve previously discussed information. As conversations accumulate, valuable exchanges become buried, leading to repeated questions and sustained burden on experienced community members.

This work contributes a set of design requirements for question-answering systems operating over unstructured chat data, a Discord bot prototype implementing those requirements named Echo, and an empirical evaluation of how such a system affects user trust. Rather than encoding discrete question-answer pairs or generating synthetic responses with a language model, Echo indexes conversation topics for semantic retrieval and presents results …

Software Engineering In The Age Of Coding Agents: Failure Modes And Rejection Patterns, Mahd Mohd Hindi

Theses

This thesis investigates the real-world behavior of LLM-driven coding agents that generate code changes and submit pull requests (PRs) to public software repositories. As these tools evolve from autocomplete-style assistants into more autonomous agents, their contributions increasingly interact with socio-technical review processes (human reviewers, bots, CI/CD gates, and project norms). The thesis focuses on understanding why agent-generated PRs are accepted or rejected and what these outcomes reveal about current agent limitations in practical development workflows.

The main objective of this thesis is to systematically characterize rejection patterns and failure modes of agent-generated pull requests in real repositories. Specifically, the thesis …

Optimizing And Fortifying Ai Software Through The Lens Of Artifact Synthesis, Jieke Shi

Dissertations and Theses Collection (Open Access)

Artificial Intelligence (AI) has transformed the software landscape, ushering in a new era of intelligent systems that increasingly shape our daily lives. This transformation is evident in various domains, including Software Engineering (SE), where Large Language Models (LLMs) support many development tools, and control systems, where self-driving cars and autonomous drones rely on deep learning models for real-time decision-making. These AI systems are collectively referred to as AI software, with the former categorized as AI4SE software (AI for Software Engineering) and the latter as AI4Control software (AI for Control). As AI software becomes central to modern computing infrastructure, its reliability …

Codeultrafeedback: An Llm-As-A-Judge Dataset For Aligning Large Language Models To Coding Preferences, Martin Weyssow, Aton Kamanda, Xin Zhou, Houari Sahraoui

Research Collection School Of Computing and Information Systems

Evaluating the alignment of large language models (LLMs) with user-defined coding preferences is a challenging endeavor that requires a deep assessment of LLMs' outputs. Existing methods and benchmarks rely primarily on automated metrics and static analysis tools, which often fail to capture the nuances of user instructions and LLM outputs. To address this gap, we introduce the LLM-as-a-Judge evaluation framework and present CodeUltraFeedback, a comprehensive dataset for assessing and improving LLM alignment with coding preferences. CodeUltraFeedback consists of 10,000 coding instructions, each annotated with four responses generated from a diverse pool of 14 LLMs. These responses are annotated using GPT-3.5 …

Invert Your Prompt: Editing-Aware Diffusion Inversion, Yangyang Xu, Wenqi Shao, Yong Du, Haiming Zhu, Yang Zhou, Jiayuan Xie, Ping Luo, Shengfeng He

Research Collection School Of Computing and Information Systems

Recent advancements in text-guided diffusion models have enabled powerful image manipulation capabilities. However, balancing reconstruction fidelity and editability for real images remains a significant challenge. In this work, we introduce Editing Inversion (EditInv), a novel framework that inverts and edits real images for specific editing tasks by optimizing specific prompt embeddings within the extended  space. By leveraging distinct embeddings across different U-Net layers and time steps, EditInv seamlessly integrates inversion and editing through reciprocal optimization, ensuring both high fidelity and precise editability. This hierarchical editing mechanism classifies tasks into structure, appearance, and global edits, optimizing only those embeddings that are …