Software Engineering Commons^™

Development Of Interactive Games On An Affordable Braille Display, Daniel Tsivkovski, Dylan Ravel, Maryam Etezad

Student Scholar Symposium Abstracts and Posters

Developing an affordable and STEM learning-focused Braille display addresses a significant disparity in the market for Braille displays, where most fail to provide a cost-effective, accessible, and education-oriented solution. This research aims to bridge this gap through innovative hardware and software development, offering a comprehensive learning experience to elementary school children (K-6) who are blind/visually impaired. The hardware features a piezo-electric tactile display that displays up to six Braille characters at once or a shape in an 8x8 pin array configuration. The educational software includes a user-friendly website packed with engaging STEM activities specifically designed for blind/visually impaired children. The …

Improving The Reproducibility Of Deep Learning Software: An Initial Investigation Through A Case Study Analysis, Nikita Ravi, Abhinav Goel, James C. Davis, George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

The field of deep learning has witnessed significant breakthroughs, spanning various applications, and fundamentally transforming current software capabilities. However, alongside these advancements, there have been increasing concerns about reproducing the results of these deep learning methods. This is significant because reproducibility is the foundation of reliability and validity in software development, particularly in the rapidly evolving domain of deep learning. The difficulty of reproducibility may arise due to several reasons, including having differences from the original execution environment, incompatible software libraries, proprietary data and source code, lack of transparency, and the stochastic nature in some software. A study conducted by …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the “best of both worlds,” using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the “best of both worlds,” using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …

Globelly: The Travel App, Diana S. Alvarez

Honors Capstones

My honors capstone project, Globelly: The Travel App, began as a feature-rich Android application designed to simplify travel planning, enhance global exploration, and foster community-driven sharing among travelers. The app was envisioned to integrate real-time suggestions using APIs like Yelp and TripAdvisor, incorporate a badge-based gamification system, and support advanced customization and privacy controls. While not all of these features were implemented in the final version, the project achieved a solid and functional foundation focused on core travel-sharing experiences.

Developed using Java, XML, and the MVC architecture in Android Studio, the completed app allows users to pin locations they’ve …

Tutortech: A Web App For A Smarter And More Efficient Tutoring System, Smarika Pathak

2025 Spring Honors Capstone Projects - Archive

The Computer Science and Engineering (CSE) department faces challenges with managing its tutoring services, especially tracking attendance, booking sessions, and overall management of the tutoring system - all of which severely limits the ability for tutors to connect and engage with students. To help overcome these issues, TutorTech, a web-based application that provides improved management of the tutoring system and supports more engaging learning experiences between students and tutors was designed. Through this project, the aim was to optimize the TutorTech search capabilities - assisting students to find tutors based on skills, while also considering the effect of user interface …

Reducing Stigma Around Neurodiversity Through The Use Of Celebratory Technology Ice Breakers In First-Year Undergraduate Classrooms, Briana Craig

Electrical Engineering and Computer Science (MS) Theses

Celebratory technology for Neurodiversity is a new paradigm in the field of human computer interaction; it focuses on reducing stigma surrounding neurodivergent labels and behaviors. Celebratory technology aims to highlight the strengths of neurodiversity rather than fixing socially undesired traits, shifting the responsibility for change from neurodivergent individuals to society's attitudes. Stigma reduction can be accomplished through providing high quality interactions, where anyone can meet and learn about positive traits in others as well as learn of interests' others have in common, thus reframing neurodivergence as inclusion in human diversity rather than a condition to be stigmatized or objectified. This …

Computer Vision In Soccer: Yolov11 Analytics Engine For Quantifying Game Strategy, Connor S. Maurer

Data Science Undergraduate Honors Theses

Single-shot object detection capabilities significantly reduce computational overhead for real-time computer vision in sports analytics at 60 FPS. YOLO11’s lightweight CNN gives promising accuracy while meeting the low-latency demand of dynamic soccer matches. As data-driven approaches take over the sport of soccer, efficient player tracking systems become critical for informing coach’s strategies. I prototype the ETL (Extract, Transform, Load) process of data collected from a single- shot detection program and evaluate its viability for estimating player fatigue. YOLO11 detects players, the ball, and other characteristics, with the output transformed by homography to estimate the positions in the real world. These …

Towards Visual Inertial Navigation With Fixed Tetrahedral Targets, Joao Leonardo Silva Cotta

Theses and Dissertations

This dissertation presents a robust method for 6DoF position estimation under impaired visual conditions utilizing a minimum 4-point Perspective-n-Point (P4P) solver designed for tetrahedral targets. Using SO(3) × R 3 instead of SE(3), the method uses a Lie group-based formulation to discriminate between rotation and translation, thereby enabling computationally efficient, resource-conscious op- optimization while preserving correct geometric behavior. Designed using the contemporary C++17 library ShomerTarget, the solver is analytically formulated and assessed under pragmatic robotic conditions. Particularly in low-light and high-dynamic environments, experiments on embedded systems, UAVs, and NASA’s Astrobee show that the proposed solver attains enhanced accuracy compared to …

Investigating Students’ Proficiency Across Statistical Software And Preferences Of Statistical Software Design, Sabrina White

Honors College Theses

This paper investigated students’ perceptions of their proficiency with statistical software applications and their preferences regarding software features. Results indicated that students’ statistical and coding experience, as well as the specific application used, did not significantly influence their self-perceived proficiency. This suggests that it may be more effective to focus on building student skills within a chosen application, rather than tailoring the application to match existing student capabilities. While students showed clear preferences for certain features, favoring clarity over depth, flexibility over safeguards, and built-in checks over unrestricted freedom, these preferences generally leaned toward balanced design rather than extremes. This …

Ml Playground: Data Modification/Preprocessing And Model Simulation Tool, Marco D. Cerrato

Electronic Theses, Projects, and Dissertations

There is a heavy reliance on programming when it comes to learning machine learning (ML). This often creates barriers for students and newcomers unfamiliar with coding. While the lessons you learn in the classroom provide essential foundational understanding, some technical or practical aspects of ML—such as data preprocessing, feature engineering, and model tuning—are best learned through hands-on interaction. ML Playground was developed to act as a proof-of-concept application to address this gap by offering a browser-based, graphical user interface that lets users engage with core ML workflows without writing code. Designed with educational accessibility in mind, the application allows users …

Tailoring Transformer-Based Deep Learning For Code Generation And Translation, Imam Nur Bani Yusuf

Dissertations and Theses Collection (Open Access)

Software is increasingly pervasive in modern society, making the effective translation of human intent into code essential. Novice programmers often struggle with domain-specific code due to limited background knowledge, while experienced developers face challenges in maintaining evolving largescale codebases. Traditional pattern-based approaches address these issues, but such approaches are task-specific and require significant adaptation for different tasks. Transformer-based models offer a more flexible alternative, as the same architecture can be tailored for diverse programming tasks.

This dissertation investigates how Transformer-based models can be customized for various code generation and translation tasks. First, it introduces Transformer-based approaches that assist end-users with …

Enriching Automatic Test Case Generation By Extracting Relevant Test Inputs From Bug Reports, Wendkuuni C. Ouedraogo, Laura Plein, Kader Kabore, Andrew Habib, Jacques Klein, David Lo, Tegawende F. Bissyande

Research Collection School Of Computing and Information Systems

The quality of software is closely tied to the effectiveness of the tests it undergoes. Manual test writing, though crucial for bug detection, is time-consuming, which has driven significant research into automated test case generation. However, current methods often struggle to generate relevant inputs, limiting the effectiveness of the tests produced. To address this, we introduce BRMiner, a novel approach that leverages Large Language Models (LLMs) in combination with traditional techniques to extract relevant inputs from bug reports, thereby enhancing automated test generation tools. In this study, we evaluate BRMiner using the Defects4J benchmark and test generation tools such as …

Enhancing Deliberativeness: Evaluating The Impact Of Multimodal Reflection Nudges, Shun Yi Yeo, Zhuoqun Jiang, Anthony Tang, Simon Tangi Perrault

Research Collection School Of Computing and Information Systems

Nudging participants with text-based reflective nudges enhances deliberation quality on online deliberation platforms. The effectiveness of multimodal reflective nudges, however, remains largely unexplored. Given the multi-sensory nature of human perception, incorporating diverse modalities into self-reflection mechanisms has the potential to better support various reflective styles. This paper explores how presenting reflective nudges of different types (direct: persona and indirect: storytelling) in different modalities (text, image, video and audio) affects deliberation quality. We conducted two user studies with 20 and 200 participants respectively. The first study identifies the preferred modality for each type of reflective nudges, revealing that text is most …

Prompting An Embodied Ai Agent: How Embodiment And Multimodal Signaling Affects Prompting Behaviour, Tianyi Zhang, Colin Au Yeung, Emily Aurelia, Yuki Onishi, Neil Chulpongsatorn, Jiannan Li, Anthony Tang

Research Collection School Of Computing and Information Systems

Current voice agents wait for a user to complete their verbal instruction before responding; yet, this is misaligned with how humans engage in everyday conversational interaction, where interlocutors use multimodal signaling (e.g. nodding, grunting, or looking at referred to objects) to ensure conversational grounding. We designed an embodied VR agent that exhibits multimodal signaling behaviors in response to situated prompts, by turning its head, or by visually highlighting objects being discussed or referred to. We explore how people prompt this agent to design and manipulate the objects in a VR scene. Through a Wizard of Oz study, we found that …

Quantitative Runtime Monitoring Of Ethereum Transaction Attacks, Xinyao Xu, Ziyu Mao, Jianzhong Su, Xingwei Lin, David Basin, Jun Sun, Jingyi Wang

Research Collection School Of Computing and Information Systems

The rapid growth of decentralized applications, while revolutionizing financial transactions, has created an attractive target for malicious attacks. Existing approaches to detecting attacks often rely on predefined rules or simplistic and overly-specialized models, which lack the flexibility to handle the wide spectrum of diverse and dynamically changing attack types. To address this challenge, we present a general and extensible framework, MoE (Monitoring Ethereum), that leverages runtime verification to detect a wide range of attacks on Ethereum. MoE features an expressive attack modeling language, based on Metric First-order Temporal Logic (MFOTL), that can formalize a wide range of attacks. We integrate …

Integrating Path Selection For Symbolic Execution And Variable Selection For Constraint Solving, Shunkai Zhu, Jun Sun, Jingyi Wang, Zhenbang Chen, Peng Cheng

Research Collection School Of Computing and Information Systems

Symbolic execution is a powerful technique that can accurately synthesize program inputs for program testing through constraint solving. Applying symbolic execution effectively means that we must solve two searching problems efficiently. One is to search through the many program paths and the other is, given a particular path condition, to search through the numerous variable assignments to identify one satisfying solution. With few exceptions, existing symbolic execution engines treat constraint solvers as black boxes. As a result, the two searches are completely separated, which results in much redundancy (i.e., the same variable assignments may be tried for solving many program …

Tensorjsfuzz: Effective Testing Of Web-Based Deep Learning Frameworks Via Input-Constraint Extraction, Lili Quan, Xiaofei Xie, Qianyu Guo, Lingxiao Jiang, Sen Chen, Junjie Wang, Xiaohong Li

Research Collection School Of Computing and Information Systems

The 2025 ACM Web Conference (WWW '25) took place from April 28 to May 2, 2025, in the Sydney Convention & Exhibition Centre, Australia. Its logo, featuring the Sydney Harbour Bridge, symbolizes the core "connecting" function of the Web. Formerly known as the International World Wide Web Conference (WWW), this event originated at CERN in 1994 and has long served as the premier venue for presenting and discussing research, development, standards, and applications related to the Web.The 2025 ACM Web Conference (WWW'25) took place from April 28 to May 2, 2025, in the Sydney Convention & Exhibition Centre, Australia. Its …

Decictor: Towards Evaluating The Robustness Of Decision-Making In Autonomous Driving Systems, Mingfei Cheng, Xiaofei Xie, Yuan Zhou, Junjie Wang, Guozhu Meng, Kairui Yang

Research Collection School Of Computing and Information Systems

Autonomous Driving System (ADS) testing is crucial in ADS development, with the current primary focus being on safety. However, the evaluation of non-safety-critical performance, particularly the ADS's ability to make optimal decisions and produce optimal paths for autonomous vehicles (AVs), is also vital to ensure the intelligence and reduce risks of AVs. Currently, there is little work dedicated to assessing the robustness of ADSs' path-planning decisions (PPDs), i.e., whether an ADS can maintain the optimal PPD after an insignificant change in the environment. The key challenges include the lack of clear oracles for assessing PPD optimality and the difficulty in …