Digital Commons Network^™

Fdi : Attack Neural Code Generation Systems Through User Feedback Channel, Zhensu Sun, Xiaoning Du, Xiapu Luo, Fu Song, David Lo, Li Li

Research Collection School Of Computing and Information Systems

Neural code generation systems have recently attracted increasing attention to improve developer productivity and speed up software development. Typically, these systems maintain a pre-trained neural model and make it available to general users as a service (e.g., through remote APIs) and incorporate a feedback mechanism to extensively collect and utilize the users' reaction to the generated code, i.e., user feedback. However, the security implications of such feedback have not yet been explored. With a systematic study of current feedback mechanisms, we find that feedback makes these systems vulnerable to feedback data injection (FDI) attacks. We discuss the methodology of FDI …

Monocular Bev Perception Of Road Scenes Via Front-To-Top View Projection, Wenxi Liu, Qi Li, Weixiang Yang, Jiaxin Cai, Yuanhong Yu, Yuexin Ma, Shengfeng He, Jia Pan

Research Collection School Of Computing and Information Systems

HD map reconstruction is crucial for autonomous driving. LiDAR-based methods are limited due to expensive sensors and time-consuming computation. Camera-based methods usually need to perform road segmentation and view transformation separately, which often causes distortion and missing content. To push the limits of the technology, we present a novel framework that reconstructs a local map formed by road layout and vehicle occupancy in the bird's-eye view given a front-view monocular image only. We propose a front-to-top view projection (FTVP) module, which takes the constraint of cycle consistency between views into account and makes full use of their correlation to strengthen …

Putting Gpt-4o To The Sword: A Comprehensive Evaluation Of Language, Vision, Speech, And Multimodal Proficiency, Sakib Shahriar, Brady D. Lund, Nishith Reddy Mannuru, Muhammad Arbab Arshad, Kadhim Hayawi, Ravi Varma Kumar Bevara, Aashrith Mannuru, Laiba Batool

All Works

As large language models (LLMs) continue to advance, evaluating their comprehensive capabilities becomes significant for their application in various fields. This research study comprehensively evaluates the language, vision, speech, and multimodal capabilities of GPT-4o. The study employs standardized exam questions, reasoning tasks, and translation assessments to assess the model’s language capability. Additionally, GPT-4o’s vision and speech capabilities are tested through image classification and object-recognition tasks, as well as accent classification. The multimodal evaluation assesses the model’s performance in integrating visual and linguistic data. Our findings reveal that GPT-4o demonstrates high accuracy and efficiency across multiple domains in language and reasoning …

Paper-Recorded Ecg Digitization Method With Automatic Reference Voltage Selection For Telemonitoring And Diagnosis, Liang Hung Wang, Chao Xin Xie, Tao Yang, Hong Xin Tan, Ming Hui Fan, I. Chun Kuo, Zne Jung Lee, Tsung Yi Chen, Pao Cheng Huang, Shih Lun Chen, Patricia Angela R. Abu

Department of Information Systems & Computer Science Faculty Publications

In electrocardiograms (ECGs), multiple forms of encryption and preservation formats create difficulties for data sharing and retrospective disease analysis. Additionally, photography and storage using mobile devices are convenient, but the images acquired contain different noise interferences. To address this problem, a suite of novel methodologies was proposed for converting paper-recorded ECGs into digital data. Firstly, this study ingeniously removed gridlines by utilizing the Hue Saturation Value (HSV) spatial properties of ECGs. Moreover, this study introduced an innovative adaptive local thresholding method with high robustness for foreground–background separation. Subsequently, an algorithm for the automatic recognition of calibration square waves was proposed …

Bridging Disciplines With Ai-Powered Coding: Empowering Non-Stem Students To Build Advanced Apis In The Humanities, Daniel Plate, James Hutson

Faculty Scholarship

The integration of AI-powered coding assistants, such as Cursor AI, GitHub Copilot, and Replit’s Ghostwriter AI, represents a transformative shift in programming education, particularly for non-STEM students. These tools democratize coding by enabling natural language code generation, intelligent error correction, and context-aware assistance within familiar coding environments. This article explores how these technologies empower educators across disciplines to introduce basic and advanced coding concepts to humanities students, a demographic traditionally underserved in programming education. By leveraging AI, instructors can teach non-STEM students the foundational principles of coding and guide them through the development of sophisticated projects, such as building APIs …

Developing Empathetic Ai: Exploring The Potential Of Artificial Intelligence To Understand And Simulate Family Dynamics And Cultural Identity, Emily Barnes, James Hutson

Faculty Scholarship

The rapid advancement of Artificial Intelligence (AI) has significantly impacted various domains. Yet, the exploration of AI's potential to develop a deep understanding of family culture and identity remains underexplored. This study introduces the concept of "a love of grandma and apple pie" to symbolize the potential of various AI to internalize and appreciate familial relationships, cultural traditions, and personal identity. The proposed study would investigate how an advanced deep learning model, trained on diverse unstructured datasets—including multimedia data from 100 families-could learn and reflect human-like emotions, values, and cultural understanding. Utilizing Convolutional Neural Networks (CNNs) for visual data processing …

Artificial Intelligence In Orthopaedic Education: A Comparative Analysis Of Chatgpt And Bing Ai’S Orthopaedic In-Training Examination Performance, Clark Chen, Vivek Biololikar, Duncan Vannest, James Raphael, Gene Shaffer

Einstein Health Papers

Background: This study evaluated the performance of generative artificial intelligence (AI) models on the Orthopaedic In-Training Examination (OITE), an annual exam administered to U.S. orthopaedic residency programs. Methods: ChatGPT 3.5 and Bing AI GPT 4.0 were evaluated on standardised sets of multiple-choice questions drawn from the American Academy of Orthopaedic Surgeons OITE online question bank spanning 5 years (2018–2022). A total of 1165 questions were posed to each AI system. The performance of both systems was standardised using the latest versions of ChatGPT 3.5 and Bing AI GPT 4.0. Historical data of resident scores taken from the annual OITE technical …

Quality Assurance In Software Engineering: A Journey Towards Explainable Automated Solutions, Ratnadira Widyasari

Dissertations and Theses Collection (Open Access)

In today's digital era, the pervasive influence of software on daily life underscores the necessity for high-quality and reliable systems. Software failures can result in substantial harm and financial losses, highlighting the pivotal role of Software Quality Assurance (SQA). While automated SQA techniques have evolved to aid developers in ensuring software quality, the necessity for explainability in these automated solutions has become equally important. For example, in automated fault localization, only identifying suspicious locations is insufficient; it is essential to provide reasoning on why these locations are suspicious. This dissertation presents a series of interconnected studies aimed at developing explainable …

Estimating Dis Performance Using Mininet, Ryan D. Winz

Theses and Dissertations

Real time distributed simulation is an exceptionally useful tool for training and wargaming used by the military and industry alike. This research aims to provide scenarios and structures to evaluate the effect of distributing simulations among different compute nodes. Specific scenarios involve the analysis of performance as a function of latency and the degree network protocols and reliability affect simulation performance. Various standards exist for administering geographically separated simulations. The focus of this thesis will be on the Distributed Interactive Simulation standard, a peer-to-peer open standard for simulation messages to adhere to, but lessons can be extended to other standards.

Advancing Robust Autonomous System Localization: Labeling Optimizations For Convolutional Neural Networks, Jeffrey L. Choate

Theses and Dissertations

AAR is increasingly critical as aircraft autonomy advances, particularly for the Global Strike mission of the USAF, enhancing operational range and endurance. Traditional methods relying on GPS and custom communication links are limited in GPS-denied environments. This dissertation advances a single camera method to estimate object pose across three interconnected studies. The system trains a CNN on synthetic imagery to predict bboxes for object components, Solve-PnP algorithm finds the 6DoF pose, then employs novel pseudo-labeling on real-world images. These findings are pivotal for the AAR community and contribute to robotics, computer vision, and CNN research. By enabling robust GPS-free autonomous …

Autonomous Experimentation For Accelerated Calibration Of Fused Deposition Modeling 3d Printers, Graig S. Ganitano

Theses and Dissertations

Additive Manufacturing (AM), also known as 3D printing, has emerged as a key component of Industry 4.0, enabling reduced cost, quick production, greater sustainability, and increased design complexity compared to its traditional manufacturing counterpart. Currently, Fused Deposition Modeling (FDM) technology dominates the AM market with respect to the number of 3D printers in use. However, the FDM process is sensitive to changes in system configuration, especially the feedstock material. Utilizing a new feedstock requires a time-consuming trial-and-error process to identify optimal settings for a large number of process parameters, acting as a barrier to the technology.

To enable greater accessibility …

Machine Visual Perception For Autonomous Docking Maneuvers, Derek B. Worth

Theses and Dissertations

This dissertation presents a novel approach to autonomous docking using machine learning for visual perception, particularly during probe and drogue aerial refueling. Autonomous vehicles have become pervasive in both civilian and defense sectors, and their ability to interact with their surroundings and each other autonomously is critical for future operations. Traditional methods relying on signals or inertial sensors face significant limitations such as interference, jamming, and drift. This research focuses on developing a computer vision-based solution to overcome these limitations. A novel pipeline, termed relative vectoring, is introduced, which utilizes dual object detection and machine learning to estimate relative positions …

Certified Continual Learning For Neural Network Regression, Hong Long Pham, Jun Sun

Research Collection School Of Computing and Information Systems

On the one hand, there has been considerable progress on neural network verification in recent years, which makes certifying neural networks a possibility. On the other hand, neural network in practice are often re-trained over time to cope with new data distribution or for solving different tasks (a.k.a. continual learning). Once re-trained, the verified correctness of the neural network is likely broken, particularly in the presence of the phenomenon known as catastrophic forgetting. In this work, we propose an approach called certified continual learning which improves existing continual learning methods by preserving, as long as possible, the established correctness properties …

Low/No-Code And Traditional Code Integration In Digital Banking, Kim Siang Yeo, Alan @ Ali Madjelisi Megargel

Research Collection School Of Computing and Information Systems

This paper seeks to combine the merits of Low/No-Code Programming (LNCP) with Traditional Programming (TP) systems to achieve true “agility” when creating banking infrastructure. While it is easy to fall prey to Shiny Object Syndrome in today’s dynamic and fast-paced banking technology world, it is not easy to pick out the right technology for today and tomorrow’s financial industry. Instead, LNCPs allow us to hedge all bets by equally lowering the technical entry barriers for each technology. The added integration of TP, when needed, also rounds out the faults related to sole LNCP use and provides any bank with a …

Performance Of 5 Prominent Large Language Models In Surgical Knowledge Evaluation: A Comparative Analysis, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

The Impact Of Data Recovery Criteria, Data Backup Schedule And Data Backup Prosses On The Efficiency Of Data Recovery Management In Data Centers, Maen T. Alrashdan, Mutaz Abdel Wahed, Emran Aljarrah, Mohammad Tubishat, Malek Alzaqebah, Nader Aljawarneh

All Works

A large-scale cloud data center must have a low failure incidence rate and great service dependability and availability. However, due to several issues, such as hardware and software malfunctions that regularly cause task and job failure, large-scale cloud data centers still have high failure rates. These mistakes can have a substantial impact on cloud service dependability and need a large resource allocation to recover from failures. Therefore, it is important to have an efficient management of data recovery to protect organizations data from loss. This paper aims to study some factors that may improve the management of data recovery by …

Unraveling The Dynamics Of Stable And Curious Audiences In Web Systems, Rodrigo Alves, Antoine Ledent, Renato Assunção, Pedro Vaz-De-Melo, Marius Kloft

Research Collection School Of Computing and Information Systems

We propose the Burst-Induced Poisson Process (BPoP), a model designed to analyze time series data such as feeds or search queries. BPoP can distinguish between the slowly-varying regular activity of a stable audience and the bursty activity of a curious audience, often seen in viral threads. Our model consists of two hidden, interacting processes: a self-feeding process (SFP) that generates bursty behavior related to viral threads, and a non-homogeneous Poisson process (NHPP) with step function intensity that is influenced by the bursts from the SFP. The NHPP models the normal background behavior, driven solely by the overall popularity of the …

Probing Effects Of Contextual Bias On Number Magnitude Estimation, Xuehao Du, Ping Ji, Wei Qin, Lei Wang, Yunshi Lan

Research Collection School Of Computing and Information Systems

The semantic understanding of numbers requires association with context. However, powerful neural networks overfit spurious correlations between context and numbers in training corpus can lead to the occurrence of contextual bias, which may affect the network's accurate estimation of number magnitude when making inferences in real-world data. To investigate the resilience of current methodologies against contextual bias, we introduce a novel out-of- distribution (OOD) numerical question-answering (QA) dataset that features specific correlations between context and numbers in the training data, which are not present in the OOD test data. We evaluate the robustness of different numerical encoding and decoding methods …

Aligning Human And Computational Coherence Evaluations, Jia Peng Lim, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Automated coherence metrics constitute an efficient and popular way to evaluate topic models. Previous work presents a mixed picture of their presumed correlation with human judgment. This work proposes a novel sampling approach to mining topic representations at a large scale while seeking to mitigate bias from sampling, enabling the investigation of widely used automated coherence metrics via large corpora. Additionally, this article proposes a novel user study design, an amalgamation of different proxy tasks, to derive a finer insight into the human decision-making processes. This design subsumes the purpose of simple rating and outlier-detection user studies. Similar to the …

Meta-Learning For Multi-Family Android Malware Classification, Yao Li, Dawei Yuan, Tao Zhang, Haipeng Cai, David Lo, Cuiyun Gao, Xiapu Luo, He Jiang

Research Collection School Of Computing and Information Systems

With the emergence of smartphones, Android has become a widely used mobile operating system. However, it is vulnerable when encountering various types of attacks. Every day, new malware threatens the security of users' devices and private data. Many methods have been proposed to classify malicious applications, utilizing static or dynamic analysis for classification. However, previous methods still suffer from unsatisfactory performance due to two challenges. First, they are unable to address the imbalanced data distribution problem, leading to poor performance for malware families with few members. Second, they are unable to address the zero-day malware (zero-day malware refers to malicious …

Bugs In Pods: Understanding Bugs In Container Runtime Systems, Jiongchi Yu, Xiaofei Xie, Ceng Zhang, Sen Chen

Research Collection School Of Computing and Information Systems

Container Runtime Systems (CRSs), which form the foundational infrastructure of container clouds, are critically important due to their impact on the quality of container cloud implementations. However, a comprehensive understanding of the quality issues present in CRS implementations remains lacking. To bridge this gap, we conduct the first comprehensive empirical study of CRS bugs. Specifically, we gather 429 bugs from 8,271 commits across dominant CRS projects, including runc, gvisor, containerd, and cri-o. Through manual analysis, we develop taxonomies of CRS bug symptoms and root causes, comprising 16 and 13 categories, respectively. Furthermore, we evaluate the capability of popular testing approaches, …

Genixer : Empowering Multimodal Large Language Models As A Powerful Data Generator, Henry Hengyuan Zhao, Pan Zhou, Mike Zheng Shou

Research Collection School Of Computing and Information Systems

Multimodal Large Language Models (MLLMs) demonstrate exceptional problem-solving capabilities, but few research studies aim to gauge the ability to generate visual instruction tuning data. This paper proposes to explore the potential of empowering MLLMs to generate data independently without relying on GPT-4. We introduce Genixer, a comprehensive data generation pipeline consisting of four key steps: (i) instruction data collection, (ii) instruction template design, (iii) empowering MLLMs, and (iv) data generation and filtering. Additionally, we outline two modes of data generation: task-agnostic and task-specific, enabling controllable output. We demonstrate that a synthetic VQA-like dataset trained with LLaVA1.5 enhances performance on 10 …

Imbalanced Graph Classification With Multi-Scale Oversampling Graph Neural Networks, Rongrong Ma, Guansong Pang, Ling Chen

Research Collection School Of Computing and Information Systems

One main challenge in imbalanced graph classification is to learn expressive representations of the graphs in under-represented (minority) classes. Existing generic imbalanced learning methods, such as oversampling and imbalanced learning loss functions, can be adopted for enabling graph representation learning models to cope with this challenge. However, these methods often directly operate on the graph representations, ignoring rich discriminative information within the graphs and their interactions. To tackle this issue, we introduce a novel multi-scale oversampling graph neural network (MOSGNN) that learns expressive minority graph representations based on intra- and inter-graph semantics resulting from oversampled graphs at multiple scales - …

Adavis: Adaptive And Explainable Visualization Recommendation For Tabular Data, Songheng Zhang, Haotian Li, Huamin Qu, Yong Wang

Research Collection School Of Computing and Information Systems

Automated visualization recommendation facilitates the rapid creation of effective visualizations, which is especially beneficial for users with limited time and limited knowledge of data visualization. There is an increasing trend in leveraging machine learning (ML) techniques to achieve an end-to-end visualization recommendation. However, existing ML-based approaches implicitly assume that there is only one appropriate visualization for a specific dataset, which is often not true for real applications. Also, they often work like a black box, and are difficult for users to understand the reasons for recommending specific visualizations. To fill the research gap, we propose AdaVis, an adaptive and explainable …

Granular3d: Delving Into Multi-Granularity 3d Scene Graph Prediction, Kaixiang Huang, Jingru Yang, Jin Wang, Shengfeng He, Zhan Wang, Haiyan He, Qifeng Zhang, Guodong Lu

Research Collection School Of Computing and Information Systems

This paper addresses the significant challenges in 3D Semantic Scene Graph (3DSSG) prediction, essential for understanding complex 3D environments. Traditional approaches, primarily using PointNet and Graph Convolutional Networks, struggle with effectively extracting multi-grained features from intricate 3D scenes, largely due to a focus on global scene processing and single-scale feature extraction. To overcome these limitations, we introduce Granular3D, a novel approach that shifts the focus towards multi-granularity analysis by predicting relation triplets from specific sub-scenes. One key is the Adaptive Instance Enveloping Method (AIEM), which establishes an approximate envelope structure around irregular instances, providing shape-adaptive local point cloud sampling, thereby …

Solving Fractional Differential Equations On A Quantum Computer: A Variational Approach, Fong Yew Leong, Dax Enshan Koh, Jian Feng Kong, Siong Thye Goh, Jun Yong Khoo, Wei Bin Ewe, Hongying Li, Jayne Thompson, Dario Poletti

Research Collection School Of Computing and Information Systems

We introduce an efficient variational hybrid quantum-classical algorithm designed for solving Caputo time-fractional partial differential equations. Our method employs an iterable cost function incorporating a linear combination of overlap history states. The proposed algorithm is not only efficient in terms of time complexity but also has lower memory costs compared to classical methods. Our results indicate that solution fidelity is insensitive to the fractional index and that gradient evaluation costs scale economically with the number of time steps. As a proof of concept, we apply our algorithm to solve a range of fractional partial differential equations commonly encountered in engineering …

Neuron Sensitivity Guided Test Case Selection, Dong Huang, Qingwen Bu, Yichao Fu, Yuhao Qing, Xiaofei Xie, Junjie Chen, Heming Cui

Research Collection School Of Computing and Information Systems

Deep Neural Networks (DNNs) have been widely deployed in software to address various tasks (e.g., autonomous driving, medical diagnosis). However, they can also produce incorrect behaviors that result in financial losses and even threaten human safety. To reveal and repair incorrect behaviors in DNNs, developers often collect rich, unlabeled datasets from the natural world and label them to test DNN models. However, properly labeling a large number of datasets is a highly expensive and time-consuming task. To address the above-mentioned problem, we propose NSS, Neuron Sensitivity Guided Test Case Selection, which can reduce the labeling time by selecting valuable test …

Image-Guided Patient-Specific Optimization Of Catheter Placement For Convection-Enhanced Nanoparticle Delivery In Recurrent Glioblastoma, Chengyue Wu, David A Hormuth, Chase D Christenson, Ryan T Woodall, Michael R A Abdelmalik, William T Phillips, Thomas J R Hughes, Andrew J Brenner, Thomas E Yankeelov

Faculty, Staff and Student Publications

Background: Proper catheter placement for convection-enhanced delivery (CED) is required to maximize tumor coverage and minimize exposure to healthy tissue. We developed an image-based model to patient-specifically optimize the catheter placement for rhenium-186 (186Re)-nanoliposomes (RNL) delivery to treat recurrent glioblastoma (rGBM).

Methods: The model consists of the 1) fluid fields generated via catheter infusion, 2) dynamic transport of RNL, and 3) transforming RNL concentration to the SPECT signal. Patient-specific tissue geometries were assigned from pre-delivery MRIs. Model parameters were personalized with either 1) individual-based calibration with longitudinal SPECT images, or 2) population-based assignment via leave-one-out cross-validation. The concordance correlation coefficient …

Dynamic Difficulty Adjustment For Combat Systems In Role-Playing Genre Video Games, Cheuk Man Chan

Dissertations, Theses, and Capstone Projects

Static difficulty adjustment has been applied to video games since their inception. However, dynamic difficulty adjustment did not become a topic of interest in either the academic fields or the industry until the turn of the century with sufficient advancement in processing power of computers and console systems. Amongst the work done in this area, most of the focus has either been placed on the action/adventure or the strategy game genre. However, there are only a limited number of studies regarding the role playing game genre which, by the nature of such games, generates a massive amount of data regarding …

Advancing Affective Computing: Emotion Recognition And Tracking Across Diverse Contexts (Varied Environments), Shao Liu

Dissertations, Theses, and Capstone Projects

Affective Computing (AC) is an interdisciplinary field that recognizes, interprets, and processes human emotions. Emotions are complex, involving consciousness, physical sensations, and behavioral expressions, and are significant in various domains like mental health, human-computer interaction, and social security. Real-world applications of AC include monitoring drivers’ emotional states to improve road safety and understanding the emotions expressed by artists in visual arts. Traditional methods relying on facial expressions often fall short due to the nuanced nature of emotions, which vary across individuals, cultures, and contexts. Accurate AC systems require sophisticated, multimodal models to handle these variations and external factors like noise …