Digital Commons Network^™

Actor-Critic For Continuous Action Chunks: A Reinforcement Learning Framework For Long-Horizon Robotic Manipulation With Sparse Reward, Jiarui Yang, Bin Zhu, Jingjing Chen, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Existing reinforcement learning (RL) methods struggle with long-horizon robotic manipulation tasks, particularly those involving sparse rewards. While action chunking is a promising paradigm for robotic manipulation, using RL to directly learn continuous action chunks in a stable and data-efficient manner remains a critical challenge. This paper introduces AC3 (Actor-Critic for Continuous Chunks), a novel RL framework that learns to generate high-dimensional, continuous action sequences. To make this learning process stable and dataefficient, AC3 incorporates targeted stabilization mechanisms for both the actor and the critic. First, to ensure reliable policy improvement, the actor is trained with an asymmetric update rule, learning …

Interpretable Machine Learning For In-Home Mild Cognitive Impairment Detection, Budhitama Subagdja, Shanthoshigaa D, Ah-Hwee Tan, Iris Rawtaer

Research Collection School Of Computing and Information Systems

This paper introduces a novel system for in-home cognitive health assessment using ambient sensors and a machine learning technology that can robustly detect mild cognitive impairment (MCI) despite limited available data. The learned model can explain the aspects of individuals’ daily lives led to the prediction, while reliably predicting MCI, providing more insights to healthcare workers for further clinical interventions. We developed the robust transparent machine learning model, based on fusion adaptive resonance theory (Fusion ART) neural network to learn individuals’ daily patterns of activity from continuous sensor data in terms of a suite of digital biomarkers reflecting four key …

Leveraging Large Language Models For Career Mobility Analysis: A Study Of Gender, Race, And Job Change Using Us Online Resume Profiles, Palakorn Achananuparp, Ye Xu, Yao Lu, Xavier Jayaraj Siddarth Ashok, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

We present a large-scale analysis of career mobility of college-educated U.S. workers using online resume profiles to investigate how gender, race, and job change options are associated with upward mobility. This study addresses key research questions of how the job changes affect their upward career mobility, and how the outcomes of upward career mobility differ by gender and race. We address data challenges – such as missing demographic attributes, missing wage data, and noisy occupation labels – through various data processing and Artificial Intelligence (AI) methods. In particular, we develop a large language models (LLMs) based occupation classification method known …

Gui Test Migration Via Abstraction And Concretization, Yakun Zhang, Chen Liu, Xiaofei Xie, Yun Lin, Jin Song Dong, Dan Hao, Lu Zhang

Research Collection School Of Computing and Information Systems

GUI test migration aims to produce test cases with events and assertions to test specific functionalities of a target app. Existing migration approaches typically focus on the widget-mapping paradigm that maps widgets from source apps to target apps. However, since different apps may implement the same functionality in different ways, direct mapping may result in incomplete or buggy test cases, thus significantly impacting the effectiveness of testing the target functionality and the practical applicability of migration approaches.In this article, we propose a new migration paradigm (i.e., the abstraction-concretization paradigm) that first abstracts the test logic for the target functionality and …

Dual-Lora And Quality-Enhanced Pseudo Replay For Multimodal Continual Food Learning, Xinlan Wu, Bin Zhu, Feng Han, Pengkun Jiao, Jingling Chen

Research Collection School Of Computing and Information Systems

Food analysis has become increasingly critical for health-related tasks such as personalized nutrition and chronic disease prevention. However, existing large multimodal models (LMMs) in food analysis suffer from catastrophic forgetting when learning new tasks, requiring costly retraining from scratch. To address this, we propose a novel continual learning framework for multimodal food learning, integrating a Dual-LoRA architecture with Quality-Enhanced Pseudo Replay. We introduce two complementary low-rank adapters for each task: a specialized LoRA that learns task-specific knowledge with orthogonal constraints to previous tasks’ subspaces, and a cooperative LoRA that consolidates shared knowledge across tasks via pseudo replay. To improve the …

Design Principles For Customer-Engaging Digital Service Systems: An Action Research Study, Keng Leng Siau, Xiaofeng Chen, Xin Tan

Research Collection School Of Computing and Information Systems

Digital services represent a business approach employed by organizations to operate in the digital environment. However, systematic development guidelines for developing quality digital service systems are lacking in the literature. The authors identified four general challenges for developing and implementing customer-engaging digital service systems (CEDSS). By employing the method of canonical action research in a digital service system project, they derived 10 design principles for developing high-quality CEDSS. They empirically evaluated the design principles in the development project and through follow-up focus group sessions. The design principles provide applicable and actionable guidelines for the development of CEDSS.

Learning-Based Graph Shrinking For Quantum Optimization Of Constrained Combinatorial Problems, Monit Sharma, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

Graph shrinking has recently emerged as a powerful preprocessing technique for hybrid classical–quantum optimization, enabling variable and constraint reduction before quantum solving. Conventional approaches rely on Semi-Definite Programming (SDP) relaxations to compute vertex correlations, but these methods suffer from high computational overhead, instance-specific tuning, and limited generalizability. In this work, we replace the handcrafted SDP correlation stage with a reinforcement learning (RL) based correlation estimator, trained to predict merge quality directly from graph structure. We reformulate the graph shrinking process as a Markov Decision Process (MDP), design a Graph Neural Network (GNN) policy to guide vertex merging, and integrate the …

Analysis Theories On Artificial Intelligence, Chatgpt, Data Science, And Metaverse: The Case Of Digital Medicine, Yin Yang, Xingyun Liu, Jorge Luis Cuyubamba Dominguez, Yuan Fang, Wen Xie, Bairong Shen, Keng Siau

Research Collection School Of Computing and Information Systems

Healthcare organizations are increasingly adopting digital technologies, with Artificial Intelligence (AI), Data Science, and the metaverse driving significant advancements in smart healthcare. Al facilitates personalized medicine and efficient drug development, while Data Science enables predictive analytics and big data management, enhancing patient outcomes and healthcare quality. The metaverse introduces immersive training and telemedicine platforms, revolutionizing patient engagement and healthcare research. This study conducts' a scoping review of 6,171 articles, analyzing the transformational impact of AI, ChatGPT, Data Science, and the metaverse on healthcare. It highlights the benefits and risks of these technologies, identifies research gaps in their application within the …

Towards Secure Program Partitioning For Smart Contracts With Llm’S In-Context Learning, Ye Liu, Yuqing Niu, Chengyan Ma, Ruidong Han, Wei Ma, Yi Li, Debin Gao, David Lo

Research Collection School Of Computing and Information Systems

Smart contracts are highly susceptible to manipulation attacks due to the leakage of sensitive information. Addressing manipulation vulnerabilities is particularly challenging because they stem from inherent data confidentiality issues rather than straightforward implementation bugs. To tackle this by preventing sensitive information leakage, we present PARTITIONGPT, the first LLM-driven approach that combines static analysis with the in-context learning capabilities of large language models (LLMs) to partition smart contracts into critical (privileged) and normal codebases, guided by a few annotated sensitive data variables. We evaluated PARTITIONGPT on 18 annotated smart contracts containing 99 sensitive functions. The results demonstrate that PARTITIONGPT successfully generates …

Trajlens: Visual Analysis For Constructing Cell Developmental Trajectories In Cross-Sample Exploration, Qipeng Wang, Shaolun Ruan, Rui Sheng, Yong Wang, Min Zhu, Huamin Qu

Research Collection School Of Computing and Information Systems

Constructing cell developmental trajectories is a critical task in single-cell RNA sequencing (scRNA-seq) analysis, enabling the inference of potential cellular progression paths. However, current automated methods are limited to establishing cell developmental trajectories within individual samples, necessitating biologists to manually link cells across samples to construct complete cross-sample evolutionary trajectories that consider cellular spatial dynamics. This process demands substantial human effort due to the complex spatial correspondence between each pair of samples. To address this challenge, we first proposed a GNN-based model to predict cross-sample cell developmental trajectories. We then developed TrajLens, a visual analytics system that supports biologists in …

Editorial: Special Section On Challenges And Opportunities In Retrieval-Augmented Generation For Llms: Techniques, Trends, And Applications, Philip S. Yu, Haofen Wang, Feida Zhu

Research Collection School Of Computing and Information Systems

Retrieval-Augmented Generation (RAG) represents a transformative advancement for Large Language Models (LLMs) by integrating external knowledge to substantially improve accuracy and mitigate hallucinations. As a pivotal technology in the contemporary generative Artificial Intelligence (AI) landscape, RAG addresses fundamental challenges in knowledge-intensive tasks. This special issue serves as a dedicated platform to showcase these cutting-edge advancements. It features six rigorously peer-reviewed papers that present state-of-the-art research and applications in the rapidly evolving field of RAG.

Qualitative Study For Llm-Assisted Design Study Process: Strategies, Challenges, And Roles, Shaolun Ruan, Rui Sheng, Xiaolin Wen, Jiachen Wang, Tianyi Zhang, Yong Wang, Tim Dwyer, Jiannan Li

Research Collection School Of Computing and Information Systems

Design studies aim to develop visualization solutions for real-world problems across various application domains. Recently, the emergence of large language models (LLMs) has introduced new opportunities to enhance the design study process, providing capabilities such as creative problem-solving, data handling, and insightful analysis. However, despite their growing popularity, there remains a lack of systematic understanding of how LLMs can effectively assist researchers in visualization-specific design studies. In this paper, we conducted a rnulti-stage qualitative study to fill this gap, which involved 30 design study researchers from diverse backgrounds and expertise levels. Through in-depth interviews and carefully-designed questionnaires, we investigated strategies …

Scaling Up Cooperative Multi-Agent Reinforcement Learning Through Hierarchical Heterogeneous Modular Architectures, Minghong Geng

Research Collection School Of Computing and Information Systems

Multi-agent reinforcement learning enables sophisticated collaborative behaviors in autonomous systems, yet fundamental scalability barriers persist: existing methods struggle to coordinate large agent populations and face challenges with extended decision-making horizons. This research develops hierarchical approaches to scale up multi-agent learning systems through two complementary directions: structural scaling for coordinating increasing numbers of agents and temporal scaling for extending decision-making horizons. This paper presents four integrated contributions: a taxonomic survey establishing hierarchical architectures as the theoretical foundation for scalable multi-agent learning systems, a benchmark for long-horizon multi-objective multi-agent reinforcement learning, a framework integrating self-organizing neural networks with multiple reinforcement learning agents …

Artem: Enhancing Large Language Model Agents With Spatial-Temporal Episodic Memory, Cassandra Hui Ming Tan, Budhitama Subagdja, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Current large language models (LLMs) exhibit significant deficiencies in episodic memory tasks including encoding, storing, and retrieving specific information from temporally dependent events over a long period of time. Recent approaches to handle memory tasks in LLMs, such as in-context learning, retrieval-augmented generation (RAG), and fine-tuning, may resolve the long-term retention issues, but are still inadequate to handle tasks requiring chronological awareness of the stored information. We introduce Agentic Retrieval with Temporal-Episodic Memory (ARTEM), a hybrid LLM-based agent architecture integrating LLMs with a self-organizing neural network named Spatial-Temporal Episodic Memory (STEM), designed to handle episodic memory tasks. Our approach employs …

Dystop: Dynamic Staleness Control And Topology Construction For Asynchronous Decentralized Federated Learning, Yizhou Shi, Qianpiao Ma, Yan Xu, Junlong Zhou, Ming Hu, Yunming Liao

Research Collection School Of Computing and Information Systems

Federated Learning (FL) has emerged as a potential distributed learning paradigm that enables model training on edge devices (i.e., workers) while preserving data privacy. However, its reliance on a centralized server leads to limited scalability. Decentralized federated learning (DFL) eliminates the dependency on a centralized server by enabling peer-to-peer model exchange. Existing DFL mechanisms mainly employ synchronous communication, which may result in training inefficiencies under heterogeneous and dynamic edge environments. Although a few recent asynchronous DFL (ADFL) mechanisms have been proposed to address these issues, they typically yield stale model aggregation and frequent model transmission, leading to degraded training performance …

Llamoco: Instruction Tuning Of Large Language Models For Optimization Code Generation, Zeyuan Ma, Yue-Jiao Gong, Hongshu Guo, Jiacheng Chen, Yining Ma, Zhiguang Cao

Research Collection School Of Computing and Information Systems

Recently, combining the strength of large language models (LLMs) and Evolutionary Computation (EC) has shown promising results for addressing optimization problems. It typically involves either iterative next-step solution seeking or directly prompting LLMs to generate critical optimization codes. However, these methods often suffer from low computational efficiency, high sensitivity to prompt design, and a lack of domain-specific knowledge. We introduce LLaMoCo, the first instruction-tuning framework designed to adapt LLMs for solving optimization problems in a code-to-code manner. LLaMoCo features a comprehensive instruction set that includes code-style problem descriptions as input prompts and robust optimization codes from expert EC optimizers as …

Revisiting The Canonicalization For Fast And Accurate Crystal Tensor Property Prediction, Haowei Hua Hua, Jingwen Yang, Wanyu Lin, Pan Zhou

Research Collection School Of Computing and Information Systems

Predicting the tensor properties of crystalline materials is a fundamental task in materials science. Unlike single-value property prediction, which is inherently invariant, tensor property prediction requires maintaining O(3) group tensor equivariance. Such equivariance constraint often requires specialized architecture designs to achieve effective predictions, inevitably introducing tremendous computational costs. Canonicalization, a classical technique for geometry, has recently been explored for efficient learning with symmetry. In this work, we revisit the problem of crystal tensor property prediction through the lens of canonicalization. Specifically, we demonstrate how polar decomposition, a simple yet efficient algebraic method, can serve as a form of canonicalization and …

Flood-Season Surface Water-Groundwater Interactions Across Distinct Geomorphic Units In A Yellow River Great Bend Tributary Basin, Yinlong Wang, Ruizhong Gao, Debin Jia, Xixi Wang, Tingxi Liu, Xiaomin Liu, Shiming Bai

Civil & Environmental Engineering Faculty Publications

Surface water-groundwater interactions are complex in the Great Bend region of the Yellow River. Clarifying water exchange and source differences among geomorphic units is important for understanding regional hydrological processes and improving water resources management. In this study, the Wulanmulun River Basin, a typical tributary of the Yellow River, was selected as the study area. A total of 90 water samples were collected, including 25 river water samples, 43 groundwater samples, and 22 precipitation samples. Gibbs diagrams, multivariate statistical analysis, PMF, and MixSIAR models were used to investigate the hydrochemical and isotopic characteristics, source contributions, and transformation relationships of surface …

Ridit-Based Adaptive Allocation In Two-Stage Clinical Trials With Binary Outcomes, Dewan Fahim

UNF Graduate Theses and Dissertations

This study explores better ways to assign patients to treatments in clinical trials with binary outcomes, such as success or failure. Adaptive methods are used to learn from early results and adjust treatment assignments during the trial, helping more patients receive better performing treatments while maintaining reliable conclusions. We focus on trials comparing multiple treatments using a two-stage design. In the first stage, several treatments are tested to identify the most promising one; in the second stage, that treatment is compared with a control. Unlike traditional equal assignment, we use adaptive allocation in the second stage to make better use …

Energy-Efficient Security For Narrowband Iot Using Blockchain And Ep-Cumac, Hafizullah Kakar

UNF Graduate Theses and Dissertations

The Narrowband Internet of Things (NB-IoT) continues to expand but faces challenges such as cryptographic overhead and energy consumption. Security frameworks such as blockchain and Energy-Performance Cumulative Message Authentication Codes (EP-CuMAC) rely heavily on SHA-256, which is not optimized for energy-limited devices.

This work unifies two complementary approaches, a hybrid blockchain-based NB-IoT framework and an EP-CuMAC-based framework, by engineering their cryptographic core with an Energy Complexity Model-optimized SHA-256 (ECM-SHA256). ECM applies parallel memory-bank mapping and block-level access optimization to reduce redundant power usage while preserving algorithmic integrity.

Experimental evaluation on identical Intel DDR3 systems using pyRAPL shows energy savings of …

Growth And Dielectric Characterization Of Epitaxial Sr1-Xmgxtio3 Thin Films, Richard Badu

UNF Graduate Theses and Dissertations

Complex oxide materials with ferroelectric ground states remain promising candi dates for next-generation high-capacitance and nonlinear microelectronic applica tions. One of those materials is SrTiO3 (STO). However, STO is an incipient fer roelectric with anomalously high dielectric permittivity at low temperatures. STO crystals possess a highly polarizable lattice that is sensitive to even small amounts of impurities. Substituting Mg into the STO matrix is predicted to induce a corre lation between ferroelectric and relaxor behavior. In this thesis, we demonstrated the growth of a series of epitaxial STO and Sr1-xMgxTiO3 thin films using molec ular beam epitaxy. The surface evolution …

Bayesian Modelling On Periodically And Multiple Periodically Correlated Time Series Data, Jie Yao

Electronic Theses & Dissertations (2024 - present)

Time series with multiple periodically correlated (MPC) components present a complex challenge, with relatively limited prior research. Most existing models are designed for simpler periodically correlated (PC) components and often struggle with over-parameterization, optimization issues, and capturing complex PC patterns within a time series. Frequency separation techniques can help preserve the correlation structure of individual PC components, while Bayesian methods can integrate new and prior information to refine beliefs about these components. This study proposes a two-stage approach that combines frequency separation and Bayesian techniques to forecast PC and MPC time series data. This method aims to demonstrate improved effectiveness …

Entropic Foundation Of Finance And Physics: Securities Price Dynamics And Quantum Theory, Mohammad Abedi

Electronic Theses & Dissertations (2024 - present)

In many scientific and financial contexts, we must reason and make predictions under conditions of incomplete information. This dissertation develops Entropic Dynamics (ED) as a unified framework for deriving dynamical laws directly from principles of inference. Within this approach, probability distributions represent states of knowledge, and their evolution is determined through entropy maximization subject to relevant constraints. This leads to a novel concept of entropic time and a formulation of dynamics as an inferential process. In this talk, I will present how ED provides a common foundation across multiple domains. In physics, quantum dynamics for particles and scalar fields in …

Artificial Intelligence, Fundamental Motives, And Evolutionary Mismatch, Amy J. Lim, Jose. C. Yong, Edison Sora Tan

Research Collection School of Social Sciences

In recent years, the intersection of artificial intelligence (AI) and psychology has garnered unprecedented attention, particularly following the advent of generative AI tools in 2022. These tools, capable of producing human-like text, images, and even deepening our understanding of cognitive processes, have not only captured the public imagination but also sparked new concerns and debates within the psychological community. While AI has been a subject of research for decades, the emergence of its generative capabilities has truly thrust AI into the spotlight. This article explores how these advancements are reshaping our understanding of human cognition and behavior, as well as …

Ultrafast Vibrational Dynamics In Important Wide-Bandgap Semiconductors, Dielectrics And Energetic Materials, Dinusha Madushanka Senarathna

Open Access Dissertations

This dissertation applies time-resolved coherent anti-Stokes Raman scattering (tr-CARS), to measure ultrafast vibrational dynamics in technologically important solid-state and van der Waals molecular systems. The central goal is to use time-domain Raman methods to resolve mode-specific phonon and vibrational dephasing processes with high temporal precision, high spectral selectivity, and sufficient experimental flexibility to probe materials ranging from wide-bandgap semiconductors and oxide crystals to energetic molecular crystals. Across the work, I show that carefully designed tr-CARS measurements can access vibrational lifetimes from hundreds of femtoseconds to several picoseconds, enabling direct observation of decay pathways, relaxation mechanisms, and dispersion effects that shape …

Challenges And Best Practices For The Development Of Coastal Hazard Decision Support Tools, Noah Hallisey

Open Access Dissertations

There is growing interest in developing Decision Support Tools (DSTs) supporting emergency managers and other decision-makers during coastal storm events. Yet many tools fail to inform decision-making due to challenges associated with their development and transition into operational tools for real-time decision-making. This dissertation investigates these challenges and offers best practices for their development and implementation for real-world decision-making through a literature review, interviews with subject matter experts in the United States, and a real-world case study.

Manuscript 1 reviews existing published literature to understand whether and how tool developers are incorporating emergency managers in the development of DSTs and …

Volatiles In Mantle Sources At Mid-Ocean Ridge And Intraplate Settings, Rebecca Lippitt

Open Access Dissertations

Volatiles play an integral role in upper mantle processes and the eruptive styles of volcanoes. Although we know the importance of volatiles to volcanic systems, processes like melting, crystallization, and degassing alter the volatile abundances of mantle melts, making it difficult to quantify mantle source compositions and the extent to which volatiles influence melting processes. Additionally, volatile content may be a key factor in setting the oxidation conditions of mantle source rocks and subsequently changing those conditions in a body of magma as it ascends through the crust and is erupted at the Earth’s surface. Recent work, however, has identified …

Superelectrophile Promoted Synthesis Of Heterospirocycles, Mariam A. Adegbenro

Graduate Research Theses & Dissertations

Spirocycles are important scaffolds with a wide range of applications in material science as well as in medicine. The introduction of a heteroatom into the spirocyclic framework can improve its electronic, photophysical, and structural properties. Various reports have been published on the incorporation of atoms other than carbon into the spirocycle. The work outlined in this dissertation involves the development of synthetic methodologies for the synthesis of hetero-spirocycles via superacid-promoted cyclization reactions. These concepts are summarized in Chapter 1.

Chapter 2: Aromatic imines were prepared from 9-fluorenone and azafluorenones, and these substrates were reacted in the Brønsted superacid, triflic acid, …

Supramolecular Self-Assemblies Of Ru( Ii ) Phototherapeutics: Biological Activity Of Micro- And Nano-Particles Acting As Reservoirs, Jérôme Laisney, Sarah M. Kriger, Dmytro Havrylyuk, Jason M. Unrine, David K. Heidary, Edith C. Glazer

Chemistry Faculty Publications

Ruthenium( II) coordination complexes have many appealing properties as prodrugs, but can suffer from poor aqueous solubility and short circulation times, drastically decreasing efficiency in vivo. Nanoformulations using a variety of carriers, such as inclusion in polymers/lipids or adsorption on inorganic nanoparticles have been applied to overcome this limitation, but unfortunately, these approaches raise additional concerns regarding the fate of the carriers, with potential long-term toxicity and accumulation in vital organs. Here, we present an alternative delivery strategy with formation of pure and polymer-supported supramolecular self-assemblies of Ru(II) complexes acting as ‘‘reservoirs’’. A facile preparation of size-controlled particles was achieved …

Characterization And Antimicrobial Activity Of Lignin-Derived Compounds In Ground Hurd Tissue Of Cannabis Sativa L. (Hemp) Cultivars, Jourdan E. Lakes, Anjam Sadik, Robert C. Pearce, Barbara L. Knutson, Stephen E. Rankin, Bert C. Lynn, Michael D. Flythe

Chemistry Faculty Publications

Objectives: Characterize lignin-derived compounds from the hurd of 10 fiber/grain Cannabis sativa L. cultivars and investigate the antimicrobial activity of select compounds on the wasteful ruminant bacterium, Acetoanaerobium sticklandii SR.   Methods: Hurd was processed using an aqueous ethanol solvent system and analyzed via GC-MS to identify and characterize lignin derivatives. Antimicrobial activity of the hurd and three monomers was assessed using solid (hurd) and liquid medium (monomers) bioassays against SR.   Results: 27 compounds were identified, most as monomers but a few were dimers, ethylated derivatives, and organic acids. There were approximately equal G- and S-units with substantially fewer H-units. Several …