Artificial Intelligence and Robotics Commons^™

Synthesizing Multi-Person And Rare Pose Images For Human Pose Estimation, Liuqing Zhao, Zichen Tian, Zou Peng, Richang Hong, Qianru Sun

Research Collection School Of Computing and Information Systems

Human pose estimation (HPE) models underperform in recognizing rare poses because they suffer from data imbalance problems (i.e., there are few image samples for rare poses) in their training datasets. From a data perspective, the most intuitive solution is to synthesize data for rare poses. Specifically, the rule-based methods apply manual manipulations (such as Cutout and GridMask) to the existing data, so the limited diversity of the data constrains the model. An alternative method is to learn the underlying data distribution via deep generative models (such as ControlNet and HumanSD) and then sample “new data” from the distribution. This works …

Transforming Urban Dynamics: Harnessing Large Language Models For Smarter Mobility, Hao Xue, Ming Jin, Shirui Pan, Flora Salim, Guansong Pang

Research Collection School Of Computing and Information Systems

Artificial intelligence (AI) has the potential to analyze mobility data and make mobility systems smarter by leveraging diverse data sources such as geospatial data, transportation logs, and real-time sensor data to optimize traffic flow, enhance public transportation systems, and support the development of autonomous vehicles. With the newly emerged generative AI paradigm, exemplified by large language models (LLMs), there is great potential to transform the current AI applications in mobility, transportation, and urban domains. This article provides an overview of recent efforts and aims to shed light on the challenges and future opportunities to facilitate the adaptation of LLMs for …

Adversarial Generative Flow Network For Solving Vehicle Routing Problems, Ni Zhang, Jingfeng Yang, Zhiguang Cao, Xu Chi

Research Collection School Of Computing and Information Systems

Recent research into solving vehicle routing problems (VRPs) has gained significant traction, particularly through the application of deep (reinforcement) learning for end-to-end solution construction. However, many current construction-based neural solvers predominantly utilize Transformer architectures, which can face scalability challenges and struggle to produce diverse solutions. To address these limitations, we introduce a novel framework beyond Transformer-based approaches, i.e., Adversarial Generative Flow Networks (AGFN). This framework integrates the generative flow network (GFlowNet)-a probabilistic model inherently adept at generating diverse solutions (routes)-with a complementary model for discriminating (or evaluating) the solutions. These models are trained alternately in an adversarial manner to improve …

Double Oracle Neural Architecture Search For Game Theoretic Deep Learning Models, Aye Phyu Phyu Aung, Xinrun Wang, Ruiyu Wang, Hau Chan, Bo An, Xiaoli Li, J. Senthilnath

Research Collection School Of Computing and Information Systems

In this paper, we propose a new approach to train deep learning models using game theory concepts including Generative Adversarial Networks (GANs) and Adversarial Training (AT) where we deploy a double-oracle framework using best response oracles. GAN is essentially a two-player zero-sum game between the generator and the discriminator. The same concept can be applied to AT with attacker and classifier as players. Training these models is challenging as a pure Nash equilibrium may not exist and even finding the mixed Nash equilibrium is difficult as training algorithms for both GAN and AT have a large-scale strategy space. Extending our …

Recdreamer: Consistent Text-To-3d Generation Via Uniform Score Distillation, Chenxi Zheng, Yihong Lin, Bangzhen Liu, Xuemiao Xu, Yongwei Nie, Shengfeng He

Research Collection School Of Computing and Information Systems

Current text-to-3D generation methods based on score distillation often suffer from geometric inconsistencies, leading to repeated patterns across different poses of 3D assets. This issue, known as the Multi-Face Janus problem, arises because existing methods struggle to maintain consistency across varying poses and are biased toward a canonical pose. While recent work has improved pose control and approximation, these efforts are still limited by this inherent bias, which skews the guidance during generation. To address this, we propose a solution called RecDreamer, which reshapes the underlying data distribution to achieve more consistent pose representation. The core idea behind our method …

The Effectiveness Of Local Updates For Decentralized Learning Under Data Heterogeneity, Tongle Wu, Zhize Li, Ying Sun

Research Collection School Of Computing and Information Systems

We revisit two fundamental decentralized optimization methods, Decentralized Gradient Tracking (DGT) and Decentralized Gradient Descent (DGD), with multiple local updates. We consider two settings and demonstrate that incorporating local update steps can reduce communication complexity. Specifically, for  $\mu$-strongly convex and $L$-smooth loss functions, we proved that local DGT  achieves communication complexity {}{$\tilde{\mathcal{O}} \Big(\frac{L}{\mu(K+1)} + \frac{\delta + {}{\mu}}{\mu (1 - \rho)} + \frac{\rho }{(1 - \rho)^2} \cdot \frac{L+ \delta}{\mu}\Big)$}, where $K$ is the number of additional local update}, $\rho$ measures the network connectivity and $\delta$ measures the second-order heterogeneity of the local losses. Our results reveal the tradeoff between communication and …

Financial Named Entity Recognition: How Far Can Llm Go?, Yi-Te Lu, Yintong Huo

Research Collection School Of Computing and Information Systems

The surge of large language models (LLMs) has revolutionized the extraction and analysis of crucial information from a growing volume of financial statements, announcements, and business news. Recognition for named entities to construct structured data poses a significant challenge in analyzing financial documents and is a foundational task for intelligent financial analytics. However, how effective are these generic LLMs and their performance under various prompts are yet need a better understanding. To fill in the blank, we present a systematic evaluation of state-of-the-art LLMs and prompting methods in the financial Named Entity Recognition (NER) problem. Specifically, our experimental results highlight …

The Impact Of Loss Function Topology On Gradient Descent, Robert B. Skudnig Jr.

Theses and Dissertations

Gradient descent is a popular optimization method that utilizes a model’s prediction error to iteratively improve its parameters for a given task. The functions that measure this error can be defined to align with the user’s goals and sometimes satisfy metric or norm properties. It is common for these functions to measure over Rn, but any differentiable space allows for gradient descent to occur. There has been some research investigating the influence of topological spaces on optimization methods, but it is a limited field of study. This thesis further explores this phenomenon by applying a transformation prediction model to multiple …

Generalizing Medical Image Segmentation Task With Efficient Deep Learning Models, Abel A. Reyes-Angulo

Dissertations, Master's Theses and Master's Reports

Medical Image Segmentation is a critical task in the field of medical imaging, playing a crucial role in diagnostics, treatment planning, and disease monitoring. The emergence of Deep Learning (DL) has ushered in a new era in Artificial Intelligence (AI), propelling remarkable advancements in key domains like language translation, object recognition, and recommendation systems. This evolution has been accompanied by continuous enhancements in computational efficiency and improvements in predictive accuracy. The introduction of sophisticated algorithms, such as convolutional neural networks (CNNs) and transformers, exemplifies these advancements. DL algorithms have demonstrated exceptional efficacy in medical image segmentation tasks, showcasing the potential …

On-Device Recommender Systems: A Comprehensive Survey, Hongzhi Yin, Liang Qu, Tong Chen, Wei Yuan, Ruiqi Zheng, Jing Long, Xin Xia, Yuhui Shi, Chengqi Zhang

Research outputs 2022 to 2026

Recommender systems have been widely deployed in various real-world applications to help users identify content of interest from massive amounts of information. Traditional recommender systems work by collecting user-item interaction data in a cloud-based data center and training a centralized model to perform the recommendation service. However, such cloud-based recommender systems (CloudRSs) inevitably suffer from excessive resource consumption, response latency, as well as privacy and security risks concerning both data and models. Recently, driven by the advances in storage, communication, and computation capabilities of edge devices, there has been a shift of focus from CloudRSs to on-device recommender systems (DeviceRSs), …

Fuel Consumption Prediction Using Bayesian Neural Networks, Syarifah Diana Permai, Jurike V. Moniaga, Zener Sukra Lie, Ferry Jie

Research outputs 2022 to 2026

Transportation is one of the necessities of life. Because humans need transportation to move from one location to another. Transportation requires fuel. On the other hand, fuel consumption is important and must be controlled. This is because fuel can come from both renewable and non-renewable energy sources, depending on the type and process of its formation. Several factors influence the fuel efficiency of a car, including the type of engine, vehicle weight, aerodynamics, driving habits, and other vehicle conditions. This research aims to predict car fuel consumption and identify the factors that affect fuel consumption. Several Machine Learning and Statistical …

Gans And Synthetic Financial Data: Calculating Var*, David E. Allen, Leonard Mushunje, Shelton Peiris

Research outputs 2022 to 2026

Generative Adversarial Neural nets (GANs) are a new branch of machine learning techniques. A GAN learns to generate new data from the training data set. We examine the characteristics of the fake financial data using GANs trained on samples of daily S&P 500 and FTSE 100 index values. GANs feature two competing neural networks in a game theoretic context. The Generator net generates pseudo data that is presented to the discriminator net which then attempts to distinguish between the real and the fake data. This facilitates unsupervised learning on the dataset. The generative network generates data sets, while the discriminative …

Optimization Of Serum And Salivary Cortisol Interpolation For Time-Dependent Modeling Frameworks In Healthy Adult Males, Nathaniel T. Berry, Travis Anderson, Christopher K. Rhea, Laurie Wideman

Rehabilitation Sciences Faculty Publications

Cortisol is an important marker of hypothalamic-pituitary-adrenal function and follows robust circadian and diurnal rhythms. However, biomarker sampling protocols can be labor-intensive and cost-prohibitive. Objectives: Explore analytical approaches that can handle differing biological sampling frequencies to maximize these data in more detailed and time-dependent analyses. Methods: Healthy adult males [N = 8; 26.1 (±3.1) years; 176.4 (±8.6) cm; 73.1 (±12.0) kg)] completed two 24 h admissions: one at rest and one including a high-intensity exercise session on the cycle ergometer. Serum and salivary cortisol were sampled every 60 and 120 min, respectively. Six alternative sampling profiles were defined by downsampling …

The Reliability Gap: How Traditional Search Engines Outperform Artificial Intelligence (Ai) Chatbots In Rosacea Public Health Information Quality, Houston C. Nelson, Morgan T. Beauchamp, April A. Pace

Department of Medicine Faculty Publications

Background: The internet has become a primary source of health information for the public, with important implications for patient decision-making and public health outcomes. However, the quality and readability of this content vary widely. With the rise of generative artificial intelligence (AI) tools such as ChatGPT and Gemini, new challenges and opportunities have emerged in how patients access and interpret medical information.

Objective: To evaluate and compare the quality, credibility, and readability of consumer health information provided by traditional search engines (Google, Bing) and generative AI platforms (ChatGPT, Gemini) using three validated instruments: DISCERN, JAMA Benchmark Criteria, and Flesch-Kincaid Readability …

A Hybrid Soft Voting And Stacking-Based Meta-Learning Approach For Sentiment Analysis Of Bangkalan Batik, Moh. Imron Wahyudi, Lailil Muflikhah, Rizal Setya Perdana

Knowledge Engineering and Data Science

Sentiment analysis is an important field in Natural Language Processing (NLP) that focuses on processing consumer opinions to gain useful insights. The information generated from sentiment analysis can be used as a basis for business decision-making, service quality evaluation, and the formulation of more effective marketing strategies. In the local context, Bangkalan Batik, as one of Madura's distinctive cultural products, has high economic value and cultural identity. However, consumer reviews available online, for example through Google Maps, are still rarely utilized optimally by MSMEs as a source of strategic information. Therefore, this study was conducted to develop a sentiment classification …

Pushing The Boundaries Of Large Language Models: Innovations And Limitations In Nlp, Finance, And Mathematics, A M Muntasir Rahman

Dissertations

Large Language Models (LLMs) have emerged as transformative tools across a spectrum of domains, yet their practical deployment reveals a blend of remarkable potential and notable limitations. This research explores innovative methodologies to extend the capabilities of LLMs while addressing critical challenges in their evaluation and application. By leveraging rule-based approaches, the in-context learning capabilities of LLMs, and human-in-the-loop validation across three focused studies, this research introduces robust strategies for dataset synthesis, model enhancement, and model assessment in three distinct domains: natural language processing, financial sentiment analysis, and mathematical reasoning

The first study proposes an efficient data augmentation framework, EASE, …

Surveying The Role Of Visual Analytics In Human-Machine Teaming, Naga Datha Saikiran Battula

Theses

Humans and machines both possess their unique capabilities and have their strengths and weaknesses, which can be complementary to one another and allow them to achieve a common goal. Teaming in the modern era involves text prompts, voice commands, gesture recognition, touch interfaces, and the latest visualization techniques that allow parties/agents to interact. Communication through visualization plays a vital role in allowing robust insights to be gained through a glance. Using visualization as a medium between humans and machines can increase the communication bandwidth. Human-machine teaming has witnessed much progress, with many theories and practical examples emerging. In the report, …

Automated Segmentation Of The Ulnar Nerve In Mri Using Deep Learning Techniques, Akhil Nagulapalli

Theses

Cubital Tunnel Syndrome (CuTS), a condition caused by compression of the ulnar nerve, results in numbness, tingling, pain, and even muscle atrophy, affecting fine motor skills and diminishing patient quality of life. Accurate diagnosis of CuTS is challenging, as current diagnostic methods—including clinical exams, nerve conduction studies, and unaided MRI—often lack the precision to reliably identify the nerve and detect compression in its early stages. Deep learning-based segmentation offers a promising solution, enabling precise and automated identification of nerve structures in MRI images, which could significantly improve diagnostic accuracy and support timely intervention.

A novel deep learning model for segmenting …

Ai-Assisted Academia: Unveiling Doctoral Students' Perspectives On Dissertation In Practice Innovation, Jennifer J. Lesh, Jévaughn J. Lancaster

Faculty and Staff Publications & Presentations

This action research study explores 73 doctoral students' perceptions of using Generative Artificial Intelligence (GAI) throughout their research journey in one educational doctorate (Ed.D) program. The first phase employed surveys, while the second incorporated semi-structured focus group interviews based on the survey data from a diverse sample of students across educational disciplines currently enrolled in the university's educational leadership doctoral program. In the study's first phase, the survey quantified educators' familiarity with, attitudes towards, perceived challenges, ethical considerations, and benefits of using GAI in doctoral research. The exploration of GAI in this practitioner-inspired doctoral program has uncovered essential insights into …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …