Artificial Intelligence and Robotics Commons^™

Sugar: A Sequence Unfolding Based Transformer Model For Group Activity Recognition, Yash U. Gondkar

Graduate Masters Theses

Large Language Models have improved significantly in the past couple of years due to the adoption of transformers. However, transformers still find it challenging to process videos due to limited context size caused by their quadratic computing cost. Therefore, we studied a booming field in machine learning which powers applications like social scene analysis and video surveillance systems called Group Activity Recognition (GAR). We found that recent models were able to achieve more than 90% accuracy on popular datasets like the Volleyball dataset, however, it turned out that even they relied on transformers.

Therefore, in this work, we developed a …

A Systemic Approach To Maximize Heterogeneous System Performance, Thomas L. Randall

All Dissertations

Continuous increases in high performance computing (HPC) throughput have served as catalysts for industry and scientific advancement in countless manners that have fundamentally shaped our modern world. Our demands on compute resources continue to scale, but the limitations of Ahmdal’s law and Dennard scaling have proven increasingly difficult to overcome when approached solely through hardware or software design. Furthermore, many HPC applications fail to utilize the collective system’s performance, even on the most advanced supercomputers.

However, the resurgence of AI in the industry has promoted an explosion of hardware and software codesign that have fueled massive improvements in GPU design …

Artificial Intelligence Applications For Grid-Connected Solar Inverters, Utkirjon Ubaydullaev, Sarvinoz Mirzaeva, Hasan Mustafoev

Chemical Technology, Control and Management

The increasing global demand for renewable energy has highlighted the importance of grid-connected solar inverters in ensuring efficient and stable power conversion. However, challenges such as fluctuations in solar energy generation, grid disturbances, and power quality issues necessitate advanced control strategies. The integration of artificial intelligence (AI) into solar inverters presents a transformative solution, enhancing performance, adaptability, and reliability in real-world applications.

This review explores the role of AI techniques, including machine learning (ML), deep learning (DL), fuzzy logic, and reinforcement learning (RL), in optimizing key inverter functionalities such as maximum power point tracking (MPPT), fault detection, power quality enhancement, …

Advances In Natural Fiber Polymer And Pla Composites Through Artificial Intelligence And Machine Learning Integration, Md Helal Uddin, Mohammed Huzaifa Mulla, Tarek Abedin, Abreeza Manap, Boon Kar Yap, Reji Kumar Rajamony, Kiran Shahapurkar, T. M.Yunus Khan, Manzoore Elahi M. Soudagar, Mohammad Nur-E-Alam

Research outputs 2022 to 2026

Natural Fibre Polymer (NFP) and Polylactic Acid (PLA) composites have received a lot of interest in a variety of sectors because they are environmentally friendly, renewable, and sustainable. Over the last decade, researchers have investigated the aspects of NFP/PLA composite development and optimization for a wide range of applications, including packaging materials, automotive components, construction materials, textile and apparel, biomedical devices, agricultural and horticultural applications, electronics, and consumer electronics. Furthermore, using Artificial Intelligence (AI) and Machine Learning (ML) methodologies has increased these polymer materials and associated technologies in their search for new potential ways to further progress in NFP and …

Optimization Of Serum And Salivary Cortisol Interpolation For Time-Dependent Modeling Frameworks In Healthy Adult Males, Nathaniel T. Berry, Travis Anderson, Christopher K. Rhea, Laurie Wideman

Rehabilitation Sciences Faculty Publications

Cortisol is an important marker of hypothalamic-pituitary-adrenal function and follows robust circadian and diurnal rhythms. However, biomarker sampling protocols can be labor-intensive and cost-prohibitive. Objectives: Explore analytical approaches that can handle differing biological sampling frequencies to maximize these data in more detailed and time-dependent analyses. Methods: Healthy adult males [N = 8; 26.1 (±3.1) years; 176.4 (±8.6) cm; 73.1 (±12.0) kg)] completed two 24 h admissions: one at rest and one including a high-intensity exercise session on the cycle ergometer. Serum and salivary cortisol were sampled every 60 and 120 min, respectively. Six alternative sampling profiles were defined by downsampling …

Optimizing Ai Language Models: A Study Of Chatgpt-4 Vs. Chatgpt-4o, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Md Fayaz Bin Hossen, Muhammad Rezaur Rahman, Md. Shahadat Jaman

Electrical & Computer Engineering Faculty Publications

This paper presents a comparative analysis of OpenAI's GPT-4 and its optimized variant, GPT-4o, focusing on their architectural differences, performance, and real-world applications. GPT-4, built upon the Transformer architecture, has set new standards in natural language processing (NLP) with its capacity to generate coherent and contextually relevant text across a wide range of tasks. However, its computational demands, requiring substantial hardware resources, make it less accessible for smaller organizations and real-time applications. In contrast, GPT-4o addresses these challenges by incorporating optimizations such as model compression, parameter pruning, and memory-efficient computation, allowing it to deliver similar performance with significantly lower computational …

Harnessing The Power Of Gradient-Based Simulations For Multi-Objective Optimization In Particle Accelerators, Kishansingh Rajput, Malachi Schram, Auralee Edelen, Jonathan Colen, Armen Kasparian, Ryan Roussel, Adam Carpenter, He Zhang, Jay Benesch

Data Science Faculty Publications

Particle accelerator operation requires simultaneous optimization of multiple objectives. Multi-objective optimization (MOO) is particularly challenging due to trade-offs between the objectives. Evolutionary algorithms, such as genetic algorithms (GAs), have been leveraged for many optimization problems, however, they do not apply to complex control problems by design. This paper demonstrates the power of differentiability for solving MOO problems in particle accelerators using a deep differentiable reinforcement learning (DDRL) algorithm. We compare the DDRL algorithm with model-free reinforcement learning (MFRL), GA, and Bayesian optimization (BO) for simultaneous optimization of heat load and trip rates in the continuous electron beam accelerator facility. The …

Real-Time Feedback-Driven Framework For Automated Cybersickness Mitigation, Md Jahirul Islam

Master's Theses

As technologies are becoming more advanced day by day, the embracement of virtual reality (VR) technology among users is also increasing in daily activities for various purposes, and subsequently, the barrier between the real and virtual world is fading. Despite the versatile uses, cybersickness (CS) is a major problem which is induced among users due to the immersive VR experience. There is a plethora of research findings and methods to measure the users’ CS such as virtual reality sickness questionnaire (VRSQ), simulator sickness questionnaire (SSQ), fast motion scale questionnaire (FMS), and others. Recently, machine learning approaches have also been adopted …

Machine Learning-Driven Process Analysis And Optimization In Solid-State Welding And Fusion-Based Additive Manufacturing, Radif Uddin Ahmed

Master's Theses

In the modern era of advanced manufacturing, optimizing process parameters is pivotal in ensuring the quality and reliability of sophisticated component fabrication. This study presents a novel, data-driven approach to parameter optimization in two cutting-edge manufacturing techniques: Friction Stir Welding (FSW) and Laser Powder Bed Fusion (LPBF). By leveraging machine learning methodologies, this research addresses the critical challenge of efficiently determining optimal process parameters, a task traditionally relying on time-consuming and resource-intensive trial-and-error methods. This study will lead to a robust data-driven framework for process analysis of more advanced manufacturing techniques like the Additive Friction Stir Deposition (AFSD) process. Friction …

An Introduction To The Time-Independent Schrödinger Equation And Methods To Solve It, Vu Giang, Alex Gnech

OUR Journal: ODU Undergraduate Research Journal

The Time-Independent Schrödinger Equation is a linear elliptic PDE that describes quantum-mechanical systems. Its significance in the science of submicroscopic phenomena, particularly quantum mechanics, is as central as Newton’s laws of motion are to classical mechanics. This study uses various methods, including novel neural networks and finite difference schemes, to solve the one-dimensional two-body equation.

Groundwater Modeling Of The Ogallala Aquifer: Use Of Machine Learning For Model Parameterization And Sustainability Assessment, Tewodros Aboret Tilahun

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Addressing groundwater depletion problems in heterogeneous aquifer systems is a challenge. The heterogeneous Ogallala Aquifer, a critical source of groundwater in the central United States, has undergone decades of decline in water levels due to pumping. This project aims to build a robust groundwater model to evaluate optimal scenarios for sustainable use of the groundwater resource within a section of the Ogallala aquifer located in the Middle Republican Natural Resources District (MRNRD). This study follows a comprehensive approach involving parameterization, construction, and optimization. The model is parametrized using hydraulic conductivity and recharge values obtained from a random forest-based machine learning …

Leveraging Generative Ai For Sustainable Farm Management Techniques Correspond To Optimization And Agricultural Efficiency Prediction, Samira Samrose

All Graduate Reports and Creative Projects, Fall 2023 to Present

Sustainable farm management practice is a multifaceted challenge. Uncovering the optimal state for production while reduction of environmental negative impacts and guaranteed inter-generational assets supervision needs balanced management. Also, considering lots of different factors (cost, profit, employment etc), the agricultural based management technique requires rigorous concentration. In this project machine learning models are applied to develop, achieve and improve the farm management techniques. This experiment ensures the resultant impacts being environment friendly and necessary resource availability and efficiency. Predicting the type of crop and rotational recommendations will disclose potentiality of productive agricultural based farming. Additionally, this project is designed to …

Optimization Pump As Turbine Coupled To A Self-Excited Induction Generator Using Multi-Objective Genetic Algorithm, Emanuel J. Nyirenda

Tanzania Journal of Engineering and Technology (TJET)

As a way of accelerating the deployment of affordable and clean renewable energy generation technologies, applying a pump working as a turbine coupled to a self-excited induction generator is gaining popularity in various areas including energy recovery and micro hydro systems. However, it is currently challenging to predict the performance of the PAT-SEIG system and there is no agreed-upon rule on the selection of the appropriate system to be installed at a particular site. This paper has presented multi-objective optimization to select the best operating point of the PAT-SEIG system. The results show that the peak efficiencies for the PAT …

Reinforcement Learning For Optimal Kicking Actions In Humanoid Robotics: Advancing Robotic Autonomy And Versatility, Suresh Dodda, Sathish Kumar Chintala, Sukender Reddy Mallreddy, Sharath Chandra Macha, Yashwanth Vasa, Sapan Bharadwaj Bonala, Navin Kamuni, Sujatha Alla

Engineering Management & Systems Engineering Faculty Publications

Acquiring the necessary skills to perform a work effectively and efficiently requires a significant investment of time and computing power. Previous applications of Reinforcement Learning (RL) for action optimization in humanoid robotics have shown how promising this technology is for moving robotics towards true autonomy and versatility. Therefore, this study offers the first use of RL to create an entirely optimal kicking action for the Alderbaran Nao robot. Kicking motions that were steady, precise, quick, and able to kick farther than any existing RoboCup squad were generated by optimizing for a multi-objective reward function. We demonstrate that the ideal kicking …

Exploring Non-Linear Dynamical Structure For Knee Kinematics Using Machine Learning, Liora Mayats-Alpay, Rahul Soangra

Physical Therapy Faculty Articles and Research

Human movement involves complex coordination between multiple limbs during execution. Human gait is cyclic, and the knee's movement inherently follows nonlinear dynamic behavior that linear models cannot adequately capture. In this study, advanced Machine Learning (ML) techniques were employed to combine the Sparse Identification of Nonlinear Dynamics (SINDy) algorithm using Python to reveal governing equations of knee movement during walking. We gathered a single subject's knee motion data using infrared markers during normal walking. We utilized the PySINDy library to determine the governing equations and calculated the coefficient of dynamical systems associated with knee kinematics. Our results emphasize governing equations …

Bare-Bones Based Salp Swarm Algorithm For Text Document Clustering, Mohammed Azmi Al-Betar, Ammar Kamal Abasi, Ghazi Al-Naymat, Kamran Arshad, Sharif Naser Makhadmeh

Machine Learning Faculty Publications

Text Document Clustering (TDC) is a challenging optimization problem in unsupervised machine learning and text mining. The Salp Swarm Algorithm (SSA) has been found to be effective in solving complex optimization problems. However, the SSA’s exploitation phase requires improvement to solve the TDC problem effectively. In this paper, we propose a new approach, known as the Bare-Bones Salp Swarm Algorithm (BBSSA), which leverages Gaussian search equations, inverse hyperbolic cosine control strategies, and greedy selection techniques to create new individuals and guide the population towards solving the TDC problem. We evaluated the performance of the BBSSA on six benchmark datasets from …

A Multi-Layer Information Dissemination Model And Interference Optimization Strategy For Communication Networks In Disaster Areas, Yuexia Zhang, Yang Hong, Mohsen Guizani, Sheng Wu, Peiying Zhang, Ruiqi Liu

Machine Learning Faculty Publications

The communication network in disaster areas (CNDA) can disseminate the key disaster information in time and provide basic information support for decision-making and rescuing. Therefore, it is of great significance to study the information dissemination mechanism of CNDA. However, a CNDA is vulnerable to interference, which affects information dissemination and rescuing. To solve this problem, this paper established a multi-layer information dissemination model of CNDA (MMND) which models the CNDA from the perspective of degree distribution of nodes. The information dissemination process and equilibrium state in CNDA is analyzed by an improved dynamic dissemination method. Then, the effects of the …

Corruption-Tolerant Algorithms For Generalized Linear Models, Bhaskar Mukhoty, Debojyoti Dey, Purushottam Kar

Machine Learning Faculty Publications

This paper presents SVAM (Sequential Variance-Altered MLE), a unified framework for learning generalized linear models under adversarial label corruption in training data. SVAM extends to tasks such as least squares regression, logistic regression, and gamma regression, whereas many existing works on learning with label corruptions focus only on least squares regression. SVAM is based on a novel variance reduction technique that may be of independent interest and works by iteratively solving weighted MLEs over variance-altered versions of the GLM objective. SVAM offers provable model recovery guarantees superior to the state-of-the-art for robust regression even when a constant fraction of training …

Machine Learning Data Feature Reduction And Model Optimization, Francisco P. Maturana, Phillip M. Lacasse

AFIT Patents

For machine learning data reduction and model optimization, a method randomly assigns each data feature of a training data set to a plurality of solution groups. Each solution group has no more than a solution group number k of data features and each data feature is assigned to a plurality of solution groups. The method identifies each solution group as a high-quality solution group or a low-quality solution group. The method further calculates data feature scores for each data feature comprising a high bin number and a low bin number. The method determines level data for each data feature from …

Strategic Planning For Flexible Agent Availability In Large Taxi Fleets, Rajiv Ranjan Kumar, Pradeep Varakantham, Shih-Fen Cheng

Research Collection School Of Computing and Information Systems

In large scale multi-agent systems like taxi fleets, individual agents (taxi drivers) are self interested (maximizing their own profits) and this can introduce inefficiencies in the system. One such inefficiency is with regards to the "required" availability of taxis at different time periods during the day. Since a taxi driver can work for limited number of hours in a day (e.g., 8-10 hours in a city like Singapore), there is a need to optimize the specific hours, so as to maximize individual as well as social welfare. Technically, this corresponds to solving a large scale multi-stage selfish routing game with …

Where Is My Spot? Few-Shot Image Generation Via Latent Subspace Optimization, Chenxi Zheng, Bangzhen Liu, Huaidong Zhang, Xuemiao Xu, Shengfeng He

Research Collection School Of Computing and Information Systems

Image generation relies on massive training data that can hardly produce diverse images of an unseen category according to a few examples. In this paper, we address this dilemma by projecting sparse few-shot samples into a continuous latent space that can potentially generate infinite unseen samples. The rationale behind is that we aim to locate a centroid latent position in a conditional StyleGAN, where the corresponding output image on that centroid can maximize the similarity with the given samples. Although the given samples are unseen for the conditional StyleGAN, we assume the neighboring latent subspace around the centroid belongs to …

Deep Hybrid Modeling Of Neuronal Dynamics Using Generative Adversarial Networks, Soheil Saghafi

Dissertations

Mechanistic modeling and machine learning methods are powerful techniques for approximating biological systems and making accurate predictions from data. However, when used in isolation these approaches suffer from distinct shortcomings: model and parameter uncertainty limit mechanistic modeling, whereas machine learning methods disregard the underlying biophysical mechanisms. This dissertation constructs Deep Hybrid Models that address these shortcomings by combining deep learning with mechanistic modeling. In particular, this dissertation uses Generative Adversarial Networks (GANs) to provide an inverse mapping of data to mechanistic models and identifies the distributions of mechanistic model parameters coherent to the data.

Chapter 1 provides background information on …

Loss Scaling And Step Size In Deep Learning Optimizatio, Nora Alosily

Dissertations

Deep learning training consumes ever-increasing time and resources, and that is
due to the complexity of the model, the number of updates taken to reach good
results, and both the amount and dimensionality of the data. In this dissertation,
we will focus on making the process of training more efficient by focusing on the
step size to reduce the number of computations for parameters in each update.
We achieved our objective in two new ways: we use loss scaling as a proxy for
the learning rate, and we use learnable layer-wise optimizers. Although our work
is perhaps not the first …

Hybrid Modeling For Electrochemical Systems, Luis Alejandro Briceno-Mena

LSU Doctoral Dissertations

The discovery of new materials like catalysts, polymeric films, and biomolecules, is driven by industrial needs such as improving reaction or separation selectivity, enhancing therapeutic effects on medical treatments, or reducing costs of replacement. However, deployment of these advances in industrial applications is often hindered by the lack of models needed for design and optimization. Due to the novelty of materials and devices, experimental data and first principles' knowledge are scarce, making it hard to build models either via data-driven or knowledge based approaches. In this context, a way to efficiently combine domain knowledge with data could provide a pathway …

Scheduling Electric Vehicle Charging For Grid Load Balancing, Zhixin Han, Katarina Grolinger, Miriam Capretz, Syed Mir

Electrical and Computer Engineering Publications

In recent years, electric vehicles (EVs) have been widely adopted because of their environmental benefits. However, the increasing volume of EVs poses capacity issues for grid operators as simultaneously charging many EVs may result in grid instabilities. Scheduling EV charging for grid load balancing has a potential to prevent load peaks caused by simultaneous EV charging and contribute to balance of supply and demand. This paper proposes a user-preference-based scheduling approach to minimize costs for the user while balancing grid loads. The EV owners benefit by charging when the electricity cost is lower, but still within the user-defined preferred charging …

Peer-To-Peer Energy Trading In Smart Residential Environment With User Behavioral Modeling, Ashutosh Timilsina

Theses and Dissertations--Computer Science

Electric power systems are transforming from a centralized unidirectional market to a decentralized open market. With this shift, the end-users have the possibility to actively participate in local energy exchanges, with or without the involvement of the main grid. Rapidly reducing prices for Renewable Energy Technologies (RETs), supported by their ease of installation and operation, with the facilitation of Electric Vehicles (EV) and Smart Grid (SG) technologies to make bidirectional flow of energy possible, has contributed to this changing landscape in the distribution side of the traditional power grid.

Trading energy among users in a decentralized fashion has been referred …

Lemurs Optimizer: A New Metaheuristic Algorithm For Global Optimization, Ammar Kamal Abasi, Sharif Naser Makhadmeh, Mohammed Azmi Al-Betar, Osama Ahmad Alomari, Mohammed A. Awadallah, Zaid Abdi Alkareem Alyasseri, Iyad Abu Doush, Ashraf Elnagar, Eman H. Alkhammash, Myriam Hadjouni

Machine Learning Faculty Publications

The Lemur Optimizer (LO) is a novel nature-inspired algorithm we propose in this paper. This algorithm’s primary inspirations are based on two pillars of lemur behavior: leap up and dance hub. These two principles are mathematically modeled in the optimization context to handle local search, exploitation, and exploration search concepts. The LO is first benchmarked on twenty-three standard optimization functions. Additionally, the LO is used to solve three real-world problems to evaluate its performance and effectiveness. In this direction, LO is compared to six well-known algorithms: Salp Swarm Algorithm (SSA), Artificial Bee Colony (ABC), Sine Cosine Algorithm (SCA), Bat Algorithm …

Products Pricing And Return Strategies For The Dual Channel Retailers, Jian Liu, Xinyue Sun, Yanyan Liu

Electrical and Computer Engineering Faculty Research & Creative Works

This paper analyzed how different return strategies and return rates affect dual-channel retailers' profits and channel pricings. Return can stimulate sales; however, the return has presented significant challenges to retailers. The return has long been studied to maximize profit and pricing; however, the different return strategies for dual-channel retailers affect channel both. This paper aimed to study whether or not dual-channel retailers should allow customers to return items in two channels and whether or not the retailer should contract with the manufacturers and pay extra fees to return products. This study indicated when the retailer should allow customers' returns to …

Reconfigurable Intelligent Surfaces And Capacity Optimization: A Large System Analysis, Aris L. Moustakas, George C. Alexandropoulos, Mérouane Debbah

Machine Learning Faculty Publications

Reconfigurable Intelligent Surfaces (RISs), comprising large numbers of low-cost and almost passive metamaterials with tunable reflection properties, have been recently proposed as an enabling technology for programmable wireless propagation environments. In this paper, we present asymptotic closed-form expressions for the mean and variance of the mutual information metric for a multi-antenna transmitter-receiver pair in the presence of multiple RISs, using methods from statistical physics. While nominally valid in the large system limit, we show that the derived Gaussian approximation for the mutual information can be quite accurate, even for modest-sized antenna arrays and metasurfaces. The above results are particularly useful …

Design And Analysis Of Strategic Behavior In Networks, Sixie Yu

McKelvey School of Engineering Graduate Student Theses & Dissertations

Networks permeate every aspect of our social and professional life.A networked system with strategic individuals can represent a variety of real-world scenarios with socioeconomic origins. In such a system, the individuals' utilities are interdependent---one individual's decision influences the decisions of others and vice versa. In order to gain insights into the system, the highly complicated interactions necessitate some level of abstraction. To capture the otherwise complex interactions, I use a game theoretic model called Networked Public Goods (NPG) game. I develop a computational framework based on NPGs to understand strategic individuals' behavior in networked systems. The framework consists of three …