Artificial Intelligence and Robotics Commons^™

Identifying Temporomandibular Disorder Morphological Risk Factors Via Explainable Deep Learning And Multiscale Biomechanical Modeling, Shuchun Sun

All Dissertations

Clarifying multifactorial musculoskeletal disorder etiologies supports risk analysis and development of targeted prevention and treatment modalities. Deep learning enables comprehensive risk factor identification through systematic analysis of disease datasets but does not provide sufficient context for mechanistic understanding, limiting clinical applicability for etiological investigations. Conversely, multiscale biomechanical modeling can evaluate mechanistic etiology within the relevant biomechanical and physiological context. We propose a hybrid approach combining 3D explainable deep learning and multiscale biomechanical modeling; we applied this approach to investigate temporomandibular joint (TMJ) disorder etiology by systematically identifying risk factors and elucidating mechanistic relationships between risk factors and TMJ biomechanics and …

Robust And Trustworthy Deep Learning: Attacks, Defenses And Designs, Bingyin Zhao

All Dissertations

Deep neural networks (DNNs) have achieved unprecedented success in many fields. However, robustness and trustworthiness have become emerging concerns since DNNs are vulnerable to various attacks and susceptible to data distributional shifts. Attacks such as data poisoning and out-of-distribution scenarios such as natural corruption significantly undermine the performance and robustness of DNNs in model training and inference and impose uncertainty and insecurity on the deployment in real-world applications. Thus, it is crucial to investigate threats and challenges against deep neural networks, develop corresponding countermeasures, and dig into design tactics to secure their safety and reliability. The works investigated in this …

Enabling And Optimizing Multi-Modal Sense-Making For Human-Ai Interaction Tasks, Dulanga Kaveesha Weerakoon Weerakoon Mudiyanselage

Dissertations and Theses Collection (Open Access)

The rapid pace of adoption of mixed-reality in tandem with advances in NLP and computer vision have opened up unprecedented opportunities for more naturalistic interaction interfaces which underpin Human-AI collaborative applications such as spatial computing and interactive conversational agents. One notable example is the emergence of interactive virtual assistants, which facilitate more natural communication of instructions and queries through modalities like voice and text. This trend is driving the development of innovative ubiquitous, mixed-reality computing applications. Such interactive, natural communication is also critical to support advances in human-robot interactive co-working, across a variety of industrial, commercial and home environments. Conventional …

Super Mario Evolution By The Augmentation Of Topology, Russell A. Autin

LSU New Orleans Theses and Dissertations

This paper describes the creation and development of an implementation of the NeuroEvolution of Augmenting Topologies (NEAT) architecture to train an agent to play Super Mario Brothers. Building off of a basic implementation of NEAT, this thesis project shows the process of refining the fitness calculation that ranks the networks in the population and also defines the creation and application of a dataset to train the agent. The use of a dataset to train an agent is a novel idea in the world of reinforcement learning because, generally, reinforcement learning trains an agent to complete a singular task like the …

3-D Reconstruction For Underwater Robots With A Monocular Camera And Lights, Monika Roznere

Dartmouth College Ph.D Dissertations

Before a robot can act, it must perceive its environment. Though, this is not a simple task when considering the challenges in underwater domains -- poor visibility conditions, limited sensor configurations, and lack of readily accessible localization. Underwater robots have, nevertheless, improved dramatically with more extensive sensor and navigation equipment. Robot and sensor use have enabled us to explore all reaches of our oceans. On the other hand, these same robots are not easily accessible or transferable to many practical tasks, including fishery management, infrastructure maintenance, disaster response, site conservation, and ecological surveys. There is a growing need for robots …

Next-Generation Crop Monitoring Technologies: Case Studies About Edge Image Processing For Crop Monitoring And Soil Water Property Modeling Via Above-Ground Sensors, Nipuna Chamara

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Artificial Intelligence (AI) has advanced rapidly in the past two decades. Internet of Things (IoT) technology has advanced rapidly during the last decade. Merging these two technologies has immense potential in several industries, including agriculture.

We have identified several research gaps in utilizing IoT technology in agriculture. One problem was the digital divide between rural, unconnected, or limited connected areas and urban areas for utilizing images for decision-making, which has advanced with the growth of AI. Another area for improvement was the farmers' demotivation to use in-situ soil moisture sensors for irrigation decision-making due to inherited installation difficulties. As Nebraska …

Sliding Markov Decision Processes For Dynamic Task Planning On Uncrewed Aerial Vehicles, Trent Wiens

Department of Mechanical and Materials Engineering: Dissertations, Theses, and Student Research

Mission and flight planning problems for uncrewed aircraft systems (UASs) are typically large and complex in space and computational requirements. With enough time and computing resources, some of these problems may be solvable offline and then executed during flight. In dynamic or uncertain environments, however, the mission may require online adaptation and replanning. In this work, we will discuss methods of creating MDPs for online applications, and a method of using a sliding resolution and receding horizon approach to build and solve Markov Decision Processes (MDPs) in practical planing applications for UASs. In this strategy, called a Sliding Markov Decision …

Teaching And Learning In Human-Robot Collaborative Tasks, Omar Obidat

Theses, Dissertations and Culminating Projects

This paper describes a proposed model for human-robot collaboration (HRC), its implementation on a real-world representative application, and a final evaluation on the overall collaborative effort. Modern manufacturing places a strong emphasis on cost-reduction and increased throughput. A common means of scaling production and increasing productivity is achieved through the deployment of industrial robots, some of which work collaboratively with human workers. This contemporary pairing poses a number of challenges, including worker safety, process efficiency, reliability, among others. This paper details the approach of a human collaborating with a robot that utilizes a vision system, employs a dynamically generated finite …

Trust In Human-Robot Collaborative Tasks, Jesse Parron

Theses, Dissertations and Culminating Projects

With recent advancements in machine learning and artificial intelligence, we have entered a new era of technology. With AI on the rise, it has led to many insurgencies in a variety of domains. One area that has particularly been growing at a rapid pace is robotics. Consequently, the ubiquitous rise of robots in new workspaces leads to the influx of human-robot collaboration. Human-robot collaboration is an important factor in this domain, as it mandates the relationship between humans and robots. One key component of this relationship is trust, which many people subconsciously determine when interacting with peers, strangers, and coworkers. …

Vr Circuit Simulation With Advanced Visualization For Enhancing Comprehension In Electrical Engineering, Elliott Wolbach

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

As technology advances, the field of electrical and computer engineering continuously demands innovative tools and methodologies to facilitate effective learning and comprehension of fundamental concepts. Through a comprehensive literature review, it was discovered that there was a gap in the current research on using VR technology to effectively visualize and comprehend non-observable electrical characteristics of electronic circuits. This thesis explores the integration of Virtual Reality (VR) technology and real-time electronic circuit simulation with enhanced visualization of non-observable concepts such as voltage distribution and current flow within these circuits. The primary objective is to develop an immersive educational platform that makes …

Towards Explainable Harmful Meme Detection Through Multimodal Debate Between Large Language Models, Hongzhan Lin, Ziyang Luo, Wei Gao, Jing Ma, Bo Wang, Ruichao Yang

Research Collection School Of Computing and Information Systems

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not explicitly conveyed through the surface text and image. However, existing harmful meme detection methods do not present readable explanations that unveil such implicit meaning to support their detection decisions. In this paper, we propose an explainable approach to detect harmful memes, achieved through reasoning over conflicting rationales from both harmless and harmful positions. Specifically, inspired by the powerful capacity of Large Language Models …

Escaping Saddle Points In Heterogeneous Federated Learning Via Distributed Sgd With Communication Compression, Sijin Chen, Zhize Li, Yuejie Chi

Research Collection School Of Computing and Information Systems

We consider the problem of finding second-order stationary points in the optimization of heterogeneous federated learning (FL). Previous works in FL mostly focus on first-order convergence guarantees, which do not rule out the scenario of unstable saddle points. Meanwhile, it is a key bottleneck of FL to achieve communication efficiency without compensating the learning accuracy, especially when local data are highly heterogeneous across different clients. Given this, we propose a novel algorithm PowerEF-SGD that only communicates compressed information via a novel error-feedback scheme. To our knowledge, PowerEF-SGD is the first distributed and compressed SGD algorithm that provably escapes saddle points …

Q-Learning Based Framework For Solving The Stochastic E-Waste Collection Problem, Dang Viet Anh Nguyen, Aldy Gunawan, Mustafa Misir, Pieter Vansteenwegen

Research Collection School Of Computing and Information Systems

Electrical and Electronic Equipment (EEE) has evolved into a gateway for accessing technological innovations. However, EEE imposes substantial pressure on the environment due to the shortened life cycles. E-waste encompasses discarded EEE and its components which are no longer in use. This study focuses on the e-waste collection problem and models it as a Vehicle Routing Problem with a heterogeneous fleet and a multi-period planning problem with time windows as well as stochastic travel times. Two different Q-learning-based methods are designed to enhance the search procedure for finding solutions. The first method involves utilizing the state-action value to determine the …

Text-Attributed Graph Representation Learning : Methods, Applications, And Challenges, Ce Zhang, Menglin Yang, Rex Ying, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Text documents are usually connected in a graph structure, resulting in an important class of data named text-attributed graph, e.g., paper citation graph and Web page hyperlink graph. On the one hand, Graph Neural Networks (GNNs) consider text in each document as general vertex attribute and do not specifically deal with text data. On the other hand, Pre-trained Language Models (PLMs) and Topic Models (TMs) learn effective document embeddings. However, most models focus on text content in each single document only, ignoring link adjacency across documents. The above two challenges motivate the development of text-attributed graph representation learning, combining GNNs …

Fashionregen: Llm‑Empowered Fashion Report Generation, Yujuan Ding, Yunshan Ma, Wenqi Fan, Yige Yao, Tat‑Seng Chua, Qing Li

Research Collection School Of Computing and Information Systems

Fashion analysis refers to the process of examining and evaluating trends, styles, and elements within the fashion industry to understand and interpret its current state, generating fashion reports. It is traditionally performed by fashion professionals based on their expertise and experience, which requires high labour cost and may also produce biased results for relying heavily on a small group of people. In this paper, to tackle the Fashion Report Generation (FashionReGen) task, we propose an intelligent Fashion Analyzing and Reporting system based the advanced Large Language Models (LLMs), debbed as GPT-FAR. Specifically, it tries to deliver FashionReGen based on effective …

On The Feasibility Of Simple Transformer For Dynamic Graph Modeling, Yuxia Wu, Yuan Fang, Lizi Liao

Research Collection School Of Computing and Information Systems

Dynamic graph modeling is crucial for understanding complex structures in web graphs, spanning applications in social networks, recommender systems, and more. Most existing methods primarily emphasize structural dependencies and their temporal changes. However, these approaches often overlook detailed temporal aspects or struggle with long-term dependencies. Furthermore, many solutions overly complicate the process by emphasizing intricate module designs to capture dynamic evolutions. In this work, we harness the strength of the Transformer’s self-attention mechanism, known for adeptly handling long-range dependencies in sequence modeling. Our approach offers a simple Transformer model, called SimpleDyG, tailored for dynamic graph modeling without complex modifications. We …

The Impact Of Ai On Ux: Challenges And Opportunities, Susan Stephanie Wells

Theses

Integrating artificial intelligence (AI) in user experience (UX) design is reshaping the field of UX, offering new opportunities and challenges for designers. This thesis project explores the multifaceted relationship between AI and UX design, focusing on the challenges, opportunities, and skills demanded of UX designers in the age of AI. Through a review of academic research and real-world experiences, this project studies the impact of AI on web design processes, UX testing, and data analysis. Key findings highlight the transformative potential of AI in enhancing user experiences, from suggesting website structures to facilitating UX testing and data analysis.

Comparative analysis …

The Role Of Student Motivation In Integrating Ai Into Web Design Education: A Longitudinal Study, Jason Lively, James Hutson

Faculty Scholarship

Amidst the current wave studies of artificial intelligence (AI) in education, this longitudinal case study, spanning Spring 2023 to Spring 2024, delves into the integration of AI in the UI/UX web design classroom. By introducing both text-based and image-based AI tools to students with varying levels of skill in introductory web design and user experience (UX) courses, the study observed a significant enhancement in student creative capabilities and project outcomes. The utilization of text-based generators markedly improved writing efficiency and coding, while image-based tools facilitated better ideation and color selection. These findings underscore the potential to augment traditional educational methods, …

Denoising Diffusion Probabilistic Models Based Accelerated Mri, Alexander Francis Bugielski

Theses and Dissertations

Magnetic Resonance Imaging (MRI) is a cornerstone in obtaining intricate visualizations of anatomy and physiological processes within the human body. However, its extensive scan duration not only causes patient discomfort but also increases the likelihood of motion-induced artifacts in the images. To address such a challenge, this study investigates deep neural network models for reconstructing high-resolution MRI images from noisy and significantly undersampled data in a supervised learning manner. Specifically, it compares three models: a conventional U-Net, a self-attentive U-Net, and an innovative probabilistic diffusion model that builds upon the self-attentive U-Net architecture. These models are evaluated on their ability …

Modeling The Spatiotemporal Variations Of The Magnetic Field In Active Regions On The Sun Using Deep Neural Networks, Godwill Asare Mensah Mensah

Open Access Theses & Dissertations

Solar active regions are areas on the Sun's surface that have especially strong magnetic fields. Active regions are usually linked to a number of phenomena that can have serious detrimental consequences on technology and, in turn, human life. Examples of these phenomena include solar flares and coronal mass ejections, or CMEs. The precise predictionof solar flares and coronal mass ejections is still an open problem since the fundamental processes underpinning the formation and development of active regions are still not well understood. One key area of research at the intersection of solar physics and artificial intelligence is deriving insights from …