Artificial Intelligence and Robotics Commons^™

On The Feasibility Of Simple Transformer For Dynamic Graph Modeling, Yuxia Wu, Yuan Fang, Lizi Liao

Research Collection School Of Computing and Information Systems

Dynamic graph modeling is crucial for understanding complex structures in web graphs, spanning applications in social networks, recommender systems, and more. Most existing methods primarily emphasize structural dependencies and their temporal changes. However, these approaches often overlook detailed temporal aspects or struggle with long-term dependencies. Furthermore, many solutions overly complicate the process by emphasizing intricate module designs to capture dynamic evolutions. In this work, we harness the strength of the Transformer’s self-attention mechanism, known for adeptly handling long-range dependencies in sequence modeling. Our approach offers a simple Transformer model, called SimpleDyG, tailored for dynamic graph modeling without complex modifications. We …

Enhancing Visual Grounding In Vision-Language Pre-Training With Position-Guided Text Prompts, Alex Jinpeng Wang, Pan Zhou, Mike Zheng Shou, Shuicheng Yan

Research Collection School Of Computing and Information Systems

Vision-Language Pre-Training (VLP) has demonstrated remarkable potential in aligning image and text pairs, paving the way for a wide range of cross-modal learning tasks. Nevertheless, we have observed that VLP models often fall short in terms of visual grounding and localization capabilities, which are crucial for many downstream tasks, such as visual reasoning. In response, we introduce a novel Position-guided Text Prompt ( PTP ) paradigm to bolster the visual grounding abilities of cross-modal models trained with VLP. In the VLP phase, PTP divides an image into N x N blocks and employs a widely-used object detector to identify objects …

Reinforcement Nash Equilibrium Solver, Xinrun Wang, Chang Yang, Shuxin Li, Pengdeng Li, Xiao Huang, Hau Chan, Bo An

Research Collection School Of Computing and Information Systems

Nash Equilibrium (NE) is the canonical solution concept of game theory, which provides an elegant tool to understand the rationalities. Computing NE in two- or multi-player general-sum games is PPAD-Complete. Therefore, in this work, we propose REinforcement Nash Equilibrium Solver (RENES), which trains a single policy to modify the games with different sizes and applies the solvers on the modified games where the obtained solution is evaluated on the original games. Specifically, our contributions are threefold. i) We represent the games as ��-rank response graphs and leverage graph neural network (GNN) to handle the games with different sizes as inputs; …

Evaluation Of Orca 2 Against Other Llms For Retrieval Augmented Generation, Donghao Huang, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

This study presents a comprehensive evaluation of Microsoft Research’s Orca 2, a small yet potent language model, in the context of Retrieval Augmented Generation (RAG). The research involved comparing Orca 2 with other significant models such as Llama-2, GPT-3.5-Turbo, and GPT-4, particularly focusing on its application in RAG. Key metrics, included faithfulness, answer relevance, overall score, and inference speed, were assessed. Experiments conducted on high-specification PCs revealed Orca 2’s exceptional performance in generating high quality responses and its efficiency on consumer-grade GPUs, underscoring its potential for scalable RAG applications. This study highlights the pivotal role of smaller, efficient models like …

Reinforcement Learning With Maskable Stock Representation For Portfolio Management In Customizable Stock Pools, Wentao Zhang, Yilei Zhao, Shuo Sun, Jie Ying, Yonggang Xie, Zitao Song, Xinrun Wang, Bo An

Research Collection School Of Computing and Information Systems

Portfolio management (PM) is a fundamental financial trading task, which explores the optimal periodical reallocation of capitals into different stocks to pursue long-term profits. Reinforcement learning (RL) has recently shown its potential to train profitable agents for PM through interacting with financial markets. However, existing work mostly focuses on fixed stock pools, which is inconsistent with investors’ practical demand. Specifically, the target stock pool of different investors varies dramatically due to their discrepancy on market states and individual investors may temporally adjust stocks they desire to trade (e.g., adding one popular stocks), which lead to customizable stock pools (CSPs). Existing …

Grasper: A Generalist Pursuer For Pursuit-Evasion Problems, Pengdeng Li, Shuxin Li, Xinrun Wang, Jakub Cerny, Youzhi Zhang, Stephen Mcaleer, Hau Chan, Bo An

Research Collection School Of Computing and Information Systems

Pursuit-evasion games (PEGs) model interactions between a team of pursuers and an evader in graph-based environments such as urban street networks. Recent advancements have demonstrated the effectiveness of the pre-training and fine-tuning paradigm in Policy-Space Response Oracles (PSRO) to improve scalability in solving large-scale PEGs. However, these methods primarily focus on specific PEGs with fixed initial conditions that may vary substantially in real-world scenarios, which significantly hinders the applicability of the traditional methods. To address this issue, we introduce Grasper, a GeneRAlist purSuer for Pursuit-Evasion pRoblems, capable of efficiently generating pursuer policies tailored to specific PEGs. Our contributions are threefold: …

Algorithms For Canvas-Based Attention Scheduling With Resizing, Yigong Hu, Ila Gokarn, Shengzhong Liu, Archan Misra, Tarek Adbelzaher

Research Collection School Of Computing and Information Systems

Canvas-based attention scheduling was recently pro-posed to improve the efficiency of real-time machine perception systems. This framework introduces a notion of focus locales, referring to those areas where the attention of the inference system should “allocate its attention”. Data from these locales (e.g., parts of the input video frames containing objects of interest) are packed together into a smaller canvas frame which is processed by the downstream machine learning algorithm. Compared with processing the entire input data frame, this practice saves resources while maintaining inference quality. Previous work was limited to a simplified solution where the focus locales are quantized …

Learning Adversarial Semantic Embeddings For Zero-Shot Recognition In Open Worlds, Tianqi Li, Guansong Pang, Xiao Bai, Jin Zheng, Lei Zhou, Xin Ning

Research Collection School Of Computing and Information Systems

Zero-Shot Learning (ZSL) focuses on classifying samples of unseen classes with only their side semantic information presented during training. It cannot handle real-life, open-world scenarios where there are test samples of unknown classes for which neither samples (e.g., images) nor their side semantic information is known during training. Open-Set Recognition (OSR) is dedicated to addressing the unknown class issue, but existing OSR methods are not designed to model the semantic information of the unseen classes. To tackle this combined ZSL and OSR problem, we consider the case of “Zero-Shot Open-Set Recognition” (ZS-OSR), where a model is trained under the ZSL …

Next-Generation Crop Monitoring Technologies: Case Studies About Edge Image Processing For Crop Monitoring And Soil Water Property Modeling Via Above-Ground Sensors, Nipuna Chamara

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Artificial Intelligence (AI) has advanced rapidly in the past two decades. Internet of Things (IoT) technology has advanced rapidly during the last decade. Merging these two technologies has immense potential in several industries, including agriculture.

We have identified several research gaps in utilizing IoT technology in agriculture. One problem was the digital divide between rural, unconnected, or limited connected areas and urban areas for utilizing images for decision-making, which has advanced with the growth of AI. Another area for improvement was the farmers' demotivation to use in-situ soil moisture sensors for irrigation decision-making due to inherited installation difficulties. As Nebraska …

Automated Cinematographer For Vr Viewing Experiences, Zihan Wu

Dartmouth College Master’s Theses

As the virtual reality (VR) industry continues to evolve, the question of how to effectively capture VR experiences for an audience remains a challenge. The predominant method of showcasing VR applications through first-person recordings lacks cinematic interest, failing to capture other viewpoints and the essence of the moment. Meanwhile, manually setting up cameras and editing videos requires technical expertise on behalf of the user. In this paper, we propose the use of machine learning (ML) to automatically select the most compelling predefined viewpoint in a VR environment, at any given moment. Our models, trained on actor motion and voice volume, …

The Impact Of Ai On Ux: Challenges And Opportunities, Susan Stephanie Wells

Theses

Integrating artificial intelligence (AI) in user experience (UX) design is reshaping the field of UX, offering new opportunities and challenges for designers. This thesis project explores the multifaceted relationship between AI and UX design, focusing on the challenges, opportunities, and skills demanded of UX designers in the age of AI. Through a review of academic research and real-world experiences, this project studies the impact of AI on web design processes, UX testing, and data analysis. Key findings highlight the transformative potential of AI in enhancing user experiences, from suggesting website structures to facilitating UX testing and data analysis.

Comparative analysis …

Comparative Predictive Analysis Of Stock Performance In The Tech Sector, Asaad Sendi

LSU New Orleans Theses and Dissertations

This study compares the performance of deep learning models, including Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Transformer, in predicting stock prices across five companies (AAPL, CSCO, META, MSFT, and TSLA) from July 2019 to July 2023. Key findings reveal that GRU models generally exhibit the lowest Mean Absolute Error (MAE), indicating higher precision, particularly notable for CSCO with a remarkably low MAE. While LSTM models often show slightly higher MAE values, they outperform Transformer models in capturing broader trends and variance in stock prices, as evidenced by higher R-squared (R2) values. Transformer models generally exhibit higher MAE …

Choreographing The Rhythms Of Observation: Dynamics For Ranged Observer Bipartite-Unipartite Spatiotemporal (Robust) Networks, Edward A. Holmberg Iv

LSU New Orleans Theses and Dissertations

Existing network analysis methods struggle to optimize observer placements in dynamic environments with limited visibility. This dissertation introduces the novel ROBUST (Ranged Observer Bipartite-Unipartite SpatioTemporal) framework, offering a significant advancement in modeling, analyzing, and optimizing observer networks within complex spatiotemporal domains. ROBUST leverages a unique bipartite-unipartite approach, distinguishing between observer and observable entities while incorporating spatial constraints and temporal dynamics.

This research extends spatiotemporal network theory by introducing novel graph-based measures, including myopic degree, spatial closeness centrality, and edge length proportion. These measures, coupled with advanced clustering techniques like Proximal Recurrence, provide insights into network structure, resilience, and the effectiveness …

Super Mario Evolution By The Augmentation Of Topology, Russell A. Autin

LSU New Orleans Theses and Dissertations

This paper describes the creation and development of an implementation of the NeuroEvolution of Augmenting Topologies (NEAT) architecture to train an agent to play Super Mario Brothers. Building off of a basic implementation of NEAT, this thesis project shows the process of refining the fitness calculation that ranks the networks in the population and also defines the creation and application of a dataset to train the agent. The use of a dataset to train an agent is a novel idea in the world of reinforcement learning because, generally, reinforcement learning trains an agent to complete a singular task like the …

Experiment Development And Validation Of A Granular Jamming Robotic Gripper, Jacob R. Dowd

UNLV Theses, Dissertations, Professional Papers, and Capstones

A granular jamming gripper (GJG) is widely known as a Universal Gripper because of the wide range of objects that it can grasp and the simplicity of control, design, and manufacturing. Despite multitude of research improving the GJG, here, we focus on the base version of the GJG and attempt to glean the range of objects that it may reliably grasp. Despite the limited range of objects, which were a sphere, rectangular prism, and cylinder, we gleaned geometric properties as it relates to successful and unsuccessful grasping. This was based on the two types of testing: push and pull testing …

Ethical Imperatives And Challenges: Review Of The Use Of Machine Learning For Predictive Analytics In Higher Education, Emily Barnes, James Hutson, Karriem Perry

Faculty Scholarship

The escalating integration of machine learning (ML) in higher education necessitates a critical examination of its ethical implications. This article conducts a comprehensive review of the application of ML for predictive analytics within higher education institutions (HEIs), emphasizing the technology's potential to enhance student outcomes and operational efficiency. The study identifies significant ethical concerns, such as data privacy, informed consent, transparency, and accountability, that arise from the use of ML. Through a detailed analysis of current practices, this review underscores the need for HEIs to develop robust ethical frameworks and technological infrastructures to navigate these challenges effectively. The findings reveal …

Learning Scene Semantics For 3d Scene Retrieval, Natalie Gleason

Honors Theses

This project presents a comprehensive exploration into semantics-driven 3D scene retrieval, aiming to bridge the gap between 2D sketches/images and 3D models. Through four distinct research objectives, this project endeavors to construct a foundational infrastructure, develop methodologies for quantifying semantic similarity, and advance a semantics-based retrieval framework for 2D scene sketch-based and image-based 3D scene retrieval. Leveraging WordNet as a foundational semantic ontology library, the research proposes the construction of an extensive hierarchical scene semantic tree, enriching 2D/3D scenes with encoded semantic information. The methodologies for semantic similarity computation utilize this semantic tree to bridge the semantic disparity between 2D …

Vr Circuit Simulation With Advanced Visualization For Enhancing Comprehension In Electrical Engineering, Elliott Wolbach

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

As technology advances, the field of electrical and computer engineering continuously demands innovative tools and methodologies to facilitate effective learning and comprehension of fundamental concepts. Through a comprehensive literature review, it was discovered that there was a gap in the current research on using VR technology to effectively visualize and comprehend non-observable electrical characteristics of electronic circuits. This thesis explores the integration of Virtual Reality (VR) technology and real-time electronic circuit simulation with enhanced visualization of non-observable concepts such as voltage distribution and current flow within these circuits. The primary objective is to develop an immersive educational platform that makes …

The Effects Of Using Machine Translators On The Performance Of Second Language Learners, Kasey Myer

University Honors College

With the rise of technology has also come the development of various online language translators and artificial intelligence that are often utilized by individuals learning a second language. However, there is a wide range of quality between the different machine translation tools, and many people tend to be under the impression that it is inferior to the quality of interpretations provided by human translators. This paper considers the positives and negatives of machine translation as a tool for second language learning. Variations between the input and output languages on a grammatical and cultural level are analyzed. Machine translation is compared …

Privacy Protection In Mobile Photography With Face Cloaking, Rithyka Heng

Computer Science and Computer Engineering Undergraduate Honors Theses

In a world of increasing connectivity, privacy is becoming ever-more difficult to maintain. People have little control over the capture of their image while in public and have even less control over the online sharing or posting of their image. This leaves many people vulnerable to being tracked or profiled via their image’s presence in other people’s photos. This thesis implements and evaluates an approach to privacy protection that involves the photographers protecting the privacy of bystanders. Because most photographs are now being taken by smartphones, a mobile application is decidedly the technology that would best achieve widespread adoption and …

Automatic Extraction Of Vulnerability Information For Security Operators Using Gpt Models, Waeland Elder

Computer Science and Computer Engineering Undergraduate Honors Theses

Artificial intelligence has progressed rapidly in recent years, greatly revolutionizing the world and helping to automate increasingly complex tasks. However, there are still some disciplines where the problem of automation has not yet been thoroughly tackled, such as in software vulnerability management. Vulnerability management is a critical component of cybersecurity for an organization. Until recently, learning about a vulnerability required a security operator to manually search and read through online information and security advisories to find needed information. Doing so is a significantly time-consuming task, as these advisories tend to be quite lengthy and packed with information about various technologies. …

Modeling The Spatiotemporal Variations Of The Magnetic Field In Active Regions On The Sun Using Deep Neural Networks, Godwill Asare Mensah Mensah

Open Access Theses & Dissertations

Solar active regions are areas on the Sun's surface that have especially strong magnetic fields. Active regions are usually linked to a number of phenomena that can have serious detrimental consequences on technology and, in turn, human life. Examples of these phenomena include solar flares and coronal mass ejections, or CMEs. The precise predictionof solar flares and coronal mass ejections is still an open problem since the fundamental processes underpinning the formation and development of active regions are still not well understood. One key area of research at the intersection of solar physics and artificial intelligence is deriving insights from …

Automated Composition Of Multivariable Scientific Workflows Considering Scientific Assumptions, Raul Alejandro Vargas Acosta

Open Access Theses & Dissertations

Many ground-breaking scientific experiments require the execution of multiple complex scientific computations. Thus, scientific workflows (i.e., a sequence of scientific computations) have received significant attention, more specifically, the automated composition of scientific workflows. Scientific workflows that repurpose data may have unique scientific assumptions that need to be considered when composing a workflow. Workflow composition tools have enabled a wider range of stakeholders (e.g., policymakers, the general public, and researchers) to create and execute workflows; however, domain expertise is still required for these tasks. The overarching goal of this work is to further improve the automatic composition of scientific workflows by …

Database And Machine Learning Model For Classifying Autism Spectrum Disorder From Smartphone Based Electroretinography, Rory Harris

Honors Scholar Theses

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that negatively affects a patient’s cognitive and communication aptitude and, therefore, can severely impact that patient’s quality of life. Because of this, early diagnosis is paramount. In recent studies, electroretinography (ERG), which is a measure of the retina’s electrical response to a brief flash of light into the eye, has shown promise in detecting ASD. Access to these scans can provide early diagnosis, improving well-being. Current ERG devices are very expensive due to their on board processing capabilities. This paper aims to create an ERG device using a smartphone as the main …

3-D Reconstruction For Underwater Robots With A Monocular Camera And Lights, Monika Roznere

Dartmouth College Ph.D Dissertations

Before a robot can act, it must perceive its environment. Though, this is not a simple task when considering the challenges in underwater domains -- poor visibility conditions, limited sensor configurations, and lack of readily accessible localization. Underwater robots have, nevertheless, improved dramatically with more extensive sensor and navigation equipment. Robot and sensor use have enabled us to explore all reaches of our oceans. On the other hand, these same robots are not easily accessible or transferable to many practical tasks, including fishery management, infrastructure maintenance, disaster response, site conservation, and ecological surveys. There is a growing need for robots …

Optimizing Adult Learner Success: Applying Random Forest Classifier In Higher Education Predictive Analytics, Emily Barnes, James Hutson, Karriem Perry

Faculty Scholarship

This study examines the application of the Random Forest Classifier (RF) model in predicting academic success among adult learners in higher education. It focuses on evaluating the model's effectiveness using key statistical measures like accuracy, precision, recall, and F1 score across a comprehensive dataset from 2013–14 to 2021–22, which includes variables such as age, ethnicity, gender, Pell Grant eligibility, and academic performance metrics. The research highlights the RF model's capability to handle large datasets with varying data types and demonstrates its superiority over traditional regression models in predictive accuracy. Through an iterative process, the study refines the RF model to …

Ethical Imperatives In Ai-Driven Educational Assessment: Framework And Implications, Ming Soon Tristan Lim

Dissertations and Theses Collection (Open Access)

This dissertation embarks on an extensive exploration of the ethical challenges emerging from the integration of AI in educational assessments. It uncovers the complex interplay between AI and the ethical imperatives these technologies pose within educational assessments.

Amidst the rapid development of AI-enabled educational technologies, such as Ubiquitous, Adaptive, and Immersive technologies, this research identifies a notable gap in literature specifically concerning the ethical imperatives and implications of AI in educational assessments. Addressing this gap, the dissertation has three primary objectives: to comprehend and analyze the underpinning educational technologies driving assessments, to elucidate the intricate relationship between AI, ethics, and …

Enabling And Optimizing Multi-Modal Sense-Making For Human-Ai Interaction Tasks, Dulanga Kaveesha Weerakoon Weerakoon Mudiyanselage

Dissertations and Theses Collection (Open Access)

The rapid pace of adoption of mixed-reality in tandem with advances in NLP and computer vision have opened up unprecedented opportunities for more naturalistic interaction interfaces which underpin Human-AI collaborative applications such as spatial computing and interactive conversational agents. One notable example is the emergence of interactive virtual assistants, which facilitate more natural communication of instructions and queries through modalities like voice and text. This trend is driving the development of innovative ubiquitous, mixed-reality computing applications. Such interactive, natural communication is also critical to support advances in human-robot interactive co-working, across a variety of industrial, commercial and home environments. Conventional …

Evaluation Of An End-To-End Radiotherapy Treatment Planning Pipeline For Prostate Cancer, Mohammad Daniel El Basha, Court Laurence, Carlos Eduardo Cardenas, Julianne Pollard-Larkin, Steven Frank, David T. Fuentes, Falk Poenisch, Zhiqian H. Yu

Dissertations and Theses (Open Access)

Radiation treatment planning is a crucial and time-intensive process in radiation therapy. This planning involves carefully designing a treatment regimen tailored to a patient’s specific condition, including the type, location, and size of the tumor with reference to surrounding healthy tissues. For prostate cancer, this tumor may be either local, locally advanced with extracapsular involvement, or extend into the pelvic lymph node chain. Automating essential parts of this process would allow for the rapid development of effective treatment plans and better plan optimization to enhance tumor control for better outcomes.

The first objective of this work, to automate the treatment …

Developing Machine Learning Agency Among Youth: Characterizing Youth Critical Use, Examination, And Production Of Machine Learning Applications, Ibrahim Oluwajoba Adisa

All Dissertations

This study explores how middle school-aged youths at an afterschool center utilized, examined, and produced AI applications for social good with the support of adults and peers. The study employs a qualitative single case study design. It uses thematic analysis and quantitative ethnography methods to analyze data from multiple sources, including field notes, interviews, focus groups, story completions, video recordings, and artifacts. Findings indicated that engaging youths in critical exploration of AI tools enhanced their ability to design interest-based AI applications that provide solutions for healthcare problems, security, and accessibility. Moreover, the computational thinking practices that youth engaged in increased …