Computer Sciences Commons^™

Reinforcement Learning For Team Based Air Combat Maneuvering Decisions With Directed Energy Weaponry, Joshua D. Combs

Theses and Dissertations

Leveraging the Advanced Framework for Simulation, Integration, and Modeling (AFSIM) we investigate the use of reinforcement learning (RL) techniques for imbuing AUCAV agents with high-quality behaviors for the within-visual-range air combat maneuvering problem (ACMP). We formulate the 2v2 WVR ACMP as a Markov decision process wherein friendly AUCAVs are equipped with DEW capabilities and operate with 6 degrees of freedom. We utilize the Double Deep Q-Network RL algorithm, which centrally trains two friendly AUCAVs and employ a phased learning approach, initially exposing the AUCAVs to a dense reward environment for early training, followed by a sparse reward environment to encourage …

A Random Forest-Based Q-Learning Algorithm: Toward Interpretable Artificial Intelligence, Victor R. Rae

Theses and Dissertations

A growing demand exists for interpretable artificial intelligence models, leading to extensive research efforts to enhance the explainability and transparency of policies generated by reinforcement learning (RL) methods. This research develops random forest-based RL algorithms as a logical progression in this academic pursuit. The algorithms are evaluated using three standard benchmark environments from OpenAI gym — CartPole, MountainCar, and LunarLander — and compared to implementations of the Deep Q-learning Network (DQN) and Double DQN (DDQN) algorithms for various metrics, including performance, robustness, efficiency, and interpretability. The random forest-based algorithms exhibit superior performance to both neural network-based algorithms in two out …

Artificial Intelligence And Perception: An Empirical Study, Anthony J. Neil

Theses and Dissertations

This thesis investigates the impact of adjusting artificial intelligence explainability levels’ outputs on user perception. The overarching study extends within the Explainable Artificial Intelligence (XAI) domain. It examines a spectrum of variables, including performance, cognizance, familiarity, transparency, system bias, and the overall impact of AI, to understand their collective and individual effects that enable effective professional use in an organization. The study aims to illuminate the relationship between the degree of explainability provided by large language models such as ChatGPT, Bard, and Bing AI and the performance of these models when tasked with XAI adjustments.

Standardization Of Risk Classifications For Unmanned Space Vehicle Missions, Collin A. Gwaltney

Theses and Dissertations

This paper seeks to model risk classification levels (A-D) for 122 Space Vehicle programs. Models include multinomial logistic regression as well as random forest, a machine learning technique based on decision trees. We use independent variables (IVs) which are theoretically correlated to risk class for the regression and one random forest model. We then include all IVs and allow the random forest technique to use those which provide the most information on risk class before paring down the number of IVs to only 7. We show that the accuracy of predictions increases from 62% to 87% by using random forest …

Random Forests For Detecting Weak Signals And Extracting Physical Information: A Case Study Of Magnetic Navigation, Mohammadamin Moradi, Zheng-Meng Zhai, Aaron Nielsen, Ying-Cheng Lai, Aaron P. Nielsen

Faculty Publications

It has been recently demonstrated that two machine-learning architectures, reservoir computing and time-delayed feed-forward neural networks, can be exploited for detecting the Earth’s anomaly magnetic field immersed in overwhelming complex signals for magnetic navigation in a GPS-denied environment. The accuracy of the detected anomaly field corresponds to a positioning accuracy in the range of 10–40 m. To increase the accuracy and reduce the uncertainty of weak signal detection as well as to directly obtain the position information, we exploit the machine-learning model of random forests that combines the output of multiple decision trees to give optimal values of the physical …

Future-Proofing The Past: Artificial Intelligence In The Restoration Of Andalusian Architectural Heritage: A Case Study Of The Alhambra Palace, Granada, Spain, Kholoud Bader Hasan Ghaith

Theses

This thesis explains the contribution of artificial intelligence in heritage restoration as an icon of Andalusian architecture by using the Alhambra as an example. The task of sustaining heritage is increasing dramatically due to the accumulation of heritage assets and the need for modern and innovative operations to cope with preservation tasks. Therefore, this thesis reviews the role of artificial intelligence in improving the restoration operation to improve accuracy and efficiency. I applied the case study as a scientific methodology to explain this work to overcome scientific and subjective obstacles, such as scarce data and software integration while explaining the …

Predictive Understanding Of Lake Water Temperature And Dissolved Oxygen Profiles Across The Red River Basin Through Interpretable Machine Learning, Isabela Suaza Sierra

Open Access Theses & Dissertations

Accurately predicting lake water temperature (LWT) and dissolved oxygen (DO) is crucial for determining threshold values of fish survivability under warmer global conditions, with recreational fishing in reservoirs significantly contributing to regional economies, such as $779 million and $1,891 million annually to the economies of Oklahoma and Texas, respectively. Current mathematical models for temperature and oxygen profiles, which incorporate multi-layer and turbulent mixing equations, are complex and challenging to parameterize, particularly due to uncertainties in acquiring sufficient data for training and validation. Leveraging the flexibility and information extraction power of machine learning (ML) methods, this master thesis aimed to set …

Test-Time Augmentation For 3d Point Cloud Classification And Segmentation, Tuan-Anh Vu, Srinjay Sarkar, Zhiyuan Zhang, Binh-Son Hua, Sai-Kit Yeung

Research Collection School Of Computing and Information Systems

Data augmentation is a powerful technique to enhance the performance of a deep learning task but has received less attention in 3D deep learning. It is well known that when 3D shapes are sparsely represented with low point density, the performance of the downstream tasks drops significantly. This work explores test-time augmentation (TTA) for 3D point clouds. We are inspired by the recent revolution of learning implicit representation and point cloud upsampling, which can produce high-quality 3D surface reconstruction and proximity-to-surface, respectively. Our idea is to leverage the implicit field reconstruction or point cloud upsampling techniques as a systematic way …

Leveraging Multimodal Features And Item‑Level User Feedback For Bundle Construction, Yunshan Ma, Xiaohao Liu, Yinwei Wei, Zhulin Tao, Xiang Wang, Tat‑Seng Chua

Research Collection School Of Computing and Information Systems

Automatic bundle construction is a crucial prerequisite step in various bundle-aware online services. Previous approaches are mostly designed to model the bundling strategy of existing bundles. However, it is hard to acquire large-scale well-curated bundle dataset, especially for those platforms that have not offered bundle services before. Even for platforms with mature bundle services, there are still many items that are included in few or even zero bundles, which give rise to sparsity and cold-start challenges in the bundle construction models. To tackle these issues, we target at leveraging multimodal features, item-level user feedback signals, and the bundle composition information, …

Reward Penalties On Augmented States For Solving Richly Constrained Rl Effectively, Jiang Hao, Tien Mai, Pradeep Varakanthan, Minh Huy Hoang

Research Collection School Of Computing and Information Systems

Constrained Reinforcement Learning employs trajectory-based cost constraints (such as expected cost, Value at Risk, or Conditional VaR cost) to compute safe policies. The challenge lies in handling these constraints effectively while optimizing expected reward. Existing methods convert such trajectory-based constraints into local cost constraints, but they rely on cost estimates, leading to either aggressive or conservative solutions with regards to cost. We propose an unconstrained formulation that employs reward penalties over states augmented with costs to compute safe policies. Unlike standard primal-dual methods, our approach penalizes only infeasible trajectories through state augmentation. This ensures that increasing the penalty parameter always …

Voice Synthesis Improvement By Machine Learning Of Natural Prosody, Joseph Kane, Michael N. Johnstone, Patryk Szewczyk

Research outputs 2022 to 2026

Since the advent of modern computing, researchers have striven to make the human–computer interface (HCI) as seamless as possible. Progress has been made on various fronts, e.g., the desktop metaphor (interface design) and natural language processing (input). One area receiving attention recently is voice activation and its corollary, computer-generated speech. Despite decades of research and development, most computer-generated voices remain easily identifiable as non-human. Prosody in speech has two primary components—intonation and rhythm—both often lacking in computer-generated voices. This research aims to enhance computer-generated text-to-speech algorithms by incorporating melodic and prosodic elements of human speech. This study explores a novel …

A Model-Based And System-Theoretic Approach To Design Advanced Autonomy For Air Dominance Missions: A Loyal Wingman Case Study, Elizabeth S. Pennington

Theses and Dissertations

In contested air environments, safe coordination between decision-makers is paramount. Although the Department of Defense (DoD) prioritizes the development of Artificially Intelligent (AI) wingmen for air combat, a lack of methodology exists to design safe, holistic coordination between human and autonomous wingmen in the same environment. This thesis delivers a framework using Systems Theoretic Process Analysis Extended for Coordination (STPA-Coord) to analyze and design holistic coordination for the Loyal Wingman concept in an Air Dominance mission. STPA-Coord is a safety and hazard analysis process that uses Systems Theory to analyze and design coordination between decisionmakers in a system-of-systems architecture. Using …

Improving Automatic Transcription Using Natural Language Processing, Anna Kiefer

Master's Theses

Digital Democracy is a CalMatters and California Polytechnic State University initia-
tive to promote transparency in state government by increasing access to the Califor-
nia legislature. While Digital Democracy is made up of many resources, one founda-
tional step of the project is obtaining accurate, timely transcripts of California Senate
and Assembly hearings. The information extracted from these transcripts provides
crucial data for subsequent steps in the pipeline. In the context of Digital Democracy,
upleveling is when humans verify, correct, and annotate the transcript results after
the legislative hearings have been automatically transcribed. The upleveling process
is done with the …

Artificial Intelligence And/Or Machine Learning (Ai &| Ml), George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

These slides are from an invited panel presentation at my home institution, Loyola University Chicago, organized by the Loyola University Chicago Retiree Association (LUCRA). I was asked to give a broad historical overview of AI and ML and speak about its societal impacts.

"The Loyola University Chicago Retiree Association embraces the Vision of Loyola University Chicago and will assist students, faculty, and administrators as they strive to serve humanity. The group values freedom of inquiry, the pursuit of truth, and care of others and embraces a commitment to excellence, service that promotes social justice, values based leadership, and global awareness."

Generative Ai In Finance: Risks And Potential Solutions, Nydia Remolina Leon

Research Collection Yong Pung How School Of Law

Generative Artificial Intelligence captured the attention of academics, policymakers, the private sector, and some regulators in 2022 after the launch of ChatGPT and its widespread adoption worldwide. Then, during the World Economic Forum session in 2023, Microsoft Chairman and Chief Executive Officer Satya Nadella said that the ‘golden age’ of AI is underway and generative AI is set to play a big role in it. Accordingly, Microsoft has invested billions of dollars into OpenAI, the company behind the launch of ChatGPT. Additionally, Google and Meta have also created their own generative AI models. Given the multiplicity of potential use cases …

Math Word Problem Generation Via Disentangled Memory Retrieval, Wei Qin, Xiaowei Wang, Zhenzhen Hu, Lei Wang, Yunshi Lan, Richang Hong

Research Collection Lee Kong Chian School Of Business

The task of math word problem (MWP) generation, which generates an MWP given an equation and relevant topic words, has increasingly attracted researchers’ attention. In this work, we introduce a simple memory retrieval module to search related training MWPs, which are used to augment the generation. To retrieve more relevant training data, we also propose a disentangled memory retrieval module based on the simple memory retrieval module. To this end, we first disentangle the training MWPs into logical description and scenario description and then record them in respective memory modules. Later, we use the given equation and topic words as …

Active Discovering New Slots For Task-Oriented Conversation, Yuxia Wu, Tianhao Dai, Zhedong Zheng, Lizi Liao

Research Collection School Of Computing and Information Systems

Existing task-oriented conversational systems heavily rely on domain ontologies with pre-defined slots and candidate values. In practical settings, these prerequisites are hard to meet, due to the emerging new user requirements and ever-changing scenarios. To mitigate these issues for better interaction performance, there are efforts working towards detecting out-of-vocabulary values or discovering new slots under unsupervised or semi-supervised learning paradigms. However, overemphasizing on the conversation data patterns alone induces these methods to yield noisy and arbitrary slot results. To facilitate the pragmatic utility, real-world systems tend to provide a stringent amount of human labeling quota, which offers an authoritative way …

Knowledge Generation For Zero-Shot Knowledge-Based Vqa, Rui Cao, Jing Jiang

Research Collection School Of Computing and Information Systems

Previous solutions to knowledge-based visual question answering (K-VQA) retrieve knowledge from external knowledge bases and use supervised learning to train the K-VQA model. Recently pre-trained LLMs have been used as both a knowledge source and a zero-shot QA model for K-VQA and demonstrated promising results. However, these recent methods do not explicitly show the knowledge needed to answer the questions and thus lack interpretability. Inspired by recent work on knowledge generation from LLMs for text-based QA, in this work we propose and test a similar knowledge-generation-based K-VQA method, which first generates knowledge from an LLM and then incorporates the generated …

Conditional Neural Heuristic For Multiobjective Vehicle Routing Problems, Mingfeng Fan, Yaoxin Wu, Zhiguang Cao, Wen Song, Guillaume Sartoretti, Huan Liu, Guohua Wu

Research Collection School Of Computing and Information Systems

Existing neural heuristics for multiobjective vehicle routing problems (MOVRPs) are primarily conditioned on instance context, which failed to appropriately exploit preference and problem size, thus holding back the performance. To thoroughly unleash the potential, we propose a novel conditional neural heuristic (CNH) that fully leverages the instance context, preference, and size with an encoder–decoder structured policy network. Particularly, in our CNH, we design a dual-attention-based encoder to relate preferences and instance contexts, so as to better capture their joint effect on approximating the exact Pareto front (PF). We also design a size-aware decoder based on the sinusoidal encoding to explicitly …

Temporal Implicit Multimodal Networks For Investment And Risk Management, Meng Kiat Gary Ang, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Many deep learning works on financial time-series forecasting focus on predicting future prices/returns of individual assets with numerical price-related information for trading, and hence propose models designed for univariate, single-task, and/or unimodal settings. Forecasting for investment and risk management involves multiple tasks in multivariate settings: forecasts of expected returns and risks of assets in portfolios, and correlations between these assets. As different sources/types of time-series influence future returns, risks, and correlations of assets in different ways, it is also important to capture time-series from different modalities. Hence, this article addresses financial time-series forecasting for investment and risk management in a …

T-Sciq: Teaching Multimodal Chain-Of-Thought Reasoning Via Large Language Model Signals For Science Question Answering, Lei Wang, Yi Hu, Jiabang He, Xing Xu, Ning Liu, Hui Liu, Heng Tao Shen

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have recently demonstrated exceptional performance in various Natural Language Processing (NLP) tasks. They have also shown the ability to perform chain-of-thought (CoT) reasoning to solve complex problems. Recent studies have explored CoT reasoning in complex multimodal scenarios, such as the science question answering task, by fine-tuning multimodal models with high-quality human-annotated CoT rationales. However, collecting high-quality COT rationales is usually time-consuming and costly. Besides, the annotated rationales are hardly accurate due to the external essential information missed. To address these issues, we propose a novel method termed T-SciQ that aims at teaching science question answering with …

Path-Bigbird: An Ai-Driven Transformer Approach To Classification Of Cancer Pathology Reports, Mayanka Chandrashekar, Isaac Lyngaas, Heidi A. Hanson, Shang Gao, Xiao Cheng Wu, John Gounley

School of Public Health Faculty Publications

PURPOSE: Surgical pathology reports are critical for cancer diagnosis and management. To accurately extract information about tumor characteristics from pathology reports in near real time, we explore the impact of using domain-specific transformer models that understand cancer pathology reports. METHODS: We built a pathology transformer model, Path-BigBird, by using 2.7 million pathology reports from six SEER cancer registries. We then compare different variations of Path-BigBird with two less computationally intensive methods: Hierarchical Self-Attention Network (HiSAN) classification model and an off-the-shelf clinical transformer model (Clinical BigBird). We use five pathology information extraction tasks for evaluation: site, subsite, laterality, histology, and behavior. …

Brain-Inspired Continual Learning: Robust Feature Distillation And Re-Consolidation For Class Incremental Learning, Hikmat Khan, Nidhal Carla Bouaynaya, Ghulam Rasool

Henry M. Rowan College of Engineering Departmental Research

Artificial intelligence and neuroscience have a long and intertwined history. Advancements in neuroscience research have significantly influenced the development of artificial intelligence systems that have the potential to retain knowledge akin to humans. Building upon foundational insights from neuroscience and existing research in adversarial and continual learning fields, we introduce a novel framework that comprises two key concepts: feature distillation and re-consolidation. The framework distills continual learning (CL) robust features and rehearses them while learning the next task, aiming to replicate the mammalian brain's process of consolidating memories through rehearsing the distilled version of the waking experiences. Furthermore, the proposed …

Comprehensive Survey On Applications Of Internet Of Things, Machine Learning And Artificial Intelligence In Precision Agriculture, Paul Stone Stone Brown Macheso S.B.

Tanzania Journal of Engineering and Technology (TJET)

A comprehensive, multidisciplinary analysis of the latest developments in digital agriculture is conducted with the use of artificial intelligence (AI), machine learning (ML), and the Internet of Things. By automation and the use of modern, scalable technology solutions that reduce risks, support sustainability, and give farmers predictive advice, traditional agricultural processes are being updated and improved to maximize production. In this paper, the applications of AI, IoT, and ML in agricultural production systems are discussed in detail. The applications that have been explored can be broadly categorized into three areas: soil management, livestock management, and crop management. Weed detection, disease …

Generative Mechanisms Of Ai Implementation: A Critical Realist Perspective On Predictive Maintenance, Alexander Stohr, Philip Ollig, Robert Keller, Alexander Rieger

Information Systems Faculty Publications and Presentations

Artificial intelligence (AI) promises various new opportunities to create and appropriate business value. However, many organizations – especially those in more traditional industries – struggle to seize these opportunities. To unpack the underlying reasons, we investigate how more traditional industries implement predictive maintenance, a promising application of AI in manufacturing organizations. For our analysis, we employ a multiple-case design and adopt a critical realist perspective to identify generative mechanisms of AI implementation. Overall, we find five interdependent mechanisms: experimentation; knowledge building and integration; data; anxiety; and inspiration. Using causal loop diagramming, we flesh out the socio-technical dynamics of these mechanisms …

A New Scientific Research Paradigm Driven By Ai And Its Applications In Academic Disciplines, Jiang Yu, Yue Zhang, Yi Zhou

Bulletin of Chinese Academy of Sciences (Chinese Version)

The artificial intelligence (AI) -driven paradigm of scientific research, deeply embedded through the integration of data, computing power, and algorithms, has triggered profound changes in the research process, thinking logic, and organizational patterns. This study systematically summarizes the main characteristics and forms of the AI-driven new scientific research paradigm. It proposes that the evolution of the AI-driven research paradigm is shifting from “automated research” to “model-based research” and “intelligent research.” The depth and scope of AI applications in scientific research continue to expand, and this will drive significant changes in research organization and governance models. In addition, this study discusses …

Data And Intelligent Driven Space Science Experimental Research: New Exploration Under Ai4s Paradigm, Shengyang Li, Kang Liu, Yunfei Liu, Chufan Lai

Bulletin of Chinese Academy of Sciences (Chinese Version)

As artificial intelligence (AI) technology continues to advance, it is revolutionizing various scientific fields, giving rise to a new research paradigm known as AI for Science (AI4S). This study highlights the unique multidisciplinary advantages of AI in space science experiments conducted under microgravity conditions. It provides a comprehensive analysis of AI-driven approaches to multimodal space science experiment data pattern mining, domain knowledge extraction, interdisciplinary knowledge integration, and cognitive intelligence. The study reveals AI’s substantial potential to enhance intelligent scientific research, cognition, and discovery within the realm of space science experiments. The findings suggest that data-driven space science research, as a …

Path And Strategy Of Pollution And Carbon Reduction By Digitization In Electric Power Enterprises, Xiaohong Chen, Runcheng Tang, Dongbin Hu, Xuesong Xu, Xiangbo Tang, Guodong Yi, Weiwei Zhang

Bulletin of Chinese Academy of Sciences (Chinese Version)

With the extensive application and innovation of digital technology in the energy sector, digital technology has become increasingly crucial for the power industry to achieve the goal of reducing pollution and carbon emissions. How digital technology enables electric power enterprises to achieve this goal has attracted much attention. Firstly, the study analyzes the progress of digital technology applications in pollution reduction and carbon reduction in electric power enterprises. Then, it identifies the existing problems in the current application of digital technology in the power industry for reducing pollution and carbon emissions. Finally, it explores the potential ways and approaches of …

Analysis And Recommendations For Energy Conservation And Carbon Emission Reduction In Industry Boosted By Digital Energy Management Systems, Duanyang Geng, Tong Xu, Qinghua Zhu, Steve Evans

Bulletin of Chinese Academy of Sciences (Chinese Version)

Energy consumption during production processes in the industry is a main source of carbon dioxide emissions. Therefore, for China’s dual-carbon goals, industrial enterprises need to focus on reducing energy waste to achieve energy-efficient production, thereby effectively reducing carbon emissions in industrial production. In recent years, with the continuous development and popularization of digital technology, digital energy management systems have played a crucial role in energy saving by visualizing invisible energy in the industry. In this context, this study first analyses the current status of digital energy management system applications in the UK, the US, Germany, and Sweden, summarizes their characteristics …

Development Path And Policy Guarantee Of China's Advanced Manufacturing Industry Under Background Of Fourth Industrial Revolution, Chang Wang, Siyuan Zhou, Hongjun Geng

Bulletin of Chinese Academy of Sciences (Chinese Version)

How to seize the opportunity window opened by the fourth industrial revolution and enhance the international competitive advantage of advanced manufacturing has become an important issue concerned by existing research and policy practitioners. This study analyzes the background, characteristics, and influence of the fourth industrial revolution on the development of advanced manufacturing industry. Based on this, it discusses the development status and problems of four types of advanced manufacturing industries, including digitally empowered new infrastructure industries, intelligent manufacturing high-end equipment industries, brand-oriented new consumption industries, and science-based industries. The development paths of “fusion innovation”, “intelligent manufacturing upgrade”, “quality improvement”, and …