Towards Efficient Annotations For A Human-Ai Collaborative, Clinical Decision Support System: A Case Study On Physical Stroke Rehabilitation Assessment,
2022
Singapore Management University
Towards Efficient Annotations For A Human-Ai Collaborative, Clinical Decision Support System: A Case Study On Physical Stroke Rehabilitation Assessment, Min Hun Lee, Daniel P. Siewiorek, Asim Smailagic, Alexandre Bernardino, Sergi Bermúdez I Badia
Research Collection School Of Computing and Information Systems
Artificial intelligence (AI) and machine learning (ML) algorithms are increasingly being explored to support various decision-making tasks in health (e.g. rehabilitation assessment). However, the development of such AI/ML-based decision support systems is challenging due to the expensive process to collect an annotated dataset. In this paper, we describe the development process of a human-AI collaborative, clinical decision support system that augments an ML model with a rule-based (RB) model from domain experts. We conducted its empirical evaluation in the context of assessing physical stroke rehabilitation with the dataset of three exercises from 15 post-stroke survivors and therapists. Our results bring …
Debiasing Nlu Models Via Causal Intervention And Counterfactual Reasoning,
2022
Singapore Management University
Debiasing Nlu Models Via Causal Intervention And Counterfactual Reasoning, Bing Tian, Yixin Cao, Yong Zhang, Chunxiao Xing
Research Collection School Of Computing and Information Systems
Recent studies have shown that strong Natural Language Understanding (NLU) models are prone to relying on annotation biases of the datasets as a shortcut, which goes against the underlying mechanisms of the task of interest. To reduce such biases, several recent works introduce debiasing methods to regularize the training process of targeted NLU models. In this paper, we provide a new perspective with causal inference to fnd out the bias. On the one hand, we show that there is an unobserved confounder for the natural language utterances and their respective classes, leading to spurious correlations from training data. To remove …
Analysis Of Generalized Artificial Intelligence Potential Through Reinforcement And Deep Reinforcement Learning Approaches,
2022
Air Force Institute of Technology
Analysis Of Generalized Artificial Intelligence Potential Through Reinforcement And Deep Reinforcement Learning Approaches, Jonathan Turner
Theses and Dissertations
Artificial Intelligence is the next competitive domain; the first nation to develop human level artificial intelligence will have an impact similar to the development of the atomic bomb. To maintain the security of the United States and her people, the Department of Defense has funded research into the development of artificial intelligence and its applications. This research uses reinforcement learning and deep reinforcement learning methods as proxies for current and future artificial intelligence agents and to assess potential issues in development. Agent performance were compared across two games and one excursion: Cargo Loading, Tower of Hanoi, and Knapsack Problem, respectively. …
Evaluating Semantic Matching Techniques For Technical Documents,
2022
Air Force Institute of Technology
Evaluating Semantic Matching Techniques For Technical Documents, Rain F. Dartt
Theses and Dissertations
Machine learning models that employ NLP techniques have become more widely accessible, making them an attractive solution for text and document classification tasks traditionally accomplished by humans. Two such use cases are matching the specialized experience required for a job to statements in applicant resumes, and finding and labelling clauses in legal contracts The AFMC has an immediate need for solutions to civilian hiring. However, there is currently no truth data to validate against. A similar task is contract understanding for which there is the CUAD, a recently published repository of 510 contracts manually labelled by legal experts. The presented …
Approximate Dynamic Programming For An Unmanned Aerial Vehicle Routing Problem With Obstacles And Stochastic Target Arrivals,
2022
Air Force Institute of Technology
Approximate Dynamic Programming For An Unmanned Aerial Vehicle Routing Problem With Obstacles And Stochastic Target Arrivals, Kassie M. Gurnell
Theses and Dissertations
The United States Air Force is investing in artificial intelligence (AI) to speed analysis in efforts to modernize the use of autonomous unmanned combat aerial vehicles (AUCAVs) in strike coordination and reconnaissance (SCAR) missions. This research examines an AUCAVs ability to execute target strikes and provide reconnaissance in a SCAR mission. An orienteering problem is formulated as anMarkov decision process (MDP) model wherein a single AUCAV must optimize its target route to aid in eliminating time-sensitive targets and collect imagery of requested named areas of interest while evading surface-to-air missile (SAM) battery threats imposed as obstacles. The AUCAV adjusts its …
Obsolescence: Evaluating An Educational Serious Game On Artificial Intelligence Impacts To Military Strategic Goals,
2022
Air Force Institute of Technology
Obsolescence: Evaluating An Educational Serious Game On Artificial Intelligence Impacts To Military Strategic Goals, Timothy C. Kokotajlo
Theses and Dissertations
Artificial Intelligence (AI) threatens to bring significant disruption to all aspects of military operations. This research develops a Serious Game (SG) and assessment methodology to provide education on the mindsets required for engaging with disruptive AI technologies. The game, Obsolescence, teaches strategic-level concepts recommended to the Department of Defense (DoD) from a compilation of reports on the current and future state of AI and warfighting. The methodology for assessing the educational value of Obsolescence addresses common challenges such as subjective reporting, control groups, population sizes, and measuring abstract or high levels of learning. The games proposed educational value is tested …
Coupled Orbit-Attitude Dynamics And Control Of A Cubesat Equipped With A Robotic Manipulator,
2022
Air Force Institute of Technology
Coupled Orbit-Attitude Dynamics And Control Of A Cubesat Equipped With A Robotic Manipulator, Charles M. Carr
Theses and Dissertations
This research investigates the utility and expected performance of a robotic servicing CubeSat. The coupled orbit-attitude dynamics of a 6U CubeSat equipped with a four-link serial manipulator are derived. A proportional-integral-derivative controller is implemented to guide the robot through a series of orbital scenarios, including rendezvous and docking following ejection from a chief spacecraft, repositioning the end effector to a desired location, and tracing a desired path with the end effector. Various techniques involving path planning and inverse differential kinematics are leveraged. Simulation results are presented and performance metrics such as settling time, state errors, control use, and system robustness …
Leveraging Machine Learning For Large Scale Analysis Of Publicly-Available Data For Gnss Interference Events,
2022
Air Force Institute of Technology
Leveraging Machine Learning For Large Scale Analysis Of Publicly-Available Data For Gnss Interference Events, David K. Stamper
Theses and Dissertations
This research documents architecture and implementation of an enhanced interference detection and classification analysis system, using both a database and storage solution utilizing machine learning algorithms to detect changes in Carrier-to-Noise strength over multiple GNSS sites. The system uses publicly-available government supported receivers to detect interference, and built using FOSS packaged as a programming library through Python. Two algorithms are discussed in terms of enhancing interference detection using both non-machine learning and machine learning approaches. Two algorithms are also discussed which are used for classification of events. In addition, an approach to Large Scale data analytics is demonstrated via a …
Automated Aircraft Visual Inspection With Artificial Data Generation Enabled Deep Learning,
2022
Air Force Institute of Technology
Automated Aircraft Visual Inspection With Artificial Data Generation Enabled Deep Learning, Nathan J. Gaul
Theses and Dissertations
Aircraft visual inspection, which is essential to daily maintenance of an aircraft, is expensive and time-consuming to perform. Augmenting trained maintenance technicians with automated UAVs to collect and analyze images for aircraft inspection is an active research topic and a potential application of CNNs. Training datasets for niche research topics such as aircraft visual inspection are small and challenging to produce, and the manual process of labeling these datasets often produces subjective annotations. Recently, researchers have produced several successful applications of artificially generated datasets with domain randomization for training CNNs for real-world computer vision problems. The research outlined herein builds …
Application Of Machine Learning Models With Numerical Simulations Of An Experimental Microwave Induced Plasma Gasification Reactor,
2022
Air Force Institute of Technology
Application Of Machine Learning Models With Numerical Simulations Of An Experimental Microwave Induced Plasma Gasification Reactor, Owen D. Sedej
Theses and Dissertations
This thesis aims to contribute to the future development of this technology by providing an in-depth literature review of how this technology physically operates and can be numerically modeled. Additionally, this thesis reviews literature of machine learning models that have been applied to gasification to make accurate predictions regarding the system. Finally, this thesis provides a framework of how to numerically model an experimental plasma gasification reactor in order to inform a variety of machine learning models.
Interpretable Knowledge Tracing: Simple And Efficient Student Modeling With Causal Relations,
2022
Singapore Management University
Interpretable Knowledge Tracing: Simple And Efficient Student Modeling With Causal Relations, Sein Minn, Jill-Jênn Vie, Koh Takeuchi, Feida Zhu
Research Collection School Of Computing and Information Systems
Intelligent Tutoring Systems have become critically important in future learning environments. Knowledge Tracing (KT) is a crucial part of that system. It is about inferring the skill mastery of students and predicting their performance to adjust the curriculum accordingly. Deep Learning based models like Deep Knowledge Tracing (DKT) and Dynamic Key-Value Memory Network (DKVMN) have shown significant predictive performance compared with traditional models like Bayesian Knowledge Tracing (BKT) and Performance Factors Analysis (PFA). However, it is difficult to extract psychologically meaningful explanations from the tens of thousands of parameters in neural networks, that would relate to cognitive theory. There are …
Human-Algorithm Collaboration Works Best If Humans Lead (Because It Is Fair!),
2022
Cambridge University
Human-Algorithm Collaboration Works Best If Humans Lead (Because It Is Fair!), David De Cremer, Jack Mcguire
Research Collection Lee Kong Chian School Of Business
Autonomous algorithms are increasingly being used by organizations to reach ever increasing heights of organizational efficiency. The emerging business model of today therefore appears to be one where autonomous algorithms are gradually expanding their occupation into becoming a leading decision-maker, and humans by default become increasingly more subordinate to such decisions. We address the question of whether this business perspective is consistent with the sort of collaboration employees want to have with algorithms at work. We explored this question by investigating in what way humans preferred to collaborate with algorithms when making decisions. Using two experimental studies (Study 1, n …
Deep Learning For Anomaly Detection: A Review,
2022
Singapore Management University
Deep Learning For Anomaly Detection: A Review, Guansong Pang, Chunhua Shen, Longbing Cao, Anton Van Den Hengel
Research Collection School Of Computing and Information Systems
Anomaly detection, a.k.a. outlier detection or novelty detection, has been a lasting yet active research area in various research communities for several decades. There are still some unique problem complexities and challenges that require advanced approaches. In recent years, deep learning enabled anomaly detection, i.e., deep anomaly detection, has emerged as a critical direction. This article surveys the research of deep anomaly detection with a comprehensive taxonomy, covering advancements in 3 high-level categories and 11 fine-grained categories of the methods. We review their key intuitions, objective functions, underlying assumptions, advantages, and disadvantages and discuss how they address the aforementioned challenges. …
Meta-Transfer Learning Through Hard Tasks,
2022
Singapore Management University
Meta-Transfer Learning Through Hard Tasks, Qianru Sun, Yaoyao Liu, Zhaozheng Chen, Chua Tat-Seng, Schiele Bernt
Research Collection School Of Computing and Information Systems
Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which only a few labeled samples are available. As deep neural networks (DNNs) tend to overfit using a few samples only, typical meta-learning models use shallow neural networks, thus limiting its effectiveness. In order to achieve top performance, some recent works tried to use the DNNs pre-trained on large-scale datasets but mostly in straight-forward manners, e.g., (1) taking their …
Riconv++: Effective Rotation Invariant Convolutions For 3d Point Clouds Deep Learning,
2022
Singapore Management University
Riconv++: Effective Rotation Invariant Convolutions For 3d Point Clouds Deep Learning, Zhiyuan Zhang, Binh-Son Hua, Sai-Kit Yeung
Research Collection School Of Computing and Information Systems
3D point clouds deep learning is a promising field of research that allows a neural network to learn features of point clouds directly, making it a robust tool for solving 3D scene understanding tasks. While recent works show that point cloud convolutions can be invariant to translation and point permutation, investigations of the rotation invariance property for point cloud convolution has been so far scarce. Some existing methods perform point cloud convolutions with rotation-invariant features, existing methods generally do not perform as well as translation-invariant only counterpart. In this work, we argue that a key reason is that compared to …
Learning Variable Ordering Heuristics For Solving Constraint Satisfaction Problems,
2022
Singapore Management University
Learning Variable Ordering Heuristics For Solving Constraint Satisfaction Problems, Wen Song, Zhiguang Cao, Jie Zhang, Chi Xu, Andrew Lim
Research Collection School Of Computing and Information Systems
Backtracking search algorithms are often used to solve the Constraint Satisfaction Problem (CSP), which is widely applied in various domains such as automated planning and scheduling. The efficiency of backtracking search depends greatly on the variable ordering heuristics. Currently, the most commonly used heuristics are hand-crafted based on expert knowledge. In this paper, we propose a deep reinforcement learning based approach to automatically discover new variable ordering heuristics that are better adapted for a given class of CSP instances, without the need of relying on hand-crafted features and heuristics. We show that directly optimizing the search tree size is not …
Heterogeneous Attentions For Solving Pickup And Delivery Problem Via Deep Reinforcement Learning,
2022
Singapore Management University
Heterogeneous Attentions For Solving Pickup And Delivery Problem Via Deep Reinforcement Learning, Jingwen Li, Liang Xin, Zhiguang Cao, Andrew Lim, Wen Song, Jie Zhang
Research Collection School Of Computing and Information Systems
Recently, there is an emerging trend to apply deep reinforcement learning to solve the vehicle routing problem (VRP), where a learnt policy governs the selection of next node for visiting. However, existing methods could not handle well the pairing and precedence relationships in the pickup and delivery problem (PDP), which is a representative variant of VRP. To address this challenging issue, we leverage a novel neural network integrated with a heterogeneous attention mechanism to empower the policy in deep reinforcement learning to automatically select the nodes. In particular, the heterogeneous attention mechanism specifically prescribes attentions for each role of the …
The Ai Chip Race,
2022
Singapore Management University
The Ai Chip Race, Guansong Pang
Research Collection School Of Computing and Information Systems
The strong demand of computing power for artificial intelligence (AI) and machine learning is accelerating the race to develop cheaper and faster AI chips. The AI chip market was valued 10.6 billion in 2021 and the total revenue is expected to reach 79.8 billion by 2027. To be part of the market, tech giants from different countries have been successively joining the race, while AI chip startups attracting billions of dollars are taking off like a rocket.
Innovative Human Motion Sensing With Earbuds,
2022
Singapore Management University
Innovative Human Motion Sensing With Earbuds, Dong Ma, Andrea Ferlini, Cecilia Mascolo
Research Collection School Of Computing and Information Systems
Earbuds, ear-worn wearables, have attracted growing attention from both industry and academia. This trend has witnessed manufacturers embedding multiple sensors on earbuds to enrich their functionalities. For example, Apple AirPods, Sony WF-1000XM3, and Bose QuietControl 30, have been equipped with accelerometers for tapping interaction or multiple microphones for noise cancellation. On the other hand, the research community regards earbuds as a powerful personal-scale human sensing and computing platform. By integrating sensors like PPG, barometer, and ultrasonic sensors, researchers have been devising a plethora of earable sensing applications, such as blood pressure monitoring [1], facial expression recognition [2], and authentication [3].
Deconfounded Visual Grounding,
2022
Singapore Management University
Deconfounded Visual Grounding, Jianqiang Huang, Yu Qin, Jiaxin Qi, Qianru Sun, Hanwang Zhang
Research Collection School Of Computing and Information Systems
We focus on the confounding bias between language and location in the visual grounding pipeline, where we find that the bias is the major visual reasoning bottleneck. For example, the grounding process is usually a trivial languagelocation association without visual reasoning, e.g., grounding any language query containing sheep to the nearly central regions, due to that most queries about sheep have groundtruth locations at the image center. First, we frame the visual grounding pipeline into a causal graph, which shows the causalities among image, query, target location and underlying confounder. Through the causal graph, we know how to break the …
