Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 6 of 6
Full-Text Articles in Entire DC Network
Group-Invariant Reinforcement Learning, Fnu Ankur
Group-Invariant Reinforcement Learning, Fnu Ankur
Master's Theses
Our work introduces a way to learn an optimal reinforcement learning agent accompanied by intrinsic properties of the environment. The extracted properties helps the agent to extrapolate the learning to unseen states efficiently. Out of all the various types of properties, we are intrigued towards equivariant and invariant properties, which essentially translates to symmetry. Contrary to many approaches, we do not assume the symmetry, rather learn them, making the approach agnostic to the environment and the property. The learned properties offers multiple perspective of the environment to exploit it to benefit decision making while interacting with the environment. By building …
Automatic Presentation Slide Generation Using Llms, Tanya Gupta
Automatic Presentation Slide Generation Using Llms, Tanya Gupta
Master's Theses
Presentation slides are widely used for conveying information in academic and professional contexts. However, manual slide creation can be time-consuming. Our research focuses on automated slide generation, specifically for scientific research papers. Automating the creation of presentation slides for scientific documents is a rather novel task and hence, there’s limited training data available and there also exists the token constraints of language models like BERT, with a maximum sequence length of 512 tokens. In this study, we fine-tune large language models, including Longformer-Encoder-Decoder (supporting sequences up to 16,834 tokens) and BIGBIRD-Pegasus (supporting sequences up to 4,096 tokens). We tackle this …
Intrinsic Motivation By The Principles Of Non-Linear Dynamical Systems, Phu C. Nguyen
Intrinsic Motivation By The Principles Of Non-Linear Dynamical Systems, Phu C. Nguyen
Master's Theses
The design of appropriate control rules for the stabilization of dynamical systems can require quite substantial domain knowledge. Modern AI methodologies, such as Reinforcement Learning, are often used to mitigate the need for such knowledge. However, these can be slow and often rely on at least some hand-designed reward structure, and thus human input, to be more effective. Here, we propose an alternative route to construct rewards requiring only minimal domain knowledge, essentially relying on the structure of the dynamical system itself. For this, we use truncated Lyapunov exponents as rewards to calculate the stabilizing controller from samples. Concretely, the …
Controllability-Constrained Deep Neural Network Models For Enhanced Control Of Dynamical Systems, Suruchi Sharma
Controllability-Constrained Deep Neural Network Models For Enhanced Control Of Dynamical Systems, Suruchi Sharma
Master's Theses
Control of a dynamical system without the knowledge of dynamics is an important and challenging task. Modern machine learning approaches, such as deep neural networks (DNNs), allow for the estimation of a dynamics model from control inputs and corresponding state observation outputs. Such data-driven models are often utilized for the derivation of model-based controllers. However, in general, there are no guarantees that a model represented by DNNs will be controllable according to the formal control-theoretical meaning of controllability, which is crucial for the design of effective controllers. This often precludes the use of DNN-estimated models in applications, where formal controllability …
Deep Learning In Ai Medical Imaging For Stroke Diagnosis, James Mario Guzman
Deep Learning In Ai Medical Imaging For Stroke Diagnosis, James Mario Guzman
Master's Theses
Enhancing medical imaging stroke diagnosis applications with artificial intelligence (AI) tools to determine lesion volume, location and clinical metadata is vital toward guiding patient treatment and procedure. A major hardship in developing stroke diagnosis AI tools is the scarcity of publicly available clinical 3D stroke datasets. Through working with Johns Hopkins University, University of Michigan’s ICPSR data repository and SJSU research, we gained access to potentially the largest 3D MRI stroke dataset with clinical metadata annotated by neuroradiologists known as ICPSR 38464. With the ICPSR 38464 dataset recently being available through institutional review board (IRB) approval or exemption, we were …
Detecting The Onion Routing Traffic In Real-Time By Using Reinforcement Learning, Dazhou Liu
Detecting The Onion Routing Traffic In Real-Time By Using Reinforcement Learning, Dazhou Liu
Master's Theses
Anonymous networks have been popularly utilized to protect user anonymity and facilitate network security for a decade. However, such networks have been a platform for adversarial affairs and various network attacks including suspicious traffic generators. As a result, detecting anonymous network traffic is one critical task to defend a network against unpredictable attacks. Many new methods using machine learning and deep learning techniques have been proposed. However, many of them rely heavily on a vast amount of labeled data and have complicated architectures. Since network traffic always fluctuates under different network environments, those techniques may degrade in performance due to …