Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences Commons™

Open Access. Powered by Scholars. Published by Universities.®

2023

Discipline
Institution
Keyword
Publication
Publication Type
File Type

Articles 961 - 990 of 3503

Full-Text Articles in Computer Sciences

Qc-Sane: Robust Control In Drl Using Quantile Critic With Spiking Actor And Normalized Ensemble, Surbhi Gupta, Gaurav Singal, Deepak Garg, Sarangapani Jagannathan Sep 2023

Qc-Sane: Robust Control In Drl Using Quantile Critic With Spiking Actor And Normalized Ensemble, Surbhi Gupta, Gaurav Singal, Deepak Garg, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

Recently Introduced Deep Reinforcement Learning (DRL) Techniques in Discrete-Time Have Resulted in Significant Advances in Online Games, Robotics, and So On. Inspired from Recent Developments, We Have Proposed an Approach Referred to as Quantile Critic with Spiking Actor and Normalized Ensemble (QC-SANE) for Continuous Control Problems, Which Uses Quantile Loss to Train Critic and a Spiking Neural Network (NN) to Train an Ensemble of Actors. the NN Does an Internal Normalization using a Scaled Exponential Linear Unit (SELU) Activation Function and Ensures Robustness. the Empirical Study on Multijoint Dynamics with Contact (MuJoCo)-Based Environments Shows Improved Training and Test Results Than …

Go to article

Advances In Quaternion-Valued Neural Networks, Jeremiah P. Bill Sep 2023

Advances In Quaternion-Valued Neural Networks, Jeremiah P. Bill

Theses and Dissertations

This dissertation investigates the construction, optimization, and application of quaternion neural networks (QNNs) to Department of Defense (DoD) related problem sets. QNNs are a type of neural network wherein the weights, biases, and input values are all represented as quaternion numbers. This work provides a critical evaluation of the myriad different quaternion backpropagation derivations that exist in the literature, testing the performance of each on a range of regression problem sets. The optimization dynamics of QNNs are explored, presenting visualizations of QNN loss surfaces and a novel method for assessing the “smoothness” of these loss surfaces. Finally, this dissertation presents …

Go to article

What Is The Best Way To Develop A Website?, Nahomy Julieta Calderon Lopez Sep 2023

What Is The Best Way To Develop A Website?, Nahomy Julieta Calderon Lopez

Theses

This project is centered around empowering individuals with the knowledge and resources necessary for effective website development. The culmination of Thesis/Directed Project II is a user-friendly website designed to distill and present the insights gathered during Thesis/Directed Project I. This website features an engaging interactive quiz, aimed to help the users identify what is the best way, for them, to develop a website. The quiz has multiple questions, each with three distinct response options, the quiz guides users towards one of three key approaches for website development: Website Builders, Content Management System platforms, or Coding. Upon receiving their quiz results, …

Go to article

Benewind: An Adaptive Benefit Win–Win Platform With Distributed Virtual Emotion Foundation, Hyunbum Kim, Jalel Ben-Othman Sep 2023

Benewind: An Adaptive Benefit Win–Win Platform With Distributed Virtual Emotion Foundation, Hyunbum Kim, Jalel Ben-Othman

All Works

In recent decades, online platforms that use Web 3.0 have tremendously expanded their goods, services, and values to numerous applications thanks to its inherent advantages of convenience, service speed, connectivity, etc. Although online commerce and other relevant platforms have clear merits, offline-based commerce and payments are indispensable and should be activated continuously, because offline systems have intrinsic value for people. With the theme of benefiting all humankind, we propose a new adaptive benefit platform, called BeneWinD, which is endowed with strengths of online and offline platforms. Furthermore, a new currency for integrated benefits, the win–win digital currency, is used in …

Go to article

Sentence Embedding Approach Using Lstm Auto-Encoder For Discussion Threads Summarization, Abdul Wali Khan, Feras Al-Obeidat, Afsheen Khalid, Adnan Amin, Fernando Moreira Sep 2023

Sentence Embedding Approach Using Lstm Auto-Encoder For Discussion Threads Summarization, Abdul Wali Khan, Feras Al-Obeidat, Afsheen Khalid, Adnan Amin, Fernando Moreira

All Works

Online discussion forums are repositories of valuable information where users interact and articulate their ideas and opinions, and share experiences about numerous topics. These online discussion forums are internet-based online communities where users can ask for help and find the solution to a problem. A new user of online discussion forums becomes exhausted from reading the significant number of irrelevant replies in a discussion. An automated discussion thread summarizing system (DTS) is necessary to create a candid view of the entire discussion of a query. Most of the previous approaches for automated DTS use the continuous bag of words (CBOW) …

Go to article

Perceptions And Barriers To Adopting Artificial Intelligence In K-12 Education: A Survey Of Educators In Fifty States, Karen Woodruff, James Hutson, Kathryn Arnone Sep 2023

Perceptions And Barriers To Adopting Artificial Intelligence In K-12 Education: A Survey Of Educators In Fifty States, Karen Woodruff, James Hutson, Kathryn Arnone

Faculty Scholarship

Artificial Intelligence (AI) is making significant strides in the field of education, offering new opportunities for personalized learning and access to education for a more diverse population. Despite this potential, the adoption of AI in K-12 education is limited, and educators’ express hesitancy towards its integration due to perceived technological barriers and misconceptions. The purpose of this study is to examine the perceptions of K-12 educators in all 50 states of the USA towards AI, policies, training, and resources related to technology and AI, their comfort with technology, willingness to adopt new technologies for classroom instruction, and needs assessment for …

Go to article

An End-To-End Cnn Approach For Enhancing Underwater Images Using Spatial And Frequency Domain Techniques, Dr Khaled Nagaty, Ayah Hesham Abo El Rejal, The British University In Egypt Sep 2023

An End-To-End Cnn Approach For Enhancing Underwater Images Using Spatial And Frequency Domain Techniques, Dr Khaled Nagaty, Ayah Hesham Abo El Rejal, The British University In Egypt

Computer Science

Underwater image processing area has been a central point of interest to many people in many fields such as control of underwater vehicles, archaeology, marine biology research, etc. Underwater exploration is becoming a big part of our life such as underwater marine and creatures research, pipeline and communication logistics, military use, touristic and entertainment use. Underwater images are subject to poor visibility, distortion, poor quality, etc., due to several reasons such as light propagation. The real problem occurs when these images have to be taken at a depth which is more than 500 feet where artificial light needs to be …

Go to article

Mpla Case: How Do You Lead As A Lead Physicist?, Patricia Sansourekidou, Leonard Kim, Lee Xu, Mary Gronberg, Cassandra Stambaugh, Dongxu Wang Sep 2023

Mpla Case: How Do You Lead As A Lead Physicist?, Patricia Sansourekidou, Leonard Kim, Lee Xu, Mary Gronberg, Cassandra Stambaugh, Dongxu Wang

Faculty, Staff and Student Publications

This work of fiction is part of a case study series developed by the Medical Physics Leadership Academy (MPLA). It is intended to facilitate the discussion of the managerial and leadership challenges faced by a clinical medical physicist. In this case, a physicist David used to work in a clinic where he thrived and felt like a leader, despite not having the title. After a job change, he is now officially the "Lead Physicist" at a hospital newly affiliated with a large academic healthcare system. He believes he will be equally successful. Yet he struggles to bring about changes and …

Go to article

Thermodynamics Of Learning With Parametric Probabilistic Models, Shervin Sadat Parsi Sep 2023

Thermodynamics Of Learning With Parametric Probabilistic Models, Shervin Sadat Parsi

Dissertations, Theses, and Capstone Projects

This study delves into the learning process within the Probabilistic Parametric Models (PPMs) framework from a unique thermodynamic perspective. By exploring the core concepts of thermodynamics and its innate connection with information theory, we showcase how this interdisciplinary approach can effectively contribute to the domain of machine learning. In the initial chapter, we establish the link between the learning problem in PPMs and a thermodynamic process by reframing various elements of the learning process within the context of thermodynamics. We introduce novel information-theoretic measurements that provide insights into the information learned in both the parameter space and the overall performance …

Go to article

Out-Of-Distribution Generalization Of Deep Learning To Illuminate Dark Protein Functional Space, Tian Cai Sep 2023

Out-Of-Distribution Generalization Of Deep Learning To Illuminate Dark Protein Functional Space, Tian Cai

Dissertations, Theses, and Capstone Projects

Dark protein illumination is a fundamental challenge in drug discovery where majority human proteins are understudied, i.e. with only known protein sequence but no known small molecule binder. It's a major road block to enable drug discovery paradigm shift from single-targeted which looks to identify a single target and design drug to regulate the single target to multi-targeted in a Systems Pharmacology perspective. Diseases such as Alzheimer's and Opioid-Use-Disorder plaguing millions of patients call for effective multi-targeted approach involving dark proteins. Using limited protein data to predict dark protein property requires deep learning systems with OOD generalization capacity. Out-of-Distribution (OOD) …

Go to article

Optimization And Application Of Graph Neural Networks, Shuo Zhang Sep 2023

Optimization And Application Of Graph Neural Networks, Shuo Zhang

Dissertations, Theses, and Capstone Projects

Graph Neural Networks (GNNs) are widely recognized for their potential in learning from graph-structured data and solving complex problems. However, optimal performance and applicability of GNNs have been an open-ended challenge. This dissertation presents a series of substantial advances addressing this problem. First, we investigate attention-based GNNs, revealing a critical shortcoming: their ignorance of cardinality information that impacts their discriminative power. To rectify this, we propose Cardinality Preserved Attention (CPA) models that can be applied to any attention-based GNNs, which exhibit a marked improvement in performance. Next, we introduce the Directional Node Pair (DNP) descriptor and the Robust Molecular Graph …

Go to article

Syne1 Mutation Is Associated With Increased Tumor Mutation Burden And Immune Cell Infiltration In Ovarian Cancer, Laura M. Harbin, Nan Lin, Frederick R. Ueland, Jill M. Kolesar Sep 2023

Syne1 Mutation Is Associated With Increased Tumor Mutation Burden And Immune Cell Infiltration In Ovarian Cancer, Laura M. Harbin, Nan Lin, Frederick R. Ueland, Jill M. Kolesar

Markey Cancer Center Faculty Publications

SYNE1, a nuclear envelope protein critical for cellular structure and signaling, is downregulated in numerous malignancies. SYNE1 alterations are found in 10% of gynecologic malignancies and 5% of epithelial ovarian cancers. Previous studies demonstrated an association between SYNE1 mutation, increased tumor mutation burden (TMB), and immunotherapy response. This study evaluates the SYNE1 mutation frequency, association with TMB, and downstream effects of SYNE1 mutation in ovarian cancer. Genetic information, including whole-exome sequencing, RNA analysis, and somatic tumor testing, was obtained for consenting ovarian cancer patients at an academic medical center. Mutation frequencies were compared between the institutional cohort and The Cancer …

Go to article

Carbon-Aware Mine Planning With A Novel Multi-Objective Framework, Nurul Asyikeen Binte Azhar, Aldy Gunawan, Shih-Fen Cheng, Erwin Leonardi Sep 2023

Carbon-Aware Mine Planning With A Novel Multi-Objective Framework, Nurul Asyikeen Binte Azhar, Aldy Gunawan, Shih-Fen Cheng, Erwin Leonardi

Research Collection School Of Computing and Information Systems

The logistical complication of long-term mine planning involves deciding the sequential extraction of materials from the mine pit and their subsequent processing steps based on geological, geometrical, and resource constraints. The net present value (NPV) of profit over the mine's lifespan usually forms the sole objective for this problem, which is considered as the NP-hard precedence-constrained production scheduling problem (PCPSP) as well. However, increased pressure for more sustainable and carbon-aware industries also calls for environmental indicators to be considered. In this paper, we enhance the generic PCPSP formulation into a multi-objective optimization (MOO) problem whereby carbon cost forms an additional …

Go to article

K-St: A Formal Executable Semantics Of The Structured Text Language For Plcs, Kun Wang, Jingyi Wang, Christopher M. Poskitt, Xiangxiang Chen, Jun Sun, Peng Cheng Sep 2023

K-St: A Formal Executable Semantics Of The Structured Text Language For Plcs, Kun Wang, Jingyi Wang, Christopher M. Poskitt, Xiangxiang Chen, Jun Sun, Peng Cheng

Research Collection School Of Computing and Information Systems

Programmable Logic Controllers (PLCs) are responsible for automating process control in many industrial systems (e.g. in manufacturing and public infrastructure), and thus it is critical to ensure that they operate correctly and safely. The majority of PLCs are programmed in languages such as Structured Text (ST). However, a lack of formal semantics makes it difficult to ascertain the correctness of their translators and compilers, which vary from vendor-to-vendor. In this work, we develop K-ST, a formal executable semantics for ST in the K framework. Defined with respect to the IEC 61131-3 standard and PLC vendor manuals, K-ST is a high-level …

Go to article

Are We Ready To Embrace Generative Ai For Software Q&A?, Bowen Xu, Thanh-Dat Nguyen, Thanh Le-Cong, Thong Hoang, Jiakun Liu, Kisub Kim, Chen Gong, Changan Niu, Chenyu Wang, David Lo, David Lo Sep 2023

Are We Ready To Embrace Generative Ai For Software Q&A?, Bowen Xu, Thanh-Dat Nguyen, Thanh Le-Cong, Thong Hoang, Jiakun Liu, Kisub Kim, Chen Gong, Changan Niu, Chenyu Wang, David Lo, David Lo

Research Collection School Of Computing and Information Systems

Stack Overflow, the world's largest software Q&A (SQA) website, is facing a significant traffic drop due to the emergence of generative AI techniques. ChatGPT is banned by Stack Overflow after only 6 days from its release. The main reason provided by the official Stack Overflow is that the answers generated by ChatGPT are of low quality. To verify this, we conduct a comparative evaluation of human-written and ChatGPT-generated answers. Our methodology employs both automatic comparison and a manual study. Our results suggest that human-written and ChatGPT-generated answers are semantically similar, however, human-written answers outperform ChatGPT-generated ones consistently across multiple aspects, …

Go to article

Methods Of Evaluating Quantum Phase Estimation Circuit Output, Charles A. Woodrum Sep 2023

Methods Of Evaluating Quantum Phase Estimation Circuit Output, Charles A. Woodrum

Theses and Dissertations

The quantum phase estimation (QPE) algorithm is one of the most important quantum computing algorithms that has been developed. The QPE algorithm estimates the phase or phases of the eigenvalue or eigenvalues of a unitary operator. It is a critical step for applications like Shor’s algorithm for factoring and the HHL algorithm for solving linear systems of equations, but it remains difficult to implement on current quantum computers due to small numbers of logical qubits and high error rates. This investigation derives a more accurate estimation of the phase of a unitary operator than would otherwise be attained with the …

Go to article

Complexity Of Verification In Self-Assembly With Prebuilt Assemblies, David Caballero, Timothy Gomez, Robert Schweller, Tim Wylie Sep 2023

Complexity Of Verification In Self-Assembly With Prebuilt Assemblies, David Caballero, Timothy Gomez, Robert Schweller, Tim Wylie

Computer Science Faculty Publications

We analyze the complexity of two fundamental verification problems within a generalization of the two-handed tile self-assembly model (2HAM) where initial system assemblies are not restricted to be singleton tiles, but may be larger prebuilt assemblies. Within this model we consider the producibility problem, which asks if a given tile system builds, or produces, a given assembly, and the unique assembly verification (UAV) problem, which asks if a given system uniquely produces a given assembly. We show that producibility is NP-complete and UAV is coNPNP -complete even when the initial assembly size and temperature threshold are both bounded by a …

Go to article

Pattern-Of-Life Modeling With Automatic Dependent Surveillance-Broadcast (Ads-B), Sarah J. Bolton Sep 2023

Pattern-Of-Life Modeling With Automatic Dependent Surveillance-Broadcast (Ads-B), Sarah J. Bolton

Theses and Dissertations

This dissertation and research were sponsored by the Air Force Research Laboratory Layered Sensing Exploitation Branch (AFRL/RYA) to investigate the utility of using the data found within aircraft secondary radar to make predictions about aircraft characteristics and intent. The research focuses on making predictions on aircraft characteristics using only the kinetic data within one type of secondary radar, Automatic Dependent Surveillance-Broadcast (ADS-B), as a surrogate for primary radar. The results from this research provide a means to reduce the reliance on a type of aircraft tracking that is vulnerable to cyber attack and other integrity concerns.

Go to article

Fine-Grained In-Context Permission Classification For Android Apps Using Control-Flow Graph Embedding, Vikas Kumar Malviya, Naing Tun Yan, Chee Wei Leow, Ailys Xynyn Tee, Lwin Khin Shar, Lingxiao Jiang Sep 2023

Fine-Grained In-Context Permission Classification For Android Apps Using Control-Flow Graph Embedding, Vikas Kumar Malviya, Naing Tun Yan, Chee Wei Leow, Ailys Xynyn Tee, Lwin Khin Shar, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

Android is the most popular operating system for mobile devices nowadays. Permissions are a very important part of Android security architecture. Apps frequently need the users’ permission, but many of them only ask for it once—when the user uses the app for the first time—and then they keep and abuse the given permissions. Longing to enhance Android permission security and users’ private data protection is the driving factor behind our approach to explore fine-grained contextsensitive permission usage analysis and thereby identify misuses in Android apps. In this work, we propose an approach for classifying the fine-grained permission uses for each …

Go to article

Threshold Attribute-Based Credentials With Redactable Signature, Rui Shi, Huamin Feng, Yang Yang, Feng Yuan, Yingjiu Li, Hwee Hwa Pang, Robert H. Deng Sep 2023

Threshold Attribute-Based Credentials With Redactable Signature, Rui Shi, Huamin Feng, Yang Yang, Feng Yuan, Yingjiu Li, Hwee Hwa Pang, Robert H. Deng

Research Collection School Of Computing and Information Systems

Threshold attribute-based credentials are suitable for decentralized systems such as blockchains as such systems generally assume that authenticity, confidentiality, and availability can still be guaranteed in the presence of a threshold number of dishonest or faulty nodes. Coconut (NDSS'19) was the first selective disclosure attribute-based credentials scheme supporting threshold issuance. However, it does not support threshold tracing of user identities and threshold revocation of user credentials, which is desired for internal governance such as identity management, data auditing, and accountability. The communication and computation complexities of Coconut for verifying credentials are linear in the number of each user's attributes and …

Go to article

Automated Question Title Reformulation By Mining Modifcation Logs From Stack Overflow, Ke Liu, Xiang Chen, Chunyang Chen, Xiaofei Xie, Zhanqi Cui Sep 2023

Automated Question Title Reformulation By Mining Modifcation Logs From Stack Overflow, Ke Liu, Xiang Chen, Chunyang Chen, Xiaofei Xie, Zhanqi Cui

Research Collection School Of Computing and Information Systems

In Stack Overflow, developers may not clarify and summarize the critical problems in the question titles due to a lack of domain knowledge or poor writing skills. Previous studies mainly focused on automatically generating the question titles by analyzing the posts’ problem descriptions and code snippets. In this study, we aim to improve title quality from the perspective of question title reformulation and propose a novel approach QETRA motivated by the findings of our formative study. Specifically, by mining modification logs from Stack Overflow, we first extract title reformulation pairs containing the original title and the reformulated title. Then we …

Go to article

Uncertainty-Adjusted Inductive Matrix Completion With Graph Neural Networks, Petr Kasalicky, Antoine Ledent, Rodrigo Alves Sep 2023

Uncertainty-Adjusted Inductive Matrix Completion With Graph Neural Networks, Petr Kasalicky, Antoine Ledent, Rodrigo Alves

Research Collection School Of Computing and Information Systems

We propose a robust recommender systems model which performs matrix completion and a ratings-wise uncertainty estimation jointly. Whilst the prediction module is purely based on an implicit low-rank assumption imposed via nuclear norm regularization, our loss function is augmented by an uncertainty estimation module which learns an anomaly score for each individual rating via a Graph Neural Network: data points deemed more anomalous by the GNN are downregulated in the loss function used to train the low-rank module. The whole model is trained in an end-to-end fashion, allowing the anomaly detection module to tap on the supervised information available in …

Go to article

Autodebloater: Automated Android App Debloating, Jiakun Liu, Xing Hu, Thung Ferdian, Shahar Maoz, Eran Toch, Debin Gao, David Lo Sep 2023

Autodebloater: Automated Android App Debloating, Jiakun Liu, Xing Hu, Thung Ferdian, Shahar Maoz, Eran Toch, Debin Gao, David Lo

Research Collection School Of Computing and Information Systems

Android applications are getting bigger with an increasing number of features. However, not all the features are needed by a specific user. The unnecessary features can increase the attack surface and cost additional resources (e.g., storage and memory). Therefore, it is important to remove unnecessary features from Android applications. However, it is difficult for the end users to fully explore the apps to identify the unnecessary features, and there is no off-the-shelf tool available to assist users to debloat the apps by themselves. In this work, we propose AutoDebloater to debloat Android applications automatically for end users. AutoDebloater is a …

Go to article

A Learning‑Based Approach For Estimating Inertial Properties Of Unknown Objects From Encoder Discrepancies, Zizhou Lao, Yuanfeng Han, Yunshan Ma, Gregory S. Chirikjian Sep 2023

A Learning‑Based Approach For Estimating Inertial Properties Of Unknown Objects From Encoder Discrepancies, Zizhou Lao, Yuanfeng Han, Yunshan Ma, Gregory S. Chirikjian

Research Collection School Of Computing and Information Systems

Many robots utilize commercial force/torque sensors to identify inertial properties of unknown objects. However, such sensors can be difficult to apply to small-sized robots due to their weight, size, and cost. In this letter, we propose a learning-based approach for estimating the mass and center of mass (COM) of unknown objects without using force/torque sensors at the end effector or on the joints. In our method, a robot arm carries an unknown object as it moves through multiple discrete configurations. Measurements are collected when the robot reaches each discrete configuration and stops. A neural network then estimates joint torques from …

Go to article

An Activity System-Based Perspective Of Generative Ai: Challenges And Research Directions, Fiona Fui-Hoon Nah, Jingyuan Cai, Ruilin Zheng, Natalie Pang Sep 2023

An Activity System-Based Perspective Of Generative Ai: Challenges And Research Directions, Fiona Fui-Hoon Nah, Jingyuan Cai, Ruilin Zheng, Natalie Pang

Research Collection School Of Computing and Information Systems

With its remarkable ability to generate content, generative artificial intelligence (GAI) has been recognized as a milestone in the development of artificial general intelligence. To understand the challenges, potential impact, and implications associated with GAI, we adopt a socio-technical perspective to analyze them. First, we identify the key characteristics of GAI, which include content generation, generalization ability, and reinforcement learning based on human feedback. Next, we address technological, ethical, societal, economic, regulatory, and governance challenges. Finally, we deploy activity theory to explore research directions in GAI. Research questions that warrant further investigation include how GAI may impact the future of …

Go to article

Understanding Multi-Homing And Switching By Platform Drivers, Xiaotong Guo, Andreas Haupt, Hai Wang, Rida Qadri, Jinhua Zhao Sep 2023

Understanding Multi-Homing And Switching By Platform Drivers, Xiaotong Guo, Andreas Haupt, Hai Wang, Rida Qadri, Jinhua Zhao

Research Collection School Of Computing and Information Systems

Freelance drivers in the shared mobility market frequently switch or work for multiple platforms, affecting driver labor supply. Due to the importance of driver labor supply for the shared mobility market, understanding drivers’ switching and multi-homing behavior is vital to managing service quality on – and effective regulation of – mobility platforms. However, a lack of individual-level data on driver behavior has thus far impeded a deeper understanding. This paper taxonomizes and estimates perceived switching and multi-homing frictions on mobility platforms. Based on a structural model of driver labor supply, we estimate switching and multi-homing costs in a platform duopoly …

Go to article

On Predicting Esg Ratings Using Dynamic Company Networks, Gary Ang, Zhiling Guo, Ee-Peng Lim Sep 2023

On Predicting Esg Ratings Using Dynamic Company Networks, Gary Ang, Zhiling Guo, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Environmental, social and governance (ESG) considerations play an increasingly important role due to the growing focus on sustainability globally. Entities, such as banks and investors, utilize ESG ratings of companies issued by specialized rating agencies to evaluate ESG risks of companies. The process of assigning ESG ratings by human analysts is however laborious and time intensive. Developing methods to predict ESG ratings could alleviate such challenges, allow ESG ratings to be generated in a more timely manner, cover more companies, and be more accessible. Most works study the effects of ESG ratings on target variables such as stock prices or …

Go to article

Constrained Multiagent Reinforcement Learning For Large Agent Population, Jiajing Ling, Arambam James Singh, Duc Thien Nguyen, Akshat Kumar Sep 2023

Constrained Multiagent Reinforcement Learning For Large Agent Population, Jiajing Ling, Arambam James Singh, Duc Thien Nguyen, Akshat Kumar

Research Collection School Of Computing and Information Systems

Learning control policies for a large number of agents in a decentralized setting is challenging due to partial observability, uncertainty in the environment, and scalability challenges. While several scalable multiagent RL (MARL) methods have been proposed, relatively few approaches exist for large scale constrained MARL settings. To address this, we first formulate the constrained MARL problem in a collective multiagent setting where interactions among agents are governed by the aggregate count and types of agents, and do not depend on agents’ specific identities. Second, we show that standard Lagrangian relaxation methods, which are popular for single agent RL, do not …

Go to article

Experimental Comparison Of Features, Analyses, And Classifiers For Android Malware Detection, Lwin Khin Shar, Biniam Fisseha Demissie, Mariano Ceccato, Naing Tun Yan, David Lo, Lingxiao Jiang, Christoph Bienert Sep 2023

Experimental Comparison Of Features, Analyses, And Classifiers For Android Malware Detection, Lwin Khin Shar, Biniam Fisseha Demissie, Mariano Ceccato, Naing Tun Yan, David Lo, Lingxiao Jiang, Christoph Bienert

Research Collection School Of Computing and Information Systems

Android malware detection has been an active area of research. In the past decade, several machine learning-based approaches based on different types of features that may characterize Android malware behaviors have been proposed. The usually-analyzed features include API usages and sequences at various abstraction levels (e.g., class and package), extracted using static or dynamic analysis. Additionally, features that characterize permission uses, native API calls and reflection have also been analyzed. Initial works used conventional classifiers such as Random Forest to learn on those features. In recent years, deep learning-based classifiers such as Recurrent Neural Network have been explored. Considering various …

Go to article

Generative Model-Based Testing On Decision-Making Policies, Zhuo Li, Xiongfei Wu, Derui Zhu, Mingfei Cheng, Siyuan Chen, Fuyuan Zhang, Xiaofei Xie, Lei Ma, Jianjun Zhao Sep 2023

Generative Model-Based Testing On Decision-Making Policies, Zhuo Li, Xiongfei Wu, Derui Zhu, Mingfei Cheng, Siyuan Chen, Fuyuan Zhang, Xiaofei Xie, Lei Ma, Jianjun Zhao

Research Collection School Of Computing and Information Systems

The reliability of decision-making policies is urgently important today as they have established the fundamentals of many critical applications, such as autonomous driving and robotics. To ensure reliability, there have been a number of research efforts on testing decision-making policies that solve Markov decision processes (MDPs). However, due to the deep neural network (DNN)-based inherit and infinite state space, developing scalable and effective testing frameworks for decision-making policies still remains open and challenging.In this paper, we present an effective testing framework for decision-making policies. The framework adopts a generative diffusion model-based test case generator that can easily adapt to different …

Go to article

First Prev Next Last