Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 8851 - 8880 of 63946

Full-Text Articles in Entire DC Network

Detecting Anomalies In Time Series Using Kernel Density Approaches, Robin Frehner, Kesheng Wu, Alexander Sim, Jinoh Kim Mar 2024

Detecting Anomalies In Time Series Using Kernel Density Approaches, Robin Frehner, Kesheng Wu, Alexander Sim, Jinoh Kim

Faculty Publications

This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing …


Exploring The Design Of Low-End Technology To Increase Patient Connectivity To Electronic Health Records, Rens Kievit, Abdullahi Abubakar Kawu, Mirjam Van Reisen, Dympna O'Sullivan, Lucy Hederman Mar 2024

Exploring The Design Of Low-End Technology To Increase Patient Connectivity To Electronic Health Records, Rens Kievit, Abdullahi Abubakar Kawu, Mirjam Van Reisen, Dympna O'Sullivan, Lucy Hederman

Conference papers

The tracking of the vitals of patients with long term health problems is essential for clinicians to determine proper care. Using Patient Generated Health Data (PGHD) communicated remotely allows patients to be monitored without requiring frequent hospital visits. Issues might arise when the communication of data digitally is difficult or impossible due to a lack of access to internet or a low level of digital literacy as is the case in many African countries. The VODAN-Africa project (van Reisen et al., 2021) started in 2020 and has greatly increased the capabilities of clinics in different countries in both Africa and …


Graph Theory And Graph Neural Network Assisted High-Throughput Crystal Structure Prediction And Screening For Energy Conversion And Storage, Joshua Ojih, Mohammed Al-Fahdi, Yagang Yao, Jianjun Hu, Ming Hu Mar 2024

Graph Theory And Graph Neural Network Assisted High-Throughput Crystal Structure Prediction And Screening For Energy Conversion And Storage, Joshua Ojih, Mohammed Al-Fahdi, Yagang Yao, Jianjun Hu, Ming Hu

Faculty Publications

Prediction of crystal structures with desirable material properties is a grand challenge in materials research, due to the enormous search space of possible combinations of elements and their countless arrangements in 3D space. Despite the recent progress of a few crystal structure prediction algorithms, most of those methods only target a few specific material families or are restricted to simple systems with limited element diversity. Moreover, these algorithms are usually coupled with first principles calculations and thus are computationally expensive and very time consuming. Therefore, establishing a workflow that can generate a large number of hypothetical structures with diverse elements …


Symptom Detection With Text Messag Log Distributions For Holistic Depression And Anxiety Screening, Ml Tlachac, Michael Heinz, Miranda Reisch, Samuel S. Ogden Mar 2024

Symptom Detection With Text Messag Log Distributions For Holistic Depression And Anxiety Screening, Ml Tlachac, Michael Heinz, Miranda Reisch, Samuel S. Ogden

Information Systems and Analytics Department Faculty Journal Articles

Major Depressive Disorder (MDD) and Generalized Anxiety Disorder (GAD) are both heterogeneous in their clinical presentations, manifesting with unique symptom profiles. Despite this, prior digital phenotype research has primarily focused on disorder-level detection rather than symptom-level detection. In this research, we predict the existence of individual symptoms of MDD and GAD with SMS log metadata, and ensemble these symptom-level classifiers to screen for depression and anxiety, thus accounting for disorder heterogeneity. Further, we collect an additional dataset of retrospectively harvested SMS logs to augment an existing dataset collected after COVID-19 altered communication patterns, and propose two new types of distribution …


A Novel Data Fusion Framework To Enhance Contextual Awareness Of The Autonomous Vehicles For Accurate Decision Making, Henry Alexander Ignatious Mar 2024

A Novel Data Fusion Framework To Enhance Contextual Awareness Of The Autonomous Vehicles For Accurate Decision Making, Henry Alexander Ignatious

Thesis/ Dissertation Defenses

Autonomous driving has the potential to bring significant changes and benefits to various aspects of transportation. Autonomous vehicles (AVs) use a combination of advanced sensors, cameras, radar, lidar, GPS, maps, and AI algorithms to perceive their environment, make decisions, and control their movements. Though there is a significant increase in the AVs utility, there are several challenges associated with the AVs among which ensuring safety and security for a reliable drive is still an existing challenge. The majority of accidents involving the AVs result from faulty decision-making resulting in fatal incidents. Multiple elements contribute to the flawed decision-making in autonomous …


Relative Vectoring Using Dual Object Detection For Autonomous Aerial Refueling, Derek B. Worth, Jeffrey L. Choate, James Lynch, Scott L. Nykl, Clark N. Taylor Mar 2024

Relative Vectoring Using Dual Object Detection For Autonomous Aerial Refueling, Derek B. Worth, Jeffrey L. Choate, James Lynch, Scott L. Nykl, Clark N. Taylor

Faculty Publications

Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process …


Towards The Design And Evaluation Of Clickbait Education Content: Leveraging User Mental Models And Learning Science Principles, A. Shrestha, A. Flood, B. Hackler, Arezou Behfar, M. N. Al-Ameen Mar 2024

Towards The Design And Evaluation Of Clickbait Education Content: Leveraging User Mental Models And Learning Science Principles, A. Shrestha, A. Flood, B. Hackler, Arezou Behfar, M. N. Al-Ameen

Computer Science Student Research

Clickbait refers to sensationalized or misleading post on social networking sites (e.g., Facebook) that can trick users into clicking on malicious links. Clickbait is often used in cyberattacks, especially to conduct 'social engineering attacks' that direct users to malicious websites, resulting in disclosure of users' personal information or installing malicious software (i.e., malware). Thus, clickbait has become a major security concern with the recent boom in social media use. Therefore, security education has become necessary more than ever for the safe and secure use of social media, where there is dearth in security education literature to explore how we could …


A Social-Aware Gaussian Pre-Trained Model For Effective Cold-Start Recommendation, Siwei Liu, Xi Wang, Craig Macdonald, Iadh Ounis Mar 2024

A Social-Aware Gaussian Pre-Trained Model For Effective Cold-Start Recommendation, Siwei Liu, Xi Wang, Craig Macdonald, Iadh Ounis

Machine Learning Faculty Publications

The use of pre-training is an emerging technique to enhance a neural model's performance, which has been shown to be effective for many neural language models such as BERT. This technique has also been used to enhance the performance of recommender systems. In such recommender systems, pre-training models are used to learn a better initialisation for both users and items. However, recent existing pre-trained recommender systems tend to only incorporate the user interaction data at the pre-training stage, making it difficult to deliver good recommendations, especially when the interaction data is sparse. To alleviate this rcommon data sparsity issue, we …


Considering The Impact Framework To Understand The Ai-Well-Being-Complex From An Interdisciplinary Perspective, Christian Montag, Preslav Nakov, Raian Ali Mar 2024

Considering The Impact Framework To Understand The Ai-Well-Being-Complex From An Interdisciplinary Perspective, Christian Montag, Preslav Nakov, Raian Ali

Natural Language Processing Faculty Publications

Artificial intelligence (AI) is built into many products and has the potential to dramatically impact societies around the world. This short theoretical paper aims to provide a simple framework that might help us understand how the introduction and/or use of products with AI might influence the well-being of humans. It is proposed that considering the dynamic Interplay between variables stemming from Modality, Person, Area, Culture and Transparency categories will help to understand the influence of AI on well-being. The Modality category encompasses areas such as the degree of AI being interactive, informational versus actualizing, or autonomous. The Person variable contains …


Smart Cities And Aging Well: Exploring The Links Between Technological Models And Social Models For Promoting Daily Social Interaction For Geriatric Care, Jocelyne Kiss, Lindenwood University Mar 2024

Smart Cities And Aging Well: Exploring The Links Between Technological Models And Social Models For Promoting Daily Social Interaction For Geriatric Care, Jocelyne Kiss, Lindenwood University

Faculty Scholarship

The aging global population requires a new social model to meet the growing social, economic, and physical needs of seniors. Western social models need to be reconsidered in light of examples that support communal ways of living, which are sustainable through smart city design for more supportive geriatric care systems. To address the complex problems of geriatric care in this growing aging population with specific needs related to increased lifespan and limited financial resources, the use of emerging technologies, such as artificial intelligence (AI) and the Internet of Things (IoT), should be considered. As retirement ages rise and funds for …


Medical Image Super-Resolution For Smart Healthcare Applications: A Comprehensive Survey, Sabina Umirzakova, Shabir Ahmad, Latif U. Khan, Taegkeun Whangbo Mar 2024

Medical Image Super-Resolution For Smart Healthcare Applications: A Comprehensive Survey, Sabina Umirzakova, Shabir Ahmad, Latif U. Khan, Taegkeun Whangbo

Machine Learning Faculty Publications

The digital transformation in healthcare, propelled by the integration of deep learning models and the Internet of Things (IoT), is creating unprecedented opportunities for improving patient care. However, the utilization of low-resolution images, often generated by IoT devices, introduces biases in the deep learning models, thereby affecting the overall clinical decision-making process. While super-resolution techniques have been extensively employed to transform low-resolution images into high-resolution counterparts, the challenge of achieving highly accurate image restoration remains unresolved. This is especially critical in the medical imaging domain, where even minor inaccuracies can lead to significant biases in model training and, consequently, impact …


Why Do We Not Stand Up To Misinformation? Factors Influencing The Likelihood Of Challenging Misinformation On Social Media And The Role Of Demographics, Selin Gurgun, Deniz Cemiloglu, Emily Arden Close, Keith Phalp, Preslav Nakov, Raian Ali Mar 2024

Why Do We Not Stand Up To Misinformation? Factors Influencing The Likelihood Of Challenging Misinformation On Social Media And The Role Of Demographics, Selin Gurgun, Deniz Cemiloglu, Emily Arden Close, Keith Phalp, Preslav Nakov, Raian Ali

Natural Language Processing Faculty Publications

This study investigates the barriers to challenging others who post misinformation on social media platforms. We conducted a survey amongst U.K. Facebook users (143 (57.2 %) women, 104 (41.6 %) men) to assess the extent to which the barriers to correcting others, as identified in literature across disciplines, apply to correcting misinformation on social media. We also group the barriers into factors and explore demographic differences amongst them. It has been suggested that users are generally hesitant to challenge misinformation. We found that most of our participants (58.8 %) were reluctant to challenge misinformation. We also identified moderating roles of …


Why Pavement Cracks Are Mostly Longitudinal, Sometimes Transversal, And Rarely Of Other Directions: A Geometric Explanation, Edgar Daniel Rodriguez Velasquez, Olga Kosheleva, Vladik Kreinovich Mar 2024

Why Pavement Cracks Are Mostly Longitudinal, Sometimes Transversal, And Rarely Of Other Directions: A Geometric Explanation, Edgar Daniel Rodriguez Velasquez, Olga Kosheleva, Vladik Kreinovich

Departmental Technical Reports (CS)

In time, pavements deteriorate, and need maintenance. One of the most typical pavement faults are cracks. Empirically, the most frequent cracks are longitudinal, i.e., following the direction of the road; less frequent are transversal cracks, which are orthogonal to the direction of the road. Sometimes, there are cracks in different directions, but such cracks are much rarer. In this paper, we show that simple geometric analysis and fundamental physical ideas can explain these observed relative frequencies.


Why Linear And Sigmoid Last Layers Work Better In Classification, Lehel Dénes-Fazakas, Lásló Szilágyi, Vladik Kreinovich Mar 2024

Why Linear And Sigmoid Last Layers Work Better In Classification, Lehel Dénes-Fazakas, Lásló Szilágyi, Vladik Kreinovich

Departmental Technical Reports (CS)

Usually, when a deep neural network is used to classify objects, its last layer computes the softmax. Our empirical results show we can improve the classification results if instead, we have linear or sigmoid last layer. In this paper, we provide an explanation for this empirical phenomenon.


Why Two Fish Follow Each Other But Three Fish Form A School: A Symmetry-Based Explanation, Shahnaz Shahbazova, Olga Kosheleva, Vladik Kreinovich Mar 2024

Why Two Fish Follow Each Other But Three Fish Form A School: A Symmetry-Based Explanation, Shahnaz Shahbazova, Olga Kosheleva, Vladik Kreinovich

Departmental Technical Reports (CS)

Recent experiments with fish has shown an unexpected strange behavior: when two fish of the same species are placed in an aquarium, they start following each other, while when three fish are placed there, they form (approximately) an equilateral triangle, and move in the direction (approximately) orthogonal to this triangle. In this paper, we use natural symmetries -- such as rotations, shifts, and permutation of fish -- to show that this observed behavior is actually optimal. This behavior is not just optimal with respect to one specific optimality criterion, it is optimal with respect to any optimality criterion -- as …


Remote Controlled Cyber: Toward Engaging And Educating A Diverse Cybersecurityworkforce, Curtice Gough, Carl Mann, Cherrise Ficke, Maureen Namukasa, Meredith Carroll, Tj Oconnor Mar 2024

Remote Controlled Cyber: Toward Engaging And Educating A Diverse Cybersecurityworkforce, Curtice Gough, Carl Mann, Cherrise Ficke, Maureen Namukasa, Meredith Carroll, Tj Oconnor

Aeronautics Faculty Publications

Cybersecurity education has grown exponentially to support the need for a skilled cybersecurity workforce. Further, capture-the-flag competitions have popularized cybersecurity by engaging and recruiting students while exposing them to cybersecurity workforce competencies. However, the heavy reliance on competition-based educational approaches may contribute to the lack of diversity in cybersecurity programs. Cybersecurity competitions are the primary catalyst to expose and recruit students from both high school and collegiate cybersecurity education programs. In response, we propose a collaborative, experiential learning approach that leverages hackable Internet of Things (IoT) toys as a pedagogical tool for cybersecurity education. We share our detailed design, activities, …


Hearing Iterative And Recursive Behavior: Sonification Improves Student Understanding, Joel C. Adams, Hayworth Anderson Mar 2024

Hearing Iterative And Recursive Behavior: Sonification Improves Student Understanding, Joel C. Adams, Hayworth Anderson

University Faculty Publications and Creative Works

Abstract topics such as recursion are challenging for many computer science students to understand. In this experience report, we explore function sonification-the addition of sound to a function to communicate information about the function's behavior in real-time as it runs-as a pedagogical approach for improving students' understanding of recursion. We present several example iterative and recursive function sonifications, plus spectrograms that illustrate their different sonic behaviors. We also present experimental evidence that using these sonifications significantly improved the understanding of recursion for students who used them, compared to students who used silent (i.e., traditional) versions of the same functions. Based …


Some Generalizations Of Corona Product Of Two Graphs, Aparajita Borah, Gajendra Pratap Singh Mar 2024

Some Generalizations Of Corona Product Of Two Graphs, Aparajita Borah, Gajendra Pratap Singh

Applications and Applied Mathematics: An International Journal (AAM)

In this paper we are seeking to conceptualize the notion of corona product of two graphs to contrive some special types of graphs. That is, here our attempt is to regenerate a familiar graph as a product graph. We are considering seven familiar graphs here to reconstruct them with the help of corona product of two graphs. Such types of families of the graphs and operations can be used to study biological pathways as well as to find the optimal order and size for the special types of graphs.


Forging The Future: Strategic Approaches To Quantum Ai Integration For Industry Transformation, Meng Leong How, Sin Mei Cheah Mar 2024

Forging The Future: Strategic Approaches To Quantum Ai Integration For Industry Transformation, Meng Leong How, Sin Mei Cheah

CCX Research

The fusion of quantum computing and artificial intelligence (AI) heralds a transformative era for Industry 4.0, offering unprecedented capabilities and challenges. This paper delves into the intricacies of quantum AI, its potential impact on Industry 4.0, and the necessary change management and innovation strategies for seamless integration. Drawing from theoretical insights and real-world case studies, we explore the current landscape of quantum AI, its foreseeable influence, and the implications for organizational strategy. We further expound on traditional change management tactics, emphasizing the importance of continuous learning, ecosystem collaborations, and proactive approaches. By examining successful and failed quantum AI implementations, lessons …


Weakly Supervised Attention-Based Recognition Under Spectral, Turbulence, And Resource Variations, Kshitij Naresh Nikhal Mar 2024

Weakly Supervised Attention-Based Recognition Under Spectral, Turbulence, And Resource Variations, Kshitij Naresh Nikhal

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

While supervised optimization paradigms are ubiquitous across diverse recognition systems, the risk of over-fitting and increasing bias have limited their applicability.

This dissertation focuses on unsupervised learning—learning without precisely curated data—and argues that unsupervised learning methods can enable both discriminability and generalizability. Through the use of attention-based machine learning and advanced clustering, unsupervised methods are able to focus on fine-grained information in images without any explicit supervision. The dissertation introduces a domain-bridging framework for tasks like cross-spectrum matching and long-range recognition, utilizing intra-domain clustering and inter-domain matching to generate pseudo-labels. Additionally, a hash-based network is proposed to accelerate the search …


Continual Online Learning-Based Optimal Tracking Control Of Nonlinear Strict-Feedback Systems: Application To Unmanned Aerial Vehicles, Irfan Ganie, Sarangapani Jagannathan Mar 2024

Continual Online Learning-Based Optimal Tracking Control Of Nonlinear Strict-Feedback Systems: Application To Unmanned Aerial Vehicles, Irfan Ganie, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

A novel optimal trajectory tracking scheme is introduced for nonlinear continuous-time systems in strict feedback form with uncertain dynamics by using neural networks (NNs). The method employs an actor-critic-based NN back-stepping technique for minimizing a discounted value function along with an identifier to approximate unknown system dynamics that are expressed in augmented form. Novel online weight update laws for the actor and critic NNs are derived by using both the NN identifier and Hamilton-Jacobi-Bellman residual error. A new continual lifelong learning technique utilizing the Fisher Information Matrix via Hamilton-Jacobi-Bellman residual error is introduced to obtain the significance of weights in …


Mask2former With Improved Query For Semantic Segmentation In Remote-Sensing Images, Shichen Guo, Qi Wang, Shiming Xiang, Shuwen Wang, Xuezhi Wang Mar 2024

Mask2former With Improved Query For Semantic Segmentation In Remote-Sensing Images, Shichen Guo, Qi Wang, Shiming Xiang, Shuwen Wang, Xuezhi Wang

Computer Science Faculty Publications and Presentations

Semantic segmentation of remote sensing (RS) images is vital in various practical applications, including urban construction planning, natural disaster monitoring, and land resources investigation. However, RS images are captured by airplanes or satellites at high altitudes and long distances, resulting in ground objects of the same category being scattered in various corners of the image. Moreover, objects of different sizes appear simultaneously in RS images. For example, some objects occupy a large area in urban scenes, while others only have small regions. Technically, the above two universal situations pose significant challenges to the segmentation with a high quality for RS …


Fuzzy Software Reliability And Optimal Release Policy With Log-Logistic Testing Effort: An Analysis, Seema Rani, Jitendra Kumar, N. Ahmad Mar 2024

Fuzzy Software Reliability And Optimal Release Policy With Log-Logistic Testing Effort: An Analysis, Seema Rani, Jitendra Kumar, N. Ahmad

Applications and Applied Mathematics: An International Journal (AAM)

We will discuss a Software Reliability Growth Model (SRGM) using fuzzy and imperfect debugging environments; we integrate Log-Logistic (LL) Testing Effort Function (TEF) into fuzzy SRGMs. Estimation methods, such as Least Square and Maximum Likelihood, are used to obtain the value of Testing-Effort and SRGMs parameters. It is not always possible and is constantly required to quantify the exact value of parameters. Due to human conduct, the value of Testing-Effort and SRGM parameters cannot be exactly quantified. In this scenario, parameters are supposed to be vague or fuzzy. To make the software consistent, the developer needs to propose some quantity …


Eyris: From The Lab To The Market, Steven Miller, David Gomulya, Mahima Rao-Kachroo Mar 2024

Eyris: From The Lab To The Market, Steven Miller, David Gomulya, Mahima Rao-Kachroo

Asian Management Insights

Singapore’s trailblazer AI algorithm for detecting diabetes-related eye diseases. Can you imagine getting the results of your eye disease screening within minutes rather than days? This capability is what EyRIS, a Singapore-based start-up that uses the AI (Artificial Intelligence)-driven Singapore Eye LEsion Analyzer (SELENA+) algorithm to screen for diabetes-related eye diseases, set out to productise and commercialise.


Superminds At Work: The Promise Of Human-Ai Collaboration, Thomas W. Malone Mar 2024

Superminds At Work: The Promise Of Human-Ai Collaboration, Thomas W. Malone

Asian Management Insights

Massachusetts Institute of Technology (MIT) Center for Collective Intelligence Director Professor Thomas W. Malone’s scholarship offers deep insights into the promise afforded by the synergies between human intelligence and technology. According to Professor Malone, the boundaries between human intellect and technological prowess are becoming increasingly blurred, but this may not be a bad thing for humankind. In Asian Management Insights’ inaugural Pulse Point interview, we get to learn more about the concept of ‘collective intelligence’, which explores how a partnership between humans and Artificial Intelligence (AI) can be catalysed to make ground-breaking advancements in addressing the wicked problems of our …


Hello, Jarvis, Archan Misra Mar 2024

Hello, Jarvis, Archan Misra

Asian Management Insights

How AI-enabled interactive agents will reshape our workforce of today and tomorrow.


Stability Of Predator-Prey Model For Worm Attack In Wireless Sensor Networks, Rajeev Kishore, Padam Singh Mar 2024

Stability Of Predator-Prey Model For Worm Attack In Wireless Sensor Networks, Rajeev Kishore, Padam Singh

Applications and Applied Mathematics: An International Journal (AAM)

In this paper, we propose a predator-prey mathematical model for analyzing the dynamical behaviors of the system. This system is an epidemic model, and it is capable of ascertaining the worm's spreading at the initial stage and improving the security of wireless sensor networks. We investigate different fixed points and examine the stability of the projected model.


Developing Singapore As A Smart Nation, Josephine Teo Mar 2024

Developing Singapore As A Smart Nation, Josephine Teo

Asian Management Insights

Mrs Josephine Teo, Singapore’s Minister for Communications and Information, and Minister-in-charge of Smart Nation and Cybersecurity, speaks about leading the country’s Smart Nation drive.


Technical Note: Generalizable And Promptable Artificial Intelligence Model To Augment Clinical Delineation In Radiation Oncology, Lian Zhang, Zhengliang Liu, Lu Zhang, Zihao Wu, Xiaowei Yu, Jason Holmes, Hongying Feng, Haixing Dai, Xiang Li, Quanzheng Li, William W. Wong, Sujay A. Vora, Dajiang Zhu, Tianming Liu, Wei Liu Mar 2024

Technical Note: Generalizable And Promptable Artificial Intelligence Model To Augment Clinical Delineation In Radiation Oncology, Lian Zhang, Zhengliang Liu, Lu Zhang, Zihao Wu, Xiaowei Yu, Jason Holmes, Hongying Feng, Haixing Dai, Xiang Li, Quanzheng Li, William W. Wong, Sujay A. Vora, Dajiang Zhu, Tianming Liu, Wei Liu

Computer Science Faculty Research & Creative Works

Background: Efficient and accurate delineation of organs at risk (OARs) is a critical procedure for treatment planning and dose evaluation. Deep learning-based auto-segmentation of OARs has shown promising results and is increasingly being used in radiation therapy. However, existing deep learning-based auto-segmentation approaches face two challenges in clinical practice: generalizability and human-AI interaction. A generalizable and prompt able auto-segmentation model, which segments OARs of multiple disease sites simultaneously and supports on-the-fly human-AI interaction, can significantly enhance the efficiency of radiation therapy treatment planning. Purpose: Meta's segment anything model (SAM) was proposed as a generalizable and prompt able model for next-generation …


Towards Understanding Convergence And Generalization Of Adamw, Pan Zhou, Xingyu Xie, Zhouchen Lin, Shuicheng Yan Mar 2024

Towards Understanding Convergence And Generalization Of Adamw, Pan Zhou, Xingyu Xie, Zhouchen Lin, Shuicheng Yan

Research Collection School Of Computing and Information Systems

AdamW modifies Adam by adding a decoupled weight decay to decay network weights per training iteration. For adaptive algorithms, this decoupled weight decay does not affect specific optimization steps, and differs from the widely used ℓ2-regularizer which changes optimization steps via changing the first- and second-order gradient moments. Despite its great practical success, for AdamW, its convergence behavior and generalization improvement over Adam and ℓ2-regularized Adam (ℓ2-Adam) remain absent yet. To solve this issue, we prove the convergence of AdamW and justify its generalization advantages over Adam and ℓ2-Adam. Specifically, AdamW provably converges but minimizes a dynamically regularized loss that …