Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons™

Open Access. Powered by Scholars. Published by Universities.®

Deep learning

Discipline
Institution
Publication Year
Publication
Publication Type
File Type

Articles 331 - 360 of 1193

Full-Text Articles in Physical Sciences and Mathematics

Catnet: Cross-Modal Fusion For Audio-Visual Speech Recognition, Xingmei Wang, Jianchen Mi, Boquan Li, Yixu Zhao, Jiaxiang Meng Feb 2024

Catnet: Cross-Modal Fusion For Audio-Visual Speech Recognition, Xingmei Wang, Jianchen Mi, Boquan Li, Yixu Zhao, Jiaxiang Meng

Research Collection School Of Computing and Information Systems

Automatic speech recognition (ASR) is a typical pattern recognition technology that converts human speeches into texts. With the aid of advanced deep learning models, the performance of speech recognition is significantly improved. Especially, the emerging Audio–Visual Speech Recognition (AVSR) methods achieve satisfactory performance by combining audio-modal and visual-modal information. However, various complex environments, especially noises, limit the effectiveness of existing methods. In response to the noisy problem, in this paper, we propose a novel cross-modal audio–visual speech recognition model, named CATNet. First, we devise a cross-modal bidirectional fusion model to analyze the close relationship between audio and visual modalities. Second, …

Go to article

Action Recognition Model Of Directed Attention Based On Cosine Similarity, Chen Li, Ming He, Chen Dong, Wei Li Jan 2024

Action Recognition Model Of Directed Attention Based On Cosine Similarity, Chen Li, Ming He, Chen Dong, Wei Li

Journal of System Simulation

Abstract: Aiming at the lack of directionality of traditional dot product attention, this paper proposes a directed attention model (DAM) based on cosine similarity. To effectively represent the direction relationship between the spatial and temporal features of video frames, the paper defines the relationship function in the attention mechanism using the cosine similarity theory, which can remove the absolute value of the relationship between features. To reduce the computational burden of the attention mechanism, the operation is decomposed from two dimensions of time and space. The computational complexity is further optimized by combining linear attention operation. The experiment is divided …

Go to article

Reusing Deep Learning Models: Challenges And Directions In Software Engineering, James C. Davis, Purvish Jajal, Wenxin Jiang, Taylor R. Schorlemmer, Nicholas Synovic, George K. Thiruvathukal Jan 2024

Reusing Deep Learning Models: Challenges And Directions In Software Engineering, James C. Davis, Purvish Jajal, Wenxin Jiang, Taylor R. Schorlemmer, Nicholas Synovic, George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new architectures) and computational costs (e.g., training). Re-using DNNs is a promising direction to amortize costs within a company and across the computing industry. As with any new technology, however, there are many challenges in re-using DNNs. These challenges include both missing technical capabilities and missing engineering practices. This vision paper describes challenges in current approaches to DNN re-use. We summarize studies of re-use failures across the spectrum of re-use techniques, …

Go to article

Open System Neural Networks, Bradley Hatch Jan 2024

Open System Neural Networks, Bradley Hatch

Theses and Dissertations

Recent advances in self-supervised learning have made it possible to reuse information-rich models that have been generally pre-trained on massive amounts of data for other downstream tasks. But the pre-training process can be drastically different from the fine-tuning training process, which can lead to inefficient learning. We address this disconnect in training dynamics by structuring the learning process like an open system in thermodynamics. Open systems can achieve a steady state when low-entropy inputs are converted to high-entropy outputs. We modify the the model and the learning process to mimic this behavior, and attend more to elements of the input …

Go to article

Deep Transfer Learning For Detection Of Upper And Lower Body Movements: Transformer With Convolutional Neural Network, Kyle Lacroix, Davoud Gholamiangonabadi, Ana Luisa Trejos, Katarina Grolinger Jan 2024

Deep Transfer Learning For Detection Of Upper And Lower Body Movements: Transformer With Convolutional Neural Network, Kyle Lacroix, Davoud Gholamiangonabadi, Ana Luisa Trejos, Katarina Grolinger

Electrical and Computer Engineering Publications

When humans repeat the same motion, the tendons, muscles, and nerves can be damaged, causing Repetitive Stress Injuries (RSI). If the repetitive motions that lead to RSI are recognized early, actions can be taken to prevent these injuries. As Human Activity Recognition (HAR) aims to identify activities employing wearable or environment sensors, HAR is the first step toward identifying repetitive motions. Deep learning models, such as Convolutional Neural Networks (CNNs), have seen great success in recognizing activities for participants whose data are used in the model training; however, their accuracy drops for new participants as people move in different ways. …

Go to article

Advancing Deep Learning With Graph-Based Structural Insights: From Graph Classification To Semantic Segmentation, Xin Ma Jan 2024

Advancing Deep Learning With Graph-Based Structural Insights: From Graph Classification To Semantic Segmentation, Xin Ma

Computer Science and Engineering Dissertations - Archive

Deep learning has profoundly transformed machine learning by offering sophisticated data representations, yet effectively incorporating structural information remains a challenge. Structural data, whether explicit or implicit, has the potential to significantly enhance the performance of deep learning tasks. This research investigates the benefits of structural information across three crucial tasks: classification, clustering, and segmentation. For explicit structural data, where inputs are directly represented as graphs, we investigate graph-level classification in brain connectivity networks. We introduce the Multi-resolution Edge Network (MENET), a novel framework designed to identify disease-specific connectomic benchmarks with high discriminatory power across diagnostic categories. MENET leverages graph-level representations …

Go to article

Cyclistai: A Smartphone Solution For Cyclist Stress Assessment Using Deep Learning, Aairish Singh Jan 2024

Cyclistai: A Smartphone Solution For Cyclist Stress Assessment Using Deep Learning, Aairish Singh

Computer Science and Engineering Theses - Archive

Cycling presents a compelling solution for promoting personal health and environmental well-being, particularly for short-distance travel. Despite its numerous advantages, cycling uptake in the United States remains disproportionately low, primarily due to safety concerns. Traditional frameworks for assessing cyclist stress are hindered by their impracticality and inability to provide real-time evaluations. Self-report surveys and physiological measurements offer alternative approaches but suffer from limitations such as retrospective reporting biases and accessibility challenges, respectively. This thesis introduces CyclistAI, a novel smartphone-based cyclist stress assessment model that leverages context sensing. By combining Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) techniques, CyclistAI …

Go to article

A Comprehensive Study Of Patent Litigation In The Pharmaceutical Sector: Employing Network Theories, Graph Neural Networks, Agent Based Modeling, Bayesian Network Autocorrelation Models, Sreehas Gopinathan Jan 2024

A Comprehensive Study Of Patent Litigation In The Pharmaceutical Sector: Employing Network Theories, Graph Neural Networks, Agent Based Modeling, Bayesian Network Autocorrelation Models, Sreehas Gopinathan

Information Systems & Operations Management Dissertations - Archive

Understanding the dynamics and predictors of patent litigation is crucial in intellectual property management, especially given the competitive edge patents offer companies. Also, patents serve as both legal tools and repositories of innovation. This research delves into the complex world of patent litigation within the pharmaceutical industry, focusing on creating and applying advanced computational models to study litigation propensities. Techniques such as Graph Neural Networks (GNN), Agent-Based Modeling (ABM), and Bayesian Analysis of Network Autocorrelation Models (BANAM) are employed to explore the litigation phenomenon

Go to article

Machine Learning As A Tool For Early Detection: A Focus On Late-Stage Colorectal Cancer Across Socioeconomic Spectrums, Hadiza Galadima, Rexford Anson-Dwamena, Ashley Johnson, Ghalib Bello, Georges Adunlin, James Blando Jan 2024

Machine Learning As A Tool For Early Detection: A Focus On Late-Stage Colorectal Cancer Across Socioeconomic Spectrums, Hadiza Galadima, Rexford Anson-Dwamena, Ashley Johnson, Ghalib Bello, Georges Adunlin, James Blando

Community & Environmental Health Faculty Publications

Purpose: To assess the efficacy of various machine learning (ML) algorithms in predicting late-stage colorectal cancer (CRC) diagnoses against the backdrop of socio-economic and regional healthcare disparities. Methods: An innovative theoretical framework was developed to integrate individual- and census tract-level social determinants of health (SDOH) with sociodemographic factors. A comparative analysis of the ML models was conducted using key performance metrics such as AUC-ROC to evaluate their predictive accuracy. Spatio-temporal analysis was used to identify disparities in late-stage CRC diagnosis probabilities. Results: Gradient boosting emerged as the superior model, with the top predictors for late-stage CRC diagnosis being anatomic site, …

Go to article

Deep Learning One-Class Classification With Support Vector Methods, Hayden D. Hampton Jan 2024

Deep Learning One-Class Classification With Support Vector Methods, Hayden D. Hampton

Graduate Thesis and Dissertation 2023-2024

Through the specialized lens of one-class classification, anomalies–irregular observations that uncharacteristically diverge from normative data patterns–are comprehensively studied. This dissertation focuses on advancing boundary-based methods in one-class classification, a critical approach to anomaly detection. These methodologies delineate optimal decision boundaries, thereby facilitating a distinct separation between normal and anomalous observations. Encompassing traditional approaches such as One-Class Support Vector Machine and Support Vector Data Description, recent adaptations in deep learning offer a rich ground for innovation in anomaly detection. This dissertation proposes three novel deep learning methods for one-class classification, aiming to enhance the efficacy and accuracy of anomaly detection in …

Go to article

Multiview Outlier Filtered Pediatric Heart Sound Classification, Sagnik Dakshit Jan 2024

Multiview Outlier Filtered Pediatric Heart Sound Classification, Sagnik Dakshit

Computer Science Faculty Publications and Presentations

The advancements in deep learning has generated a large-scale interest in development of black-box models for various use cases in different domains such as healthcare, in both at-home and critical setting for diagnosis and monitoring of various health conditions. The use of audio signals as a view for diagnosis is nascent and the success of deep learning models in ingesting multimedia data provides an opportunity for use as a diagnostic medium. For the widespread use of these decision support systems, it is prudent to develop high performing systems which require large quantities of data for training and low-cost method of …

Go to article

Machine-Learning-Enabled Diagnostics With Improved Visualization Of Disease Lesions In Chest X-Ray Images, Md. Fashiar Rahman, Tzu-Liang (Bill) Tseng, Michael Pokojovy, Peter Mccaffrey, Eric Walser, Scott Moen, Alex Vo, Johnny C. Ho Jan 2024

Machine-Learning-Enabled Diagnostics With Improved Visualization Of Disease Lesions In Chest X-Ray Images, Md. Fashiar Rahman, Tzu-Liang (Bill) Tseng, Michael Pokojovy, Peter Mccaffrey, Eric Walser, Scott Moen, Alex Vo, Johnny C. Ho

Mathematics & Statistics Faculty Publications

The class activation map (CAM) represents the neural-network-derived region of interest, which can help clarify the mechanism of the convolutional neural network’s determination of any class of interest. In medical imaging, it can help medical practitioners diagnose diseases like COVID-19 or pneumonia by highlighting the suspicious regions in Computational Tomography (CT) or chest X-ray (CXR) film. Many contemporary deep learning techniques only focus on COVID-19 classification tasks using CXRs, while few attempt to make it explainable with a saliency map. To fill this research gap, we first propose a VGG-16-architecture-based deep learning approach in combination with image enhancement, segmentation-based region …

Go to article

Log Sequence Anomaly Detection Based On Template And Parameter Parsing Via Bert, Xiaolin Chai, Hang Zhang, Jue Zhang, Yan Sun, Sajal K. Das Jan 2024

Log Sequence Anomaly Detection Based On Template And Parameter Parsing Via Bert, Xiaolin Chai, Hang Zhang, Jue Zhang, Yan Sun, Sajal K. Das

Computer Science Faculty Research & Creative Works

Logs record various operations and events during system running in text format, which is an essential basis for detecting and identifying potential security threats or system failures and is widely used in system management to ensure security and reliability. Existing log sequence anomaly detection is limited by log parsing and does not consider all key features of logs, which may cause false or missed detection. In this paper, we propose a fast and accurate log parsing method and feed the entire log content into the deep learning network for analysis. To avoid semantic loss during parsing, we replace some variables …

Go to article

Persistent Monitoring Of Insect-Pests On Sticky Traps Through Hierarchical Transfer Learning And Slicing-Aided Hyper Inference, Fateme Fotouhi, Kevin Menke, Aaron Prestholt, Ashish Gupta, Matthew E. Carroll, Hsin Jung Yang, Edwin J. Skidmore, Matthew O'Neal, Nirav Merchant, Sajal K. Das, Peter Kyveryga, Baskar Ganapathysubramanian, Asheesh K. Singh, Arti Singh, Soumik Sarkar Jan 2024

Persistent Monitoring Of Insect-Pests On Sticky Traps Through Hierarchical Transfer Learning And Slicing-Aided Hyper Inference, Fateme Fotouhi, Kevin Menke, Aaron Prestholt, Ashish Gupta, Matthew E. Carroll, Hsin Jung Yang, Edwin J. Skidmore, Matthew O'Neal, Nirav Merchant, Sajal K. Das, Peter Kyveryga, Baskar Ganapathysubramanian, Asheesh K. Singh, Arti Singh, Soumik Sarkar

Computer Science Faculty Research & Creative Works

Introduction: Effective monitoring of insect-pests is vital for safeguarding agricultural yields and ensuring food security. Recent advances in computer vision and machine learning have opened up significant possibilities of automated persistent monitoring of insect-pests through reliable detection and counting of insects in setups such as yellow sticky traps. However, this task is fraught with complexities, encompassing challenges such as, laborious dataset annotation, recognizing small insect-pests in low-resolution or distant images, and the intricate variations across insect-pests life stages and species classes. Methods: to tackle these obstacles, this work investigates combining two solutions, Hierarchical Transfer Learning (HTL) and Slicing-Aided Hyper Inference …

Go to article

Deep Transfer Learning-Based Bird Species Classification Using Mel Spectrogram Images, Mrinal Kanti Baowaly, Bisnu Chandra Sarkar, Md.Abul Ala Walid, Md. Martuza Ahamad, Bikash Chandra Singh, Eduardo Silva Alvarado, Imran Ashraf, Md. Abdus Samad Jan 2024

Deep Transfer Learning-Based Bird Species Classification Using Mel Spectrogram Images, Mrinal Kanti Baowaly, Bisnu Chandra Sarkar, Md.Abul Ala Walid, Md. Martuza Ahamad, Bikash Chandra Singh, Eduardo Silva Alvarado, Imran Ashraf, Md. Abdus Samad

School of Cybersecurity Faculty Publications

The classification of bird species is of significant importance in the field of ornithology, as it plays an important role in assessing and monitoring environmental dynamics, including habitat modifications, migratory behaviors, levels of pollution, and disease occurrences. Traditional methods of bird classification, such as visual identification, were time-intensive and required a high level of expertise. However, audio-based bird species classification is a promising approach that can be used to automate bird species identification. This study aims to establish an audio-based bird species classification system for 264 Eastern African bird species employing modified deep transfer learning. In particular, the pre-trained EfficientNet …

Go to article

Efficient Classification Of Very High Resolution Images, Mohammad I. Nouyed Jan 2024

Efficient Classification Of Very High Resolution Images, Mohammad I. Nouyed

Graduate Theses, Dissertations, and Problem Reports (ETD)

In recent decades, deep learning approaches have shown significant improvement in various image understanding tasks. However, analysis of high-resolution images remains a major challenge. In this work, we address the challenge of very high-resolution histopathological image (VHRHI) classification using a new information-theoretic discriminative patch selection approach. We show results on a high-resolution image dataset, namely, gigapixel whole slide tissue images for cancer tumors. Then we address how to efficiently classify challenging histopathology images, such as gigapixel whole-slide images for cancer diagnostics with image-level annotation. These ``weak labels'' are applied throughout the image but describe tumor regions of variable sizes and …

Go to article

Pneumothorax Detection And Segmentation From Chest X-Ray Radiographs Using A Patch-Based Fully Convolutional Encoder-Decoder Network, Jakov Ivan S. Dumbrique, Reynan Hernandez, Juan Miguel L. Cruz, Ryan M. Pagdanganan, Prospero C. Naval Jan 2024

Pneumothorax Detection And Segmentation From Chest X-Ray Radiographs Using A Patch-Based Fully Convolutional Encoder-Decoder Network, Jakov Ivan S. Dumbrique, Reynan Hernandez, Juan Miguel L. Cruz, Ryan M. Pagdanganan, Prospero C. Naval

Mathematics Faculty Publications

Pneumothorax, a life-threatening condition characterized by air accumulation in the pleural cavity, requires early and accurate detection for optimal patient outcomes. Chest X-ray radiographs are a common diagnostic tool due to their speed and affordability. However, detecting pneumothorax can be challenging for radiologists because the sole visual indicator is often a thin displaced pleural line. This research explores deep learning techniques to automate and improve the detection and segmentation of pneumothorax from chest X-ray radiographs. We propose a novel architecture that combines the advantages of fully convolutional neural networks (FCNNs) and Vision Transformers (ViTs) while using only convolutional modules to …

Go to article

Nonuniform Sampling-Based Breast Cancer Classification, Santiago Posso Jan 2024

Nonuniform Sampling-Based Breast Cancer Classification, Santiago Posso

Theses and Dissertations--Electrical and Computer Engineering

The emergence of deep learning models and their success in visual object recognition have fueled the medical imaging community's interest in integrating these algorithms to improve medical diagnosis. However, natural images, which have been the main focus of deep learning models and mammograms, exhibit fundamental differences. First, breast tissue abnormalities are often smaller than salient objects in natural images. Second, breast images have significantly higher resolutions but are generally heavily downsampled to fit these images to deep learning models. Models that handle high-resolution mammograms require many exams and complex architectures. Additionally, spatially resizing mammograms leads to losing discriminative details essential …

Go to article

Urban Flood Extent Segmentation And Evaluation From Real-World Surveillance Camera Images Using Deep Convolutional Neural Network, Yidi Wang, Yawen Shen, Behrouz Salahshour, Mecit Cetin, Khan Iftekharuddin, Navid Tahvildari, Guoping Huang, Devin K. Harris, Kwame Ampofo, Jonathan L. Goodall Jan 2024

Urban Flood Extent Segmentation And Evaluation From Real-World Surveillance Camera Images Using Deep Convolutional Neural Network, Yidi Wang, Yawen Shen, Behrouz Salahshour, Mecit Cetin, Khan Iftekharuddin, Navid Tahvildari, Guoping Huang, Devin K. Harris, Kwame Ampofo, Jonathan L. Goodall

Civil & Environmental Engineering Faculty Publications

This study explores the use of Deep Convolutional Neural Network (DCNN) for semantic segmentation of flood images. Imagery datasets of urban flooding were used to train two DCNN-based models, and camera images were used to test the application of the models with real-world data. Validation results show that both models extracted flood extent with a mean F1-score over 0.9. The factors that affected the performance included still water surface with specular reflection, wet road surface, and low illumination. In testing, reduced visibility during a storm and raindrops on surveillance cameras were major problems that affected the segmentation of flood extent. …

Go to article

Sub-Band Backdoor Attack In Remote Sensing Imagery, Kazi Aminul Islam, Hongyi Wu, Chunsheng Xin, Rui Ning, Liuwan Zhu, Jiang Li Jan 2024

Sub-Band Backdoor Attack In Remote Sensing Imagery, Kazi Aminul Islam, Hongyi Wu, Chunsheng Xin, Rui Ning, Liuwan Zhu, Jiang Li

Electrical & Computer Engineering Faculty Publications

Remote sensing datasets usually have a wide range of spatial and spectral resolutions. They provide unique advantages in surveillance systems, and many government organizations use remote sensing multispectral imagery to monitor security-critical infrastructures or targets. Artificial Intelligence (AI) has advanced rapidly in recent years and has been widely applied to remote image analysis, achieving state-of-the-art (SOTA) performance. However, AI models are vulnerable and can be easily deceived or poisoned. A malicious user may poison an AI model by creating a stealthy backdoor. A backdoored AI model performs well on clean data but behaves abnormally when a planted trigger appears in …

Go to article

Adversarial Training Based Domain Adaptation Of Skin Cancer Images, Syed Qasim Gilani, Muhammad Umair, Maryam Naqvi, Oge Marques, Hee-Cheol Kim Jan 2024

Adversarial Training Based Domain Adaptation Of Skin Cancer Images, Syed Qasim Gilani, Muhammad Umair, Maryam Naqvi, Oge Marques, Hee-Cheol Kim

Electrical & Computer Engineering Faculty Publications

Skin lesion datasets used in the research are highly imbalanced; Generative Adversarial Networks can generate synthetic skin lesion images to solve the class imbalance problem, but it can result in bias and domain shift. Domain shifts in skin lesion datasets can also occur if different instruments or imaging resolutions are used to capture skin lesion images. The deep learning models may not perform well in the presence of bias and domain shift in skin lesion datasets. This work presents a domain adaptation algorithm-based methodology for mitigating the effects of domain shift and bias in skin lesion datasets. Six experiments were …

Go to article

Accelerating Cavity Fault Prediction Using Deep Learning At Jefferson Laboratory, Md M. Rahman, A. Carpenter, K. Iftekharuddin, C. Tennant Jan 2024

Accelerating Cavity Fault Prediction Using Deep Learning At Jefferson Laboratory, Md M. Rahman, A. Carpenter, K. Iftekharuddin, C. Tennant

Electrical & Computer Engineering Faculty Publications

Accelerating cavities are an integral part of the continuous electron beam accelerator facility (CEBAF) at Jefferson Laboratory. When any of the over 400 cavities in CEBAF experiences a fault, it disrupts beam delivery to experimental user halls. In this study, we propose the use of a deep learning model to predict slowly developing cavity faults. By utilizing pre-fault signals, we train a long short-term memory-convolutional neural network binary classifier to distinguish between radio-frequency (RF) signals during normal operation and RF signals indicative of impending faults. We optimize the model by adjusting the fault confidence threshold and implementing a multiple consecutive …

Go to article

Scene Classification Of Remote Sensing Image Based On Multi-Path Reconfigurable Neural Network, Wenyi Hu, Chunjie Lan, Tian Chen, Shan Liu, Lirong Yin, Lei Wang Jan 2024

Scene Classification Of Remote Sensing Image Based On Multi-Path Reconfigurable Neural Network, Wenyi Hu, Chunjie Lan, Tian Chen, Shan Liu, Lirong Yin, Lei Wang

Electrical & Computer Engineering Faculty Publications

Land image recognition and classification and land environment detection are important research fields in remote sensing applications. Because of the diversity and complexity of different tasks of land environment recognition and classification, it is difficult for researchers to use a single model to achieve the best performance in scene classification of multiple remote sensing land images. Therefore, to determine which model is the best for the current recognition classification tasks, it is often necessary to select and experiment with many different models. However, finding the optimal model is accompanied by an increase in trial-and-error costs and is a waste of …

Go to article

Integrated Machine Learning And Deep Learning Models For Cardiovascular Disease Risk Prediction: A Comprehensive Comparative Study, Shadman Mahmood Khan Pathan, Sakan Binte Imran Jan 2024

Integrated Machine Learning And Deep Learning Models For Cardiovascular Disease Risk Prediction: A Comprehensive Comparative Study, Shadman Mahmood Khan Pathan, Sakan Binte Imran

Electrical & Computer Engineering Faculty Publications

Cardiovascular Diseases (CVDs) pose a significant global health challenge, necessitating accurate risk prediction for effective preventive measures. This comprehensive comparative study explores the performance of traditional Machine Learning (ML) and Deep Learning (DL) models in predicting CVD risk, utilizing a meticulously curated dataset derived from health records. Rigorous preprocessing, including normalization and outlier removal, enhances model robustness. Diverse ML models (Logistic Regression, Random Forest, Support Vector Machine, K-Nearest Neighbor, Decision Tree, and Gradient Boosting) are compared with a Long Short-Term Memory (LSTM) neural network for DL. Evaluation metrics include accuracy, ROC AUC, computation time, and memory usage. Results identify the …

Go to article

Multimodal Fusion For Audio-Image And Video Action Recognition, Muhammad B. Shaikh, Douglas Chai, Syed M. S. Islam, Naveed Akhtar Jan 2024

Multimodal Fusion For Audio-Image And Video Action Recognition, Muhammad B. Shaikh, Douglas Chai, Syed M. S. Islam, Naveed Akhtar

Research outputs 2022 to 2026

Multimodal Human Action Recognition (MHAR) is an important research topic in computer vision and event recognition fields. In this work, we address the problem of MHAR by developing a novel audio-image and video fusion-based deep learning framework that we call Multimodal Audio-Image and Video Action Recognizer (MAiVAR). We extract temporal information using image representations of audio signals and spatial information from video modality with the help of Convolutional Neutral Networks (CNN)-based feature extractors and fuse these features to recognize respective action classes. We apply a high-level weights assignment algorithm for improving audio-visual interaction and convergence. This proposed fusion-based framework utilizes …

Go to article

Integrative Machine Learning Approaches For Enhanced Classification Of Genomic Sequences: A Next-Generation Sequencing Perspective, Sujatha Alla, Nagesh Bheesetty, Sai Gireesh Komaragiri, Prasanthi Chidipudi, Joshit Mohanty, Sathish Kumar Chintala, Jubin Thomas, Jayapal Vummadi, Hemanth Volikatla, Navin Kamuni Jan 2024

Integrative Machine Learning Approaches For Enhanced Classification Of Genomic Sequences: A Next-Generation Sequencing Perspective, Sujatha Alla, Nagesh Bheesetty, Sai Gireesh Komaragiri, Prasanthi Chidipudi, Joshit Mohanty, Sathish Kumar Chintala, Jubin Thomas, Jayapal Vummadi, Hemanth Volikatla, Navin Kamuni

Engineering Management & Systems Engineering Faculty Publications

The advent of Next-Generation Sequencing (NGS) techniques has revolutionized genomic research by enabling the rapid sequencing of DNA and RNA. This data can be used for various applications, including genome sequencing, transcriptome profiling, metagenomics, and epigenetics studies. For this study, DNA classifier dataset was extracted from UCI repository of machine learning databases. This vast amount of genomic data necessitates the development of sophisticated machine learning (ML) models for effective classification and analysis. This study presents a comprehensive comparison of various ML models, including Support Vector Machines (SVM), Random Forests (RF), and Neural Networks (NNs), approaches, in classifying genomic data. We …

Go to article

Integrating Generative Artificial Intelligence With Systems Architecting Diagram Creation: Advancement, Challenges, Opportunities And Future Perspectives, Cansu Yalim, Holly H. Handley Jan 2024

Integrating Generative Artificial Intelligence With Systems Architecting Diagram Creation: Advancement, Challenges, Opportunities And Future Perspectives, Cansu Yalim, Holly H. Handley

Engineering Management & Systems Engineering Faculty Publications

Generative AI (GenAI) serves as a powerful tool that can create a wide range of content, including but not limited to text, speech, images, code, videos, and 3D models. ChatGPT stands out as a particularly appealing Generative Pretrained Transformer (GPT) model that offers supplementary capabilities through GPTs and plugins. These extensions enable users to engage with the chatbot and improve its functionality, surpassing mere content generation. Our study delves into the potential of ChatGPT, specifically GPT-4, to expedite the creation of diagrams to support the system architecting process. To this end, we explored the use of ChatGPT's Diagrams Show Me …

Go to article

Improving Neuropathological Analysis With Aβgan: Addressing Morphology Imbalance For Efficient Alzheimer's Disease Diagnosis, Sujatha Alla, Prasanthi Chidipudi, Nagesh Bheesetty, Vedvikash Reddy Velur, Joshit Mohanty, Puneeth Bheesetty, Marisha Jmukhadze, Narendra Lakshmana Gowda, Sai Gireesh Komaragiri Jan 2024

Improving Neuropathological Analysis With Aβgan: Addressing Morphology Imbalance For Efficient Alzheimer's Disease Diagnosis, Sujatha Alla, Prasanthi Chidipudi, Nagesh Bheesetty, Vedvikash Reddy Velur, Joshit Mohanty, Puneeth Bheesetty, Marisha Jmukhadze, Narendra Lakshmana Gowda, Sai Gireesh Komaragiri

Engineering Management & Systems Engineering Faculty Publications

Histopathologists are experiencing a digital revolution in their field thanks to the digitization of Whole Slide Images (WSIs), which are microscope slides of tissue that can measure gigapixels in size. With so much high resolution data at their disposal, computer vision techniques can now be used to automate laboratory processes, create visual standards, and increase analysis throughput, all of which reduce the workload of pathologists [1]. The "gold" standard in neuropathology, particularly for Alzheimer's Disease- is pathological diagnosis made by looking at White Matter Inclusions (WSIs) in brain tissue. Semi-quantitative scoring in accordance with the standards established by the Consortium …

Go to article

Potato Disease Identification Using Transfer Learning Approaches, Tarza Hasan Abdullah Jan 2024

Potato Disease Identification Using Transfer Learning Approaches, Tarza Hasan Abdullah

Mesopotamian Journal of Computer Science

Potato crop is one of the prominent consumed foods by human beings. When potato crops are infected by diseases it affects farmers negatively and to run in a loss. Therefore, early detection of the potato crop disease can play a vital role in minimizing the loss of the farmers. Nowadays, artificial intelligence technologies, more specifically deep learning techniques, provide solutions to many crops disease-related problems. However, training deep learning models requires a high computational power and huge amount of data as they are data hungry models. Also, designing a custom CNN models a difficult task and there are some variations …

Go to article

Uniform Convergence Of Deep Neural Networks With Lipschitz Continuous Activation Functions And Variable Widths, Yuesheng Xu, Haizhang Zhang Jan 2024

Uniform Convergence Of Deep Neural Networks With Lipschitz Continuous Activation Functions And Variable Widths, Yuesheng Xu, Haizhang Zhang

Mathematics & Statistics Faculty Publications

We consider deep neural networks (DNNs) with a Lipschitz continuous activation function and with weight matrices of variable widths. We establish a uniform convergence analysis framework in which sufficient conditions on weight matrices and bias vectors together with the Lipschitz constant are provided to ensure uniform convergence of DNNs to a meaningful function as the number of their layers tends to infinity. In the framework, special results on uniform convergence of DNNs with a fixed width, bounded widths and unbounded widths are presented. In particular, as convolutional neural networks are special DNNs with weight matrices of increasing widths, we put …

Go to article

First Prev Next Last