Computer Engineering Commons^™

Benchmarking And Enhancing Generalization In Multilingual Speech Emotion Recognition, Mohamed Osman Ismael

Theses and Dissertations

Speech Emotion Recognition (SER) is pivotal in advancing human-computer interaction by enabling machines to understand and respond to human emotions. Despite significant progress with self-supervised learning models, SER systems often struggle with generalization across diverse languages and unseen data distributions, limiting their real-world applicability. This thesis addresses these challenges by first introducing a large-scale benchmark to evaluate the robustness and adaptability of state-of-the-art SER models in both in-domain and out-of-domain settings. The benchmark includes a diverse set of multilingual datasets, emphasizing cross-lingual and out-of-domain evaluations to assess model generalization. Surprisingly, we find that the Whisper model, originally designed for automatic …

Predicting Remaining Useful Life Of Turbofan Engines On Cmapss And N-Cmapss Using Deep Recurrent Neural Networks, Samaikya Tippareddy

Master's Projects

Aircraft engines are susceptible to failure at multiple points over their lifespan and need replacement or repairs. The ability to proactively determine how long an engine will function helps avoid fatalities and build a reliable prognostic system. To accomplish this, predictive models are being developed using various approaches like physics-based and data-driven techniques. Physics-based models need huge computing power for simulations and domain knowledge for understanding and implementing the models. Alternatively, if we have substantial data for prediction, data-driven models can be used. In this research, we use data-driven approach for engine Remaining-Useful-Life (RUL) prediction on the NASA Commercial Modular …

Multimodal Techniques For Malware Classification, Jonathan Jiang

Master's Projects

The threat of malware has remained a serious concern for computer networks and systems, highlighting the need for accurate classification techniques. This research adopted the structured nature of PE files incorporated with a multi-modal machinelearning approach, to classify malware types. Features extracted from the PE headers were used to train an LSTM model. Features extracted from the PE sections were used to train a CNN model. Probabilities produced from these two models were then concatenated and fed into an SVM classifier. This multi-modal approach demonstrated high accuracy by experimenting with and verifying the approach on a large and labeled dataset. …

Explainable Reinforcement Learning For Network Routing Optimization, Yu Xiu

Master's Projects

Software-defined Networking (SDN) provides a solution for configuring multiple network devices by offering a centralized controller architecture. Network routing is one of the most crucial problems in network configuration. In particular, the surging network traffic demands require efficient routing techniques to load balance communication links. In order to optimize the communication path’s utilization and reduce request blocking, this project utilizes Reinforcement Learning (RL) to decide the routes for given network requests. Furthermore, we adopt Explainable Reinforcement Learning (XRL) to explain the RL learning agent’s decision-making process to enhance the trustworthiness of our approach. In particular, we focus on Feature Importance …

Social Media Bot Detection Using Dropout-Gan, Anant Shukla

Master's Projects

Bot activity on social media platforms is a pervasive problem, undermining the credibility of online discourse and potentially leading to cybercrime. We propose an approach to bot detection using Generative Adversarial Networks (GAN). We discuss how we overcome the issue of mode collapse by utilizing multiple discriminators to train against one generator, while decoupling the discriminator to perform social media bot detection and utilizing the generator for data augmentation. We demonstrate that our approach outperforms---in terms of accuracy---the state-of-the-art techniques in this field. We also show how the generator in the GAN can be used to evade such a classification …

Gradual Typing For Information Flow Control In Typescript Using Es Lint, Ashish Agarwal

Master's Projects

Current state-of-the-art systems tackle data security threats by incorporating information flow control (IFC) to ensure that a piece of information reaches only its intended recipient. However, most IFC implementations introduce a custom language built on top of a well-known language. Adaptations of such languages are limited due to limited support and updates, along with difficulty in learning new syntaxes. Implementations without a custom language offer incomplete IFC support. We present a comprehensive framework by leveraging Typescript, in conjunction with ESLint and NodeJS, aiming to resolve some of the limitations of IFC and intending to facilitate acceptance by a wide range …

Zookeeper Through The Ages: A Comparative Performance Analysis Of Evolutionary Versions, Ashish Khanchandani

Master's Projects

The rise in the need for scalable, fault-tolerant, and high-performance systems is the primary factor driving the developments in distributed computing. However, the proliferation of distributed computing creates significant difficulties. In an internet- scale setting where errors and network delays are frequent, coordinating distributed applications presents difficulties that ZooKeeper attempts to solve. It ensures several crucial characteristics that guarantee reliability and consistency. However, performance and latency play a huge part when it comes to dealing with systems built for handling very high loads. ZooKeeper has very low latency for read-heavy workloads, making it suitable for real-time applications. These factors contribute …

A Censorship Resistant News Website Using The Ethereum Blockchain, Hoang Lai

Master's Projects

Misleading information, false claims, and fabricated news articles not only misguide readers but also undermine the trustworthiness of the news platforms themselves. The blockchain provides decentralized, immutable data storage and offers a promising solution to prevent censorship on news websites. Compared to traditional news websites, a decentralized application (dApp) offers benefits such as greater stability and resistance to information manipulation. A decentralized web app is harder to attack than centralized servers since the database is stored across a blockchain network. Moreover, blockchain prevents censorship by letting readers check data across all blocks in the Blockchain, which is good for a …

Echo: A Browser Extension That Runs Experimental Javascript, Prayuj Pillai

Master's Projects

Narcissus is a JavaScript interpreter written in JavaScript. While it is a good engine for experimenting with JavaScript’s design, it does not integrate easily into the browser. This project introduces ‘‘Echo’’, a browser add-on designed to execute Narcissus JavaScript files and scripts within web browsers. The project explores the performance of the Narcissus interpreter against native browser JavaScript engines and benchmarks the results, showcasing the trade-offs in running an experimental engine—the Narcissus interpreter—on the browser versus native JavaScript. Additionally, as a proof of concept, we implement taint tracking, a capability meant to boost security by preventing sensitive data from being …

Domain Switch On Sentiment Analysis Using Gradient Reversal Layer, Hemish Veeraboina

Master's Projects

Switching domains in sentiment analysis presents the challenge of transferring learned knowledge from one context to another without the need to label data. Traditional methods often struggle when dealing with differences in data distribution a problem known as the domain shift issue. To tackle this using Gradient Reversal Layers (GRL) has emerged as a solution for adapting to different domains in an unsupervised learning setting. This study introduces an enhancement to the standard GRL approach by incorporating a sigmoid function that gradually adjusts how intensely domain adaptation occurs during training. This upgraded GRL technique ensures controlled learning outcomes making it …

Scalable Container Caching Optimization With Action Masking For Serverless Edge Computing, Manikanta Sanjay Veera

Master's Projects

Serverless edge computing is an emerging technology that realizes the low latency and resource-efficient function calls for responsive computing. In cloud-based serverless computing, it is a common practice to cache sufficiently many function containers for future reuse to reduce the overhead of container initiation. In contrast, the capacity limitation of edge nodes poses a complex problem to the caching strategy in serverless edge computing of selecting an appropriate set of container caches based on the request distribution. Deep Reinforcement Learning (DRL) can play a crucial role in optimizing the caching decisions under dynamic request arrivals. In this paper, we propose …

Regional Sea Level Rise Prediction In Monterey Bay With Lstms And Vertical Land Motion, Branden Lopez

Master's Projects

Earth system data is vast in volume and variety, and is used to forecast weather,

hurricanes, floods, and sea level. Sea Level Rise (SLR) impacts various sectors, espe- cially ecosystems, food production, industry, population, health, and the availability of

clean water. Because of its broad impact, describing the behavior and forecasting SLR is an important topic. Traditional Machine Learning (ML) models vary in use, but many are not capable of capturing all the non-linear spatial and temporal properties of SLR factors. Deep learning models efficaciously handle complex time series data, noise, and high dimensional spaces, making them a focus of …

Skin Cancer Detection Using Reinforcement Learning, Vikas Chercadu

Master's Projects

Advances in medical diagnostics have increasingly harnessed the power of artificial

intelligence, offering substantial improvements in early and accurate disease identifi- cation. This paper elaborates on a novel integration of Multi-Agent Reinforcement

Learning (MARL) with Deep Learning for the early detection of skin cancer, one of the most prevalent and lethal forms of cancer when left unchecked. Our project capitalizes on the sophisticated VGG16 Network for the extraction of detailed features from the widely-utilized HAM10000 dermatoscopic dataset, enhancing these features with additional color, texture, and shape analysis. Utilizing a custom-designed MARL environment, we facilitate a collaboration among multiple intelligent agents, …

Mitigating Learning Bias In Healthcare Datasets, Samyak Jagdish Kumbhalwar

Master's Projects

CVDs have been a major cause of deaths worldwide with WHO reporting 17.9 million deaths annually. Although there are advancements in the treatment of these diseases, most of the fatalities are a result of untimely diagnosis. Active research is going on to collect data points and risk factors related to these diseases, which can enable early diagnosis. Of the datasets available, many researchers have employed different ML models to predict/detect the prevalence of heart diseases. Many employed Tree based, regression models [3, 6]. Few also tried ensemble approaches [1, 2, 4]. These healthcare datasets are generally found to be imbalanced. …

Understanding Distracted Driving And Gaze Patterns In A Driving Simulator: Simple Vs. Complex Challenges, Rishi Prabhat Narayana Sannala

Master's Projects

Distracted driving has grown in criticality over the recent years, given the numerous distractions that drivers face today, and which have further been magnified by the proliferation of in-vehicle technologies and mobile devices. Such distractions can seriously compromise a driver's ability to be fully focused on the road and to carry out timely responses and informed decisions that are key in minimizing the risks of a crash and maximizing road safety. The general aim of the research is to observe how simple versus complex distractors affect driving performance and gaze patterns. The eyetracker used is the Tobii Pro Fusion, synchronized …

Hindi Image Captioning Using Indictrans2 And Encoder-Decoder Architecture, Anahita Vayalombrone Dinesh

Master's Projects

One of the most prominent tasks that lie on the conjunction of Natural Language Processing (NLP) and computer vision, is image captioning. Image captioning is the generative task of achieving textual descriptions from images. Its application finds use in many real-world scenarios like aiding the visually impaired, editing applications, recommendation systems, and medical imaging. This research focus lies in Hindi image captioning, the official language of India, as it has not been explored as far as its need. Several challenges such as the lack of substantial Hindi text data for training models, the need for human annotators to verify the …

A Rule-Based Hybrid Translation Model For Context-Aware Speech To Indian Sign Language Tasks, Dania Jaison

Master's Projects

In India, one of the most significant tools to communicate with the Deaf and Hard of Hearing (DHH) communities is Indian Sign Language(ISL). The issue of a scarcity of computational resources for ISL is even more pronounced when it comes to the translation of written or spoken English into ISL. This paper proposes a rule-based model for translation where the spoken english sentences are translated into ISL by focusing on the specific syntactic and grammatical differences between these two languages. ISL uses a simplified syntax unlike the nuanced sentence structures in English — we omit most of the auxiliary verbs …

Multimodal Emotion Detection In Conversations And Dialogues: A Fusion Model Approach, Abhinay Jatoth

Master's Projects

Emotion recognition is gaining traction due to its wide range of potential applications across different fields. With the rise of social media, chat platforms, and voice assistants, there is a vast increase in data through which humans implicitly and explicitly carry emotional cues. With new algorithms being developed for understanding the nuances of human language and emotion, businesses can tailor more personalized and empathetic service. Sentiment analysis, expresses a positive, negative, or neutral viewpoint laid the foundation of Emotion classification. Emotion classification in conversations represents the most advanced stage of classification. It is also challenging due to the existence and …

Lexigen: Lexical-Driven Image Generation, Sangram Prashant Chincholkar

Master's Projects

This research project proposes a novel approach to user-driven image editing via natural language descriptions. The aim is an accurate change of certain features of an image with respect to the descriptive text while maintaining, with equal concern, the integrity of the remaining parts of the image not affected by the description. The task is particularly relevant for fields like content creation, personalized design, and automated image editing that require both coherence of a visual scene and textual description. We propose a generative model, LexiGen, which perfectly integrates natural language descriptions with their corresponding visual changes within an image. The …

Personalizing Image Generation From Prompts Using Generative Ai, Mit Ramesh Jain

Master's Projects

The rapid advancements in Generative AI, particularly Text-to-Image (T2I) models, have opened up new possibilities for personalized image generation. Finetuning large T2I models for specific downstream tasks is a key approach to achieving tailored outputs. In recent years, Parameter-Efficient Fine-Tuning (PEFT) techniques have gained significant attention as a cost-effective and efficient solution for fine-tuning large models. Initially developed for fine-tuning large language models (LLMs), PEFT techniques have been extensively studied and compared in the context of language tasks. However, regarding the T2I domain, there is a lack of similarly exhaustive and detailed literature on PEFT. This research project, in the …

Load Balancing For Cloud-Based Applications, Nitish Ranjan

Master's Projects

Effective load balancing is critical in ensuring optimal resource utilization, reducing latency, and improving the overall performance of distributed systems. This report commences with a comprehensive literature review on existing load-balancing algorithms, examining their methodologies, strengths, and limitations within various computing environments, including cloud computing, data centers, and network traffic management. Despite significant advancements in this field, the dynamic nature of distributed systems, coupled with the ever-increasing demand for efficient data processing, poses ongoing challenges. In response, this study proposes a novel load-balancing algorithm to address these contemporary challenges. The approach leverages dynamic and hybrid load balancing, distinguishing it from …

Exploring The Use And Misuse Of Large Language Models (Llms), Hezekiah Paul D. Valdez

Master's Projects

Large Language Models (LLMs) have quickly gone from simple rule-based systems to complex knowledge bases capable of tackling many different tasks across a variety of fields. What began as an exercise in human-computer interaction has become the basis for artificial intelligence in a variety of mediums. When attached to larger systems, LLMs become generative assistants that can perform highly on human proficiency assessments and other benchmark skill assessments. This increase in proficiency has led these systems to be deployed in fields such as cybersecurity, business, and programming to help improve productivity and efficiency. However, such a wide availability has allowed …

Code Quality Enhancement: Evaluating Ai Code Generation With Software Metrics, Sirisha Krishna Murthy

Master's Projects

With the advancements in the stream of AI in the recent time and the evolution of Generative AI, it is a given that there is a need to effectively integrate AI into daily tasks, including Coding. When talking about Generative AI, one important thing to consider is prompting, which is that way to talk to the AI. Depending on specific needs and tasks the way we need to prompt AI can vary. With rapid development in the field, there are a lot of new benchmarks that evaluate the AI coders on correctness, but to effectively adapt AI into actual coding …

Enhancing Qwen2.5-Coder: A Deep Dive Into Fine-Tuning Using Peft For Superior Code Outputs, Lohith Nagaraja

Master's Projects

The main objective of this research is to improve the quality of software code that is produced by the Qwen2.5-Coder model specifically in terms of maintainability, complexity, and reliability. Our approach is going to be a more specific one that will involve the Parameter-Efficient Fine Tuning (PEFT) framework combined with quantization through Low-Rank Adaption (LoRA). This approach involves fine-tuning only some of the parameters of a model to make it suitable for software programming with the general structure of the model largely intact. In this paper, SonarQube is used as a tool to help quantify the improvements made to the …

Joint Learning Of Unknown Safety Constraints And Control Policies In Reinforcement Learning, Lunet Abiye Yifru

Graduate Theses, Dissertations, and Problem Reports (ETD)

Reinforcement learning (RL) has revolutionized decision-making across a wide range of domains over the past few decades. Yet, deploying RL policies in real-world scenarios presents the crucial challenge of ensuring safety. Traditional safe RL approaches have predominantly focused on incorporating predefined safety constraints into the policy learning process. However, this reliance on predefined safety constraints poses limitations in dynamic and unpredictable real-world settings where such constraints may not be available or sufficiently adaptable. Bridging this gap, we propose a novel approach that concurrently learns a safe RL control policy and identifies the unknown safety constraint parameters of a given environment. …

Machine Learning Based Intrusion Detection Framework For Can Bus Vulnerabilities In Modern Vehicles, Obinna C. Agbo

Graduate Theses, Dissertations, and Problem Reports (ETD)

The Controller Area Network (CAN) bus is a crucial communication backbone in modern vehicles, connecting various Electronic Control Units (ECUs). However, inherent design weaknesses such as the lack of encryption and authentication make CAN networks vulnerable to cyber-attacks, including spoofing, Denial of Service (DoS), and fuzzing attacks. This thesis thoroughly evaluates these vulnerabilities and the limitations of existing security frameworks like Message Authentication Codes (MACs) and encryption, advocating for the adoption of Intrusion Detection Systems (IDS) as a more practical solution for CAN bus security. The proposed IDS leverages advanced machine learning techniques to accurately detect intrusions, even under complex …

Resilience In The Wake Of Storms: Unveiling Spatiotemporal Mobility Dynamics Of Gulf Coast Communities Through Crowd-Sourced Data, Joswin Valerian Concessao

Computer Science and Engineering Theses - Archive

Flood events present substantial challenges for coastal communities, severely impacting public safety, transportation infrastructure, and overall livability. Tropical storms, hurricanes, and sea level rise can cause extensive damage to homes and critical systems, requiring costly and prolonged recovery efforts. Coastal transportation networks are particularly vulnerable to flooding, leading to road closures, increased congestion, restricted access to essential services, and long-term economic disruptions. Understanding the effects of flood events on mobility patterns is crucial for urban planning and effective disaster management.

This thesis utilizes motif analysis to examine transportation network disruptions and access patterns in Harrison County, Mississippi, during Hurricane Ida …

Adaptive Neh With Constrained Nearest Neighbor Subtours For The Electric Vehicle Routing Problem With Time Windows, Andrew Struthers

All Master's Theses

The development of electric vehicles is currently considered one of the most innovative areas in manufacturing. Largely driven by the desire to reduce greenhouse emissions, electric vehicles are seen as a viable alternative to internal combustion engine cars. Starting from consumer cars, a dedicated effort is being made to translate this into commercial vehicles for freight and delivery. This research introduces a novel adaptive Nawaz, Enscore, Ham (NEH) algorithm with constrained nearest neighbor subtour (NEH-NN). This algorithm is tested on the standard benchmark problems in literature and used as a seed solution for the Genetic Algorithm (GA). The performance and …

Machine Learning For Electronic Structure Prediction, Shashank Pathrudkar

Dissertations, Master's Theses and Master's Reports

Kohn-Sham density functional theory is the work horse of computational material science research. The core of Kohn-Sham density functional theory, the Kohn-Sham equations, output charge density, energy levels and wavefunctions. In principle, the electron density can be used to obtain several other properties of interest including total potential energy of the system, atomic forces, binding energies and electric constants. In this work we present machine learning models designed to bypass the Kohn-Sham equations by directly predicting electron density. Two distinct models were developed: one tailored to predict electron density for quasi one-dimensional materials under strain, while the other is applicable …

Multirelational Twitter Bot Detection Using Graph Neural Networks, Ketan Jadhav

Master's Projects

Social media is a key resource in modern human communication as well as for information. Ease of access and global reach is a primary factor to the popularity of several social media platforms like Twitter. Social Media Bots are automated programs which are developed for social engagement. These bots, however, are being used with malicious intent as well, to spread fake news and manipulate the masses. Identification of social media bot accounts has become crucial since social media has become one of the primary sources of news and information for a lot of people. This project aims to propose Multirelation …