Computer Engineering Commons^™

Toward Strategy Identification And Subtask Decomposition In Task Exploration, Tom Odem

Master's Projects

This research builds on work in anticipatory human-machine interaction, a subfield of human-machine interaction where machines can facilitate advantageous interactions by anticipating a user’s future state. The aim of this research is to further a machine’s understanding of user knowledge, skill, and behavior in pursuit of implicit coordination. A task explorer pipeline was developed that uses clustering techniques, paired with factor analysis and string edit distance, to automatically identify key global and local strategies that are used to complete tasks. Global strategies identify generalized sets of actions used to complete tasks, while local strategies identify sequences that used those sets …

Faux Capabilities: A Novel Approach For Code Analysis, Tanay Godse

Master's Projects

When using third-party packages or libraries, it is crucial to understand their behavior. Typically, this requires developers to either conduct code reviews or set up sandbox environments for testing or write unit tests with mocked values for every function used in their code. However, these approaches are often inefficient and time-consuming. A more effective solution would provide developers with a broad understanding of the functionality required by the code they plan to import. This can be done using object capabilities, where a particular functionality is the capability that an object must possess, in order to be able to perform the …

Disease Diagnosis Using Rag Llm With Smart Prompt Engineering, Qadeerullah Syed

Master's Projects

Although recent trends indicate that LLMs outperform traditional methods in solving complex problems with enhanced reasoning, there has been barely any progress in replicating the quality of diagnoses like those of actual human doctors. The identification of an accurate diagnosis with thorough reasoning is still a significant challenge, even with advanced AI models. The process of performing accurate diagnosis remains challenging due to a lack of transparency in state-of-the-art models existing today, a lack of explanation in the diagnosis process, an emphasis on results rather than reasoning, and a lack of foundational knowledge in models, along with limited exploration of …

Malware Generation And Classification Using Pixelcnn, Mounika Krishna Teja Karumudi

Master's Projects

Malware poses a serious threat to both data privacy and system security. With the wide variety of malware families and the surge in cyber-attacks, the accurate classification of malware is crucial for building effective detection and prevention systems. In recent years, deep learning (DL) methods in computer vision have shown promise in classifying malware by converting malware files into visual representations and applying DL algorithms to classify the resulting images. Among the different approaches to malware family classification, image-based methods have gained significant interest. This research focuses on leveraging DL techniques for image-based classification of malware. The success of identifying …

Smart: Semantic Mapping And Analysis For Regional Terrain Using Multi-Scale U-Net And Topsis, Rashmi Sonth

Master's Projects

Accurate land use classification is the backbone for urban planning. But with poor quality satellite images, varied landscapes and structures which are changing faster than ever, it becomes a challenge to define clear boundaries and hence to urban planning. This research explores the application of deep-learning model for land use classification and asses the suitability of the land. The proposed model combines a multi-scale U-Net architecture with Transformer blocks applied on a multi-spectral satellite images that improves the semantic segmentation greatly across the urban and rural regions. Additionally, a patch-wise segmentation is applied to overcome the common problem of feature …

Multimodal Feature Fusion And Machine Learning For Adhd Detection Using Neuroimaging Data, Isabel Pham

Master's Projects

Attention Deficit Hyperactivity Disorder (ADHD) is a common neurodevelopment disorder that can significantly affect a person’s attention, impulse control, and executive function. Currently, the traditional diagnosis method often relies on clinical assessments and observations. However, these methods can be subjective and lead to inconsistencies in diagnosis between individuals. To address this challenge, neuroimaging and machine learning (ML) are promising tools for providing a more objective diagnosis of ADHD. The goal of this project is to apply a multimodal approach in which structural and functional features of specific regions of the brain are used to develop a more accurate and objective …

Simple Vs. Complex Human Activity Classification Via Hybrid Machine Learning Models, Anusha Kukreja

Master's Projects

In-depth understanding of the complexity of daily human activities is crucial for building responsive health monitoring and assistive technologies. However, limited research has focused on distinguishing activities based on their involvement level, as most existing work classifies only the type of activity performed. In this thesis, we address this gap by proposing a method to classify human activities as either simple or complex using sensor data from the Opportunity dataset. We define complex activities as those involving object interactions or multiple coordinated movements (e.g., drinking from a cup, cleaning a table), and simple activities as static or low-effort postures (e.g., …

Visionmate: Ai-Powered Image Captioning Web Application, Sai Anoushka Kokku

Master's Projects

VisionMate is a web application that generates captions for camera-captured images. It is designed
to assist users with visual impairments by converting visual input into spoken and written text. The
application uses the GIT-base model from Hugging Face, which processes the image and returns a
descriptive caption. Users can take a picture using the device camera—either via webcam on
desktop or the native camera interface on mobile. The app provides audio output using the
SpeechSynthesis API and uses full-screen tap interaction to simplify accessibility.

The frontend is implemented in React.js, and the backend is built with FastAPI. The backend calls …

Phishing Detection Using Continual Learning And Large Language Models, Gopi Prajeev Battula

Master's Projects

Adaptive phishing detection remains crucial as the nature of cyber-attacks changes over time, which renders static models obsolete. This project extends phishing detection through the implementation of continual learning approaches, namely Elastic Weight Consolidation (EWC) and Learning Without Forgetting (LWF) with RoBERTa, a Large Language Model (LLM) and compares the results of these approaches against GPT-4o-mini, another LLM. Our approach begins with fine-tuning RoBERTa on multiple phishing datasets to establish an effective baseline. EWC is then implemented to preserve vital model parameters based on their importance measured by the Fisher Information Matrix, while LWF uses knowledge distillation to retain prior …

On The Adversarial Robustness Of Quantized Neural Networks Against Common Adversaries In Time-Series Forecasting, Maanak Arora

Master's Projects

Real-world edge applications now use modern machine learning models which require both resource efficiency and robustness against adversarial threats. Deep neural networks which include time series forecasting models still face risks from adversarial perturbations while quantization techniques used for memory and compute efficiency create unpredictable robustness challenges. This project investigates the adversarial resistance of Long Short-Term Memory (LSTM) models after applying post-training quantization at three different precision levels: 16-bit floating point (FP16), 8-bit integer (INT8) and custom 4-bit quantization. The Jena Climate dataset serves as our main benchmark for training a fullprecision LSTM model followed by multiple quantization strategies which …

Physiotrack: A Gamified Physiotherapy System, Pranavi Chaturvedula

Master's Projects

Traditional physiotherapy methods tend to be non-interactive and provide little to no personalized instruction, even though physiotherapy is critical to stroke recovery. This thesis explores a fully adaptive, sensor-based, feedback architecture intended for stroke patients which remotely supervises movement and personalizes exercises enabled by multimodal sensors. The system uses filtering and windowed segmentation of accelerometer and skeletal data to compute features like jerk, speed, and joint movement angular range. A game engine applies accelerometer and skeletal features together with optimized, lightweight ML models to drive adaptive feedback, scoring, and difficulty adjustment. The architecture supports responsive continuous sensor streaming within the …

Secured Data Storage Management With Deduplication In Cloud Computing And Local Gpt Integration, Pavan Myana

Master's Projects

Exponential growth in cloud computing has brought enormous changes in data storage and processing, but also raised several questions on the security, privacy, and efficient storage of data. This report provides a dual-focused approach toward solving these challenges. First, we try to build an application securely and efficiently using data deduplication and Proxy Re-Encryption for optimization of storage and enabling secure data sharing. Deduplication ensures that redundant data is removed before encryption for maximum efficiency in storage, while PRE enables the safe sharing of encrypted data by re-encrypting the keys for specified recipients without the leakage of sensitive information. We …

Performance Comparison Of Machine Learning Across Metal, Cuda, And Neuromorphic Frameworks, Ryan Saini

Master's Projects

Machine learning’s computational demands necessitate optimal performance and utilization. This research compares Apple Silicon M3 Pro with MPS, NVIDIA RTX 3070 GPU with CUDA, and neuromorphic computing for machine learning methods. We provide a cross-platform and cross-architecture performance analysis of machine learning methods to identify optimal configurations for training and inference scenarios. On traditional neural networks, Apple Silicon with MPS delivers superior energy efficiency at the cost of longer processing times for training and inference. NVIDIA with CUDA offers faster computation in training and inference at higher energy costs. Convolutional spiking neural networks perform competitively on event-based data, particularly on …

Malware Opcode Embedding And Quality Assessment Of Generative Sample Embeddings, Atishay Jain

Master's Projects

Malware is software used to damage and disrupt computer systems with the intent to cause damage to the victim. Malware detection and classification into malware families is a crucial problem for cybersecurity researchers. One of the major bottlenecks in improving these systems is the shortage of good quality labeled malware data, especially for malware families with scarce samples. Researchers have utilized generative models to generate malware data to address this issue. Malware embeddings encode patterns within a malware file, which can be used to detect and classify malware. Recently, encouraging results have been obtained in generating malware embeddings using generative …

Gen Ai For Malicious Network Data, Aneesh Maturu

Master's Projects

Though botnet attacks are on the rise, they also have become sophisticated and difficult to detect. Such a rising threat demands more and more sophisticated cybersecurity that leverages machine learning technology. Nevertheless, one of the biggest bottlenecks remains the unavailability of large and well-balanced datasets, particularly for malicious traffic, which hampers the efficacy of detection models. In an attempt to address this issue, our research utilizes Generative Adversarial Networks (GANs) to produce synthetic samples of botnet traffic from the CTU-13 dataset. While the majority of generative models have been targeting image data, we use GANs for a new application: generating …

Human Vs. Llm: Interpreting Emotion From Neutral Faces In Contextually Charged Backgrounds, Sai Mounika Peteti

Master's Projects

In this study, we investigate the intersection of cultural context, visual perception, and implicit bias in interpreting neutral human expressions. Specifically, we explore how emotionally charged backgrounds can shape viewers interpretations of neutral facial expressions. Using an experimental setup, participants are shown neutral human portraits paired with varying background types ranging from emotionally neutral or pleasant to evocative scenes. Participants are tasked with selecting which background best matches the emotional state of the person depicted in the portraits. Eye-tracking data is collected to analyze visual attention patterns and cognitive processing. In parallel, we also evaluate how large language models (LLMs) …

Image-To-Text Transcription: Analyzing And Describing Visual Content, Zixiao Fan

Master's Projects

Image captioning, which provides a textual understanding of visual content, is the fundamental support for the advancement of Human-A.I. Interaction technology. In the hope of exploring the application of such technology, this project focuses on two specific goals. One is to directly explore the application of the image informationretrieving abilities, and the other is to dive into the specifics of the pipeline and components of image captioning models. As a result, this project presents a working app that exploits the text retrieval functionalities to enable image storage with functions like tagging and transcription. It also supports search functionality with a …

Advanced Knowledge Extraction With Biomedical Data Using Llms, Akshat Krishna

Master's Projects

The rapid growth of biomedical research has led to an overwhelming volume of unstructured textual data in the scientific literature. This has necessitated the development of an automated approach for knowledge extraction and integration. In

this project, we present a comprehensive pipeline for constructing a unified biomed- ical knowledge graph by combining two well-known datasets: CHEMPROT [1],

which captures chemical–protein interactions, and EU-ADR [2], which annotates drug–gene–disease relationships. In order to identify important biomedical entities and interactions from CHEMPROT dataset, we perform Named Entity Recognition (NER) and relation Extraction (RE) using state-of-the-art biomedical models like BioBERT [3], BioGPT [4] and …

Mitigating Cold Start Problem Through Metadata Integration And User Preference Analysis, Prabaljit Walia

Master's Projects

Recommendation systems power the most popular platforms in the world: from content catalogs on Netflix to custom feeds on TikTok – the importance of recommendation systems is significant. Collaborative filtering, the most popular recommendation technique, is essentially based on the idea of leveraging collective user intelligence i.e., creating recommendations by finding similar users. But this technique suffers when there is not enough data in the profiles of users, formally termed as the cold start problem. This research focuses on this problem by introducing an approach that integrates metadata-driven similarity measures with profile expansion techniques. Our approach combines traditional collaborative filtering …

Machine Learning Based Network Traffic Classification With Cosine-Similarity Based Out-Of-Distribution Detection, Prabhat Edupuganti

Master's Projects

The changes occurring in the amount of encrypted network traffic is growing at an alarming rate. This development has created intricate problems in traffic classification which is vital for effective cybersecurity. Moreover, most frameworks seem to ignore OOD detection, model calibration and novel pattern detection as cornerstone problem areas. The due analysis is presented as a machine learning approach aimed at resolving encrypted traffic classification issues and focuses on novel OOD detection and calibration issues. Primary contributions comprise detection of out-of-distribution states using softmax scaled cosine similarity, advanced variance-based feature elimination, and lowering ECE using stringent NNs. This work demonstrates …

Real-Time Adaptive Framework For Topic Modeling In Social Engineering Attacks, Manav Bhasin

Master's Projects

Detecting social engineering attempts is crucial for security, as these threats are becoming more frequent and increasingly exploit human vulnerabilities. This research focuses on topic modeling using conversational data from Kevin Mitnick’s ”The Art of Deception” with dialogues that illustrate various social engineering strategies. The dataset comprises manually extracted and synthetically augmented conversations to ensure natural dialogue flow. Two methodologies are presented for utterance-level and global topic extraction: prompt engineering leveraging OpenAI’s GPT-4o-mini, characterized by few-shot learning and chain-of-thought prompting, and Quantized Low Rank Adaptation (QLoRA) utilizing Mistral’s 7B instruct model for efficient fine-tuning. Through experimentation and evaluation, this study …

Homomorphically Encrypted Faceted Values, Tanmay Singal

Master's Projects

Faceted values prevent the implicit flow of sensitive information by controlling the visibility of program data. They achieve this by maintaining two facets for each variable: a public facet, which is observable, and a private facet, which remains hidden. Although this method secures the flow of sensitive data, it can be leaked if the server storing the faceted values is compromised. While faceted values may be encrypted on the server, doing so would necessitate that the private facets be briefly decrypted during execution to allow arithmetic operations to be performed on them, creating an attack vector for information to be …

Bot Detection In Social Media Using Graphsage And Bert, Abhishek Deshmukh

Master's Projects

This project details a novel bot detection system developed to battle the ever- changing challenge of disinformation, misinformation, and other bot-generated content.

The methodology employed in this project combines the text-based analytical strength of BERT (Bidirectional Encoder Representations from Transformers) with the strength of GraphSage (Graph Sample and Aggregation) for analyzing network structures. The project concatenates BERT and GraphSage vectors to create an 896-size feature embedding with a rich blend of network and text features. This project employs a Support Vector Machine to process the concatenated embeddings, as SVM works well with high-dimensional data. This project was evaluated on two …

Ai Powered Legal Decision Support System, Alisha Rath

Master's Projects

The large volume of legal cases presented by judicial professionals has made it
challenging to study and predict results. With advances in research methods and
technology, predicting law cases in a more accurate manner has become an important
trend. Prediction tools based on AI may help manage a large number of legislative
texts and documents that cannot possibly be fully read, reduce the number of cases
to be seen, and give accurate outcomes of how cases may turn out. Now, when
we look into the current AI legal prediction tools in this domain, they mostly lack
efficiency and interpretability, the …

Retrieval-Augmented Generation (Rag) Chatbots: A Comparative Study Of Claude, Gpt-4o, Deepseek, And Llama, Kalindi Vijesh Parekh

Master's Projects

The use of Retrieval-augmented generation (RAG) in chatbot platforms has transformed academic spaces by significantly improving information accessibility. RAG has become a viable approach to upgrading Large Language Models (LLMs) with external knowledge access in real time. With the growing availability of advanced LLMs such as GPT, DeepSeek, Claude, Gemini, and Llama, there is a growing need to compare RAG systems based on different LLMs. This study compares the responses of four different RAG chatbots using popular LLMs against a uniquely designed evaluation dataset. Specifically, the study compares the responses and performance of closed-source (GPT-4o and Claude) and open-source models …

Social Engineering Scenario Generation For Awareness-Based Attack Resilience, Jade Webb

Master's Projects

Social engineering is found in a strong majority of cyberattacks today, as it is a powerful manipulation tactic that does not require the technical skills of hacking. Calculated social engineers utilize simple communication to deceive and exploit their victims, all by capitalizing on the vulnerabilities of human nature: trust and fear. When successful, this inconspicuous technique can lead to millions of dollars in losses. Social engineering is not a one-dimensional technique; criminals often leverage a combination of strategies to craft a robust yet subtle attack. In addition, offenders are continually evolving their methods in efforts to surpass preventive measures. A …

Cca Analysis Using Computer Vision Techniques, Rahul Thakur

Master's Projects

Coral reefs are an essential part of the marine ecosystem. They perform a wide variety of tasks, some directly and others indirectly. They can produce oxygen, absorb carbon dioxide, along with supporting ocean habitat. Crustose Coralline Algae (“CCA”) plays an important role in helping provide structural support to Coral Reef ecosystems. However, global warming is causing ocean water to become more acidic resulting in coral bleaching. This is leading to changes in coral environments and causing coral deaths at alarming rates. Object detection using computer vision techniques, specifically deep learning, can help to monitor coral reef health and identify CCA …

Coral Vision – Crustose Coralline Algae Detection With Computer Vision, Ryan Tseng

Master's Projects

Crustose coralline algae (CCA) are a group of red algae that are vital contributors to the health of coral reef ecosystems. Monitoring CCA abundance can serve as an indicator for coral reef health and improve reef conservation efforts. Autonomous Reef Monitoring Structures (ARMS) are artificial structures that can be deployed into coral reef ecosystems and retrieved to gather ecological data without harming reef structures. Traditional methods of calculating CCA abundance require manual analysis and are labor-intensive. Recent developments in computer vision and deep learning technology have provided an avenue to fully automate this task. This research aims to train a …

Ai-Enabled Anticipatory Handover Predictions In 5g Networks, Ojas Ankush Naik

Master's Projects

As users move across network cells in 5G, it is critical to maintain seamless connectivity through efficient and fast handovers. However, as 5G networks have a very dense deployment of cells and higher carrier frequencies, handovers are often more frequent and challenging, leading to failures or the ping-pong effect. In this research, we are going to use Artificial Intelligence (AI) techniques to enable predicting handover(HO) events proactively as opposed to reactively, aiming to reduce HO failures and unnecessary handovers. We develop Long-Short-Term Memory (LSTM) and Bidirectional LSTM (Bi-LSTM) models to forecast future signal measurements, predict handover trigger points, and compare …

Landslide Prediction Using Time-Series Decomposition, Reinforcement Learning-Based Feature Selection And Ml Models, Mohith Sai Venkat Ankem

Master's Projects

Landslides pose significant risks to human life, the community, and the environment, yet their prediction remains a complex and unexplored challenge. Existing prediction models often rely on surface measurements and satellite images, neglecting the critical role, in providing deeper insights into landslide analysis. The literature review highlights a lack of research in time series decomposition techniques, despite their potential to improve prediction accuracy. Similarly, feature selection methods that enhance model robustness and precision have not been adequately addressed. This study presents a novel approach to predicting landslide displacement by combining feature selection through reinforcement learning techniques with advanced time-series machine …