Computer Sciences Commons^™

Exploring A Multimodal Fusion-Based Deep Learning Network For Detecting Facial Palsy, Heng Yim Nicole Oo, Min Hun Lee, J. H. Lim

Research Collection School Of Computing and Information Systems

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model that utilizes unstructured data (i.e. an image frame with facial line segments) and structured data (i.e. features of facial expressions) to detect facial palsy. We then contribute to a study to analyze the effect of different data modalities and the benefits of a multimodal fusion-based approach using videos of 21 facial palsy patients. Our experimental results show that among various data modalities (i.e. unstructured data - RGB images …

Personalized Driving Using Inverse Reinforcement Learning, Rodrigo J. Gonzalez Salinas

Theses and Dissertations

This thesis introduces an autonomous driving controller designed to replicate individual driving behaviors based on a provided demonstration. The controller employs Inverse Reinforcement Learning (IRL) to formulate the reward function associated with the provided demonstration. IRL is implemented through a dual-feedback loop system. The inner loop utilizes Q-learning, a model-free reinforcement learning technique, to optimize the Hamilton-Jacobi-Bellman (HJB) equation and derive an appropriate control solution. The outer loop leverages this derived control solution to generate parameters for the reward function, which are subsequently integrated into the HJB equation. The ultimate control policy is deduced from the final reward function obtained …

Detection And Classification Of Unauthorized Use Of Irrigation Motors In Agricultural Irrigation, Önder Ci̇velek, Sedat Görmüş, Hali̇l İbrahi̇m Okumuş, Orhan Gazi̇ Kederoglu

Turkish Journal of Electrical Engineering and Computer Sciences

The decarbonisation of electricity generation requires the real-time monitoring and control of grid components in order to efficiently and timely dispatch demand. This highly automated system, known as the Smart Grid, relies on smart or sensor-equipped distribution network components to optimise energy flow and minimise losses. However, energy theft, a major obstacle to efficient resource utilisation, poses a significant challenge to achieving this goal. This study proposes and evaluates a real-time telemetry and control system designed to mitigate energy theft in agricultural irrigation applications. The system increases energy efficiency by tracking the energy use in agricultural irrigation. The key challenge …

Vysion Software, Isaias Hernandez-Dominguez Jr, Chander Luderman Miller

2024 Symposium

Vision loss presents significant challenges in daily life. Existing solutions for blind and visually impaired individuals are often limited in functionality, expensive, or complex to use. Vysion Software addresses this gap by developing a user-friendly, all-in-one AI companion app that provides features including text summarization, real-time audio descriptions, and AI-enhanced navigation. This project details the development plan, initial functionalities, and future vision for Vysion Software.

An Exploratory Study Of Conventional Machine Learning And Large Language Models For Sentiment Analysis, Cui Zou, Jingyuan Cai, Langtao Chen, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

Sentiment analysis is the use of natural language processing to identify affective states and determine people’s opinions in various analytical applications such as customer reviews and social media analyses. Large language models (LLMs) such as GPT-4o demonstrate impressive performance in text generation tasks. Despite numerous studies in the extant literature, few have compared the performance of conventional machine learning models with LLMs for sentiment analysis. This study aims to fill this gap by conducting an evaluation of these models using a balanced dataset of 2,000 IMDb movie reviews. Our study shows that GPT-4o achieves the highest performance, while GPT-3.5 and …

Predicting Critical Risks And Long-Term Impact Of Covid-19 Patients With Substance Use Disorder (Sud) Using Machine Learning, Jiawei Wu

Dissertations (1934 -)

The crisis of substance use disorder (SUD), a problematic pattern of substance use that causes significant impairment or distress, is one of the most devastating threats to the public health system in the United States and it is ongoing. Opioid dependency or opioid overdose is a common drug use disorder and the number of deaths due to opioid overdose is increasing significantly during the COVID-19 pandemic because opioid use impacts mostly human respiratory, increases vulnerability to COVID-19, and further leads to higher morbidity and mortality. Other substance use disorders, including alcohol, cocaine, cannabis, and tobacco, will also exacerbate both physical …

Machine Learning Multimodal Framework For Fake News Detection And Mitigation, Nada A. Gaballah

Theses and Dissertations

Social media has become our new reality, people wake up every morning and the first thing they do before getting out of bed, is check their social media. Nowadays, people rarely read newspapers, they even rarely watch TV news or listen to radio broadcasts. In recent years, we have witnessed lots of fake news roaming social media every second, with people simply believing it and spreading it even more without checking the credibility of this news. This fake news affected several domains like what happened in the US election in 2016 and again in 2020, the false information about Covid-19 …

Predictive Power Of Machine Learning Models On Degree Completion Among Adult Learners, Emily Barnes, James Hutson, Karriem Perry

Faculty Scholarship

The integration of machine learning (ML) into higher education has been recognized as a transformative force for adult learners, a growing demographic facing unique educational challenges. This study evaluates the predictive power of three ML models—Random Forest, Gradient-Boosting Machine, and Decision Trees—in forecasting degree completion among this group. Utilizing a dataset from the academic years 2013-14 to 2021-22, which includes demographic and academic performance metrics, the study employs accuracy, precision, recall, and F1 score to assess the efficacy of these models. The results indicate that the Gradient-Boosting Machine model outperforms others in predicting degree completion, suggesting that ML can significantly …

Speeding Up Coded Distributed Machine Learning, Xian Su

Dissertations, Theses, and Capstone Projects

The advancement of artificial intelligence has facilitated the generation of vast datasets, whose size often exceeds tens of terabytes. Meanwhile, machine learning has become the most important technique for big data analytics, and sophisticated models with thousands or even millions of parameters are designed to leverage big data. However, processing big data and training large models necessitate significant storage and computational resources, which has been a bottleneck in the development of artificial intelligence. Distributed computing, such as MapReduce, has been proposed to surmount the computational bottlenecks associated with single-machine analysis.

Although distributed computing harnesses the collective power of numerous less …

Investigating Bias In Mortgage-Rate Machine Learning Models, Will Kalikman

Computer Science Senior Theses

Banks and fintech lenders increasingly rely on computer-aided models in lending decisions. Traditional models were interpretable: decisions were based on observable factors, such as whether a borrower's credit score was above a threshold value, and explainable in terms of combinations of these factors. In contrast, modern machine learning models are opaque and non-interpretable. Their opaqueness and reliance on historical data that is the artifact of past racial discrimination means these new models risk embedding and exacerbating such discrimination, even if lenders do not intend to discriminate. We calibrate two random forest classifiers using publicly available HMDA loan data and publicly …

Building A Data Pipeline And Machine Learning Model For Insurance Data, Connor Weyers

Honors Program: Senior Projects (Public)

Insurance telematics is an emerging and exciting field. It combines the advancements in GPS tracking, computational analytics, data processing, and machine learning into a useful tool to help insurance companies make the best product for their consumers. This is why National Indemnity looked to implement a telematics portion to their business processes of underwriting insurance policies and sponsored a School of Computing Senior Design project. In this report, we will first review existing solutions that been used to solve problems and subproblems similar to that we are given in this project. We then propose designs for the data pipeline and …

Machine Learning: Face Recognition, Mohammed E. Amin

Publications and Research

This project explores the cutting-edge intersection of machine learning (ML) and face recognition (FR) technology, utilizing the OpenCV library to pioneer innovative applications in real-time security and user interface enhancement. By processing live video feeds, our system encodes visual inputs and employs advanced face recognition algorithms to accurately identify individuals from a database of photos. This integration of machine learning with OpenCV not only showcases the potential for bolstering security systems but also enriches user experiences across various technological platforms. Through a meticulous examination of unique facial features and the application of sophisticated ML algorithms and neural networks, our project …

Toward The Integration Of Behavioral Sensing And Artificial Intelligence, Subigya K. Nepal

Dartmouth College Ph.D Dissertations

The integration of behavioral sensing and Artificial Intelligence (AI) has increasingly proven invaluable across various domains, offering profound insights into human behavior, enhancing mental health monitoring, and optimizing workplace productivity. This thesis presents five pivotal studies that employ smartphone, wearable, and laptop-based sensing to explore and push the boundaries of what these technologies can achieve in real-world settings. This body of work explores the innovative and practical applications of AI and behavioral sensing to capture and analyze data for diverse purposes. The first part of the thesis comprises longitudinal studies on behavioral sensing, providing a detailed, long-term view of how …

Using Machine Learning To Identify Hate Speech And Offensive Language On Twitter., Mayara Lorens, Thayene Lorens

BSc (Hons) in Computing in IT

The central theme of this project is the application of Machine Learning to identify both hate speech and offensive language on Twitter. We chose this topic for its ethical relevance in the technological environment and its business potential. This topic raises concerns such as cyberbullying and the existence of a hostile environment for users. For this reason, we sought to implement four different models to create an automated system capable of identifying and categorizing whether specific content is offensive, non-offensive or neutral.

Murmurations And Root Numbers, Alexey Pozdnyakov

University Scholar Projects

We report on a machine learning investigation of large datasets of elliptic curves and L-functions. This leads to the discovery of murmurations, an unexpected correlation between the root numbers and Dirichlet coefficients of L-functions. We provide a formal definition of murmurations, describe the connection with 1-level density, and provide three examples for which the murmuration phenomenon has been rigorously proven. Using our understanding of murmurations, we then build new machine learning models in search of a polynomial time algorithm for predicting root numbers. Based on our models and several heuristic arguments, we conclude that it is unlikely for …

Movie Recommendation System., Ingrid Menezes Castro, Robert Szlufik

ICT

This project is focused on implementing a Movie Recommendation System with the use of Machine Learning. The system was developed in Python and the datasets used were 'Movies' and 'Ratings' from MovieLens 25M. This project was developed with the CRISP-DM methodology and each of the phases is detailed in a report and Jupyter Notebook.

The system is a hybrid combining best qualities of collaboration filtering and user grouping. In the project we compare some models' accuracies, upgrade a chosen model and show the improved performance of our hybrid model that used the SVD algorithm. We are able to find recommended …

Learning Scene Semantics For 3d Scene Retrieval, Natalie Gleason

Honors Theses

This project presents a comprehensive exploration into semantics-driven 3D scene retrieval, aiming to bridge the gap between 2D sketches/images and 3D models. Through four distinct research objectives, this project endeavors to construct a foundational infrastructure, develop methodologies for quantifying semantic similarity, and advance a semantics-based retrieval framework for 2D scene sketch-based and image-based 3D scene retrieval. Leveraging WordNet as a foundational semantic ontology library, the research proposes the construction of an extensive hierarchical scene semantic tree, enriching 2D/3D scenes with encoded semantic information. The methodologies for semantic similarity computation utilize this semantic tree to bridge the semantic disparity between 2D …

Cross-Framework Validation Of Cnn Architectures: From Pytorch To Onnx, Shreya Nandanwar

Theses and Dissertations

This research presents CIPAC (CNN Inter-framework Parameter Analysis and Comparison), a validation approach designed to ensure the integrity of Deep Learning models during their transfer between computational frameworks. Although initially tested on Convolutional Neural Networks (CNNs), CIPAC is versatile enough for various Deep Learning architectures. It goes beyond traditional methods that focus on output accuracy, by examining the models’ architecture, parameters, and components to maintain consistency after transitions, like moving from PyTorch to ONNX framework. Inspired by software architecture’s stringent validation standards, CIPAC addresses the challenges of working with Machine Learning models on different platforms, making it an essential tool …

Database And Machine Learning Model For Classifying Autism Spectrum Disorder From Smartphone Based Electroretinography, Rory Harris

Honors Scholar Theses

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that negatively affects a patient’s cognitive and communication aptitude and, therefore, can severely impact that patient’s quality of life. Because of this, early diagnosis is paramount. In recent studies, electroretinography (ERG), which is a measure of the retina’s electrical response to a brief flash of light into the eye, has shown promise in detecting ASD. Access to these scans can provide early diagnosis, improving well-being. Current ERG devices are very expensive due to their on board processing capabilities. This paper aims to create an ERG device using a smartphone as the main …

Optimizing Adult Learner Success: Applying Random Forest Classifier In Higher Education Predictive Analytics, Emily Barnes, James Hutson, Karriem Perry

Faculty Scholarship

This study examines the application of the Random Forest Classifier (RF) model in predicting academic success among adult learners in higher education. It focuses on evaluating the model's effectiveness using key statistical measures like accuracy, precision, recall, and F1 score across a comprehensive dataset from 2013–14 to 2021–22, which includes variables such as age, ethnicity, gender, Pell Grant eligibility, and academic performance metrics. The research highlights the RF model's capability to handle large datasets with varying data types and demonstrates its superiority over traditional regression models in predictive accuracy. Through an iterative process, the study refines the RF model to …

From Tweets To Token Sales: Assessing Ico Success Through Social Media Sentiments, Donghao Huang, S. Samuel, Quoc Toan Huynh, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

With the advent of social network technology, the influence of collective opinions has significantly impacted business, marketing, and fundraising. Particularly in the blockchain space, Initial Coin Offerings (ICOs) gain substantial exposure across various online platforms. Yet, the intricate relationships among these elements remain largely unexplored. This study aims to investigate the relationships between social media sentiment, engagement metrics, and ICO success. We hypothesize a positive correlation between favorable sentiment in ICO-related tweets and overall project success. Additionally, we recognize social media engagement indicators (mentions, retweets, likes, follower counts) as critical factors affecting ICO performance. Employing machine learning techniques, we conduct …

Developing Machine Learning Agency Among Youth: Characterizing Youth Critical Use, Examination, And Production Of Machine Learning Applications, Ibrahim Oluwajoba Adisa

All Dissertations

This study explores how middle school-aged youths at an afterschool center utilized, examined, and produced AI applications for social good with the support of adults and peers. The study employs a qualitative single case study design. It uses thematic analysis and quantitative ethnography methods to analyze data from multiple sources, including field notes, interviews, focus groups, story completions, video recordings, and artifacts. Findings indicated that engaging youths in critical exploration of AI tools enhanced their ability to design interest-based AI applications that provide solutions for healthcare problems, security, and accessibility. Moreover, the computational thinking practices that youth engaged in increased …

Code For Care: Hypertension Prediction In Women Aged 18-39 Years, Kruti Sheth

Electronic Theses, Projects, and Dissertations

The longstanding prevalence of hypertension, often undiagnosed, poses significant risks of severe chronic and cardiovascular complications if left untreated. This study investigated the causes and underlying risks of hypertension in females aged between 18-39 years. The research questions were: (Q1.) What factors affect the occurrence of hypertension in females aged 18-39 years? (Q2.) What machine learning algorithms are suited for effectively predicting hypertension? (Q3.) How can SHAP values be leveraged to analyze the factors from model outputs? The findings are: (Q1.) Performing Feature selection using binary classification Logistic regression algorithm reveals an array of 30 most influential factors at an …

Gender Detection In Facial Images: A Comprehensive Cnn Analysis, Jose N T Ambrosio, Anas Hourani, Magdalene Moy

SACAD: Scholarly Activities

This research investigates the construction of a robust gender detection system using facial features and Convolutional Neural Networks (CNNs), exploring the impact of different layer configurations on accuracy and computational efficiency. With a validation accuracy of 91%, findings illuminate the nuanced relationship between precision and computational resources, enriching discussions on facial recognition technologies.

Discourse- And Lesion-Based Aphasia Quotient Estimation Using Machine Learning, Nicholas Riccardi, Satvik Nelakuditi, Dirk B. Den Ouden, Chris Rorden, Julius Fridriksson, Rutvik H. Desai

Communication Sciences and Disorders Faculty Articles and Research

Discourse is a fundamentally important aspect of communication, and discourse production provides a wealth of information about linguistic ability. Aphasia commonly affects, in multiple ways, the ability to produce discourse. Comprehensive aphasia assessments such as the Western Aphasia Battery-Revised (WAB-R) are time- and resource-intensive. We examined whether discourse measures can be used to estimate WAB-R Aphasia Quotient (AQ), and whether this can serve as an ecologically valid, less resource-intensive measure. We used features extracted from discourse tasks using three AphasiaBank prompts involving expositional (picture description), story narrative, and procedural discourse. These features were used to train a machine learning model …

Unveiling The Origins Of Source Code Through Authorship Attribution: A Comparative Study Of Ai And Human Coding Patterns, Shamma Humaid Alalawi

Thesis/ Dissertation Defenses

In recent years, artificial intelligence (AI) techniques have been used for source code authorship attribution, which is the process of identifying the original author of a given piece of code. With the advancement of AI technologies like ChatGPT, which can generate code, there is a need to accurately identify whether a piece of code is written by a human or generated by a machine. This is crucial for intellectual property protection, cybersecurity, and software forensics. The main objective of this thesis is to review existing research on source code authorship attribution and conduct several experiments to determine the best AI …

Exploring Tokenization Techniques To Optimize Patch-Based Time-Series Transformers, Gabriel L. Asher

Computer Science Senior Theses

Transformer architectures have revolutionized deep learning, impacting natural language processing and computer vision. Recently, PatchTST has advanced long-term time-series forecasting by embedding patches of time-steps to use as tokens for transformers. This study examines and seeks to enhance PatchTST's embedding techniques. Using eight benchmark datasets, we explore explore novel token embedding techniques. To this end, we introduce several PatchTST variants, which alter the embedding methods of the original paper. These variants consist of the following architectural changes: using CNNs to embed inputs to tokens, embedding an aggregate measure like the mean, max, or sum of a patch, adding the exponential …

Unveiling The Origins Of Source Code Through Authorship Attribution: A Comparative Study Of Ai And Human Coding Patterns, Shamma Humaid Alalawi

Theses

In recent years, Artificial Intelligence (AI) techniques have been used for source code authorship attribution, which is the process of identifying the original author of a given piece of code. With the advancement of AI technologies like ChatGPT, which can generate code, there is a need to accurately identify whether a piece of code is written by a human or generated by a machine. This is crucial for intellectual property protection, cybersecurity, and software forensics. The main objective of this thesis is to review existing research on source code authorship attribution and conduct several experiments to determine the best AI …

Artificial General Intelligence And The Mind-Body Problem: Exploring The Computability Of Simulated Human Intelligence In Light Of The Immaterial Mind, Caleb Parks

Senior Honors Theses

In this thesis I explore whether achieving artificial general intelligence (AGI) through simulating the human brain is theoretically possible. Because of the scientific community’s predominantly physicalist outlook on the mind-body problem, AGI research may be limited by erroneous foundational presuppositions. Arguments from linguistics and mathematics demonstrate that the human intellect is partially immaterial, opening the door for novel analysis of the mind’s simulability. I categorize mind-body problem philosophies in a manner relevant to computer science based upon state transitions, and determine their ramifications on mind-simulation. Finally, I demonstrate how classical architectures cannot resolve so-called Gödel statements, discuss why this inability …

Improving Medical Image Classification Accuracy Through Unsupervised Segmentation And Confounder Mitigation With Limited Data, Nikolai Fetisov

USF Tampa Graduate Theses and Dissertations

Medical images are indispensable for assisting health care professionals to make more accurate cancer diagnosis and prognosis decisions. Several image modalities exist including, but not limited to, histopathology or whole slide images (WSI), computed tomography (CT), positron emission tomography (PET) and radiography (i.e., X-Ray), each having their own application in clinical practice.

Today, machine learning and deep learning methods have evolved to the point of being practically usable. These approaches learn and extract knowledge from data to make possible automating certain tasks. At the point of writing this dissertation, they have reached human-level performance in general image recognition tasks, became …