Physical Sciences and Mathematics Commons^™

Wildfire Spread Prediction Using Attention Mechanisms In U-Net, Kamen Haresh Shah, Kamen Haresh Shah

Master's Theses

An investigation into using attention mechanisms for better feature extraction in wildfire spread prediction models. This research examines the U-net architecture to achieve image segmentation, a process that partitions images by classifying pixels into one of two classes. The deep learning models explored in this research integrate modern deep learning architectures, and techniques used to optimize them. The models are trained on 12 distinct observational variables derived from the Google Earth Engine catalog. Evaluation is conducted with accuracy, Dice coefficient score, ROC-AUC, and F1-score. This research concludes that when augmenting U-net with attention mechanisms, the attention component improves feature suppression …

Improving Reader Motivation With Machine Learning, Tanner A. Bohn

Electronic Thesis and Dissertation Repository

This thesis focuses on the problem of increasing reading motivation with machine learning (ML). The act of reading is central to modern human life, and there is much to be gained by improving the reading experience. For example, the internal reading motivation of students, especially their interest and enjoyment in reading, are important factors in their academic success.

There are many topics in natural language processing (NLP) which can be applied to improving the reading experience in terms of readability, comprehension, reading speed, motivation, etc. Such topics include personalized recommendation, headline optimization, text simplification, and many others. However, to the …

Generating Effective Sentence Representations: Deep Learning And Reinforcement Learning Approaches, Mahtab Ahmed

Electronic Thesis and Dissertation Repository

Natural language processing (NLP) is one of the most important technologies of the information age. Understanding complex language utterances is also a crucial part of artificial intelligence. Many Natural Language applications are powered by machine learning models performing a large variety of underlying tasks. Recently, deep learning approaches have obtained very high performance across many NLP tasks. In order to achieve this high level of performance, it is crucial for computers to have an appropriate representation of sentences. The tasks addressed in the thesis are best approached having shallow semantic representations. These representations are vectors that are then embedded in …

Impromptune: Symbolic Music Generation With Relative Attention Mechanisms, Connor J. Lennox

Honors Theses and Capstones

By combining attention-based mechanisms that have proved beneficial in the field of natural language processing with domain-specific knowledge about the structure of music, better predictions about piece continuations can be made. The goal of this work is to adapt current natural language processing techniques to a musical domain, and to generate new music by predicting continuations on a sequence of notes. An adaptation of traditional attention mechanisms to create a single prediction from sequential input is used to extend musical pieces by appending new elements repeatedly.