Computational Engineering Commons^™

Improving Semantic Precision In Text-To-Image Diffusion Models Via Latent-Space Optimization And Semantically-Parsed Evaluation, Mohammad Rouie Miab

McKelvey School of Engineering Graduate Student Theses & Dissertations

Text-to-image diffusion models can produce visually impressive images from natural-language prompts, but they often fail to satisfy the detailed semantic constraints expressed in compositional prompts. Typical failure modes include omitted objects, merged entities, incorrect quantities, incorrect attribute binding, and leakage of one entity's attributes onto another. This thesis studies the problem of semantic precision in text-to-image generation: how faithfully a generated image satisfies the structured meaning of its prompt.   The thesis makes two linked contributions. First, it presents a training-free inference-time refinement method for diffusion-based image generation. The method operates directly in latent space during denoising and uses noun-phrase-aware cross-attention …

The Digital Neuron: Neural Cellular Automata For Neural–Symbolic Translation, Nicole Assenza

SMU Data Science Review

A neural cellular automata (NCA) architecture, referred to as Pluto’s NCA, was developed to characterize bilateral communication and semantic reciprocity between symbolic representations and a spatially distributed update field. The architecture employs an encoder–automata–decoder pipeline that maps symbolic inputs into a multichannel state field and reconstructs them through agreement-driven attractor convergence within a stable semantic attractor landscape. System behavior was evaluated under controlled perturbations, including rhythmic desynchronization, graded ablations, correlated and independent noise, and percolation-based structural degradation. Quantities such as Agreement(t), internal coherence Aᵢ(t), the recovery time constant τ, and the critical percolation threshold pc were measured to assess stability, …

A Novel Federated Llm Framework For Distributed Traffic Modelling In Intelligent Transportation Systems, Seerat Kaur

Theses and Dissertations (Comprehensive)

Intelligent transportation systems (ITS) depend on accurate traffic prediction to support congestion management, infrastructure planning, and real-time operational decisions. Despite substantial progress in data-driven forecasting, several challenges continue to limit practical deployment: traffic data is distributed across independent regional authorities, making centralized aggregation infeasible, standard federated aggregation strategies ignore traffic-specific characteristics that meaningfully affect model quality, and existing models produce only numerical outputs without interpretable reasoning that urban planners can act upon. This thesis addresses these challenges through four contributions that collectively advance privacy-preserving, explainable, and scalable traffic forecasting.

The first contribution provides a systematic review of 129 peer-reviewed publications, …

Prism (Proxy Recognition And Inclusion Scoring Method), Destiny Raburnel, Crystal Tubbs, Md Abdullah Al Hafiz Khan

Symposium of Student Scholars

AI-driven automated hiring tools are reshaping how companies find talent, but they often reproduce the hidden biases embedded in their training data. Our project, PRISM (Proxy Recognition and Inclusion Scoring Method), investigates how subtle demographic signals, specifically first names associated with gender and race, influence AI resume screening even when candidates have identical qualifications. We built a controlled dataset of resumes that are identical in every way except for the applicant's first name, with each resume using a racially neutral surname to isolate how first names alone affect scoring. We tested these resumes against job postings in technology, healthcare, and …

A Predictive Model For Multi- Week Respiratory Risk From Red Tide On Florida’S Gulf Coast., Elmer S. Ochaeta

Computer Science and Engineering Faculty Publications

Florida’s Gulf Coast red tide (Karenia brevis) can put toxins into the air, making people cough, irritating the throat, and worsening asthma or other breathing problems especially when winds blow from the ocean toward the beach. Right now, most public updates don’t really help with the question people actually ask when planning a weekend or vacation: “Will going to or close to the beach be risky in the next few weeks?”.

In this project, I build a weekly early warning system that estimates respiratory risk for specific beaches and predicts that risk 2 to 4 weeks ahead. The study covers …

Iso-Detr: A Novel Detection Transformer For Industrial Small Object Detection, Faisal Saeed, Anand Paul

School of Public Health Faculty Publications

Effectively detecting and assessing real-time structural and ecological parameters in contemporary manufacturing environments poses significant challenges, particularly in identifying minute objects within product images. The swift evolution of the industrial sector underscores the necessity for intelligent manufacturing environments to uphold stringent product quality standards. However, accelerating production processes at high speeds heightens the risk of defective product outcomes. This research addresses the challenges inherent in small object detection within industrial contexts, proposing an innovative detection transformer model tailored to modern manufacturing environments. The proposed model integrates a feature-enhanced multi-head self-attention block (FEMSA), merging cross-channel communication network and multiple multi-head self-attention …

Human Identification And Action Recognition Using Small Data And Deep Domain Adaptation, Alexander M. Glandon

Electrical & Computer Engineering Theses & Dissertations

Human identification and human action recognition problems are two important research areas for real-world security and surveillance applications. In both human identification and action recognition, it is necessary to operate by collecting small datasets in the field, possibly in a short time window of observation. This dissertation studies and develops computational modeling and high-performance machine learning (ML) and deep learning (DL) models for human identification and human action recognition using small amounts of data. These methods and computational models may be useful for different security and surveillance applications.

This dissertation on human recognition develops a ML computational model to estimate …

Collaborative Ai: Oer Materials For Exploring Ai As A Partner Rather Than A Tool, David Smith

Open Educational Resources

The Collaborative AI Open Educational Resource (OER) explores how artificial intelligence can act as a creative and analytical collaborator rather than a tool. Centered on the Balanced Blended Space (BBS) framework and the philosophy of the Center for Holistic Integration (CHI), the OER includes curriculum materials, theoretical models, and live research environments. It offers an interesting approach to blending physical, virtual, and conceptual spaces through shared human–AI agency and invites ongoing participation in interdisciplinary meta-projects.

Cognitive Map Generation For Vision And Language Navigation, Alexander Sandoval Mesa

Dissertations and Theses

Visual-Language Navigation (VLN) presents significant challenges for autonomous agents, such as robots and virtual assistants, particularly in complex, dynamic environments where the seamless integration of visual perception and natural language understanding is critical. Traditional VLN systems often struggle with effectively aligning language instructions and visual scene understanding, limiting their adaptability and navigation efficiency.

This thesis proposes a novel Cognitive Map-based framework that addresses these challenges by transforming natural language navigation instructions into structured graph representations. The Cognitive Map consists of nodes representing waypoints, landmarks, decision points, and edges encoding spatial relationships and navigational actions. These maps are generated using Large …

Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen

Computer Science and Engineering Theses and Dissertations

Scientific paper recommendation systems aim to help researchers discover relevant papers amidst the vast and ever-growing body of literature. With the exponential yearly increase in scientific publications, the demand for effective paper recommendation solutions has become both critical and increasingly challenging. In recent years, deep learning techniques have revolutionized recommender systems, and scientific paper recommendations have naturally integrated these advancements. In this dissertation, we address these challenges through three progressive contributions.

First, we enhance traditional content-based methods using Graph Neural Networks (GNNs) by introducing a Graph Convolutional Network-strengthened Topic Modeling (GCN-TM) approach. This method improves upon conventional topic modeling techniques …

Development Of A Rule-Based Monitoring System For Autonomous Heavy Equipment Safety, Amirpooya Shirazi

Department of Construction Engineering and Management: Dissertations, Theses, and Student Research

Roadway construction work zones are constantly exposed to interactions among construction equipment, workers, and vehicles. Furthermore, ensuring safety in these areas is considered a challenging task due to the complexity of the environment. As shown in the rising trend of fatal accidents in roadway work zones, current OSHA regulations in construction safety are insufficient in effectively detecting unsafe situations and mitigating the risks. Furthermore, best practices, such as internal traffic control planning (ITCP), exhibit critical limitations requiring continuous monitoring of active work zones as well as adjustments to the site coordination plans due to the dynamic nature of work zone …

Computational Modeling And Analysis Of Facial Expressions And Gaze For Discovery Of Candidate Behavioral Biomarkers For Children And Young Adults With Autism Spectrum Disorder, Megan Anita Witherow

Electrical & Computer Engineering Theses & Dissertations

Facial expression production and perception in autism spectrum disorder (ASD) suggest the potential presence of behavioral biomarkers that may stratify individuals on the spectrum into prognostic or treatment subgroups. High-speed internet and the ease of technology have enabled remote, scalable, affordable, and timely access to medical care, such as measurements of ASDrelated behaviors in familiar environments to complement clinical observation. Machine and deep learning (DL)-based analysis of video tracking (VT) of expression production and eye tracking (ET) of expression perception may aid stratification biomarker discovery for children and young adults with ASD. However, there are open challenges in 1) facial …

Path-Bigbird: An Ai-Driven Transformer Approach To Classification Of Cancer Pathology Reports, Mayanka Chandrashekar, Isaac Lyngaas, Heidi A. Hanson, Shang Gao, Xiao Cheng Wu, John Gounley

School of Public Health Faculty Publications

PURPOSE: Surgical pathology reports are critical for cancer diagnosis and management. To accurately extract information about tumor characteristics from pathology reports in near real time, we explore the impact of using domain-specific transformer models that understand cancer pathology reports. METHODS: We built a pathology transformer model, Path-BigBird, by using 2.7 million pathology reports from six SEER cancer registries. We then compare different variations of Path-BigBird with two less computationally intensive methods: Hierarchical Self-Attention Network (HiSAN) classification model and an off-the-shelf clinical transformer model (Clinical BigBird). We use five pathology information extraction tasks for evaluation: site, subsite, laterality, histology, and behavior. …

Adaptable And Trustworthy Machine Learning For Human Activity Recognition From Bioelectric Signals, Morgan S. Stuart

Theses and Dissertations

Enabling machines to learn measures of human activity from bioelectric signals has many applications in human-machine interaction and healthcare. However, labeled activity recognition datasets are costly to collect and highly varied, which challenges machine learning techniques that rely on large datasets. Furthermore, activity recognition in practice needs to account for user trust - models are motivated to enable interpretability, usability, and information privacy. The objective of this dissertation is to improve adaptability and trustworthiness of machine learning models for human activity recognition from bioelectric signals. We improve adaptability by developing pretraining techniques that initialize models for later specialization to unseen …

Adaptive Neh With Constrained Nearest Neighbor Subtours For The Electric Vehicle Routing Problem With Time Windows, Andrew Struthers

All Master's Theses

The development of electric vehicles is currently considered one of the most innovative areas in manufacturing. Largely driven by the desire to reduce greenhouse emissions, electric vehicles are seen as a viable alternative to internal combustion engine cars. Starting from consumer cars, a dedicated effort is being made to translate this into commercial vehicles for freight and delivery. This research introduces a novel adaptive Nawaz, Enscore, Ham (NEH) algorithm with constrained nearest neighbor subtour (NEH-NN). This algorithm is tested on the standard benchmark problems in literature and used as a seed solution for the Genetic Algorithm (GA). The performance and …

The Integration Of Neuromorphic Computing In Autonomous Robotic Systems, Md Abu Bakr Siddique

Dissertations, Master's Theses and Master's Reports

Deep Neural Networks (DNNs) have come a long way in many cognitive tasks by training on large, labeled datasets. However, this method has problems in places with limited data and energy, like when planetary robots are used or when edge computing is used [1]. In contrast to this data-heavy approach, animals demonstrate an innate ability to learn by communicating with their environment and forming associative memories among events and entities, a process known as associative learning [2-4]. For instance, rats in a T-maze learn to associate different stimuli with outcomes through exploration without needing labeled data [5]. This learning paradigm …

Disentangling Cyclic Causality: An Instance-Based Framework For Causal Discovery, Chase A. Yakaboski

Dartmouth College Ph.D Dissertations

Correlation does not imply causation" is one of the fundamental principles taught in science, emphasizing that associations between variables do not necessarily indicate causality. Yet, over the past three decades, extensive research has begun to challenge this perspective by developing sophisticated methods to differentiate causal from correlative relationships. This research suggests that correlations often involve a blend of confounded and causal interactions, which, given certain assumptions, can be disentangled to uncover actionable insights and deepen our understanding of physical, biological, and societal systems.

Accurately discovering causal relationships from data amidst cyclic dynamics remains a challenging open problem in causality research. …

Balanced Blended Space: Proposing A Universal Theoretical Framework For Combinative Reality, David Smith, Frederick Bianchi

Publications and Research

In today's fragmented societies, a unified framework for communication and collaboration across different realities is crucial. We introduce Balanced Blended Space (BBS) as a framework for describing combinative reality, encompassing virtual, physical, and conceptual realms, all intrinsically connected. Interactions within these environments shape our perceptual space. This paper outlines key axiomatic assumptions, criteria for a universal framework, and fundamental terminology. We identify deep symmetries enabling the BBS framework, including Cognitive and Computational Symmetry, Physical and Virtual Symmetry, Mediation Pathway Symmetry, Space-Time Symmetry, and Sensory Symmetry. We propose tests to determine its viability, emphasizing virtual intelligence as a collaborative partner. We …

Machine Learning-Based Data And Model Driven Bayesian Uncertanity Quantification Of Inverse Problems For Suspended Non-Structural System, Zhiyuan Qin

All Dissertations

Inverse problems involve extracting the internal structure of a physical system from noisy measurement data. In many fields, the Bayesian inference is used to address the ill-conditioned nature of the inverse problem by incorporating prior information through an initial distribution. In the nonparametric Bayesian framework, surrogate models such as Gaussian Processes or Deep Neural Networks are used as flexible and effective probabilistic modeling tools to overcome the high-dimensional curse and reduce computational costs. In practical systems and computer models, uncertainties can be addressed through parameter calibration, sensitivity analysis, and uncertainty quantification, leading to improved reliability and robustness of decision and …

Achieving Causal Fairness In Recommendation, Wen Huang

Graduate Theses and Dissertations

Recommender systems provide personalized services for users seeking information and play an increasingly important role in online applications. While most research papers focus on inventing machine learning algorithms to fit user behavior data and maximizing predictive performance in recommendation, it is also very important to develop fairness-aware machine learning algorithms such that the decisions made by them are not only accurate but also meet desired fairness requirements. In personalized recommendation, although there are many works focusing on fairness and discrimination, how to achieve user-side fairness in bandit recommendation from a causal perspective still remains a challenging task. Besides, the deployed …

Statistical Approach To Quantifying Interceptability Of Interaction Scenarios For Testing Autonomous Surface Vessels, Benjamin E. Hargis, Yiannis E. Papelis

Modeling, Simulation and Visualization Student Capstone Conference

This paper presents a probabilistic approach to quantifying interceptability of an interaction scenario designed to test collision avoidance of autonomous navigation algorithms. Interceptability is one of many measures to determine the complexity or difficulty of an interaction scenario. This approach uses a combined probability model of capability and intent to create a predicted position probability map for the system under test. Then, intercept-ability is quantified by determining the overlap between the system under test probability map and the intruder’s capability model. The approach is general; however, a demonstration is provided using kinematic capability models and an odometry-based intent model.

Towards Nlp-Based Conceptual Modeling Frameworks, David Shuttleworth, Jose Padilla

Modeling, Simulation and Visualization Student Capstone Conference

This paper presents preliminary research using Natural Language Processing (NLP) to support the development of conceptual modeling frameworks. NLP-based frameworks are intended to lower the barrier of entry for non-modelers to develop models and to facilitate communication across disciplines considering simulations in research efforts. NLP drives conceptual modeling in two ways. Firstly, it attempts to automate the generation of conceptual models and simulation specifications, derived from non-modelers’ narratives, while standardizing the conceptual modeling process and outcome. Secondly, as the process is automated, it is simpler to replicate and be followed by modelers and non-modelers. This allows for using a common …

Lidar Buoy Detection For Autonomous Marine Vessel Using Pointnet Classification, Christopher Adolphi, Dorothy Dorie Parry, Yaohang Li, Masha Sosonkina, Ahmet Saglam, Yiannis E. Papelis

Modeling, Simulation and Visualization Student Capstone Conference

Maritime autonomy, specifically the use of autonomous and semi-autonomous maritime vessels, is a key enabling technology supporting a set of diverse and critical research areas, including coastal and environmental resilience, assessment of waterway health, ecosystem/asset monitoring and maritime port security. Critical to the safe, efficient and reliable operation of an autonomous maritime vessel is its ability to perceive on-the-fly the external environment through onboard sensors. In this paper, buoy detection for LiDAR images is explored by using several tools and techniques: machine learning methods, Unity Game Engine (herein referred to as Unity) simulation, and traditional image processing. The Unity Game …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Drone Detection Using Yolov5, Burchan Aydin, Subroto Singha

Faculty Publications

The rapidly increasing number of drones in the national airspace, including those for recreational and commercial applications, has raised concerns regarding misuse. Autonomous drone detection systems offer a probable solution to overcoming the issue of potential drone misuse, such as drug smuggling, violating people’s privacy, etc. Detecting drones can be difficult, due to similar objects in the sky, such as airplanes and birds. In addition, automated drone detection systems need to be trained with ample amounts of data to provide high accuracy. Real-time detection is also necessary, but this requires highly configured devices such as a graphical processing unit (GPU). …

Neuromorphic Computing Applications In Robotics, Noah Zins

Dissertations, Master's Theses and Master's Reports

Deep learning achieves remarkable success through training using massively labeled datasets. However, the high demands on the datasets impede the feasibility of deep learning in edge computing scenarios and suffer from the data scarcity issue. Rather than relying on labeled data, animals learn by interacting with their surroundings and memorizing the relationships between events and objects. This learning paradigm is referred to as associative learning. The successful implementation of associative learning imitates self-learning schemes analogous to animals which resolve the challenges of deep learning. Current state-of-the-art implementations of associative memory are limited to simulations with small-scale and offline paradigms. Thus, …

Liquid Tab, Nathan Hulet

Williams Honors College, Honors Research Projects

Guitar transcription is a complex task requiring significant time, skill, and musical knowledge to achieve accurate results. Since most music is recorded and processed digitally, it would seem like many tools to digitally analyze and transcribe the audio would be available. However, the problem of automatic transcription presents many more difficulties than are initially evident. There are multiple ways to play a guitar, many diverse styles of playing, and every guitar sounds different. These problems become even more difficult considering the varying qualities of recordings and levels of background noise.

Machine learning has proven itself to be a flexible tool …

Wildfire Spread Prediction Using Attention Mechanisms In U-Net, Kamen Haresh Shah, Kamen Haresh Shah

Master's Theses

An investigation into using attention mechanisms for better feature extraction in wildfire spread prediction models. This research examines the U-net architecture to achieve image segmentation, a process that partitions images by classifying pixels into one of two classes. The deep learning models explored in this research integrate modern deep learning architectures, and techniques used to optimize them. The models are trained on 12 distinct observational variables derived from the Google Earth Engine catalog. Evaluation is conducted with accuracy, Dice coefficient score, ROC-AUC, and F1-score. This research concludes that when augmenting U-net with attention mechanisms, the attention component improves feature suppression …

Single-Pass Inline Pipeline 3d Reconstruction Using Depth Camera Array, Zhexiong Shang, Zhigang Shen

Department of Construction Engineering and Management: Faculty Publications

A novel inline inspection (ILI) approach using depth cameras array (DCA) is introduced to create high-fidelity, dense 3D pipeline models. A new camera calibration method is introduced to register the color and the depth information of the cameras into a unified pipe model. By incorporating the calibration outcomes into a robust camera motion estimation approach, dense and complete 3D pipe surface reconstruction is achieved by using only the inline image data collected by a self-powered ILI rover in a single pass through a straight pipeline. The outcomes of the laboratory experiments demonstrate one-millimeter geometrical accuracy and 0.1-pixel photometric accuracy. …

Intra-Hour Solar Forecasting Using Cloud Dynamics Features Extracted From Ground-Based Infrared Sky Images, Guillermo Terrén-Serrano

Electrical and Computer Engineering ETDs

Due to the increasing use of photovoltaic systems, power grids are vulnerable to the projection of shadows from moving clouds. An intra-hour solar forecast provides power grids with the capability of automatically controlling the dispatch of energy, reducing the additional cost for a guaranteed, reliable supply of energy (i.e., energy storage). This dissertation introduces a novel sky imager consisting of a long-wave radiometric infrared camera and a visible light camera with a fisheye lens. The imager is mounted on a solar tracker to maintain the Sun in the center of the images throughout the day, reducing the scattering effect produced …