Open Access. Powered by Scholars. Published by Universities.®

Computational Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences

Institution
Keyword
Publication Year
Publication
Publication Type

Articles 1 - 30 of 187

Full-Text Articles in Computational Engineering

From Code To Cube: Interactive Fluid Simulation With Real Time Motion Control, Dominic Ziccardi, Carter Groezinger Aug 2026

From Code To Cube: Interactive Fluid Simulation With Real Time Motion Control, Dominic Ziccardi, Carter Groezinger

Discovery Day - Daytona Beach

This research project explores the use of FluidX3D, an open-source lattice Boltzmann method (LBM) solver, to simulate fluid behavior within a three-dimensional cube container. The system supports both standard water models and rheoscopic fluid visualization, allowing detailed observation of complex flow dynamics in real time. The simulation accurately represents fluid motion, gravity-driven behavior, and rotational response within a bounded cubic domain. The longterm objective is to extend this digital simulation into a physical installation consisting of six synchronized square displays arranged to form a cube. This configuration will create a volumetric illusion of fluid occupying a tangible, handheld structure. An …


Contemporary Cybersecurity Challenges In Emerging Technologies: A Systematic Literature Analysis, Faztudo Languisse Prof Jul 2026

Contemporary Cybersecurity Challenges In Emerging Technologies: A Systematic Literature Analysis, Faztudo Languisse Prof

Journal of Cybersecurity Education, Research and Practice

The accelerating convergence of artificial intelligence (AI), the Internet of Things (IoT), cloud computing, blockchain, and quantum computing has fundamentally transformed the global threat landscape, introducing cybersecurity challenges of unprecedented complexity and scale. This systematic literature review synthesizes findings from peer-reviewed publications, institutional reports, and regulatory documents published primarily between 2020 and 2025 to provide an integrated analysis of contemporary cybersecurity challenges across five key emerging technology domains. The review identifies critical vulnerabilities inherent to each domain, documents the evolution of threat actors and attack methodologies — including AI-powered ransomware, adversarial machine learning, and harvest-now-decrypt-later quantum attacks — and evaluates …


Improving Semantic Precision In Text-To-Image Diffusion Models Via Latent-Space Optimization And Semantically-Parsed Evaluation, Mohammad Rouie Miab May 2026

Improving Semantic Precision In Text-To-Image Diffusion Models Via Latent-Space Optimization And Semantically-Parsed Evaluation, Mohammad Rouie Miab

McKelvey School of Engineering Graduate Student Theses & Dissertations

Text-to-image diffusion models can produce visually impressive images from natural-language prompts, but they often fail to satisfy the detailed semantic constraints expressed in compositional prompts. Typical failure modes include omitted objects, merged entities, incorrect quantities, incorrect attribute binding, and leakage of one entity's attributes onto another. This thesis studies the problem of semantic precision in text-to-image generation: how faithfully a generated image satisfies the structured meaning of its prompt.   The thesis makes two linked contributions. First, it presents a training-free inference-time refinement method for diffusion-based image generation. The method operates directly in latent space during denoising and uses noun-phrase-aware cross-attention …


Hdra-Fusion: Hybrid Detection With Routed Architecture For Manipulation-Aware Ai Face Forgery Detection, Omar Ebeid May 2026

Hdra-Fusion: Hybrid Detection With Routed Architecture For Manipulation-Aware Ai Face Forgery Detection, Omar Ebeid

Theses and Dissertations

With the rapid advancements in artificial intelligence-based image generation and manipulation tools, it is extremely difficult to detect if an image is genuine or artificially crafted. Despite extensive research in this area, existing image detection systems suffer from three major problems: suboptimal cross-dataset generalization due to shortcut learning of dataset-specific patterns, unreliable probability estimates due to domain shift, particularly in cross-manipulation evaluation settings, and an inability to detect images manipulated by multiple types of manipulations within a single detection framework. To address these limitations, we propose HDRA-Fusion (Hybrid Detection with Routed Architecture), a framework built on the conclusion that different …


The Digital Neuron: Neural Cellular Automata For Neural–Symbolic Translation, Nicole Assenza Apr 2026

The Digital Neuron: Neural Cellular Automata For Neural–Symbolic Translation, Nicole Assenza

SMU Data Science Review

A neural cellular automata (NCA) architecture, referred to as Pluto’s NCA, was developed to characterize bilateral communication and semantic reciprocity between symbolic representations and a spatially distributed update field. The architecture employs an encoder–automata–decoder pipeline that maps symbolic inputs into a multichannel state field and reconstructs them through agreement-driven attractor convergence within a stable semantic attractor landscape. System behavior was evaluated under controlled perturbations, including rhythmic desynchronization, graded ablations, correlated and independent noise, and percolation-based structural degradation. Quantities such as Agreement(t), internal coherence Aᵢ(t), the recovery time constant τ, and the critical percolation threshold pc were measured to assess stability, …


A Virtual-Reality-Based Dental Simulator For Endodontics With Automated Formative Feedback, Yousef Salah Abo El Ela Jan 2026

A Virtual-Reality-Based Dental Simulator For Endodontics With Automated Formative Feedback, Yousef Salah Abo El Ela

Theses and Dissertations

Advancements in virtual reality (VR) and haptic technology are transforming the landscape of medical and dental education, offering new avenues for safe, immersive, and repeatable training experiences. Within dentistry, endodontics presents unique challenges for preclinical education due to anatomical complexity, limited access to extracted teeth, ethical concerns, and the shortcomings of conventional plastic models. Despite endodontics specific plastic teeth being available, they fall short of replicating the hardness of real extracted teeth, are relatively costly compared to generic plastic teeth, and are ultimately a disposable item which makes them inadequate as a sustainable long-term solution. Extracted teeth do a much …


A Novel Federated Llm Framework For Distributed Traffic Modelling In Intelligent Transportation Systems, Seerat Kaur Jan 2026

A Novel Federated Llm Framework For Distributed Traffic Modelling In Intelligent Transportation Systems, Seerat Kaur

Theses and Dissertations (Comprehensive)

Intelligent transportation systems (ITS) depend on accurate traffic prediction to support congestion management, infrastructure planning, and real-time operational decisions. Despite substantial progress in data-driven forecasting, several challenges continue to limit practical deployment: traffic data is distributed across independent regional authorities, making centralized aggregation infeasible, standard federated aggregation strategies ignore traffic-specific characteristics that meaningfully affect model quality, and existing models produce only numerical outputs without interpretable reasoning that urban planners can act upon. This thesis addresses these challenges through four contributions that collectively advance privacy-preserving, explainable, and scalable traffic forecasting.

The first contribution provides a systematic review of 129 peer-reviewed publications, …


Prism (Proxy Recognition And Inclusion Scoring Method), Destiny Raburnel, Crystal Tubbs, Md Abdullah Al Hafiz Khan Dec 2025

Prism (Proxy Recognition And Inclusion Scoring Method), Destiny Raburnel, Crystal Tubbs, Md Abdullah Al Hafiz Khan

Symposium of Student Scholars

AI-driven automated hiring tools are reshaping how companies find talent, but they often reproduce the hidden biases embedded in their training data. Our project, PRISM (Proxy Recognition and Inclusion Scoring Method), investigates how subtle demographic signals, specifically first names associated with gender and race, influence AI resume screening even when candidates have identical qualifications. We built a controlled dataset of resumes that are identical in every way except for the applicant's first name, with each resume using a racially neutral surname to isolate how first names alone affect scoring. We tested these resumes against job postings in technology, healthcare, and …


A Predictive Model For Multi- Week Respiratory Risk From Red Tide On Florida’S Gulf Coast., Elmer S. Ochaeta Dec 2025

A Predictive Model For Multi- Week Respiratory Risk From Red Tide On Florida’S Gulf Coast., Elmer S. Ochaeta

Computer Science and Engineering Faculty Publications

Florida’s Gulf Coast red tide (Karenia brevis) can put toxins into the air, making people cough, irritating the throat, and worsening asthma or other breathing problems especially when winds blow from the ocean toward the beach. Right now, most public updates don’t really help with the question people actually ask when planning a weekend or vacation: “Will going to or close to the beach be risky in the next few weeks?”.

In this project, I build a weekly early warning system that estimates respiratory risk for specific beaches and predicts that risk 2 to 4 weeks ahead. The study covers …


Iso-Detr: A Novel Detection Transformer For Industrial Small Object Detection, Faisal Saeed, Anand Paul Dec 2025

Iso-Detr: A Novel Detection Transformer For Industrial Small Object Detection, Faisal Saeed, Anand Paul

School of Public Health Faculty Publications

Effectively detecting and assessing real-time structural and ecological parameters in contemporary manufacturing environments poses significant challenges, particularly in identifying minute objects within product images. The swift evolution of the industrial sector underscores the necessity for intelligent manufacturing environments to uphold stringent product quality standards. However, accelerating production processes at high speeds heightens the risk of defective product outcomes. This research addresses the challenges inherent in small object detection within industrial contexts, proposing an innovative detection transformer model tailored to modern manufacturing environments. The proposed model integrates a feature-enhanced multi-head self-attention block (FEMSA), merging cross-channel communication network and multiple multi-head self-attention …


Universal Systems Simulation Via Constraint Hypergraphs With Applications To Digital Twins, John Morris Dec 2025

Universal Systems Simulation Via Constraint Hypergraphs With Applications To Digital Twins, John Morris

All Dissertations

The characterization of systems encompasses a variety of modeling frameworks designed to capture specific behaviors and components of various system domains. Whatever the framework, the core elements of a system representation are the information of the system and a description of how that information is related. The relations in deterministic systems are functions, which, when composed to form executable processes, can be used to simulate system data. A declarative modeling framework is one that encodes mechanisms for preparing these simulations within the model structure, allowing an external agent to form the execution processes required for a given context. To date, …


Human Identification And Action Recognition Using Small Data And Deep Domain Adaptation, Alexander M. Glandon Dec 2025

Human Identification And Action Recognition Using Small Data And Deep Domain Adaptation, Alexander M. Glandon

Electrical & Computer Engineering Theses & Dissertations

Human identification and human action recognition problems are two important research areas for real-world security and surveillance applications. In both human identification and action recognition, it is necessary to operate by collecting small datasets in the field, possibly in a short time window of observation. This dissertation studies and develops computational modeling and high-performance machine learning (ML) and deep learning (DL) models for human identification and human action recognition using small amounts of data. These methods and computational models may be useful for different security and surveillance applications.

This dissertation on human recognition develops a ML computational model to estimate …


Modeling Synaptic Dysfunction As Neural Contagion: A Graph-Based Sedr Framework For Simulating Signal Spread, Michelle Marfo, Dr. Padmanabhan Seshaiyer, Alonso Ogueda-Oliva Nov 2025

Modeling Synaptic Dysfunction As Neural Contagion: A Graph-Based Sedr Framework For Simulating Signal Spread, Michelle Marfo, Dr. Padmanabhan Seshaiyer, Alonso Ogueda-Oliva

Annual Symposium on Biomathematics and Ecology Education and Research

No abstract provided.


Using Gaussian Process Regression To Learn Thermodynamic Equations Of State With Uncertainty Quantification, Austen T. Lee May 2025

Using Gaussian Process Regression To Learn Thermodynamic Equations Of State With Uncertainty Quantification, Austen T. Lee

Chemical Engineering Undergraduate Honors Theses

This study investigates the use of derivative-informed Gaussian Process (GP) models to estimate thermodynamic behavior across temperature and density by building a Helmholtz-based equation of state. Argon, a stable monatomic gas, was chosen as a case study within the vapor region. The GP model was trained using values of experimentally measurable properties found by taking first and second derivatives of the original potential function. Results show that while the GP model offered uncertainty quantification and informed thermodynamic behavior, it predicted values that deviated from the ground truth depending on the property. The model exhibited high confidence in regions with substantial …


A Formal Simulation Model For Discrete Rate Simulation, Thomas J. Tracey Apr 2025

A Formal Simulation Model For Discrete Rate Simulation, Thomas J. Tracey

Electrical & Computer Engineering Theses & Dissertations

Simulation is an essential tool for virtualizing systems by creating a representative model of real or hypothetical systems and observing how they change over time. Two predominant simulation paradigms include Discrete Event Simulation (DES) and Continuous Simulation, which both have their strengths and weaknesses. DES does not handle continuous state variables, while continuous simulation handles continuous state variables but encounters errors where these variables have discrete changes in their behavior. This difficulty between the two predominant simulation paradigms prompted the creation of a new simulation paradigm to cover this gap: Discrete Rate Simulation (DRS). DRS as a simulation paradigm focuses …


Testing Autonomy: Hybrid Scenario Synthesis, Benjamin E. Hargis Apr 2025

Testing Autonomy: Hybrid Scenario Synthesis, Benjamin E. Hargis

Electrical & Computer Engineering Theses & Dissertations

Hybrid Scenario Synthesis merges static and adaptive techniques to generate interactions that rigorously assess autonomous performance under multi-factor testing. Multifactor scenarios employ multiple individual stimuli to rigorously test system responses in complex settings. Static Scenario Testing involves scripted test cases that simulate specific conditions or events. These scenarios represent typical situations an autonomous system might encounter. The benefits of static testing include early defect detection, focused review by trained experts, and efficiency. In multi-factor scenarios, however, statically defined scenario factors are not able to guarantee meaningful interactions as the presence of other factors may invalidate underlying assumptions regarding the system …


Collaborative Ai: Oer Materials For Exploring Ai As A Partner Rather Than A Tool, David Smith Mar 2025

Collaborative Ai: Oer Materials For Exploring Ai As A Partner Rather Than A Tool, David Smith

Open Educational Resources

The Collaborative AI Open Educational Resource (OER) explores how artificial intelligence can act as a creative and analytical collaborator rather than a tool. Centered on the Balanced Blended Space (BBS) framework and the philosophy of the Center for Holistic Integration (CHI), the OER includes curriculum materials, theoretical models, and live research environments. It offers an interesting approach to blending physical, virtual, and conceptual spaces through shared human–AI agency and invites ongoing participation in interdisciplinary meta-projects.


Modelled Flooding Impacts On Lower Fish River Watershed, Sebastian Loschner Mar 2025

Modelled Flooding Impacts On Lower Fish River Watershed, Sebastian Loschner

Shelby Hall Graduate Research Forum Posters

This study investigates the impacts of compound flooding in the Lower Fish River watershed, Baldwin County, Alabama, with a focus on the potential effects of sea level rise due to climate change. Coastal flooding, particularly in smaller watersheds, is a growing concern as it results from the interaction of multiple factors, including rainfall, tidal changes, and extreme weather events. Compound flooding, which involves multiple flood drivers, is expected to worsen with climate change, as increased precipitation and rising sea levels create heightened flood risks. However, existing research on compound flooding predominantly focuses on large-scale watersheds, leaving a knowledge gap in …


Cognitive Map Generation For Vision And Language Navigation, Alexander Sandoval Mesa Jan 2025

Cognitive Map Generation For Vision And Language Navigation, Alexander Sandoval Mesa

Dissertations and Theses

Visual-Language Navigation (VLN) presents significant challenges for autonomous agents, such as robots and virtual assistants, particularly in complex, dynamic environments where the seamless integration of visual perception and natural language understanding is critical. Traditional VLN systems often struggle with effectively aligning language instructions and visual scene understanding, limiting their adaptability and navigation efficiency.

This thesis proposes a novel Cognitive Map-based framework that addresses these challenges by transforming natural language navigation instructions into structured graph representations. The Cognitive Map consists of nodes representing waypoints, landmarks, decision points, and edges encoding spatial relationships and navigational actions. These maps are generated using Large …


Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen Dec 2024

Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen

Computer Science and Engineering Theses and Dissertations

Scientific paper recommendation systems aim to help researchers discover relevant papers amidst the vast and ever-growing body of literature. With the exponential yearly increase in scientific publications, the demand for effective paper recommendation solutions has become both critical and increasingly challenging. In recent years, deep learning techniques have revolutionized recommender systems, and scientific paper recommendations have naturally integrated these advancements. In this dissertation, we address these challenges through three progressive contributions.

First, we enhance traditional content-based methods using Graph Neural Networks (GNNs) by introducing a Graph Convolutional Network-strengthened Topic Modeling (GCN-TM) approach. This method improves upon conventional topic modeling techniques …


Ai Bioelectricity Management System, Fungai Jacqueline Kiwa, Tawanda Bundukutu, Thoko Matnell Mawoyo, Batsiranai Linda Chiduku, Martin Muduva, Belinda Ndlovu Sep 2024

Ai Bioelectricity Management System, Fungai Jacqueline Kiwa, Tawanda Bundukutu, Thoko Matnell Mawoyo, Batsiranai Linda Chiduku, Martin Muduva, Belinda Ndlovu

African Conference on Information Systems and Technology

This document emphasizes on the generation of electricity from trees and its usability in all the sectors of Zimbabwe. The research focused on positively changing the lives of citizens through the provision of uninterrupted and reliable bioelectricity. The literature review was completely and accurately performed through finding out the current news associated with the use of trees in producing electricity and the use of AI to manage the flow. The Scrum’s development model was adopted and followed during the research project to address issues like transparency, early mitigation of risks and constant feedback. The Scrum-model is one of the best …


Aligning Human And Computational Coherence Evaluations, Jia Peng Lim, Hady Wirawan Lauw Sep 2024

Aligning Human And Computational Coherence Evaluations, Jia Peng Lim, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Automated coherence metrics constitute an efficient and popular way to evaluate topic models. Previous work presents a mixed picture of their presumed correlation with human judgment. This work proposes a novel sampling approach to mining topic representations at a large scale while seeking to mitigate bias from sampling, enabling the investigation of widely used automated coherence metrics via large corpora. Additionally, this article proposes a novel user study design, an amalgamation of different proxy tasks, to derive a finer insight into the human decision-making processes. This design subsumes the purpose of simple rating and outlier-detection user studies. Similar to the …


Safe And Efficient Operation Of Mobile Robots In Indoor Environments: A User-Centric Shared Control System With High-Level Navigation Capabilities, Ahmet Saglam Jul 2024

Safe And Efficient Operation Of Mobile Robots In Indoor Environments: A User-Centric Shared Control System With High-Level Navigation Capabilities, Ahmet Saglam

Electrical & Computer Engineering Theses & Dissertations

Hospitalization and isolation can be a traumatic experience for immunocompromised children, especially because they are separated from their families and friends. Social robots have been proposed as a way to improve the quality of care for children hospitalized in isolation by providing alternative means of social interaction and support. Remote control of such robots in a hospital setting, particularly where safety is a major concern, can be a daunting task for young patients.

This dissertation introduces a multilevel shared control system for mobile robots, specifically companion robots in hospital-like indoor spaces. The system integrates user inputs with algorithmic semi-autonomous control …


Development Of A Rule-Based Monitoring System For Autonomous Heavy Equipment Safety, Amirpooya Shirazi Jul 2024

Development Of A Rule-Based Monitoring System For Autonomous Heavy Equipment Safety, Amirpooya Shirazi

Department of Construction Engineering and Management: Dissertations, Theses, and Student Research

Roadway construction work zones are constantly exposed to interactions among construction equipment, workers, and vehicles. Furthermore, ensuring safety in these areas is considered a challenging task due to the complexity of the environment. As shown in the rising trend of fatal accidents in roadway work zones, current OSHA regulations in construction safety are insufficient in effectively detecting unsafe situations and mitigating the risks. Furthermore, best practices, such as internal traffic control planning (ITCP), exhibit critical limitations requiring continuous monitoring of active work zones as well as adjustments to the site coordination plans due to the dynamic nature of work zone …


Star-Based Reachability Analysis Of Binary Neural Networks On Continuous Input, Mykhailo Ivashchenko May 2024

Star-Based Reachability Analysis Of Binary Neural Networks On Continuous Input, Mykhailo Ivashchenko

School of Computing: Dissertations, Theses, and Student Research

Deep Neural Networks (DNNs) have become a popular instrument for solving various real-world problems. DNNs’ sophisticated structure allows them to learn complex representations and features. However, architecture specifics and floating-point number usage result in increased computational operations complexity. For this reason, a more lightweight type of neural networks is widely used when it comes to edge devices, such as microcomputers or microcontrollers – Binary Neural Networks (BNNs). Like other DNNs, BNNs are vulnerable to adversarial attacks; even a small perturbation to the input set may lead to an errant output. Unfortunately, only a few approaches have been proposed for verifying …


Data Engineering: Building Software Efficiency In Medium To Large Organizations, Alessandro De La Torre Apr 2024

Data Engineering: Building Software Efficiency In Medium To Large Organizations, Alessandro De La Torre

Whittier Scholars Program

The introduction of PoetHQ, a mobile application, offers an economical strategy for colleges, potentially ushering in significant cost savings. These savings could be redirected towards enhancing academic programs and services, enriching the educational landscape for students. PoetHQ aims to democratize access to crucial software, effectively removing financial barriers and facilitating a richer educational experience. By providing an efficient software solution that reduces organizational overhead while maximizing accessibility for students, the project highlights the essential role of equitable education and resource optimization within academic institutions.


Development Of On-The-Fly Quasi-Steady State Approximation For Chemical Kinetics In Cfd, Abhinav Balamurugan Apr 2024

Development Of On-The-Fly Quasi-Steady State Approximation For Chemical Kinetics In Cfd, Abhinav Balamurugan

Doctoral Dissertations and Master's Theses

This study analyzes the feasibility of On-The-Fly Quasi-Steady-State Approximation (OTF-QSSA) application for solving chemical kinetics within Computational Fluid Dynamics (CFD) simulations, aiming to reduce the computational demand of detailed mechanisms. An algorithm that dynamically identifies and designates Quasi-Steady-State (QSS) species at specific grid locations and instances during the simulation was developed. With this information, our method pseudo-delays the advancement of concentrations for these QSS species—effectively setting their rate of concentration change to zero for a set number iteration before updating using the detailed mechanism and thereby omitting the computationally intensive processes typically required for their calculation during those skipped iteration. …


Computational Modeling And Analysis Of Facial Expressions And Gaze For Discovery Of Candidate Behavioral Biomarkers For Children And Young Adults With Autism Spectrum Disorder, Megan Anita Witherow Apr 2024

Computational Modeling And Analysis Of Facial Expressions And Gaze For Discovery Of Candidate Behavioral Biomarkers For Children And Young Adults With Autism Spectrum Disorder, Megan Anita Witherow

Electrical & Computer Engineering Theses & Dissertations

Facial expression production and perception in autism spectrum disorder (ASD) suggest the potential presence of behavioral biomarkers that may stratify individuals on the spectrum into prognostic or treatment subgroups. High-speed internet and the ease of technology have enabled remote, scalable, affordable, and timely access to medical care, such as measurements of ASDrelated behaviors in familiar environments to complement clinical observation. Machine and deep learning (DL)-based analysis of video tracking (VT) of expression production and eye tracking (ET) of expression perception may aid stratification biomarker discovery for children and young adults with ASD. However, there are open challenges in 1) facial …


Weakly Supervised Attention-Based Recognition Under Spectral, Turbulence, And Resource Variations, Kshitij Naresh Nikhal Mar 2024

Weakly Supervised Attention-Based Recognition Under Spectral, Turbulence, And Resource Variations, Kshitij Naresh Nikhal

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

While supervised optimization paradigms are ubiquitous across diverse recognition systems, the risk of over-fitting and increasing bias have limited their applicability.

This dissertation focuses on unsupervised learning—learning without precisely curated data—and argues that unsupervised learning methods can enable both discriminability and generalizability. Through the use of attention-based machine learning and advanced clustering, unsupervised methods are able to focus on fine-grained information in images without any explicit supervision. The dissertation introduces a domain-bridging framework for tasks like cross-spectrum matching and long-range recognition, utilizing intra-domain clustering and inter-domain matching to generate pseudo-labels. Additionally, a hash-based network is proposed to accelerate the search …


Path-Bigbird: An Ai-Driven Transformer Approach To Classification Of Cancer Pathology Reports, Mayanka Chandrashekar, Isaac Lyngaas, Heidi A. Hanson, Shang Gao, Xiao Cheng Wu, John Gounley Feb 2024

Path-Bigbird: An Ai-Driven Transformer Approach To Classification Of Cancer Pathology Reports, Mayanka Chandrashekar, Isaac Lyngaas, Heidi A. Hanson, Shang Gao, Xiao Cheng Wu, John Gounley

School of Public Health Faculty Publications

PURPOSE: Surgical pathology reports are critical for cancer diagnosis and management. To accurately extract information about tumor characteristics from pathology reports in near real time, we explore the impact of using domain-specific transformer models that understand cancer pathology reports. METHODS: We built a pathology transformer model, Path-BigBird, by using 2.7 million pathology reports from six SEER cancer registries. We then compare different variations of Path-BigBird with two less computationally intensive methods: Hierarchical Self-Attention Network (HiSAN) classification model and an off-the-shelf clinical transformer model (Clinical BigBird). We use five pathology information extraction tasks for evaluation: site, subsite, laterality, histology, and behavior. …