Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 29 of 29

Full-Text Articles in Physical Sciences and Mathematics

Exploring Quaternion Neural Network Loss Surfaces, Jeremiah Bill, Bruce A. Cox Apr 2024

Exploring Quaternion Neural Network Loss Surfaces, Jeremiah Bill, Bruce A. Cox

Faculty Publications

This paper explores the superior performance of quaternion multi-layer perceptron (QMLP) neural networks over real-valued multi-layer perceptron (MLP) neural networks, a phenomenon that has been empirically observed but not thoroughly investigated. The study utilizes loss surface visualization and projection techniques to examine quaternion-based optimization loss surfaces for the first time. The primary contribution of this research is the statistical evidence that QMLP models yield smoother loss surfaces than real-valued neural networks, which are measured and compared using a robust quantitative measure of loss surface “goodness” based on estimates of surface curvature. Extensive computational testing validates the effectiveness of these surface …


Complete Solution Of The Lady In The Lake Scenario, Alexander Von Moll, Meir Pachter Jan 2024

Complete Solution Of The Lady In The Lake Scenario, Alexander Von Moll, Meir Pachter

Faculty Publications

In the Lady in the Lake scenario, a mobile agent, L, is pitted against an agent, M, who is constrained to move along the perimeter of a circle. L is assumed to begin inside the circle and wishes to escape to the perimeter with some finite angular separation from M at the perimeter. This scenario has, in the past, been formulated as a zero-sum differential game wherein L seeks to maximize terminal separation and M seeks to minimize it. Its solution is well-known. However, there is a large portion of the state space for which the canonical solution does not …


Legendre Pairs Of Lengths ℓ ≡ 0 (Mod 5), Ilias S. Kotsireas, Christopher Koutschan, Dursun Bulutoglu, David M. Arquette, Jonathan S. Turner, Kenneth J. Ryan Nov 2023

Legendre Pairs Of Lengths ℓ ≡ 0 (Mod 5), Ilias S. Kotsireas, Christopher Koutschan, Dursun Bulutoglu, David M. Arquette, Jonathan S. Turner, Kenneth J. Ryan

Faculty Publications

By assuming a type of balance for length ℓ = 87 and nontrivial subgroups of multiplier groups of Legendre pairs (LPs) for length ℓ = 85 , we find LPs of these lengths. We then study the power spectral density (PSD) values of m compressions of LPs of length 5 m . We also formulate a conjecture for LPs of lengths ℓ ≡ 0 (mod 5) and demonstrate how it can be used to decrease the search space and storage requirements for finding such LPs. The newly found LPs decrease the number of integers in the range ≤ 200 for …


Anomaly Detection In The Molecular Structure Of Gallium Arsenide Using Convolutional Neural Networks, Timothy Roche *, Aihua W. Wood, Philip Cho *, Chancellor Johnstone Aug 2023

Anomaly Detection In The Molecular Structure Of Gallium Arsenide Using Convolutional Neural Networks, Timothy Roche *, Aihua W. Wood, Philip Cho *, Chancellor Johnstone

Faculty Publications

This paper concerns the development of a machine learning tool to detect anomalies in the molecular structure of Gallium Arsenide. We employ a combination of a CNN and a PCA reconstruction to create the model, using real images taken with an electron microscope in training and testing. The methodology developed allows for the creation of a defect detection model, without any labeled images of defects being required for training. The model performed well on all tests under the established assumptions, allowing for reliable anomaly detection. To the best of our knowledge, such methods are not currently available in the open …


Numerical Simulation Of The Korteweg–De Vries Equation With Machine Learning, Kristina O. F. Williams *, Benjamin F. Akers Jun 2023

Numerical Simulation Of The Korteweg–De Vries Equation With Machine Learning, Kristina O. F. Williams *, Benjamin F. Akers

Faculty Publications

A machine learning procedure is proposed to create numerical schemes for solutions of nonlinear wave equations on coarse grids. This method trains stencil weights of a discretization of the equation, with the truncation error of the scheme as the objective function for training. The method uses centered finite differences to initialize the optimization routine and a second-order implicit-explicit time solver as a framework. Symmetry conditions are enforced on the learned operator to ensure a stable method. The procedure is applied to the Korteweg–de Vries equation. It is observed to be more accurate than finite difference or spectral methods on coarse …


A Bit-Parallel Tabu Search Algorithm For Finding Es2 -Optimal And Minimax-Optimal Supersaturated Designs, Luis B. Morales, Dursun A. Bulotuglu Jun 2023

A Bit-Parallel Tabu Search Algorithm For Finding Es2 -Optimal And Minimax-Optimal Supersaturated Designs, Luis B. Morales, Dursun A. Bulotuglu

Faculty Publications

We prove the equivalence of two-symbol supersaturated designs (SSDs) with N (even) rows, m columns, smax=4t+i, where i ∈ {0,2}, t ∈ Z≥0 and resolvable incomplete block designs (RIBDs) whose any two blocks intersect in at most (N+4t+i)/4 points. Using this equivalence, we formulate the search for two-symbol E(s2)-optimal and minimax-optimal SSDs with smax ∈ {2,4,6} as a search for RIBDs whose blocks intersect accordingly. This allows developing a bit-parallel tabu search (TS) algorithm. The TS algorithm found E(s2)-optimal and minimax-optimal SSDs achieving the sharpest known E(s2) lower bound with …


A Comparison Of Quaternion Neural Network Backpropagation Algorithms, Jeremiah Bill, Bruce A. Cox, Lance Champaign Jun 2023

A Comparison Of Quaternion Neural Network Backpropagation Algorithms, Jeremiah Bill, Bruce A. Cox, Lance Champaign

Faculty Publications

This research paper focuses on quaternion neural networks (QNNs) - a type of neural network wherein the weights, biases, and input values are all represented as quaternion numbers. Previous studies have shown that QNNs outperform real-valued neural networks in basic tasks and have potential in high-dimensional problem spaces. However, research on QNNs has been fragmented, with contributions from different mathematical and engineering domains leading to unintentional overlap in QNN literature. This work aims to unify existing research by evaluating four distinct QNN backpropagation algorithms, including the novel GHR-calculus backpropagation algorithm, and providing concise, scalable implementations of each algorithm using a …


Node Generation For Rbf-Fd Methods By Qr Factorization, Tony Liu, Rodrigo B. Platte Aug 2021

Node Generation For Rbf-Fd Methods By Qr Factorization, Tony Liu, Rodrigo B. Platte

Faculty Publications

Polyharmonic spline (PHS) radial basis functions (RBFs) have been used in conjunction with polynomials to create RBF finite-difference (RBF-FD) methods. In 2D, these methods are usually implemented with Cartesian nodes, hexagonal nodes, or most commonly, quasi-uniformly distributed nodes generated through fast algorithms. We explore novel strategies for computing the placement of sampling points for RBF-FD methods in both 1D and 2D while investigating the benefits of using these points. The optimality of sampling points is determined by a novel piecewise-defined Lebesgue constant. Points are then sampled by modifying a simple, robust, column-pivoting QR algorithm previously implemented to find sets of …


Estimating Turbulence Distribution Over A Heterogeneous Path Using Time‐Lapse Imagery From Dual Cameras, Benjamin Wilson, Santasri Bose-Pillai, Jack E. Mccrae, Kevin J. Keefer, Steven T. Fiorino Jul 2021

Estimating Turbulence Distribution Over A Heterogeneous Path Using Time‐Lapse Imagery From Dual Cameras, Benjamin Wilson, Santasri Bose-Pillai, Jack E. Mccrae, Kevin J. Keefer, Steven T. Fiorino

Faculty Publications

Knowledge of turbulence distribution along an experimental path can help in effective turbulence compensation and mitigation. Although scintillometers are traditionally used to measure the strength of turbulence, they provide a path-integrated measurement and have limited operational ranges. A technique to profile turbulence using time-lapse imagery of a distant target from spatially separated cameras is presented here. The method uses the turbulence induced differential motion between pairs of point features on a target, sensed at a single camera and between cameras to extract turbulence distribution along the path. The method is successfully demonstrated on a 511 m almost horizontal path going …


Defect Detection In Atomic Resolution Transmission Electron Microscopy Images Using Machine Learning, Philip Cho, Aihua W. Wood, Krishnamurthy Mahalingam, Kurt Eyink May 2021

Defect Detection In Atomic Resolution Transmission Electron Microscopy Images Using Machine Learning, Philip Cho, Aihua W. Wood, Krishnamurthy Mahalingam, Kurt Eyink

Faculty Publications

Point defects play a fundamental role in the discovery of new materials due to their strong influence on material properties and behavior. At present, imaging techniques based on transmission electron microscopy (TEM) are widely employed for characterizing point defects in materials. However, current methods for defect detection predominantly involve visual inspection of TEM images, which is laborious and poses difficulties in materials where defect related contrast is weak or ambiguous. Recent efforts to develop machine learning methods for the detection of point defects in TEM images have focused on supervised methods that require labeled training data that is generated via …


Meta-Heuristic Optimization Methods For Quaternion-Valued Neural Networks, Jeremiah Bill, Lance E. Champagne, Bruce Cox, Trevor J. Bihl Apr 2021

Meta-Heuristic Optimization Methods For Quaternion-Valued Neural Networks, Jeremiah Bill, Lance E. Champagne, Bruce Cox, Trevor J. Bihl

Faculty Publications

In recent years, real-valued neural networks have demonstrated promising, and often striking, results across a broad range of domains. This has driven a surge of applications utilizing high-dimensional datasets. While many techniques exist to alleviate issues of high-dimensionality, they all induce a cost in terms of network size or computational runtime. This work examines the use of quaternions, a form of hypercomplex numbers, in neural networks. The constructed networks demonstrate the ability of quaternions to encode high-dimensional data in an efficient neural network structure, showing that hypercomplex neural networks reduce the number of total trainable parameters compared to their real-valued …


A Radial Basis Function Finite Difference Scheme For The Benjamin–Ono Equation, Benjamin F. Akers, Tony Liu, Jonah A. Reeger Jan 2021

A Radial Basis Function Finite Difference Scheme For The Benjamin–Ono Equation, Benjamin F. Akers, Tony Liu, Jonah A. Reeger

Faculty Publications

A radial basis function-finite differencing (RBF-FD) scheme was applied to the initial value problem of the Benjamin–Ono equation. The Benjamin–Ono equation has traveling wave solutions with algebraic decay and a nonlocal pseudo-differential operator, the Hilbert transform. When posed on ℝ, the former makes Fourier collocation a poor discretization choice; the latter is challenging for any local method. We develop an RBF-FD approximation of the Hilbert transform, and discuss the challenges of implementing this and other pseudo-differential operators on unstructured grids. Numerical examples, simulation costs, convergence rates, and generalizations of this method are all discussed.


Acceleration Of Boltzmann Collision Integral Calculation Using Machine Learning, Ian Holloway, Aihua W. Wood, Alexander Alekseenko Jan 2021

Acceleration Of Boltzmann Collision Integral Calculation Using Machine Learning, Ian Holloway, Aihua W. Wood, Alexander Alekseenko

Faculty Publications

The Boltzmann equation is essential to the accurate modeling of rarefied gases. Unfortunately, traditional numerical solvers for this equation are too computationally expensive for many practical applications. With modern interest in hypersonic flight and plasma flows, to which the Boltzmann equation is relevant, there would be immediate value in an efficient simulation method. The collision integral component of the equation is the main contributor of the large complexity. A plethora of new mathematical and numerical approaches have been proposed in an effort to reduce the computational cost of solving the Boltzmann collision integral, yet it still remains prohibitively expensive for …


Harmonic Equiangular Tight Frames Comprised Of Regular Simplices, Matthew C. Fickus, Courtney A. Schmitt Feb 2020

Harmonic Equiangular Tight Frames Comprised Of Regular Simplices, Matthew C. Fickus, Courtney A. Schmitt

Faculty Publications

An equiangular tight frame (ETF) is a sequence of unit-norm vectors in a Euclidean space whose coherence achieves equality in the Welch bound, and thus yields an optimal packing in a projective space. A regular simplex is a simple type of ETF in which the number of vectors is one more than the dimension of the underlying space. More sophisticated examples include harmonic ETFs which equate to difference sets in finite abelian groups. Recently, it was shown that some harmonic ETFs are comprised of regular simplices. In this paper, we continue the investigation into these special harmonic ETFs. We begin …


Legendre G-Array Pairs And The Theoretical Unification Of Several G-Array Families, K. T. Arasu, Dursun A. Bulutoglu, J. R. Hollon Jan 2020

Legendre G-Array Pairs And The Theoretical Unification Of Several G-Array Families, K. T. Arasu, Dursun A. Bulutoglu, J. R. Hollon

Faculty Publications

We investigate how Legendre G-array pairs are related to several different perfect binary G-array families. In particular we study the relations between Legendre G-array pairs, Sidelnikov-Lempel-Cohn-Eastman ℤq−1-arrays, Yamada-Pott G-array pairs, Ding-Helleseth-Martinsen ℤ2×ℤmp-arrays, Yamada ℤ(q−1)/2-arrays, Szekeres ℤmp-array pairs, Paley ℤmp-array pairs, and Baumert ℤm1p1×ℤm2p2-array pairs. Our work also solves one of the two open problems posed in Ding~[J. Combin. Des. 16 (2008), 164-171]. Moreover, we provide several computer search based existence and non-existence results regarding Legendre ℤn-array pairs. …


Polyphase Equiangular Tight Frames And Abelian Generalized Quadrangles, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson, Cody E. Watson Nov 2019

Polyphase Equiangular Tight Frames And Abelian Generalized Quadrangles, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson, Cody E. Watson

Faculty Publications

An equiangular tight frame (ETF) is a type of optimal packing of lines in a finite-dimensional Hilbert space. ETFs arise in various applications, such as waveform design for wireless communication, compressed sensing, quantum information theory and algebraic coding theory. In a recent paper, signature matrices of ETFs were constructed from abelian distance regular covers of complete graphs. We extend this work, constructing ETF synthesis operators from abelian generalized quadrangles, and vice versa. This produces a new infinite family of complex ETFs as well as a new proof of the existence of certain generalized quadrangles. This work involves designing matrices whose …


Hadamard Equiangular Tight Frames, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson Aug 2019

Hadamard Equiangular Tight Frames, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson

Faculty Publications

An equiangular tight frame (ETF) is a type of optimal packing of lines in Euclidean space. They are often represented as the columns of a short, fat matrix. In certain applications we want this matrix to be flat, that is, have the property that all of its entries have modulus one. In particular, real flat ETFs are equivalent to self-complementary binary codes that achieve the Grey-Rankin bound. Some flat ETFs are (complex) Hadamard ETFs, meaning they arise by extracting rows from a (complex) Hadamard matrix. These include harmonic ETFs, which are obtained by extracting the rows of a character table …


Periodic Traveling Interfacial Hydroelastic Waves With Or Without Mass Ii: Multiple Bifurcations And Ripples, Benjamin F. Akers, David M. Ambrose, David W. Sulon Aug 2019

Periodic Traveling Interfacial Hydroelastic Waves With Or Without Mass Ii: Multiple Bifurcations And Ripples, Benjamin F. Akers, David M. Ambrose, David W. Sulon

Faculty Publications

In a prior work, the authors proved a global bifurcation theorem for spatially periodic interfacial hydroelastic traveling waves on infinite depth, and computed such traveling waves. The formulation of the traveling wave problem used both analytically and numerically allows for waves with multi-valued height. The global bifurcation theorem required a one-dimensional kernel in the linearization of the relevant mapping, but for some parameter values, the kernel is instead two-dimensional. In the present work, we study these cases with two-dimensional kernels, which occur in resonant and non-resonant variants. We apply an implicit function theorem argument to prove existence of traveling waves …


Finding The Symmetry Group Of An Lp With Equality Constraints And Its Application To Classifying Orthogonal Arrays, Andrew J. Geyer, Dursun A. Bulutoglu, Kenneth J. Ryan May 2019

Finding The Symmetry Group Of An Lp With Equality Constraints And Its Application To Classifying Orthogonal Arrays, Andrew J. Geyer, Dursun A. Bulutoglu, Kenneth J. Ryan

Faculty Publications

Excerpt: For a given linear program (LP) a permutation of its variables that sends feasible points to feasible points and preserves the objective function value of each of its feasible points is a symmetry of the LP. The set of all symmetries of an LP, denoted by GLP, is the symmetry group of the LP. Margot (2010) described a method for computing a subgroup of the symmetry group GLP of an LP. This method computes GLP when the LP has only non-redundant inequalities and its feasible set satisfies no equality constraints.


Atmospheric Propagation Of High Energy Lasers: Thermal Blooming Simulation, Jonathan Gustafsson, Benjamin F. Akers, Jonah A. Reeger, Sivaguru S. Sritharan Apr 2019

Atmospheric Propagation Of High Energy Lasers: Thermal Blooming Simulation, Jonathan Gustafsson, Benjamin F. Akers, Jonah A. Reeger, Sivaguru S. Sritharan

Faculty Publications

High Energy Laser (HEL) propagation through turbulent atmosphere is examined via numerical simulation. The beam propagation is modeled with the paraxial equation, which in turn is written as a system of equations for a quantum fluid, via the Madelung transform. A finite volume solver is applied to the quantum fluid equations, which supports sharp gradients in beam intensity. The atmosphere is modeled via a coupled advection-diffusion equation whose initial data have Kolmogorov spectrum. In this model the combined effects of thermal blooming, beam slewing, and deep turbulence are simulated.


Equiangular Tight Frames That Contain Regular Simplices, Matthew C. Fickus, John Jasper, Emily J. King, Dustin G. Mixon Oct 2018

Equiangular Tight Frames That Contain Regular Simplices, Matthew C. Fickus, John Jasper, Emily J. King, Dustin G. Mixon

Faculty Publications

An equiangular tight frame (ETF) is a type of optimal packing of lines in Euclidean space. A regular simplex is a special type of ETF in which the number of vectors is one more than the dimension of the space they span. In this paper, we consider ETFs that contain a regular simplex, that is, have the property that a subset of its vectors forms a regular simplex. As we explain, such ETFs are characterized as those that achieve equality in a certain well-known bound from the theory of compressed sensing. We then consider the so-called binder of such an …


Equiangular Tight Frames From Group Divisible Designs, Matthew C. Fickus, John Jasper Oct 2018

Equiangular Tight Frames From Group Divisible Designs, Matthew C. Fickus, John Jasper

Faculty Publications

An equiangular tight frame (ETF) is a type of optimal packing of lines in a real or complex Hilbert space. In the complex case, the existence of an ETF of a given size remains an open problem in many cases. In this paper, we observe that many of the known constructions of ETFs are of one of two types. We further provide a new method for combining a given ETF of one of these two types with an appropriate group divisible design (GDD) in order to produce a larger ETF of the same type. By applying this method to known …


Equiangular Tight Frames With Centroidal Symmetry, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson, Cody E. Watson Mar 2018

Equiangular Tight Frames With Centroidal Symmetry, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson, Cody E. Watson

Faculty Publications

An equiangular tight frame (ETF) is a set of unit vectors whose coherence achieves the Welch bound, and so is as incoherent as possible. Though they arise in many applications, only a few methods for constructing them are known. Motivated by the connection between real ETFs and graph theory, we introduce the notion of ETFs that are symmetric about their centroid. We then discuss how well-known constructions, such as harmonic ETFs and Steiner ETFs, can have centroidal symmetry. Finally, we establish a new equivalence between centroid-symmetric real ETFs and certain types of strongly regular graphs (SRGs). Together, these results give …


Tremain Equiangular Tight Frames, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson Jan 2018

Tremain Equiangular Tight Frames, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Jesse D. Peterson

Faculty Publications

Equiangular tight frames provide optimal packings of lines through the origin. We combine Steiner triple systems with Hadamard matrices to produce a new infinite family of equiangular tight frames. This in turn leads to new constructions of strongly regular graphs and distance-regular antipodal covers of the complete graph.


A Brief Introduction To Equi-Chordal And Equi-Isoclinic Tight Fusion Frames, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Cody E. Watson Aug 2017

A Brief Introduction To Equi-Chordal And Equi-Isoclinic Tight Fusion Frames, Matthew C. Fickus, John Jasper, Dustin G. Mixon, Cody E. Watson

Faculty Publications

Equi-chordal and equi-isoclinic tight fusion frames (ECTFFs and EITFFs) are both types of optimal packings of subspaces in Euclidean spaces. In the special case where these subspaces are one-dimensional, ECTFFs and EITFFs both correspond to types of optimal packings of lines known as equiangular tight frames. In this brief note, we review some of the fundamental ideas and results concerning ECTFFs and EITFFs.


Periodic Traveling Interfacial Hydroelastic Waves With Or Without Mass, Benjamin F. Akers, David M. Ambrose, David W. Sulon Apr 2017

Periodic Traveling Interfacial Hydroelastic Waves With Or Without Mass, Benjamin F. Akers, David M. Ambrose, David W. Sulon

Faculty Publications

We study the motion of an interface between two irrotational, incompressible fluids, with elastic bending forces present; this is the hydroelastic wave problem. We prove a global bifurcation theorem for the existence of families of spatially periodic traveling waves on infinite depth. Our traveling wave formulation uses a parameterized curve, in which the waves are able to have multi-valued height. This formulation and the presence of the elastic bending terms allows for the application of an abstract global bifurcation theorem of "identity plus compact" type. We furthermore perform numerical computations of these families of traveling waves, finding that, depending on …


A Generalized Schur–Horn Theorem And Optimal Frame Completions, Matthew C. Fickus, Justin D. Marks, Miriam J. Poteet May 2016

A Generalized Schur–Horn Theorem And Optimal Frame Completions, Matthew C. Fickus, Justin D. Marks, Miriam J. Poteet

Faculty Publications

The Schur-Horn theorem is a classical result in matrix analysis which characterizes the existence of positive semi-definite matrices with a given diagonal and spectrum. In recent years, this theorem has been used to characterize the existence of finite frames whose elements have given lengths and whose frame operator has a given spectrum. We provide a new generalization of the Schur-Horn theorem which characterizes the spectra of all possible finite frame completions. That is, we characterize the spectra of the frame operators of the finite frames obtained by adding new vectors of given lengths to an existing frame. We then exploit …


The Lp Relaxation Orthogonal Array Polytope And Its Permutation Symmetries, Andrew J. Geyer, Dursun A. Bulutoglu, Steven J. Rosenberg Nov 2014

The Lp Relaxation Orthogonal Array Polytope And Its Permutation Symmetries, Andrew J. Geyer, Dursun A. Bulutoglu, Steven J. Rosenberg

Faculty Publications

Symmetry plays a fundamental role in design of experiments. In particular, symmetries of factorial designs that preserve their statistical properties are exploited to find designs with the best statistical properties. By using a result proved by Rosenberg [6], the concept of the LP relaxation orthogonal array polytope is developed and studied. A complete characterization of the permutation symmetry group of this polytope is made. Also, this characterization is verified computationally for many cases. Finally, a proof is provided.


The Road To Deterministic Matrices With The Restricted Isometry Property, Afonso S. Bandeira, Matthew C. Fickus, Dustin G. Mixon, Percy Wong Jan 2013

The Road To Deterministic Matrices With The Restricted Isometry Property, Afonso S. Bandeira, Matthew C. Fickus, Dustin G. Mixon, Percy Wong

Faculty Publications

The restricted isometry property (RIP) is a well-known matrix condition that provides state-of-the-art reconstruction guarantees for compressed sensing. While random matrices are known to satisfy this property with high probability, deterministic constructions have found less success. In this paper, we consider various techniques for demonstrating RIP deterministically, some popular and some novel, and we evaluate their performance. In evaluating some techniques, we apply random matrix theory and inadvertently find a simple alternative proof that certain random matrices are RIP. Later, we propose a particular class of matrices as candidates for being RIP, namely, equiangular tight frames (ETFs). Using the known …