Unitary And Symmetric Structure In Deep Neural Networks,
2020
University of Kentucky
Unitary And Symmetric Structure In Deep Neural Networks, Kehelwala Dewage Gayan Maduranga
Theses and Dissertations--Mathematics
Recurrent neural networks (RNNs) have been successfully used on a wide range of sequential data problems. A well-known difficulty in using RNNs is the vanishing or exploding gradient problem. Recently, there have been several different RNN architectures that try to mitigate this issue by maintaining an orthogonal or unitary recurrent weight matrix. One such architecture is the scaled Cayley orthogonal recurrent neural network (scoRNN), which parameterizes the orthogonal recurrent weight matrix through a scaled Cayley transform. This parametrization contains a diagonal scaling matrix consisting of positive or negative one entries that can not be optimized by gradient descent. Thus the …
Orthogonal Recurrent Neural Networks And Batch Normalization In Deep Neural Networks,
2020
University of Kentucky
Orthogonal Recurrent Neural Networks And Batch Normalization In Deep Neural Networks, Kyle Eric Helfrich
Theses and Dissertations--Mathematics
Despite the recent success of various machine learning techniques, there are still numerous obstacles that must be overcome. One obstacle is known as the vanishing/exploding gradient problem. This problem refers to gradients that either become zero or unbounded. This is a well known problem that commonly occurs in Recurrent Neural Networks (RNNs). In this work we describe how this problem can be mitigated, establish three different architectures that are designed to avoid this issue, and derive update schemes for each architecture. Another portion of this work focuses on the often used technique of batch normalization. Although found to be successful …
Filtered-Dynamic-Inversion Control For Unknown Minimum-Phase Systems With Unknown Relative Degree,
2020
University of Kentucky
Filtered-Dynamic-Inversion Control For Unknown Minimum-Phase Systems With Unknown Relative Degree, Sumit Suryakant Kamat
Theses and Dissertations--Mechanical and Aerospace Engineering
We present filtered-dynamic-inversion (FDI) control for unknown linear time-invariant systems that are multi-input multi-output and minimum phase with unknown-but-bounded relative degree. This FDI controller requires limited model information, specifically, knowledge of an upper bound on the relative degree and knowledge of the first nonzero Markov parameter. The FDI controller is a single-parameter high-parameter-stabilizing controller that is robust to uncertainty in the relative degree. We characterize the stability of the closed-loop system. We present numerical examples, where the FDI controller is implemented in feedback with mathematical and physical systems. The numerical examples demonstrate that the FDI controller for unknown relative degree …
Three Point Boundary Value Problems For Ordinary Differential Equations, Uniqueness Implies Existence,
2020
University of Dayton
Three Point Boundary Value Problems For Ordinary Differential Equations, Uniqueness Implies Existence, Paul W. Eloe, Johnny Henderson, Jeffrey T. Neugebauer
Mathematics Faculty Publications
We consider a family of three point n − 2, 1, 1 conjugate boundary value problems for nth order nonlinear ordinary differential equations and obtain conditions in terms of uniqueness of solutions imply existence of solutions. A standard hypothesis that has proved effective in uniqueness implies existence type results is to assume uniqueness of solutions of a large family of n−point boundary value problems. Here, we replace that standard hypothesis with one in which we assume uniqueness of solutions of large families of two and three point boundary value problems. We then close the paper with verifiable conditions on the …
Description Of Income And Substitution Effects Using Slutsky Identity,
2020
University of Mary Washington
Description Of Income And Substitution Effects Using Slutsky Identity, Julius N. Esunge, Dali Magrakvelidze
Mathematics Articles
In the paper we describe how income and price changes affect consumer's decision making using the Slutsky Identity. We also investigate economical meaning of curve turn-movements of consumer's budget. For analyzing the changes of consumer's choice we are using two step movements (turn, then parallel movement) of budget curve.
Hybrid Electric Vehicle Energy Management Strategy With Consideration Of Battery Aging,
2020
Michigan Technological University
Hybrid Electric Vehicle Energy Management Strategy With Consideration Of Battery Aging, Bin Zhou
Dissertations, Master's Theses and Master's Reports
The equivalent consumption minimization strategy (ECMS) is a well-known energy management strategy for Hybrid Electric Vehicles (HEV). ECMS is very computationally efficient since it yields an instantaneous optimal control. ECMS has been shown to minimize fuel consumption under certain conditions. But, minimizing the fuel consumption often leads to excessive battery damage. The objective of this dissertation is to develop a real-time implementable optimal energy management strategy which improves both the fuel economy and battery aging for Hybrid Electric Vehicles by using ECMS. This work introduces a new optimal control problem where the cost function includes terms for both fuel consumption …
The Singular Value Expansion For Compact And Non-Compact Operators,
2020
Michigan Technological University
The Singular Value Expansion For Compact And Non-Compact Operators, Daniel Crane
Dissertations, Master's Theses and Master's Reports
Given any bounded linear operator T : X → Y between separable Hilbert spaces X and Y , there exists a measure space (M, Α, µ) and isometries V : L2(M) → X, U : L2(M) → Y and a nonnegative, bounded, measurable function σ : M → [0, ∞) such that
T = UmσV †,
with mσ : L2(M ) → L2(M ) defined by mσ(f ) = σf for all f …
Sub-Sampled Matrix Approximations,
2020
Michigan Technological University
Sub-Sampled Matrix Approximations, Joy Azzam
Dissertations, Master's Theses and Master's Reports
Matrix approximations are widely used to accelerate many numerical algorithms. Current methods sample row (or column) spaces to reduce their computational footprint and approximate a matrix A with an appropriate embedding of the data sampled. This work introduces a novel family of randomized iterative algorithms which use significantly less data per iteration than current methods by sampling input and output spaces simultaneously. The data footprint of the algorithms can be tuned (independent of the underlying matrix dimension) to available hardware. Proof is given for the convergence of the algorithms, which are referred to as sub-sampled, in terms of numerically tested …
On The Intermediate Long Wave Propagation For Internal Waves In The Presence Of Currents,
2020
Technological University Dublin
On The Intermediate Long Wave Propagation For Internal Waves In The Presence Of Currents, Joseph Cullen, Rossen Ivanov
Articles
A model for the wave motion of an internal wave in the presence of current in the case of intermediate long wave approximation is studied. The lower layer is considerably deeper, with a higher density than the upper layer. The flat surface approximation is assumed. The fluids are incompressible and inviscid. The model equations are obtained from the Hamiltonian formulation of the dynamics in the presence of a depth-varying current. It is shown that an appropriate scaling leads to the integrable Intermediate Long Wave Equation (ILWE). Two limits of the ILWE leading to the integrable Benjamin-Ono and KdV equations are …
Camassa-Holm Cuspons, Solitons And Their Interactions Via The Dressing Method,
2020
Technological University Dublin
Camassa-Holm Cuspons, Solitons And Their Interactions Via The Dressing Method, Rossen Ivanov, Tony Lyons, Nigel Orr
Articles
A dressing method is applied to a matrix Lax pair for the Camassa–Holm equation, thereby allowing for the construction of several global solutions of the system. In particular, solutions of system of soliton and cuspon type are constructed explicitly. The interactions between soliton and cuspon solutions of the system are investigated. The geometric aspects of the Camassa–Holm equation are re-examined in terms of quantities which can be explicitly constructed via the inverse scattering method.
Modeling Gene Expression With Differential Equations,
2020
Arcadia University
Modeling Gene Expression With Differential Equations, Madison Kuduk
Capstone Showcase
Gene expression is the process by which the information stored in DNA is convertedinto a functional gene product, such as protein. The two main functions that makeup the process of gene expression are transcription and translation. Transcriptionand translation are controlled by the number of mRNA and protein in the cell. Geneexpression can be represented as a system of first order differential equations for the rateof change of mRNA and proteins. These equations involve transcription, translation,degradation and feedback loops. In this paper, I investigate a system of first orderdifferential equations to model gene expression proposed by Hunt, Laplace, Miller andPham in …
Exploration And Implementation Of Neural Ordinary Differential Equations,
2020
Arcadia University
Exploration And Implementation Of Neural Ordinary Differential Equations, Long Huu Nguyen, Andy Malinsky
Capstone Showcase
Neural ordinary differential equations (ODEs) have recently emerged as a novel ap- proach to deep learning, leveraging the knowledge of two previously separate domains, neural networks and differential equations. In this paper, we first examine the back- ground and lay the foundation for traditional artificial neural networks. We then present neural ODEs from a rigorous mathematical perspective, and explore their advantages and trade-offs compared to traditional neural nets.
Stationary Distribution Of Recombination On 4x4 Grid Graph As It Relates To Gerrymandering,
2020
Claremont Colleges
Stationary Distribution Of Recombination On 4x4 Grid Graph As It Relates To Gerrymandering, Camryn Hollarsmith
Scripps Senior Theses
A gerrymandered political districting plan is used to benefit a group seeking to elect more of their own officials into office. This practice happens at the city, county and state level. A gerrymandered plan can be strategically designed based on partisanship, race, and other factors. Gerrymandering poses a contradiction to the idea of “one person, one vote” ruled by the United States Supreme Court case Reynolds v. Sims (1964) because it values one demographic’s votes more than another’s, thus creating an unfair advantage and compromising American democracy. To prevent the practice of gerrymandering, we must know how to detect a …
Phylogenetic Networks And Functions That Relate Them,
2020
The University of Akron
Phylogenetic Networks And Functions That Relate Them, Drew Scalzo
Williams Honors College, Honors Research Projects
Phylogenetic Networks are defined to be simple connected graphs with exactly n labeled nodes of degree one, called leaves, and where all other unlabeled nodes have a degree of at least three. These structures assist us with analyzing ancestral history, and its close relative - phylogenetic trees - garner the same visualization, but without the graph being forced to be connected. In this paper, we examine the various characteristics of Phylogenetic Networks and functions that take these networks as inputs, and convert them to more complex or simpler structures. Furthermore, we look at the nature of functions as they relate …
Pulsatile Flow Through Idealized Renal Tubules: Fluid-Structure Interaction And Dynamic Pathologies,
2020
Cleveland State University
Pulsatile Flow Through Idealized Renal Tubules: Fluid-Structure Interaction And Dynamic Pathologies, Niksa Praljak, Shawn D. Ryan, Andrew Resnick
Mathematics and Statistics Faculty Publications
Kidney tubules are lined with flow-sensing structures, yet information about the flow itself is not easily obtained. We aim to generate a multiscale biomechanical model for analyzing fluid flow and fluid-structure interactions within an elastic kidney tubule when the driving pressure is pulsatile. We developed a two-dimensional macroscopic mathematical model of a single fluid-filled tubule corresponding to a distal nephron segment and determined both flow dynamics and wall strains over a range of driving frequencies and wall compliances using finite-element analysis. The results presented here demonstrate good agreement with available analytical solutions and form a foundation for future inclusion of …
L1-Norm Regularized L1-Norm Best-Fit Line Problem,
2020
Virginia Commonwealth University
L1-Norm Regularized L1-Norm Best-Fit Line Problem, Xiao Ling, Paul Brooks
Graduate Research Posters
Background
Conventional Principal Component Analysis (PCA) is a widely used technique to reduce data dimension. PCA finds linear combinations of the original features capturing maximal variance of data via Singular Value Decomposition (SVD). However, SVD is sensitive to outliers, and often leads to high dimensional results. To address the issues, we propose a new method to estimate best-fit one-dimensional subspace, called l1-norm Regularized l1-norm.
Methods
In this article, we describe a method to fit a lower-dimensional subspace by approximate a non-linear, non-convex, non-smooth optimization problem called l1 regularized l1-norm Best- Fit Line problem; minimize a combination of the l1 error …
Swimming Of Motile Gyrotactic Microorganisms And Nanoparticles In Blood Flow Through Anisotropically Tapered Arteries,
2020
The British University in Egypt
Swimming Of Motile Gyrotactic Microorganisms And Nanoparticles In Blood Flow Through Anisotropically Tapered Arteries, M. M. Bhatti, M. Marin, A. Zeeshan, R. Ellahi, Sara I. Abdelsalam
Basic Science Engineering
In the present article, we have presented a theoretical study on the swimming of migratory gyrotactic microorganisms in a non-Newtonian blood-based nanofluid via an anisotropically narrowing artery. Sutterby fluid model is used in order to understand the rheology of the blood as a non-Newtonian fluid model. This fluid pattern has the ability to show Newtonian and non-Newtonian features. The mathematical formulation is performed via continuity, temperature, motile microorganism, momentum, and concentration equation. The series solutions are obtained using the perturbation scheme up to the third-order approximation. The resulting solutions are discussed with the help of graphs for all the leading …
A Primer On Laplacian Dynamics In Directed Graphs,
2020
Portland State University
A Primer On Laplacian Dynamics In Directed Graphs, J. J. P. Veerman, R. Lyons
Mathematics and Statistics Faculty Publications and Presentations
We analyze the asymptotic behavior of general first order Laplacian processes on digraphs. The most important ones of these are diffusion and consensus with both continuous and discrete time. We treat diffusion and consensus as dual processes. This is the first complete exposition of this material in a single work.
A Review On Superluminal Physics And Superluminal Communication In Light Of The Neutrosophic Logic Perspective,
2020
University of New Mexico
A Review On Superluminal Physics And Superluminal Communication In Light Of The Neutrosophic Logic Perspective, Victor Christianto, Florentin Smarandache
Branch Mathematics and Statistics Faculty and Staff Publications
In a recent paper, we describe a model of quantum communication based on combining consciousness experiment and entanglement, which can serve as impetus to stop 5G-network-caused diseases. Therefore, in this paper we consider superluminal physics and superluminal communication as a bridge or intermediate way between subluminal physics and action-at-a-distance (AAAD) physics, especially from neutrosophic logic perspective. Although several ways have been proposed to bring such a superluminal communication into reality, such as Telluric wave or Telepathy analog of Horejev and Baburin, here we also review two possibilities: quaternion communication and also quantum communication based on quantum noise. Further research is …
Global Existence And Asymptotic Behavior Of The Solutions To Models For Chemotaxis Systems With Chemo Attractants And Repellents,
2020
West Virginia University
Global Existence And Asymptotic Behavior Of The Solutions To Models For Chemotaxis Systems With Chemo Attractants And Repellents, Aesha Lagha
Graduate Theses, Dissertations, and Problem Reports (ETD)
We study global existence and asymptotic behavior of the solutions to models for chemotaxis systems with chemo attractants and repellents in three dimensions. Chemo attractants and repellents may be called chemo agents. For Part I, we use the logistic model for the mass. The interactions between chemo agents and the mass are taken into account. For Part II, we consider the case when mass is conserved and we use the Lotka-Volterra type model for chemo agents. To accomplish this, we use the Fourier transform and energy method. We show the existence of global solutions by the energy method. Also, we …
