Control Theory Commons^™

Optimal Control Of Stochastic Systems: A Numerical Study Of The Stochastic Linear Quadratic Regulator Framework, Gülşen Orucova Büyüköz, Yaprak Güldoğan Dericioğlu, Tuğçem Partal

Mathematical Modelling and Numerical Simulation with Applications

Optimal control of stochastic linear systems is fundamental in control theory, with applications in robotics, finance, and engineering. The Stochastic Linear Quadratic Regulator (SLQR) derives optimal feedback laws via the Riccati equation but requires numerical discretization of the resulting stochastic dynamics. Despite extensive studies on numerical methods for stochastic differential equations, their performance within the SLQR framework remains insufficiently explored. This study compares two predictor–corrector schemes of different orders: the Order 1.0 Predictor-Corrector (PC) method and the Order 2.0 Weak PC method. A one-dimensional linear quadratic problem with a closed-form solution enables precise error evaluation against the analytical trajectory. Convergence …

Analysis And Numerical Investigation Of A Breast Cancer Treatment Model Incorporating Ketogenic Diet And Immune Boosters Via Optimal Control Theory, Kunnisai Muniroh, Ummu Habibah, Wuryansari Muharini Kusumawinahyu, Nur’Izzati Hamdan

Mathematical Modelling and Numerical Simulation with Applications

This paper develops a mathematical model to investigate breast cancer dynamics by incorporating tumor–immune interactions, ketogenic diet effects, and medical treatment. The model is formulated as a system of nonlinear ordinary differential equations and analyzed within an optimal control framework. Time-dependent control variables are introduced to represent treatment strategies aimed at minimizing tumor progression while reducing therapeutic costs. The model’s well-posedness is established through positivity and boundedness analysis. The necessary conditions for optimality are derived using Pontryagin’s Minimum Principle, resulting in a coupled system of state and adjoint equations. Numerical solutions are obtained using the fourth-order Runge–Kutta method combined with …

Stability Analysis Of Thermohaline Convection With A Time-Varying Shear Flow Using The Lyapunov Method, Kalin Kochnev

Honors Scholar Theses

This work applies the Lyapunov method to identify instabilities and compute the growth rate of a linear time-varying system. The linear system studied describes cold fresh water on top of hot salty water with a periodically time-varying background shear flow. A time-dependent weighting matrix is employed to construct a Lyapunov function candidate. The resulting linear matrix inequalities are discretized in time using the forward Euler method. As the number of temporal discretization points increases, the growth rate predicted by the Lyapunov method or Floquet theory, used for comparison, will converge to the same value obtained from numerical simulations. Furthermore, the …

Ai-Driven Optimization Of Wind Energy Distribution In Texas Using Multi-Agent Reinforcement Learning, Waleed Amer, Owolabi Oluwadamilola, Bassey Ogbonnaya

SMU Data Science Review

Abstract. The integration of large-scale wind power into modern electrical grids presents persistent challenges due to variability, curtailment, and compliance with operational constraints. This study proposes a multi-agent reinforcement learning (MARL) framework for optimizing wind energy distribution within the Texas power grid. The system employs three specialized agents—managing wind curtailment, storage utilization, and load adjustments—to collaboratively balance supply and demand under dynamic grid conditions. Using historical operational data from the Electric Reliability Council of Texas (ERCOT), the framework was trained and evaluated on a range of scenarios encompassing both typical and extreme operating conditions. Results demonstrate substantial performance improvements compared …

Using Compartmental Systems Of Ordinary Differential Equations And Optimal Control Theory To Compute Ideal Quantities Of Mentors For Student Populations, Timofey B. Gafurov

Annual Symposium on Biomathematics and Ecology Education and Research

No abstract provided.

Exploring Solutions To Food Addiction Challenges Using Mathematical Modeling, Simulation, And Analysis Applying Optimal Control Theory, Dia Bonsu, Padmanabhan Seshaiyer, Alonso Ogueda-Oliva

Annual Symposium on Biomathematics and Ecology Education and Research

No abstract provided.

Sustainable Insecticide Spraying Strategy For Long-Term Chagas Disease Vector Control, Bismark Oduro

Annual Symposium on Biomathematics and Ecology Education and Research

No abstract provided.

Using Compartmental Systems Of Ordinary Differential Equations And Optimal Control Theory To Compute Ideal Quantities Of Mentors For Student Populations, Timofey B. Gafurov

Annual Symposium on Biomathematics and Ecology Education and Research

No abstract provided.

Dynamics And Optimal Intervention Strategies In A Shigellosis Transmission Model, Mehmet Gümüs, Shewafera Wondimagegnhu Teklu, Kemal Türk

Mathematical Modelling and Numerical Simulation with Applications

This research explores how water treatment contributes to limiting the transmission of Shigellosis, an infection caused by bacteria from the Shigella genus. A mathematical framework is formulated to evaluate the influence of protective strategies and water purification on the spread of the disease. To confirm the model's biological relevance, its well-posedness is investigated. The basic reproduction number $(\mathfrak{R}_0)$, a critical indicator of disease behavior, is derived using the matrix operator method. Findings indicate that if $\mathfrak{R}_01$, the infection persists, with the endemic equilibrium exhibiting local asymptotic stability. A comprehensive cost-effectiveness analysis reveals that combining environmental protection with water treatment represents …

On The H-Property For Step-Graphons: Residual Case, Wanting Gao

McKelvey School of Engineering Graduate Student Theses & Dissertations

We investigate the H-property for step-graphons. Specifically, we sample graphs Gn on n nodes from a step-graphon and evaluate the probability that Gn has a Hamiltonian decomposition in the asymptotic regime as n → ∞. It has been shown in Belabbas and Chen (2023); Belabbas et al. (2021) that for almost all step-graphons, this probability converges to either zero or one. We focus in this paper on the residual case where the zero-one law does not apply. We show that the limit of the probability still exists and provide an explicit expression of it. We present a complete proof of …

Conformable Regulator Problems With Fixed Delay, Seth Baur, Joseph E. Smith, Nick Wintz

2025 Student Academic Showcase

In this project, we consider processes guided by a conformable derivative first introduced by Khalil et al in 2014. This time-weighted derivative has many of the same properties as the classical derivative but lacks the semigroup property for the exponential. Here, we study a conformable linear system where the state and control are subject to the same fixed delay. Our process is also subject to wear and tear, represented by a cost functional. Our goal is to find an optimal control that minimizes this cost. This control is propagated by a quasi-Ricatti equation, which itself includes a time delay. Finally, …

Applications For The Conformable Information Filter, Sophia Hungerford, Joseph E. Smith, Nick Wintz

2025 Student Academic Showcase

In this project, we offer application to our previously constructed information filter. The information filter is an algorithm used to estimate the information of a process corrupted in some way. The information filter is mathematically similar to the Kalman filter, widely used in navigation. Unlike the Kalman filter, the information filter propagates backwards in time and is more effective in smoothing. Here, our corrupted system is in terms of conformable derivative introduced by Khalil et al. in 2014. This time-weighted derivative shares many of the same properties as the classical derivative but lacks the usual semigroup property associated with the …

Using Mathematical Modeling To Study The Dynamics Of Legionnaires’ Disease And Consider Management Options, Mark Z. Wang, Christina J. Edholm, Lihong Zhao

Faculty Articles

Legionnaires' disease (LD) is a largely understudied and underreported pneumonic environmentally transmitted disease caused by the bacteria \textit{Legionella}. It primarily occurs in places with poorly maintained artificial sources of water. There is currently a lack of mathematical models on the dynamics of LD. In this paper, we formulate a novel ordinary differential equation-based susceptible-exposed-infected-recovered (SEIR) model for LD. One issue with LD is the difficulty in its detection, as the majority of countries around the world lack the proper surveillance and diagnosis methods. Thus, there is not much publicly available data or literature on LD. We use parameter estimation for …

Dual Quaternions For Gravity Recovery Missions, Ryan Kinzie

Doctoral Dissertations and Master's Theses

A dual quaternion-based modeling, state estimation and control approach is introduced as a better alternative to the traditional methods which are currently utilized for gravity recovery missions. The proposed modeling and control approach was verified against and compared to the tangent bundle to Special Euclidean Group 3 through MATLAB simulations. The dual quaternion-based approach shows superior performance over traditional linearized and uncoupled methodologies, in both modeling accuracy of spacecraft translational position, and the ability to control the pose of a test mass relative to its host spacecraft. Utilizing data products from the Gravity Recovery and Climate Experiment Follow-On mission, a …

Finite Hybrid- And Semi-Markov Chains, Jose L. Menaldi, Maurice Robin

Mathematics Faculty Research Publications

The ergodic behaviour of finite Markov chains having also instantaneous transition are considered. Some estimates are obtained which complement our previous work [29]. Also, an optimal switching control model for semi-Markov chains is analysed, without any particular assumptions on the recurrent classes.

Ergodic Switching Control For Markov-Feller Processes Ii, Jose L. Menaldi, Maurice Robin

Mathematics Faculty Research Publications

This is the continuation of Part I [14], where we considered control problems with long term average (or ergodic) cost for Markov switching processes (zt , nt ), nt being a discrete component with values in a finite set N . The control acts only on this discrete component and consists of immediate switching actions. We solve the ergodic problem in several situations extending previous works, mainly when zt is a reflected diffusion with or without jumps and when the set of control values is strictly smaller than N . In this Part II, we conclude our theoretical analysis with …

Ergodic Switching Control For Markov-Feller Processes I, Jose L. Menaldi, Maurice Robin

Mathematics Faculty Research Publications

We consider control problems with long term average (or ergodic) cost for Markov switching processes (zt, nt ), nt being a discrete component with values in a finite set N . The control acts only on this discrete component and consists of immediate switching actions. We solve the ergodic problem in several situations extending previous works, mainly when zt is a reflected diffusion with or without jumps and when the set of control values is strictly smaller than N .

Centralized Deep Reinforcement Learning For Homogeneous Multi-Component Maintenance Optimization, Joseph W. Wittrock

Theses and Dissertations

This thesis explores an application of reinforcement learning (RL) in maintenance optimization. Recent advances in hardware-accelerated computation and deep learning have made RL a powerful tool for solving optimization problems which are too complex for traditional methods. Maintenance optimization involves improving the efficiency and effectiveness of maintenance activities through data-driven approaches, ultimately reducing costs and increasing asset availability. Making informed maintenance decisions is crucial to long-term sustainability.

A desirable maintenance policy maximizes a utility signal while minimizing the cost of maintenance. Techniques in sequential decision making such as dynamic programming (DP) and RL have found success in optimizing these maintenance …

Solvability Of Stochastic Linear-Quadratic Optimal Control Problems Under Partial Stabilizability Conditions, Al-Sadh Rahman Imadh

Honors Undergraduate Theses

Optimal Control Theory, a branch of Control Theory, is applicable in fields such as engineering, operations research, and economics. Stochastic Optimal Control deals with noisy systems and data using Ito’s formulation. Given a noisy system and a cost functional, the goal is to find a control that will minimize the cost. This thesis focuses on linear quadratic stochastic optimal control, and we explore state equations that are not stabilizable. We first address measurability concerns arising from the semigroup property of the state trajectory. The notions of partial stability and partial stabilizability are introduced, and we formulate their corresponding Lyapunov and …

Quantized Average Agreement Algorithms With Error Correction For Digraphs, Shuaib A. Mughal

Honors Undergraduate Theses

Multi-agent systems have become more and more prevalent as technology increasingly gets integrated into our daily lives. Some of these technological systems are large in size; for example, the smart grid where multiple devices are used to monitor and control different aspects of the energy grid. Another example is a team of autonomous systems deployed for a specific task. When these systems are spatially distributed, an important component of distributed algorithms is the ability for the agents to reach consensus on the global state of the system. Reaching agreement enables the spatially distributed agent make decisions or determine the next …