Physical Sciences and Mathematics Commons^™

On Some Ergodic Impulse Control Problems With Constraint, J. L. Menaldi, Maurice Robin

Mathematics Faculty Research Publications

This paper studies the impulse control of a general Markov process under the average (or ergodic) cost when the impulse instants are restricted to be the arrival times of an exogenous process, and this restriction is referred to as a constraint. A detailed setting is described, a characterization of the optimal cost is obtained as a solution of an HJB equation, and an optimal impulse control is identified.

Discrete-Time Hybrid Control In Borel Spaces: Average Cost Optimality Criterion, Héctor Jasso-Fuentes, José-Luis Menaldi, Tomás Prieto-Rumeau, Maurice Robin

Mathematics Faculty Research Publications

This paper addresses an optimal hybrid control problem in discrete-time with Borel state and action spaces. By hybrid we mean that the evolution of the state of the system may undergo deep changes according to structural modifications of the dynamic. Such modifications occur either by the position of the state or by means of the controller's actions. The optimality criterion is of a long-run ratio-average (or ratio-ergodic) type. We provide the existence of optimal average policies for this hybrid control problem by analyzing an associated dynamic programming equation. We also show that this problem can be translated into a standard …

Discrete-Time Hybrid Control In Borel Spaces, Héctor Jasso-Fuentes, José-Luis Menaldi, Tomás Prieto-Rumeau

Mathematics Faculty Research Publications

A discrete-time hybrid control model with Borel state and action spaces is introduced. In this type of models, the dynamic of the system is composed by two sub-dynamics affecting the evolution of the state; one is of a standard-type that runs almost every time and another is of a special-type that is active under special circumstances. The controller is able to use two different type of actions, each of them is applied to each of the two sub-dynamics, and the activations of these sub-dynamics are possible according to an activation rule that can be handled by the controller. The aim …

Switching Diffusion Systems With Past-Dependent Switching Having A Countable State Space, Hai Dang Nguyen

Wayne State University Dissertations

Emerging and existing applications in wireless communications, queueing networks, biological models, financial engineering, and social networks demand the

mathematical modeling and analysis of hybrid models in which continuous dynamics and discrete events coexist.

Assuming that the systems are in continuous times,

stemming from stochastic-differential-equation-based models and random discrete events,

switching diffusions come into being. In such systems, continuous states and discrete events

(discrete states)

coexist and interact.

A switching diffusion is a two-component process $(X(t),\alpha(t))$, a continuous component and a discrete component taking values in a discrete set (a set consisting of isolated points).

When the discrete component takes a …

Sdes, Jumps And Estimates, Jose L. Menaldi

Mathematics Faculty Research Publications

Long Title: Stochastic Ordinary Differential Equations with Jumps: Theory and Estimates. Chapters: Stochastic Integrals - Initial Approach to SDEs - Estimates of SDEs - Other Formulations of SDEs - SDEs with Reflection - PDE Connections.

Monotonicity Of Set-Valued Mappings And Full Stability Of General Parametrical Variational Systems, Dat Pham

Wayne State University Dissertations

The dissertation introduces and studies the notions of Lipschitzian and Holderian full stability of solutions to three-parametric variational systems described in the generalized equation formalism involving nonsmooth base mappings and partial subgradients of prox-regular functions acting in Hilbert spaces. Employing advanced tools and techniques of second-order variational analysis allows us to establish complete characterizations of, as well as directly variable sufficient conditions for, such full stability properties under mild assumptions. Furthermore, we derive exact formulas and effective quantitative estimates for the corresponding moduli.