Control Theory Commons^™

Optimal Stopping Problems For A Family Of Continuous-Time Markov Processes, Héctor Jasso-Fuentes, Jose-Luis Menaldi, Fidel Vásquez-Rojas

Mathematics Faculty Research Publications

In this paper we study the well-know optimal stopping problem applied to a general family of continuous-time Markov process. The approach to follow is merely analytic and it is based on the characterization of stopping problems through the study of a certain variational inequality; namely one solution of this inequality will coincide with the optimal value of the stopping problem. In addition, by means of this characterization, it is possible to find the so-named continuation region, and as a byproduct obtaining the optimal stopping time. The most of the material is based on the semigroup theory, infinitesimal generators and resolvents. …

Basic Probability Theory, Jose Luis Menaldi

Mathematics Faculty Research Publications

Long title: Basic Probability Theory: Independent Random Variables and Sample Spaces. Chapters: Elementary Probability - Basic Probability - Canonical Sample Spaces - Working on Probability Spaces - A Solutions to Exercises.

Relaxation And Linear Programs On A Hybrid Control Model, Héctor Jasso-Fuentes, Jose-Luis Menaldi

Mathematics Faculty Research Publications

Some optimality results for hybrid control problems are presented. The hybrid model under study consists of two subdynamics, one of a standard type governed by an ordinary differential equation, and the other of a special type having a discrete evolution. We focus on the case when the interaction between the subdynamics takes place only when the state of the system reaches a given fixed region of the state space. The controller is able to apply two controls, each applied to one of the two subdynamics, whereas the state follows a composite evolution, of continuous type and discrete type. By the …

On Optimal Stopping And Impulse Control With Constraint, J. L. Menaldi, M. Robin

Mathematics Faculty Research Publications

The optimal stopping and impulse control problems for a Markov-Feller process are considered when the controls are allowed only when a signal arrives. This is referred to as control problems with constraint. In [28, 29, 30], the HJB equation was solved and an optimal control (for the optimal stopping problem, the discounted impulse control problem and the ergodic impulse control problem, respectively) was obtained, under suitable conditions, including a setting on a compact metric state space. In this work, we extend most of the results to the situation where the state space of the Markov process is locally compact.

On Some Ergodic Impulse Control Problems With Constraint, J. L. Menaldi, Maurice Robin

Mathematics Faculty Research Publications

This paper studies the impulse control of a general Markov process under the average (or ergodic) cost when the impulse instants are restricted to be the arrival times of an exogenous process, and this restriction is referred to as a constraint. A detailed setting is described, a characterization of the optimal cost is obtained as a solution of an HJB equation, and an optimal impulse control is identified.

Discrete-Time Hybrid Control In Borel Spaces: Average Cost Optimality Criterion, Héctor Jasso-Fuentes, José-Luis Menaldi, Tomás Prieto-Rumeau, Maurice Robin

Mathematics Faculty Research Publications

This paper addresses an optimal hybrid control problem in discrete-time with Borel state and action spaces. By hybrid we mean that the evolution of the state of the system may undergo deep changes according to structural modifications of the dynamic. Such modifications occur either by the position of the state or by means of the controller's actions. The optimality criterion is of a long-run ratio-average (or ratio-ergodic) type. We provide the existence of optimal average policies for this hybrid control problem by analyzing an associated dynamic programming equation. We also show that this problem can be translated into a standard …

Discrete-Time Hybrid Control In Borel Spaces, Héctor Jasso-Fuentes, José-Luis Menaldi, Tomás Prieto-Rumeau

Mathematics Faculty Research Publications

A discrete-time hybrid control model with Borel state and action spaces is introduced. In this type of models, the dynamic of the system is composed by two sub-dynamics affecting the evolution of the state; one is of a standard-type that runs almost every time and another is of a special-type that is active under special circumstances. The controller is able to use two different type of actions, each of them is applied to each of the two sub-dynamics, and the activations of these sub-dynamics are possible according to an activation rule that can be handled by the controller. The aim …

Sdes, Jumps And Estimates, Jose L. Menaldi

Mathematics Faculty Research Publications

Long Title: Stochastic Ordinary Differential Equations with Jumps: Theory and Estimates. Chapters: Stochastic Integrals - Initial Approach to SDEs - Estimates of SDEs - Other Formulations of SDEs - SDEs with Reflection - PDE Connections.

On Some Impulse Control Problems With Constraint, Jose L. Menaldi, Maurice Robin

Mathematics Faculty Research Publications

The impulse control of a Markov–Feller process is considered when the impulses are allowed only when a signal arrives. This is referred to as an impulse control problem with constraint. A detailed setting is described, a characterization of the optimal cost is obtained using previous results of the authors on optimal stopping problems with constraint, and an optimal impulse control is identified.

Stochastic Differential Equations With Jumps, Jose L. Menaldi

Mathematics Faculty Research Publications

Part I Stochastic Processes with Jumps Chapters: Probability Spaces, Semigroup Theory - Part II Stochastic Differential Equations with Jumps Chapters: Stochastic Calculus, Stochastic Differential Equations - Part III Reflected SDE with Jumps Chapters: Stochastic Differential Equations II, Stochastic Differential Equations III.

Comment: This is last version from 2014-01-07. *This Initial version 15/May/2008 was corrected and augmented to produce the others 5 volumes.