Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 5 of 5
Full-Text Articles in Physical Sciences and Mathematics
Remarks On Risk-Sensitive Control Problems, José Luis Menaldi, Maurice Robin
Remarks On Risk-Sensitive Control Problems, José Luis Menaldi, Maurice Robin
Mathematics Faculty Research Publications
The main purpose of this paper is to investigate the asymptotic behavior of the discounted risk-sensitive control problem for periodic diffusion processes when the discount factor α goes to zero. If uα(θ, x) denotes the optimal cost function, being the risk factor, then it is shown that limα→0αuα(θ, x) = ξ(θ) where ξ(θ) is the average on ]0, θ[ of the optimal cost of the (usual) in nite horizon risk-sensitive control problem.
Impulse Control Of Stochastic Navier-Stokes Equations, J. L. Menaldi, S. S. Sritharan
Impulse Control Of Stochastic Navier-Stokes Equations, J. L. Menaldi, S. S. Sritharan
Mathematics Faculty Research Publications
In this paper we study stopping time and impulse control problems for stochastic Navier-Stokes equation. Exploiting a local monotonicity property of the nonlinearity, we establish existence and uniqueness of strong solutions in two dimensions which gives a Markov-Feller process. The variational inequality associated with the stopping time problem and the quasi-variational inequality associated with the impulse control problem are resolved in a weak sense, using semigroup approach with a convergence uniform over path.
Singular Ergodic Control For Multidimensional Gaussian Processes, J. L. Menaldi, M. Robin, M. I. Taksar
Singular Ergodic Control For Multidimensional Gaussian Processes, J. L. Menaldi, M. Robin, M. I. Taksar
Mathematics Faculty Research Publications
A multidimensional Wiener process is controlled by an additive process of bounded variation. A convex nonnegative function measures the cost associated with the position of the state process, and the cost of controlling is proportional to the displacement induced. We minimize a limiting time-average expected (ergodic) criterion. Under reasonable assumptions, we prove that the optimal discounted cost converges to the optimal ergodic cost. Moreover, under some additional conditions there exists a convex Lipschitz continuous function solution to the corresponding Hamilton-Jacobi-Bellman equation which provides an optimal stationary feedback control.
On The Optimal Reward Function Of The Continuous Time Multiarmed Bandit Problem, José Luis Menaldi, Maurice Robin
On The Optimal Reward Function Of The Continuous Time Multiarmed Bandit Problem, José Luis Menaldi, Maurice Robin
Mathematics Faculty Research Publications
The optimal reward function associated with the so-called "multiarmed bandit problem" for general Markov-Feller processes is considered. It is shown that this optimal reward function has a simple expression (product form) in terms of individual stopping problems, without any smoothness properties of the optimal reward function neither for the global problem nor for the individual stopping problems. Some results relative to a related problem with switching cost are obtained.
Some Estimates For Finite Difference Approximations, José-Luis Menaldi
Some Estimates For Finite Difference Approximations, José-Luis Menaldi
Mathematics Faculty Research Publications
Some estimates for the approximation of optimal stochastic control problems by discrete time problems are obtained. In particular an estimate for the solutions of the continuous time versus the discrete time Hamilton-Jacobi-Bellman equations is given. The technique used is more analytic than probabilistic.