Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 2 of 2
Full-Text Articles in Physical Sciences and Mathematics
Singular Ergodic Control For Multidimensional Gaussian Processes, J. L. Menaldi, M. Robin, M. I. Taksar
Singular Ergodic Control For Multidimensional Gaussian Processes, J. L. Menaldi, M. Robin, M. I. Taksar
Mathematics Faculty Research Publications
A multidimensional Wiener process is controlled by an additive process of bounded variation. A convex nonnegative function measures the cost associated with the position of the state process, and the cost of controlling is proportional to the displacement induced. We minimize a limiting time-average expected (ergodic) criterion. Under reasonable assumptions, we prove that the optimal discounted cost converges to the optimal ergodic cost. Moreover, under some additional conditions there exists a convex Lipschitz continuous function solution to the corresponding Hamilton-Jacobi-Bellman equation which provides an optimal stationary feedback control.
Some Estimates For Finite Difference Approximations, José-Luis Menaldi
Some Estimates For Finite Difference Approximations, José-Luis Menaldi
Mathematics Faculty Research Publications
Some estimates for the approximation of optimal stochastic control problems by discrete time problems are obtained. In particular an estimate for the solutions of the continuous time versus the discrete time Hamilton-Jacobi-Bellman equations is given. The technique used is more analytic than probabilistic.