Open Access. Powered by Scholars. Published by Universities.®

Probability Commons™

Open Access. Powered by Scholars. Published by Universities.®

Numerical Analysis and Computation

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 31 - 40 of 40

Full-Text Articles in Probability

Impulse Control Of Stochastic Navier-Stokes Equations, J. L. Menaldi, S. S. Sritharan Jan 2003

Impulse Control Of Stochastic Navier-Stokes Equations, J. L. Menaldi, S. S. Sritharan

Mathematics Faculty Research Publications

In this paper we study stopping time and impulse control problems for stochastic Navier-Stokes equation. Exploiting a local monotonicity property of the nonlinearity, we establish existence and uniqueness of strong solutions in two dimensions which gives a Markov-Feller process. The variational inequality associated with the stopping time problem and the quasi-variational inequality associated with the impulse control problem are resolved in a weak sense, using semigroup approach with a convergence uniform over path.

Go to article

Stochastic Hybrid Control, A. Bensoussan, J. L. Menaldi Sep 2000

Stochastic Hybrid Control, A. Bensoussan, J. L. Menaldi

Mathematics Faculty Research Publications

The objective of this paper is to study the stochastic version of a previous paper of the authors, in which hybrid control for deterministic systems was considered. The modelling is quite similar to the deterministic case. We have a system whose state is composed of a continuous part and a discrete part. They are affected by a continuous type control and an impulse control. The dynamics is moreover perturbed by noise, also a continuous and a discrete noise process. The Markovian character of the state process is preserved. We develop the model and show how the dynamic programming approach leads …

Go to article

Invariant Measure For Diffusions With Jumps, Jose-Luis Menaldi, Maurice Robin Feb 1999

Invariant Measure For Diffusions With Jumps, Jose-Luis Menaldi, Maurice Robin

Mathematics Faculty Research Publications

Our purpose is to study an ergodic linear equation associated to diffusion processes with jumps in the whole space. This integro-differential equation plays a fundamental role in ergodic control problems of second order Markov processes. The key result is to prove the existence and uniqueness of an invariant density function for a jump diffusion, whose lower order coefficients are only Borel measurable. Based on this invariant probability, existence and uniqueness (up to an additive constant) of solutions to the ergodic linear equation are established.

Go to article

Ergodic Control Of Reflected Diffusions With Jumps, Jose-Luis Menaldi, Maurice Robin Mar 1997

Ergodic Control Of Reflected Diffusions With Jumps, Jose-Luis Menaldi, Maurice Robin

Mathematics Faculty Research Publications

No abstract provided.

Go to article

On An Investment-Consumption Model With Transaction Costs, Marianne Akian, José Luis Menaldi, Agnès Sulem Jan 1996

On An Investment-Consumption Model With Transaction Costs, Marianne Akian, José Luis Menaldi, Agnès Sulem

Mathematics Faculty Research Publications

This paper considers the optimal consumption and investment policy for an investor who has available one bank account paying a fixed interest rate and n risky assets whose prices are log-normal diffusions. We suppose that transactions between the assets incur a cost proportional to the size of the transaction. The problem is to maximize the total utility of consumption. Dynamic programming leads to a variational inequality for the value function. Existence and uniqueness of a viscosity solution are proved. The variational inequality is solved by using a numerical algorithm based on policies, iterations, and multigrid methods. Numerical results are displayed …

Go to article

Optimal Control And Differential Games With Measures, E. N. Barron, R. Jensen, J. L. Menaldi Jan 1993

Optimal Control And Differential Games With Measures, E. N. Barron, R. Jensen, J. L. Menaldi

Mathematics Faculty Research Publications

We consider control problems with trajectories which involve ordinary measureable control functions and controls which are measures. The payoff involves a running cost in time and a running cost against the control measures. In the optimal control problem we are trying to minimize this payoff with both controls. In the differential game problem we are trying to minimize the cost with the ordinary controls assuming that the measure controls are chosen to maximize the cost. We will characterize the value functions in both cases using viscosity solution theory by deriving the Bellman and Isaacs equations.

Go to article

Singular Ergodic Control For Multidimensional Gaussian Processes, J. L. Menaldi, M. Robin, M. I. Taksar Mar 1992

Singular Ergodic Control For Multidimensional Gaussian Processes, J. L. Menaldi, M. Robin, M. I. Taksar

Mathematics Faculty Research Publications

A multidimensional Wiener process is controlled by an additive process of bounded variation. A convex nonnegative function measures the cost associated with the position of the state process, and the cost of controlling is proportional to the displacement induced. We minimize a limiting time-average expected (ergodic) criterion. Under reasonable assumptions, we prove that the optimal discounted cost converges to the optimal ergodic cost. Moreover, under some additional conditions there exists a convex Lipschitz continuous function solution to the corresponding Hamilton-Jacobi-Bellman equation which provides an optimal stationary feedback control.

Go to article

On The Optimal Reward Function Of The Continuous Time Multiarmed Bandit Problem, José Luis Menaldi, Maurice Robin Jan 1990

On The Optimal Reward Function Of The Continuous Time Multiarmed Bandit Problem, José Luis Menaldi, Maurice Robin

Mathematics Faculty Research Publications

The optimal reward function associated with the so-called "multiarmed bandit problem" for general Markov-Feller processes is considered. It is shown that this optimal reward function has a simple expression (product form) in terms of individual stopping problems, without any smoothness properties of the optimal reward function neither for the global problem nor for the individual stopping problems. Some results relative to a related problem with switching cost are obtained.

Go to article

Some Estimates For Finite Difference Approximations, José-Luis Menaldi May 1989

Some Estimates For Finite Difference Approximations, José-Luis Menaldi

Mathematics Faculty Research Publications

Some estimates for the approximation of optimal stochastic control problems by discrete time problems are obtained. In particular an estimate for the solutions of the continuous time versus the discrete time Hamilton-Jacobi-Bellman equations is given. The technique used is more analytic than probabilistic.

Go to article

On Asymptotic Behavior Of Stopping Time Problems, Jose Luis Menaldi, Maurice Robin Jan 1989

On Asymptotic Behavior Of Stopping Time Problems, Jose Luis Menaldi, Maurice Robin

Mathematics Faculty Research Publications

No abstract provided.

Go to article

First Prev