2002PAMMRequires access

On the value function for optimal control problems with infinite horizon

Antonio Leitão

Open publisher page 0 citations

Abstract

We consider optimal control problems of infinite horizon type, whose control laws are given by L1loc-functions and whose objective function has the meaning of a discounted utility. Our main objective is the verification of the fact that the value function is a viscosity solution of the Hamilton-Jacobi-Bellman (HJB) equation in this framework. The usual final condition for the HJB-equation in the finite horizon case (V (T, x) = 0 or V (T, x) = g(x)) has to be substituted by a decay condition at the infinity. Following the dynamic programming approach, we obtain Bellman's optimality principle and the dynamic programming equation (see (3)). We also prove a regularity result (local Lipschitz continuity) for the value function.

About this research paper

What this paper is about

We consider optimal control problems of infinite horizon type, whose control laws are given by L1loc-functions and whose objective function has the meaning of a discounted utility. Our main objective is the verification of the fact that the value function is a viscosity solution of the Hamilton-Jacobi-Bellman (HJB) equation in this framework. The usual final condition for the HJB-equation in the finite horizon case (V (T, x) = 0 or V (T, x) = g(x)) has to be substituted by a decay condition at the infinity. Following the dynamic programming approach, we obtain Bellman's optimality principle and the dynamic programming equation (see (3)). We also prove a regularity result (local Lipschitz continuity) for the value function.

Why it matters

A significance statement is not available in the OpenAlex record.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

We consider optimal control problems of infinite horizon type, whose control laws are given by L1loc-functions and whose objective function has the meaning of a discounted utility. Our main objective is the verification of the fact that the value function is a viscosity solution of the Hamilton-Jacobi-Bellman (HJB) equation in this framework. The usual final condition for the HJB-equation in the finite horizon case (V (T, x) = 0 or V (T, x) = g(x)) has to be substituted by a decay condition at the infinity. Following the dynamic programming approach, we obtain Bellman's optimality principle and the dynamic programming equation (see (3)). We also prove a regularity result (local Lipschitz continuity) for the value function.

Key concepts: Hamilton–Jacobi–Bellman equation, Bellman equation, Viscosity solution, Lipschitz continuity, Mathematics, Dynamic programming, Optimal control, Function (biology)

Related papers

Back to paper searchBrowse research topicsOriginal source
On the value function for optimal control problems with infinite horizon — Research Paper | ScholarLens