2020•IFAC-PapersOnLineOpen access

Continuity of the Value Function for Stochastic Sparse Optimal Control

Kaito Ito, Takuya Ikeda, Kenji Kashima

Open full text 4 citations

Abstract

In this paper, we investigate the continuity of the value function for a stochastic sparse optimal control. The most common method to solve stochastic optimal control problems is the dynamic programming. Specifically, if the value function is smooth, it satisfies the associated Hamilton-Jacobi-Bellman (HJB) equation. However, in general, the value function for our problem is not differentiable because of the nonsmoothness of the L0 cost functional. Instead, we can expect that the value function is a viscosity solution to the HJB equation. This paper shows the continuity of our value function as a first step for showing that the value function is a viscosity solution.

About this research paper

What this paper is about

In this paper, we investigate the continuity of the value function for a stochastic sparse optimal control. The most common method to solve stochastic optimal control problems is the dynamic programming. Specifically, if the value function is smooth, it satisfies the associated Hamilton-Jacobi-Bellman (HJB) equation. However, in general, the value function for our problem is not differentiable because of the nonsmoothness of the L0 cost functional. Instead, we can expect that the value function is a viscosity solution to the HJB equation. This paper shows the continuity of our value function as a first step for showing that the value function is a viscosity solution.

Why it matters

OpenAlex reports 4 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

In this paper, we investigate the continuity of the value function for a stochastic sparse optimal control. The most common method to solve stochastic optimal control problems is the dynamic programming. Specifically, if the value function is smooth, it satisfies the associated Hamilton-Jacobi-Bellman (HJB) equation. However, in general, the value function for our problem is not differentiable because of the nonsmoothness of the L0 cost functional. Instead, we can expect that the value function is a viscosity solution to the HJB equation. This paper shows the continuity of our value function as a first step for showing that the value function is a viscosity solution.

Key concepts: Hamilton–Jacobi–Bellman equation, Bellman equation, Viscosity solution, Differentiable function, Stochastic control, Function (biology), Optimal control, Value (mathematics)

Related papers

Back to paper searchBrowse research topicsOriginal source
Continuity of the Value Function for Stochastic Sparse Optimal Control — Research Paper | ScholarLens