Optimal bounds for numerical approximations of infinite horizon problems based on dynamic programming approach

In this paper we get error bounds for fully discrete approximations of infinite horizon problems via the dynamic programming approach. It is well known that, considering a time discretization with a positive step size h, an error bound of size h can be proved for the difference between the value fun...

Descripción completa

Detalles Bibliográficos
Autores: De Frutos, Javier, Novo Martín, Julia
Tipo de recurso: artículo
Fecha de publicación:2022
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/708440
Acceso en línea:http://hdl.handle.net/10486/708440
https://dx.doi.org/10.1137/21M1459290
Access Level:acceso abierto
Palabra clave:Dynamic Programming
Hamilton-Jacobi-Bellman Equation
Optimal Control
Error Analysis
Matemáticas
Descripción
Sumario:In this paper we get error bounds for fully discrete approximations of infinite horizon problems via the dynamic programming approach. It is well known that, considering a time discretization with a positive step size h, an error bound of size h can be proved for the difference between the value function (viscosity solution of the Hamilton-Jacobi-Bellman equation corresponding to the infinite horizon) and the value function of the discrete time problem. However, including also a spatial discretization based on elements of size k, an error bound of size O(k/h) can be found in the literature for the error between the value functions of the continuous problem and the fully discrete problem. In this paper we revise the error bound of the fully discrete method and prove, under assumptions similar to those of the time discrete case, that the error of the fully discrete case is in fact O(h + k), which gives first order in time and space for the method. This error bound matches the numerical experiments of many papers in the literature in which the behavior 1/h from the bound O(k/h) has not been observed