Loading…

Deep Neural Networks Algorithms for Stochastic Control Problems on Finite Horizon: Numerical Applications

This paper presents several numerical applications of deep learning-based algorithms for discrete-time stochastic control problems in finite time horizon that have been introduced in Huré et al. ( 2018 ). Numerical and comparative tests using TensorFlow illustrate the performance of our different al...

Full description

Saved in:
Bibliographic Details
Published in:Methodology and computing in applied probability 2022-03, Vol.24 (1), p.143-178
Main Authors: Bachouch, Achref, Huré, Côme, Langrené, Nicolas, Pham, Huyên
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents several numerical applications of deep learning-based algorithms for discrete-time stochastic control problems in finite time horizon that have been introduced in Huré et al. ( 2018 ). Numerical and comparative tests using TensorFlow illustrate the performance of our different algorithms, namely control learning by performance iteration (algorithms NNcontPI and ClassifPI), control learning by hybrid iteration (algorithms Hybrid-Now and Hybrid-LaterQ), on the 100-dimensional nonlinear PDEs examples from Weinan et al. ( 2017 ) and on quadratic backward stochastic differential equations as in Chassagneux and Richou ( 2016 ). We also performed tests on low-dimension control problems such as an option hedging problem in finance, as well as energy storage problems arising in the valuation of gas storage and in microgrid management. Numerical results and comparisons to quantization-type algorithms Qknn, as an efficient algorithm to numerically solve low-dimensional control problems, are also provided.
ISSN:1387-5841
1573-7713
DOI:10.1007/s11009-019-09767-9