Convergence of a robust deep FBSDE method for stochastic control

01/18/2022
by   Kristoffer Andersson, et al.
0

In this paper we propose a deep learning based numerical scheme for strongly coupled FBSDE, stemming from stochastic control. It is a modification of the deep BSDE method in which the initial value to the backward equation is not a free parameter, and with a new loss function being the weighted sum of the cost of the control problem, and a variance term which coincides with the means square error in the terminal condition. We show by a numerical example that a direct extension of the classical deep BSDE method to FBSDE, fails for a simple linear-quadratic control problem, and motivate why the new method works. Under regularity and boundedness assumptions on the exact controls of time continuous and time discrete control problems we provide an error analysis for our method. We show empirically that the method converges for three different problems, one being the one that failed for a direct extension of the deep BSDE method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2020

Hamilton-Jacobi Deep Q-Learning for Deterministic Continuous-Time Systems with Lipschitz Continuous Controls

In this paper, we propose Q-learning algorithms for continuous-time dete...
research
11/27/2019

Introduction to Solving Quant Finance Problems with Time-Stepped FBSDE and Deep Learning

In this introductory paper, we discuss how quantitative finance problems...
research
09/17/2020

Regularity and time discretization of extended mean field control problems: a McKean-Vlasov FBSDE approach

We analyze the solution regularity and discrete-time approximations of e...
research
03/22/2022

Linear convergence of a policy gradient method for finite horizon continuous time stochastic control problems

Despite its popularity in the reinforcement learning community, a provab...
research
01/09/2020

Regularity and stability of feedback relaxed controls

This paper proposes a relaxed control regularization with general explor...
research
10/24/2021

Deep Learning Approximation of Diffeomorphisms via Linear-Control Systems

In this paper we propose a Deep Learning architecture to approximate dif...
research
04/07/2021

Numerics for Stochastic Distributed Parameter Control Systems: a Finite Transposition Method

In this chapter, we present some recent progresses on the numerics for s...

Please sign up or login with your details

Forgot password? Click here to reset