Discrete-time stochastic optimal control via occupation measures and moment relaxations

We consider discrete-time nonlinear stochastic optimal control problems for which all the data are polynomial. For this class of problems we derive a hierarchy of linear matrix inequality relaxations which is based on occupation measures and moment theory. The dual of the convex problem obtained, wh...

Full description

Saved in:
Bibliographic Details
Main Authors: Savorgnan, C., Lasserre, J.B., Diehl, M.
Format: Conference Proceeding
Language:English
Subjects:
Costs
Difference equations
Extraterrestrial measurements
Linear matrix inequalities
Linear programming
Optimal control
Polynomials
Process control
Stochastic processes
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We consider discrete-time nonlinear stochastic optimal control problems for which all the data are polynomial. For this class of problems we derive a hierarchy of linear matrix inequality relaxations which is based on occupation measures and moment theory. The dual of the convex problem obtained, which can be interpreted in terms of the Bellman equation, is then used to derive an almost optimal control law. A numerical example illustrates the effectiveness of the approach.
ISSN:0191-2216
DOI:10.1109/CDC.2009.5399899