Discrete-Time Impulsive Adaptive Dynamic Programming

In this paper, a new iterative adaptive dynamic programming (ADP) algorithm is developed to solve optimal impulsive control problems for infinite horizon discrete-time nonlinear systems. Considering the constraint of the impulsive interval, in each iteration, the iterative impulsive value function u...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on cybernetics 2020-10, Vol.50 (10), p.4293-4306
Main Authors: Wei, Qinglai, Song, Ruizhuo, Liao, Zehua, Li, Benkai, Lewis, Frank L.
Format: Article
Language:English
Subjects:
Adaptive algorithms
Adaptive control
Adaptive critic designs
adaptive dynamic programming (ADP)
approximate dynamic programming
Computer simulation
Control theory
Convergence
Discrete time systems
Dynamic programming
Heuristic algorithms
impulsive control
Indexes
Nonlinear systems
Optimal control
Optimization
Performance analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, a new iterative adaptive dynamic programming (ADP) algorithm is developed to solve optimal impulsive control problems for infinite horizon discrete-time nonlinear systems. Considering the constraint of the impulsive interval, in each iteration, the iterative impulsive value function under each possible impulsive interval is obtained, and then the iterative value function and iterative control law are achieved. A new convergence analysis method is developed which proves an iterative value function to converge to the optimum as the iteration index increases to infinity. The properties of the iterative control law are analyzed, and the detailed implementation of the optimal impulsive control law is presented. Finally, two simulation examples with comparisons are given to show the effectiveness of the developed method.
ISSN:2168-2267
2168-2275
DOI:10.1109/TCYB.2019.2906694