Stability and bounded real lemmas of discrete-time MJLSs with the Markov chain on a Borel space

• Published in: Automatica (Oxford) 2024-11, Vol.169, p.111827, Article 111827
• Main Authors: Xiao, Chunjie, Hou, Ting, Zhang, Weihai
• Format: Article
• Language: English
• Subjects: Borel space; Bounded real lemma; Exponential stability; Markov jump linear systems
• ISSN: 0005-1098
• DOI: 10.1016/j.automatica.2024.111827

In this paper, exponential stability of discrete-time Markov jump linear systems (MJLSs) with the Markov chain on a Borel space (Θ,B(Θ)) is studied, and bounded real lemmas (BRLs) are given. The work generalizes the results from the previous literature that considered only the Markov chain taking values in a countable set to the scenario of an uncountable set and provides unified approaches for describing exponential stability and H∞ performance of MJLSs. This paper covers two kinds of exponential stabilities: one is exponential mean-square stability with conditioning (EMSSy-C), and the other is exponential mean-square stability (EMSSy). First, based on the infinite-dimensional operator theory, the equivalent conditions for determining these two kinds of stabilities are shown respectively by the exponentially stable evolutions generated by the corresponding bounded linear operators on different Banach spaces, which turn out to present the spectral criteria of EMSSy-C and EMSSy. Furthermore, the relationship between these two kinds of stabilities is discussed. Moreover, some easier-to-check criteria are established for EMSSy-C of MJLSs in terms of the existence of uniformly positive definite solutions of Lyapunov-type equations or inequalities. In addition, BRLs are given separately in terms of the existence of solutions of the Θ-coupled difference Riccati equation for the finite horizon case and algebraic Riccati equation for the infinite horizon case, which facilitates the H∞ analysis of MJLSs with the Markov chain on a Borel space.