Continuous-Time Markov Jump Linear Systems


Book Description

It has been widely recognized nowadays the importance of introducing mathematical models that take into account possible sudden changes in the dynamical behavior of a high-integrity systems or a safety-critical system. Such systems can be found in aircraft control, nuclear power stations, robotic manipulator systems, integrated communication networks and large-scale flexible structures for space stations, and are inherently vulnerable to abrupt changes in their structures caused by component or interconnection failures. In this regard, a particularly interesting class of models is the so-called Markov jump linear systems (MJLS), which have been used in numerous applications including robotics, economics and wireless communication. Combining probability and operator theory, the present volume provides a unified and rigorous treatment of recent results in control theory of continuous-time MJLS. This unique approach is of great interest to experts working in the field of linear systems with Markovian jump parameters or in stochastic control. The volume focuses on one of the few cases of stochastic control problems with an actual explicit solution and offers material well-suited to coursework, introducing students to an interesting and active research area. The book is addressed to researchers working in control and signal processing engineering. Prerequisites include a solid background in classical linear control theory, basic familiarity with continuous-time Markov chains and probability theory, and some elementary knowledge of operator theory. ​




Discrete-Time Markov Jump Linear Systems


Book Description

This will be the most up-to-date book in the area (the closest competition was published in 1990) This book takes a new slant and is in discrete rather than continuous time




Positive Markov Jump Linear Systems


Book Description

Positive Markov Jump Linear Systems are piecewise positive linear systems affected by a stochastic signal generated by a Markov chain. Positive systems naturally arise in the description of biological systems, compartmental models, population dynamics, traffic modeling, chemical reactions, queue processes, and so on. A rich literature on positive linear systems is now available. Positive Markov Jump Linear Systems is the first work to provide an overview of these developments. It outlines the typical applications of such systems, giving a detailed description of the mathematical theory underpinning the subject. Positive Markov Jump Linear Systems provides a comprehensive and timely introduction to the study of such systems. Readers who are new to the topic will find everything required to understand such systems in a concise and accessible form.




Stability Analysis of Markovian Jump Systems


Book Description

This book focuses on the stability analysis of Markovian jump systems (MJSs) with various settings and discusses its applications in several different areas. It also presents general definitions of the necessary concepts and an overview of the recent developments in MJSs. Further, it addresses the general robust problem of Markovian jump linear systems (MJLSs), the asynchronous stability of a class of nonlinear systems, the robust adaptive control scheme for a class of nonlinear uncertain MJSs, the practical stability of MJSs and its applications as a modelling tool for networked control systems, Markovian-based control for wheeled mobile manipulators and the jump-linear-quadratic (JLQ) problem of a class of continuous-time MJLSs. It is a valuable resource for researchers and graduate students in the field of control theory and engineering.




Finite-Time Stability: An Input-Output Approach


Book Description

Systematically presents the input-output finite-time stability (IO-FTS) analysis of dynamical systems, covering issues of analysis, design and robustness The interest in finite-time control has continuously grown in the last fifteen years. This book systematically presents the input-output finite-time stability (IO-FTS) analysis of dynamical systems, with specific reference to linear time-varying systems and hybrid systems. It discusses analysis, design and robustness issues, and includes applications to real world engineering problems. While classical FTS has an important theoretical significance, IO-FTS is a more practical concept, which is more suitable for real engineering applications, the goal of the research on this topic in the coming years. Key features: Includes applications to real world engineering problems. Input-output finite-time stability (IO-FTS) is a practical concept, useful to study the behavior of a dynamical system within a finite interval of time. Computationally tractable conditions are provided that render the technique applicable to time-invariant as well as time varying and impulsive (i.e. switching) systems. The LMIs formulation allows mixing the IO-FTS approach with existing control techniques (e. g. H∞ control, optimal control, pole placement, etc.). This book is essential reading for university researchers as well as post-graduate engineers practicing in the field of robust process control in research centers and industries. Topics dealt with in the book could also be taught at the level of advanced control courses for graduate students in the department of electrical and computer engineering, mechanical engineering, aeronautics and astronautics, and applied mathematics.




Non-cooperative Stochastic Differential Game Theory of Generalized Markov Jump Linear Systems


Book Description

This book systematically studies the stochastic non-cooperative differential game theory of generalized linear Markov jump systems and its application in the field of finance and insurance. The book is an in-depth research book of the continuous time and discrete time linear quadratic stochastic differential game, in order to establish a relatively complete framework of dynamic non-cooperative differential game theory. It uses the method of dynamic programming principle and Riccati equation, and derives it into all kinds of existence conditions and calculating method of the equilibrium strategies of dynamic non-cooperative differential game. Based on the game theory method, this book studies the corresponding robust control problem, especially the existence condition and design method of the optimal robust control strategy. The book discusses the theoretical results and its applications in the risk control, option pricing, and the optimal investment problem in the field of finance and insurance, enriching the achievements of differential game research. This book can be used as a reference book for non-cooperative differential game study, for graduate students majored in economic management, science and engineering of institutions of higher learning.




Advances in the Control of Markov Jump Linear Systems with No Mode Observation


Book Description

This brief broadens readers’ understanding of stochastic control by highlighting recent advances in the design of optimal control for Markov jump linear systems (MJLS). It also presents an algorithm that attempts to solve this open stochastic control problem, and provides a real-time application for controlling the speed of direct current motors, illustrating the practical usefulness of MJLS. Particularly, it offers novel insights into the control of systems when the controller does not have access to the Markovian mode.




Analysis and Design of Markov Jump Systems with Complex Transition Probabilities


Book Description

The book addresses the control issues such as stability analysis, control synthesis and filter design of Markov jump systems with the above three types of TPs, and thus is mainly divided into three parts. Part I studies the Markov jump systems with partially unknown TPs. Different methodologies with different conservatism for the basic stability and stabilization problems are developed and compared. Then the problems of state estimation, the control of systems with time-varying delays, the case involved with both partially unknown TPs and uncertain TPs in a composite way are also tackled. Part II deals with the Markov jump systems with piecewise homogeneous TPs. Methodologies that can effectively handle control problems in the scenario are developed, including the one coping with the asynchronous switching phenomenon between the currently activated system mode and the controller/filter to be designed. Part III focuses on the Markov jump systems with memory TPs. The concept of σ-mean square stability is proposed such that the stability problem can be solved via a finite number of conditions. The systems involved with nonlinear dynamics (described via the Takagi-Sugeno fuzzy model) are also investigated. Numerical and practical examples are given to verify the effectiveness of the obtained theoretical results. Finally, some perspectives and future works are presented to conclude the book.




Analysis and Design of Singular Markovian Jump Systems


Book Description

This monograph is an up-to-date presentation of the analysis and design of singular Markovian jump systems (SMJSs) in which the transition rate matrix of the underlying systems is generally uncertain, partially unknown and designed. The problems addressed include stability, stabilization, H∞ control and filtering, observer design, and adaptive control. applications of Markov process are investigated by using Lyapunov theory, linear matrix inequalities (LMIs), S-procedure and the stochastic Barbalat’s Lemma, among other techniques. Features of the book include: · study of the stability problem for SMJSs with general transition rate matrices (TRMs); · stabilization for SMJSs by TRM design, noise control, proportional-derivative and partially mode-dependent control, in terms of LMIs with and without equation constraints; · mode-dependent and mode-independent H∞ control solutions with development of a type of disordered controller; · observer-based controllers of SMJSs in which both the designed observer and controller are either mode-dependent or mode-independent; · consideration of robust H∞ filtering in terms of uncertain TRM or filter parameters leading to a method for totally mode-independent filtering · development of LMI-based conditions for a class of adaptive state feedback controllers with almost-certainly-bounded estimated error and almost-certainly-asymptotically-stable corres ponding closed-loop system states · applications of Markov process on singular systems with norm bounded uncertainties and time-varying delays Analysis and Design of Singular Markovian Jump Systems contains valuable reference material for academic researchers wishing to explore the area. The contents are also suitable for a one-semester graduate course.




Periodic Systems


Book Description

This book offers a comprehensive treatment of the theory of periodic systems, including the problems of filtering and control. It covers an array of topics, presenting an overview of the field and focusing on discrete-time signals and systems.