Stochastic Networked Control Systems


Book Description

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization. A thorough, self-contained book, Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included: · Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. · Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. · Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. · Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. · Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end. · Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. · Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. · Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. · Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. · Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.




Networked Control Systems


Book Description

This book nds its origin in the WIDE PhD School on Networked Control Systems, which we organized in July 2009 in Siena, Italy. Having gathered experts on all the aspects of networked control systems, it was a small step to go from the summer school to the book, certainly given the enthusiasm of the lecturers at the school. We felt that a book collecting overviewson the important developmentsand open pr- lems in the eld of networked control systems could stimulate and support future research in this appealing area. Given the tremendouscurrentinterests in distributed control exploiting wired and wireless communication networks, the time seemed to be right for the book that lies now in front of you. The goal of the book is to set out the core techniques and tools that are ava- able for the modeling, analysis and design of networked control systems. Roughly speaking, the book consists of three parts. The rst part presents architectures for distributed control systems and models of wired and wireless communication n- works. In particular, in the rst chapter important technological and architectural aspects on distributed control systems are discussed. The second chapter provides insight in the behavior of communication channels in terms of delays, packet loss and information constraints leading to suitable modeling paradigms for commu- cation networks.







Optimal Networked Control Systems with MATLAB


Book Description

Optimal Networked Control Systems with MATLAB® discusses optimal controller design in discrete time for networked control systems (NCS). The authors apply several powerful modern control techniques in discrete time to the design of intelligent controllers for such NCS. Detailed derivations, rigorous stability proofs, computer simulation examples, and downloadable MATLAB® codes are included for each case. The book begins by providing background on NCS, networked imperfections, dynamical systems, stability theory, and stochastic optimal adaptive controllers in discrete time for linear and nonlinear systems. It lays the foundation for reinforcement learning-based optimal adaptive controller use for finite and infinite horizons. The text then: Introduces quantization effects for linear and nonlinear NCS, describing the design of stochastic adaptive controllers for a class of linear and nonlinear systems Presents two-player zero-sum game-theoretic formulation for linear systems in input–output form enclosed by a communication network Addresses the stochastic optimal control of nonlinear NCS by using neuro dynamic programming Explores stochastic optimal design for nonlinear two-player zero-sum games under communication constraints Treats an event-sampled distributed NCS to minimize transmission of state and control signals within the feedback loop via the communication network Covers distributed joint optimal network scheduling and control design for wireless NCS, as well as the effect of network protocols on the wireless NCS controller design An ideal reference for graduate students, university researchers, and practicing engineers, Optimal Networked Control Systems with MATLAB® instills a solid understanding of neural network controllers and how to build them.




Packet-Based Control for Networked Control Systems


Book Description

This book introduces a unique, packet-based co-design control framework for networked control systems. It begins by providing a comprehensive survey of state-of-the-art research on networked control systems, giving readers a general overview of the field. It then verifies the proposed control framework both theoretically and experimentally – the former using multiple control methodologies, and the latter using a unique online test rig for networked control systems. The framework investigates in detail the most common, communication constraints, including network-induced delays, data packet dropout, data packet disorders, and network access constraints, as well as multiple controller design and system analysis tools such as model predictive control, linear matrix inequalities and optimal control. This unique and complete co-design framework greatly benefits researchers, graduate students and engineers in the fields of control theory and engineering.




Nonlinear Control and Filtering for Stochastic Networked Systems


Book Description

In this book, control and filtering problems for several classes of stochastic networked systems are discussed. In each chapter, the stability, robustness, reliability, consensus performance, and/or disturbance attenuation levels are investigated within a unified theoretical framework. The aim is to derive the sufficient conditions such that the resulting systems achieve the prescribed design requirements despite all the network-induced phenomena. Further, novel notions such as randomly occurring sensor failures and consensus in probability are discussed. Finally, the theories/techniques developed are applied to emerging research areas. Key Features Unifies existing and emerging concepts concerning stochastic control/filtering and distributed control/filtering with an emphasis on a variety of network-induced complexities Includes concepts like randomly occurring sensor failures and consensus in probability (with respect to time-varying stochastic multi-agent systems) Exploits the recursive linear matrix inequality approach, completing the square method, Hamilton-Jacobi inequality approach, and parameter-dependent matrix inequality approach to handle the emerging mathematical/computational challenges Captures recent advances of theories, techniques, and applications of stochastic control as well as filtering from an engineering-oriented perspective Gives simulation examples in each chapter to reflect the engineering practice




Optimal and Robust Scheduling for Networked Control Systems


Book Description

Optimal and Robust Scheduling for Networked Control Systems tackles the problem of integrating system components—controllers, sensors, and actuators—in a networked control system. It is common practice in industry to solve such problems heuristically, because the few theoretical results available are not comprehensive and cannot be readily applied by practitioners. This book offers a solution to the deterministic scheduling problem that is based on rigorous control theoretical tools but also addresses practical implementation issues. Helping to bridge the gap between control theory and computer science, it suggests that the consideration of communication constraints at the design stage will significantly improve the performance of the control system. Technical Results, Design Techniques, and Practical Applications The book brings together well-known measures for robust performance as well as fast stochastic algorithms to assist designers in selecting the best network configuration and guaranteeing the speed of offline optimization. The authors propose a unifying framework for modelling NCSs with time-triggered communication and present technical results. They also introduce design techniques, including for the codesign of a controller and communication sequence and for the robust design of a communication sequence for a given controller. Case studies explore the use of the FlexRay TDMA and time-triggered control area network (CAN) protocols in an automotive control system. Practical Solutions to Your Time-Triggered Communication Problems This unique book develops ready-to-use engineering tools for large-scale control system integration with a focus on robustness and performance. It emphasizes techniques that are directly applicable to time-triggered communication problems in the automotive industry and in avionics, robotics, and automated manufacturing.




Analysis and Design of Nonlinear Control Systems


Book Description

This book is a tribute to Prof. Alberto Isidori on the occasion of his 65th birthday. Prof. Isidori’s proli?c, pioneering and high-impact research activity has spanned over 35 years. Throughout his career, Prof. Isidori has developed ground-breaking results, has initiated researchdirections and has contributed towardsthe foundationofnonlinear controltheory.In addition,his dedication to explain intricate issues and di?cult concepts in a simple and rigorous way and to motivate young researchers has been instrumental to the intellectual growth of the nonlinear control community worldwide. The volume collects 27 contributions written by a total of 52 researchers. The principal author of each contribution has been selected among the - searchers who have worked with Prof. Isidori, have in?uenced his research activity, or have had the privilege and honour of being his PhD students. The contributions address a signi?cant number of control topics, including th- retical issues, advanced applications, emerging control directions and tutorial works. The diversity of the areas covered, the number of contributors and their international standing provide evidence of the impact of Prof. Isidori in the control and systems theory communities. The book has been divided into six parts: System Analysis, Optimization Methods, Feedback Design, Regulation, Geometric Methods and Asymptotic Analysis, re?ecting important control areas which have been strongly in- enced and, in some cases, pioneered by Prof. Isidori.




Analysis and Synthesis of Networked Control Systems


Book Description

Analysis and Synthesis of Networked Control Systems focuses on essential aspects of this field, including quantization over networks, data fusion over networks, predictive control over networks and fault detection over networks. The networked control systems have led to a complete new range of real-world applications. In recent years, the techniques of Internet of Things are developed rapidly, the research of networked control systems plays a key role in Internet of Things. The book is self-contained, providing sufficient mathematical foundations for understanding the contents of each chapter. It will be of significant interest to scientists and engineers engaged in the field of Networked Control Systems. Dr. Yuanqing Xia, a professor at Beijing Institute of Technology, has been working on control theory and its applications for over ten years.




Networked Control Systems with Intermittent Feedback


Book Description

Networked Control Systems (NCSs) are spatially distributed systems for which the communication between sensors, actuators and controllers is realized by a shared (wired or wireless) communication network. NCSs offer several advantages, such as reduced installation and maintenance costs, as well as greater flexibility, over conventional control systems in which parts of control loops exchange information via dedicated point-to-point connections. The principal goal of this book is to present a coherent and versatile framework applicable to various settings investigated by the authors over the last several years. This framework is applicable to nonlinear time-varying dynamic plants and controllers with delayed dynamics; a large class of static, dynamic, probabilistic and priority-oriented scheduling protocols; delayed, noisy, lossy and intermittent information exchange; decentralized control problems of heterogeneous agents with time-varying directed (not necessarily balanced) communication topologies; state- and output-feedback; off-line and on-line intermittent feedback; optimal intermittent feedback through Approximate Dynamic Programming (ADP) and Reinforcement Learning (RL); and control systems with exogenous disturbances and modeling uncertainties.