Output Feedback Reinforcement Learning Control for Linear Systems


Book Description

This monograph explores the analysis and design of model-free optimal control systems based on reinforcement learning (RL) theory, presenting new methods that overcome recent challenges faced by RL. New developments in the design of sensor data efficient RL algorithms are demonstrated that not only reduce the requirement of sensors by means of output feedback, but also ensure optimality and stability guarantees. A variety of practical challenges are considered, including disturbance rejection, control constraints, and communication delays. Ideas from game theory are incorporated to solve output feedback disturbance rejection problems, and the concepts of low gain feedback control are employed to develop RL controllers that achieve global stability under control constraints. Output Feedback Reinforcement Learning Control for Linear Systems will be a valuable reference for graduate students, control theorists working on optimal control systems, engineers, and applied mathematicians.




Feedback Control Theory


Book Description

An excellent introduction to feedback control system design, this book offers a theoretical approach that captures the essential issues and can be applied to a wide range of practical problems. Its explorations of recent developments in the field emphasize the relationship of new procedures to classical control theory, with a focus on single input and output systems that keeps concepts accessible to students with limited backgrounds. The text is geared toward a single-semester senior course or a graduate-level class for students of electrical engineering. The opening chapters constitute a basic treatment of feedback design. Topics include a detailed formulation of the control design program, the fundamental issue of performance/stability robustness tradeoff, and the graphical design technique of loopshaping. Subsequent chapters extend the discussion of the loopshaping technique and connect it with notions of optimality. Concluding chapters examine controller design via optimization, offering a mathematical approach that is useful for multivariable systems.




Multivariable Feedback Control


Book Description

Multivariable Feedback Control: Analysis and Design, Second Edition presents a rigorous, yet easily readable, introduction to the analysis and design of robust multivariable control systems. Focusing on practical feedback control and not on system theory in general, this book provides the reader with insights into the opportunities and limitations of feedback control. Taking into account the latest developments in the field, this fully revised and updated second edition: * features a new chapter devoted to the use of linear matrix inequalities (LMIs); * presents current results on fundamental performance limitations introduced by RHP-poles and RHP-zeros; * introduces updated material on the selection of controlled variables and self-optimizing control; * provides simple IMC tuning rules for PID control; * covers additional material including unstable plants, the feedback amplifier, the lower gain margin and a clear strategy for incorporating integral action into LQG control; * includes numerous worked examples, exercises and case studies, which make frequent use of Matlab and the new Robust Control toolbox. Multivariable Feedback Control: Analysis and Design, Second Edition is an excellent resource for advanced undergraduate and graduate courses studying multivariable control. It is also an invaluable tool for engineers who want to understand multivariable control, its limitations, and how it can be applied in practice. The analysis techniques and the material on control structure design should prove very useful in the new emerging area of systems biology. Reviews of the first edition: "Being rich in insights and practical tips on controller design, the book should also prove to be very beneficial to industrial control engineers, both as a reference book and as an educational tool." Applied Mechanics Reviews "In summary, this book can be strongly recommended not only as a basic text in multivariable control techniques for graduate and undergraduate students, but also as a valuable source of information for control engineers." International Journal of Adaptive Control and Signal Processing




Feedback Systems


Book Description

The essential introduction to the principles and applications of feedback systems—now fully revised and expanded This textbook covers the mathematics needed to model, analyze, and design feedback systems. Now more user-friendly than ever, this revised and expanded edition of Feedback Systems is a one-volume resource for students and researchers in mathematics and engineering. It has applications across a range of disciplines that utilize feedback in physical, biological, information, and economic systems. Karl Åström and Richard Murray use techniques from physics, computer science, and operations research to introduce control-oriented modeling. They begin with state space tools for analysis and design, including stability of solutions, Lyapunov functions, reachability, state feedback observability, and estimators. The matrix exponential plays a central role in the analysis of linear control systems, allowing a concise development of many of the key concepts for this class of models. Åström and Murray then develop and explain tools in the frequency domain, including transfer functions, Nyquist analysis, PID control, frequency domain design, and robustness. Features a new chapter on design principles and tools, illustrating the types of problems that can be solved using feedback Includes a new chapter on fundamental limits and new material on the Routh-Hurwitz criterion and root locus plots Provides exercises at the end of every chapter Comes with an electronic solutions manual An ideal textbook for undergraduate and graduate students Indispensable for researchers seeking a self-contained resource on control theory




Robust Output Feedback H-infinity Control and Filtering for Uncertain Linear Systems


Book Description

"Robust Output Feedback H-infinity Control and Filtering for Uncertain Linear Systems" discusses new and meaningful findings on robust output feedback H-infinity control and filtering for uncertain linear systems, presenting a number of useful and less conservative design results based on the linear matrix inequality (LMI) technique. Though primarily intended for graduate students in control and filtering, the book can also serve as a valuable reference work for researchers wishing to explore the area of robust H-infinity control and filtering of uncertain systems. Dr. Xiao-Heng Chang is a Professor at the College of Engineering, Bohai University, China.




Truncated Predictor Based Feedback Designs for Linear Systems with Input Delay


Book Description

This monograph is the first of its kind to present innovative research results on truncated predictor feedback (TPF) designs for general linear systems with input delay. Beginning with a brief review of time delay systems, the first half of the book focuses on TPF with a constant feedback parameter. Both state feedback and output feedback are considered. It is established that TPF achieves stabilization in the presence of an arbitrarily large bounded delay if the open loop system is not exponentially unstable. Examples are presented to illustrate that TPF may fail to stabilize an exponentially unstable system when the delay is sufficiently large. Bounds on the delay are then established under which stabilization can be achieved. The second half of the book explores variations of the TPF laws designed with a non-constant feedback parameter to accommodate unknown delays and improve closed-loop performance. The authors employ a step-by-step approach to presenting the ultimate result on a completely delay-independent feedback law. Truncated Predictor Based Feedback Designs for Linear Systems with Input Delay will appeal to control engineers, control theorists, and graduate students studying control systems. This volume will also be a valuable resource for engineers and applied mathematicians interested in dynamic systems with time delays.




Feedback Control Systems


Book Description

This self-study book offers optimum clarity and a thorough analysis of the principles of classical and modern feedback control. It emphasizes the difference between mathematical models and the physical systems that the models represent. The authors organize topic coverage into three sections--linear analog control systems, linear digital control systems, and nonlinear analog control systems, using the advanced features of MATLAB throughout the book. For practicing engineers with some experience in linear-system analysis, who want to learn about control systems.




Linear Feedback Controls


Book Description

Control systems are one of the most important engineering fields, and recent advances in microelectonics and microelectromechanical systems have made feedback controls ubiquitous – a simple cell phone, for example, can have dozens of feedback control systems. Recent research focuses on advanced controls, such as nonlinear systems, adaptive controls, or controls based on computer learning and artificial intelligence. Conversely, classical (linear) control theory is well established; yet, it provides the crucial foundation not only for advanced control topics, but also for the many everyday control systems ranging from cell phone backlight control to self-balancing hoverboard scooters. Linear Feedback Controls provides a comprehensive, yet compact introduction to classical control theory. The present Second Edition has been expanded to include important topics, such as state-space models and control robustness. Moreover, aspects of the practical realization have been significantly expanded with complete design examples and with typical building blocks for control systems. The book is ideal for upper level students in electrical and mechanical engineering, for whom a course in Feedback Controls is usually required. Moreover, students in bioengineering, chemical engineering, and agricultural and environmental engineering can benefit from the introductory character and the practical examples, and the book provides an introduction or helpful refresher for graduate students and professionals. Focuses on the essentials of control fundamentals, system analysis, mathematical description and modeling, and control design to guide the reader Illustrates how control theory is linked to design of control systems and their performance by introducing theoretical elements as tools in a designer’s toolbox Guides the reader through the different analysis and design tools with strands of examples that weave throughout the book Highlights both the design process and typical applications by presenting detailed practical examples and their realization and performance, complete with circuit diagrams and measured performance data




Low Gain Feedback


Book Description

This book gives a unified and unique presentation of low gain and high gain design methodologies. In particular the development of low gain feedback design methodology is discussed. The development of both low and high gain feedback enhances the industrial relevance of modern control theory, by providing solutions to a wide range of problems that are of paramount practical importance. This detailed monograph provides the reader with a comprehensive insight into these problems: research results are examined and solutions to the problems are considered. Compared to that of high gain feedback, the power and significance of low gain feedback is not as widely recognized. The purpose of this monograph is to present some recent developments in low gain feedback, and its applications. Several low gain techniques are examined, including the control of linear systems with saturating actuators, semi-global stabilization of minimum phase input-output linearizable systems and H2 suboptimal control.