Adaptive and Learning-Based Control of Safety-Critical Systems


Book Description

This book stems from the growing use of learning-based techniques, such as reinforcement learning and adaptive control, in the control of autonomous and safety-critical systems. Safety is critical to many applications, such as autonomous driving, air traffic control, and robotics. As these learning-enabled technologies become more prevalent in the control of autonomous systems, it becomes increasingly important to ensure that such systems are safe. To address these challenges, the authors provide a self-contained treatment of learning-based control techniques with rigorous guarantees of stability and safety. This book contains recent results on provably correct control techniques from specifications that go beyond safety and stability, such as temporal logic formulas. The authors bring together control theory, optimization, machine learning, and formal methods and present worked-out examples and extensive simulation examples to complement the mathematical style of presentation. Prerequisites are minimal, and the underlying ideas are accessible to readers with only a brief background in control-theoretic ideas, such as Lyapunov stability theory.




Learning-Based Control


Book Description

The recent success of Reinforcement Learning and related methods can be attributed to several key factors. First, it is driven by reward signals obtained through the interaction with the environment. Second, it is closely related to the human learning behavior. Third, it has a solid mathematical foundation. Nonetheless, conventional Reinforcement Learning theory exhibits some shortcomings particularly in a continuous environment or in considering the stability and robustness of the controlled process. In this monograph, the authors build on Reinforcement Learning to present a learning-based approach for controlling dynamical systems from real-time data and review some major developments in this relatively young field. In doing so the authors develop a framework for learning-based control theory that shows how to learn directly suboptimal controllers from input-output data. There are three main challenges on the development of learning-based control. First, there is a need to generalize existing recursive methods. Second, as a fundamental difference between learning-based control and Reinforcement Learning, stability and robustness are important issues that must be addressed for the safety-critical engineering systems such as self-driving cars. Third, data efficiency of Reinforcement Learning algorithms need be addressed for safety-critical engineering systems. This monograph provides the reader with an accessible primer on a new direction in control theory still in its infancy, namely Learning-Based Control Theory, that is closely tied to the literature of safe Reinforcement Learning and Adaptive Dynamic Programming.




L1 Adaptive Control Theory


Book Description

Contains results not yet published in technical journals and conference proceedings.




Safe Autonomy with Control Barrier Functions


Book Description

This book presents the concept of Control Barrier Function (CBF), which captures the evolution of safety requirements during the execution of a system and can be used to enforce safety. Safety is formalized using an emerging state-of-the-art approach based on CBFs, and many illustrative examples from autonomous driving, traffic control, and robot control are provided. Safety is central to autonomous systems since they are intended to operate with minimal or no human supervision, and a single failure could result in catastrophic results. The authors discuss how safety can be guaranteed via both theoretical and application perspectives. This presented method is computationally efficient and can be easily implemented in real-time systems that require high-frequency reactive control. In addition, the CBF approach can easily deal with nonlinear models and complex constraints used in a wide spectrum of applications, including autonomous driving, robotics, and traffic control. With the proliferation of autonomous systems, such as self-driving cars, mobile robots, and unmanned air vehicles, safety plays a crucial role in ensuring their widespread adoption. This book considers the integration of safety guarantees into the operation of such systems including typical safety requirements that involve collision avoidance, technological system limitations, and bounds on real-time executions. Adaptive approaches for safety are also proposed for time-varying execution bounds and noisy dynamics.




Collaborative and Humanoid Robots


Book Description

Collaborative and Humanoid Robots guides readers through the fundamentals and state-of-the-art concepts and future expectations of robotics. It showcases interesting research topics on robots and cobots by researchers, industry practitioners, and academics. Divided into two sections on “Collaborative Robots” and “Humanoid Robots,” this book includes surveys of recent publications that investigative the interaction between humanoid robots and humans; safe adaptive trajectory tracking control of robots; 3D printed, self-learning robots; robot trajectory, guidance, and control; social robots; Tiny Blind assistive humanoid robots; and more.




Machine Learning and Knowledge Discovery in Databases


Book Description

The multi-volume set LNAI 13713 until 13718 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2022, which took place in Grenoble, France, in September 2022. The 236 full papers presented in these proceedings were carefully reviewed and selected from a total of 1060 submissions. In addition, the proceedings include 17 Demo Track contributions. The volumes are organized in topical sections as follows: Part I: Clustering and dimensionality reduction; anomaly detection; interpretability and explainability; ranking and recommender systems; transfer and multitask learning; Part II: Networks and graphs; knowledge graphs; social network analysis; graph neural networks; natural language processing and text mining; conversational systems; Part III: Deep learning; robust and adversarial machine learning; generative models; computer vision; meta-learning, neural architecture search; Part IV: Reinforcement learning; multi-agent reinforcement learning; bandits and online learning; active and semi-supervised learning; private and federated learning; Part V: Supervised learning; probabilistic inference; optimal transport; optimization; quantum, hardware; sustainability; Part VI: Time series; financial machine learning; applications; applications: transportation; demo track.




Proceedings of 2021 Chinese Intelligent Systems Conference


Book Description

This book presents the proceedings of the 17th Chinese Intelligent Systems Conference, held in Fuzhou, China, on Oct 16-17, 2021. It focuses on new theoretical results and techniques in the field of intelligent systems and control. This is achieved by providing in-depth study on a number of major topics such as Multi-Agent Systems, Complex Networks, Intelligent Robots, Complex System Theory and Swarm Behavior, Event-Triggered Control and Data-Driven Control, Robust and Adaptive Control, Big Data and Brain Science, Process Control, Intelligent Sensor and Detection Technology, Deep learning and Learning Control Guidance, Navigation and Control of Flight Vehicles and so on. The book is particularly suited for readers who are interested in learning intelligent system and control and artificial intelligence. The book can benefit researchers, engineers, and graduate students.




Robotics


Book Description

Papers from a flagship conference reflect the latest developments in the field, including work in such rapidly advancing areas as human-robot interaction and formal methods. Robotics: Science and Systems VIII spans a wide spectrum of robotics, bringing together contributions from researchers working on the mathematical foundations of robotics, robotics applications, and analysis of robotics systems. This volume presents the proceedings of the eighth annual Robotics: Science and Systems (RSS) conference, held in July 2012 at the University of Sydney. The contributions reflect the exciting diversity of the field, presenting the best, the newest, and the most challenging work on such topics as mechanisms, kinematics, dynamics and control, human-robot interaction and human-centered systems, distributed systems, mobile systems and mobility, manipulation, field robotics, medical robotics, biological robotics, robot perception, and estimation and learning in robotic systems. The conference and its proceedings reflect not only the tremendous growth of robotics as a discipline but also the desire in the robotics community for a flagship event at which the best of the research in the field can be presented.




Intelligent Decision Technologies


Book Description

This book gathers selected papers from the KES-IDT 2022 Conference, held in Rhodes, Greece on June 20–22, 2022. The book presents and discusses the latest research results and generates new ideas in the field of intelligent decision-making. The range of topics discussed are classification, prediction, data analysis, big data, data science, decision support, knowledge engineering, and modeling in diverse areas such as finance, cybersecurity, economics, health, management, and transportation. The problems in Industry 4.0 and IoT are also addressed. The book contains several sections devoted to specific topics, such as intelligent data processing and its applications, high-dimensional data analysis and its applications, multi-criteria decision analysis—theory and applications, large-scale systems for intelligent decision-making and knowledge engineering, decision technologies and related topics in big data analysis of social and financial issues, and decision-making theory for economics.




Process Operational Safety and Cybersecurity


Book Description

This book is focused on the development of rigorous, yet practical, methods for the design of advanced process control systems to improve process operational safety and cybersecurity for a wide range of nonlinear process systems. Process Operational Safety and Cybersecurity develops designs for novel model predictive control systems accounting for operational safety considerations, presents theoretical analysis on recursive feasibility and simultaneous closed-loop stability and safety, and discusses practical considerations including data-driven modeling of nonlinear processes, characterization of closed-loop stability regions and computational efficiency. The text then shifts focus to the design of integrated detection and model predictive control systems which improve process cybersecurity by efficiently detecting and mitigating the impact of intelligent cyber-attacks. The book explores several key areas relating to operational safety and cybersecurity including: machine-learning-based modeling of nonlinear dynamical systems for model predictive control; a framework for detection and resilient control of sensor cyber-attacks for nonlinear systems; insight into theoretical and practical issues associated with the design of control systems for process operational safety and cybersecurity; and a number of numerical simulations of chemical process examples and Aspen simulations of large-scale chemical process networks of industrial relevance. A basic knowledge of nonlinear system analysis, Lyapunov stability techniques, dynamic optimization, and machine-learning techniques will help readers to understand the methodologies proposed. The book is a valuable resource for academic researchers and graduate students pursuing research in this area as well as for process control engineers. Advances in Industrial Control reports and encourages the transfer of technology in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. The series offers an opportunity for researchers to present an extended exposition of new work in all aspects of industrial control.