Learning-based Model Predictive Control with closed-loop guarantees


Book Description

The performance of model predictive control (MPC) largely depends on the accuracy of the prediction model and of the constraints the system is subject to. However, obtaining an accurate knowledge of these elements might be expensive in terms of money and resources, if at all possible. In this thesis, we develop novel learning-based MPC frameworks that actively incentivize learning of the underlying system dynamics and of the constraints, while ensuring recursive feasibility, constraint satisfaction, and performance bounds for the closed-loop. In the first part, we focus on the case of inaccurate models, and analyze learning-based MPC schemes that include, in addition to the primary cost, a learning cost that aims at generating informative data by inducing excitation in the system. In particular, we first propose a nonlinear MPC framework that ensures desired performance bounds for the resulting closed-loop, and then we focus on linear systems subject to uncertain parameters and noisy output measurements. In order to ensure that the desired learning phase occurs in closed-loop operations, we then propose an MPC framework that is able to guarantee closed-loop learning of the controlled system. In the last part of the thesis, we investigate the scenario where the system is known but evolves in a partially unknown environment. In such a setup, we focus on a learning-based MPC scheme that incentivizes safe exploration if and only if this might yield to a performance improvement.




Model Predictive Control


Book Description




Assessment and Future Directions of Nonlinear Model Predictive Control


Book Description

Thepastthree decadeshaveseenrapiddevelopmentin the areaofmodelpred- tive control with respect to both theoretical and application aspects. Over these 30 years, model predictive control for linear systems has been widely applied, especially in the area of process control. However, today’s applications often require driving the process over a wide region and close to the boundaries of - erability, while satisfying constraints and achieving near-optimal performance. Consequently, the application of linear control methods does not always lead to satisfactory performance, and here nonlinear methods must be employed. This is one of the reasons why nonlinear model predictive control (NMPC) has - joyed signi?cant attention over the past years,with a number of recent advances on both the theoretical and application frontier. Additionally, the widespread availability and steadily increasing power of today’s computers, as well as the development of specially tailored numerical solution methods for NMPC, bring thepracticalapplicabilityofNMPCwithinreachevenforveryfastsystems.This has led to a series of new, exciting developments, along with new challenges in the area of NMPC.




Predictive Control for Linear and Hybrid Systems


Book Description

With a simple approach that includes real-time applications and algorithms, this book covers the theory of model predictive control (MPC).




Large-Scale Inverse Problems and Quantification of Uncertainty


Book Description

This book focuses on computational methods for large-scale statistical inverse problems and provides an introduction to statistical Bayesian and frequentist methodologies. Recent research advances for approximation methods are discussed, along with Kalman filtering methods and optimization-based approaches to solving inverse problems. The aim is to cross-fertilize the perspectives of researchers in the areas of data assimilation, statistics, large-scale optimization, applied and computational mathematics, high performance computing, and cutting-edge applications. The solution to large-scale inverse problems critically depends on methods to reduce computational cost. Recent research approaches tackle this challenge in a variety of different ways. Many of the computational frameworks highlighted in this book build upon state-of-the-art methods for simulation of the forward problem, such as, fast Partial Differential Equation (PDE) solvers, reduced-order models and emulators of the forward problem, stochastic spectral approximations, and ensemble-based approximations, as well as exploiting the machinery for large-scale deterministic optimization through adjoint and other sensitivity analysis methods. Key Features: Brings together the perspectives of researchers in areas of inverse problems and data assimilation. Assesses the current state-of-the-art and identify needs and opportunities for future research. Focuses on the computational methods used to analyze and simulate inverse problems. Written by leading experts of inverse problems and uncertainty quantification. Graduate students and researchers working in statistics, mathematics and engineering will benefit from this book.




Recent Advances in Model Predictive Control


Book Description

This book focuses on distributed and economic Model Predictive Control (MPC) with applications in different fields. MPC is one of the most successful advanced control methodologies due to the simplicity of the basic idea (measure the current state, predict and optimize the future behavior of the plant to determine an input signal, and repeat this procedure ad infinitum) and its capability to deal with constrained nonlinear multi-input multi-output systems. While the basic idea is simple, the rigorous analysis of the MPC closed loop can be quite involved. Here, distributed means that either the computation is distributed to meet real-time requirements for (very) large-scale systems or that distributed agents act autonomously while being coupled via the constraints and/or the control objective. In the latter case, communication is necessary to maintain feasibility or to recover system-wide optimal performance. The term economic refers to general control tasks and, thus, goes beyond the typically predominant control objective of set-point stabilization. Here, recently developed concepts like (strict) dissipativity of optimal control problems or turnpike properties play a crucial role. The book collects research and survey articles on recent ideas and it provides perspectives on current trends in nonlinear model predictive control. Indeed, the book is the outcome of a series of six workshops funded by the German Research Foundation (DFG) involving early-stage career scientists from different countries and from leading European industry stakeholders.




Handbook of Model Predictive Control


Book Description

Recent developments in model-predictive control promise remarkable opportunities for designing multi-input, multi-output control systems and improving the control of single-input, single-output systems. This volume provides a definitive survey of the latest model-predictive control methods available to engineers and scientists today. The initial set of chapters present various methods for managing uncertainty in systems, including stochastic model-predictive control. With the advent of affordable and fast computation, control engineers now need to think about using “computationally intensive controls,” so the second part of this book addresses the solution of optimization problems in “real” time for model-predictive control. The theory and applications of control theory often influence each other, so the last section of Handbook of Model Predictive Control rounds out the book with representative applications to automobiles, healthcare, robotics, and finance. The chapters in this volume will be useful to working engineers, scientists, and mathematicians, as well as students and faculty interested in the progression of control theory. Future developments in MPC will no doubt build from concepts demonstrated in this book and anyone with an interest in MPC will find fruitful information and suggestions for additional reading.




Model Predictive Control in the Process Industry


Book Description

Model Predictive Control is an important technique used in the process control industries. It has developed considerably in the last few years, because it is the most general way of posing the process control problem in the time domain. The Model Predictive Control formulation integrates optimal control, stochastic control, control of processes with dead time, multivariable control and future references. The finite control horizon makes it possible to handle constraints and non linear processes in general which are frequently found in industry. Focusing on implementation issues for Model Predictive Controllers in industry, it fills the gap between the empirical way practitioners use control algorithms and the sometimes abstractly formulated techniques developed by researchers. The text is firmly based on material from lectures given to senior undergraduate and graduate students and articles written by the authors.




Model-Based Predictive Control


Book Description

Model Predictive Control (MPC) has become a widely used methodology across all engineering disciplines, yet there are few books which study this approach. Until now, no book has addressed in detail all key issues in the field including apriori stability and robust stability results. Engineers and MPC researchers now have a volume that provides a complete overview of the theory and practice of MPC as it relates to process and control engineering. Model-Based Predictive Control, A Practical Approach, analyzes predictive control from its base mathematical foundation, but delivers the subject matter in a readable, intuitive style. The author writes in layman's terms, avoiding jargon and using a style that relies upon personal insight into practical applications. This detailed introduction to predictive control introduces basic MPC concepts and demonstrates how they are applied in the design and control of systems, experiments, and industrial processes. The text outlines how to model, provide robustness, handle constraints, ensure feasibility, and guarantee stability. It also details options in regard to algorithms, models, and complexity vs. performance issues.




Deep Learning for Unmanned Systems


Book Description

This book is used at the graduate or advanced undergraduate level and many others. Manned and unmanned ground, aerial and marine vehicles enable many promising and revolutionary civilian and military applications that will change our life in the near future. These applications include, but are not limited to, surveillance, search and rescue, environment monitoring, infrastructure monitoring, self-driving cars, contactless last-mile delivery vehicles, autonomous ships, precision agriculture and transmission line inspection to name just a few. These vehicles will benefit from advances of deep learning as a subfield of machine learning able to endow these vehicles with different capability such as perception, situation awareness, planning and intelligent control. Deep learning models also have the ability to generate actionable insights into the complex structures of large data sets. In recent years, deep learning research has received an increasing amount of attention from researchers in academia, government laboratories and industry. These research activities have borne some fruit in tackling some of the challenging problems of manned and unmanned ground, aerial and marine vehicles that are still open. Moreover, deep learning methods have been recently actively developed in other areas of machine learning, including reinforcement training and transfer/meta-learning, whereas standard, deep learning methods such as recent neural network (RNN) and coevolutionary neural networks (CNN). The book is primarily meant for researchers from academia and industry, who are working on in the research areas such as engineering, control engineering, robotics, mechatronics, biomedical engineering, mechanical engineering and computer science. The book chapters deal with the recent research problems in the areas of reinforcement learning-based control of UAVs and deep learning for unmanned aerial systems (UAS) The book chapters present various techniques of deep learning for robotic applications. The book chapters contain a good literature survey with a long list of references. The book chapters are well written with a good exposition of the research problem, methodology, block diagrams and mathematical techniques. The book chapters are lucidly illustrated with numerical examples and simulations. The book chapters discuss details of applications and future research areas.