Principles of Optimal Control Theory


Book Description

In the late 1950's, the group of Soviet mathematicians consisting of L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko made fundamental contributions to optimal control theory. Much of their work was collected in their monograph, The Mathematical Theory of Optimal Processes. Subsequently, Professor Gamkrelidze made further important contributions to the theory of necessary conditions for problems of optimal control and general optimization problems. In the present monograph, Professor Gamkrelidze presents his current view of the fundamentals of optimal control theory. It is intended for use in a one-semester graduate course or advanced undergraduate course. We are now making these ideas available in English to all those interested in optimal control theory. West Lafayette, Indiana, USA Leonard D. Berkovitz Translation Editor Vll Preface This book is based on lectures I gave at the Tbilisi State University during the fall of 1974. It contains, in essence, the principles of general control theory and proofs of the maximum principle and basic existence theorems of optimal control theory. Although the proofs of the basic theorems presented here are far from being the shortest, I think they are fully justified from the conceptual view point. In any case, the notions we introduce and the methods developed have one unquestionable advantage -they are constantly used throughout control theory, and not only for the proofs of the theorems presented in this book.




Optimal Control Theory


Book Description

Upper-level undergraduate text introduces aspects of optimal control theory: dynamic programming, Pontryagin's minimum principle, and numerical techniques for trajectory optimization. Numerous figures, tables. Solution guide available upon request. 1970 edition.




Introduction to Optimal Control Theory


Book Description

This monograph is an introduction to optimal control theory for systems governed by vector ordinary differential equations. It is not intended as a state-of-the-art handbook for researchers. We have tried to keep two types of reader in mind: (1) mathematicians, graduate students, and advanced undergraduates in mathematics who want a concise introduction to a field which contains nontrivial interesting applications of mathematics (for example, weak convergence, convexity, and the theory of ordinary differential equations); (2) economists, applied scientists, and engineers who want to understand some of the mathematical foundations. of optimal control theory. In general, we have emphasized motivation and explanation, avoiding the "definition-axiom-theorem-proof" approach. We make use of a large number of examples, especially one simple canonical example which we carry through the entire book. In proving theorems, we often just prove the simplest case, then state the more general results which can be proved. Many of the more difficult topics are discussed in the "Notes" sections at the end of chapters and several major proofs are in the Appendices. We feel that a solid understanding of basic facts is best attained by at first avoiding excessive generality. We have not tried to give an exhaustive list of references, preferring to refer the reader to existing books or papers with extensive bibliographies. References are given by author's name and the year of publication, e.g., Waltman [1974].




Calculus of Variations and Optimal Control Theory


Book Description

This textbook offers a concise yet rigorous introduction to calculus of variations and optimal control theory, and is a self-contained resource for graduate students in engineering, applied mathematics, and related subjects. Designed specifically for a one-semester course, the book begins with calculus of variations, preparing the ground for optimal control. It then gives a complete proof of the maximum principle and covers key topics such as the Hamilton-Jacobi-Bellman theory of dynamic programming and linear-quadratic optimal control. Calculus of Variations and Optimal Control Theory also traces the historical development of the subject and features numerous exercises, notes and references at the end of each chapter, and suggestions for further study. Offers a concise yet rigorous introduction Requires limited background in control theory or advanced mathematics Provides a complete proof of the maximum principle Uses consistent notation in the exposition of classical and modern topics Traces the historical development of the subject Solutions manual (available only to teachers) Leading universities that have adopted this book include: University of Illinois at Urbana-Champaign ECE 553: Optimum Control Systems Georgia Institute of Technology ECE 6553: Optimal Control and Optimization University of Pennsylvania ESE 680: Optimal Control Theory University of Notre Dame EE 60565: Optimal Control




A Primer on Pontryagin's Principle in Optimal Control


Book Description

EDITORIAL REVIEW: This book provides a guided tour in introducing optimal control theory from a practitioner's point of view. As in the first edition, Ross takes the contrarian view that it is not necessary to prove Pontryagin's Principle before using it. Using the same philosophy, the second edition expands the ideas over four chapters: In Chapter 1, basic principles related to problem formulation via a structured approach are introduced: What is a state variable? What is a control variable? What is state space? And so on. In Chapter 2, Pontryagin's Principle is introduced using intuitive ideas from everyday life: Like the process of "measuring" a sandwich and how it relates to costates. A vast number of illustrations are used to explain the concepts without going into the minutia of obscure mathematics. Mnemonics are introduced to help a beginner remember the collection of conditions that constitute Pontryagin's Principle. In Chapter 3, several examples are worked out in detail to illustrate a step-by-step process in applying Pontryagin's Principle. Included in this example is Kalman's linear-quadratic optimal control problem. In Chapter 4, a large number of problems from applied mathematics to management science are solved to illustrate how Pontryagin's Principle is used across the disciplines. Included in this chapter are test problems and solutions. The style of the book is easygoing and engaging. The classical calculus of variations is an unnecessary prerequisite for understanding optimal control theory. Ross uses original references to weave an entertaining historical account of various events. Students, particularly beginners, will embark on a minimum-time trajectory to applying Pontryagin's Principle.




Principles of Optimal Design


Book Description

Principles of Optimal Design puts the concept of optimal design on a rigorous foundation and demonstrates the intimate relationship between the mathematical model that describes a design and the solution methods that optimize it. Since the first edition was published, computers have become ever more powerful, design engineers are tackling more complex systems, and the term optimization is now routinely used to denote a design process with increased speed and quality. This second edition takes account of these developments and brings the original text thoroughly up to date. The book now includes a discussion of trust region and convex approximation algorithms. A new chapter focuses on how to construct optimal design models. Three new case studies illustrate the creation of optimization models. The final chapter on optimization practice has been expanded to include computation of derivatives, interpretation of algorithmic results, and selection of algorithms and software. Both students and practising engineers will find this book a valuable resource for design project work.




Optimal Control of Partial Differential Equations


Book Description

Optimal control theory is concerned with finding control functions that minimize cost functions for systems described by differential equations. The methods have found widespread applications in aeronautics, mechanical engineering, the life sciences, and many other disciplines. This book focuses on optimal control problems where the state equation is an elliptic or parabolic partial differential equation. Included are topics such as the existence of optimal solutions, necessary optimality conditions and adjoint equations, second-order sufficient conditions, and main principles of selected numerical techniques. It also contains a survey on the Karush-Kuhn-Tucker theory of nonlinear programming in Banach spaces. The exposition begins with control problems with linear equations, quadratic cost functions and control constraints. To make the book self-contained, basic facts on weak solutions of elliptic and parabolic equations are introduced. Principles of functional analysis are introduced and explained as they are needed. Many simple examples illustrate the theory and its hidden difficulties. This start to the book makes it fairly self-contained and suitable for advanced undergraduates or beginning graduate students. Advanced control problems for nonlinear partial differential equations are also discussed. As prerequisites, results on boundedness and continuity of solutions to semilinear elliptic and parabolic equations are addressed. These topics are not yet readily available in books on PDEs, making the exposition also interesting for researchers. Alongside the main theme of the analysis of problems of optimal control, Tröltzsch also discusses numerical techniques. The exposition is confined to brief introductions into the basic ideas in order to give the reader an impression of how the theory can be realized numerically. After reading this book, the reader will be familiar with the main principles of the numerical analysis of PDE-constrained optimization.




Optimal Control Theory


Book Description

Optimal control methods are used to determine optimal ways to control a dynamic system. The theoretical work in this field serves as a foundation for the book, which the authors have applied to business management problems developed from their research and classroom instruction. Sethi and Thompson have provided management science and economics communities with a thoroughly revised edition of their classic text on Optimal Control Theory. The new edition has been completely refined with careful attention to the text and graphic material presentation. Chapters cover a range of topics including finance, production and inventory problems, marketing problems, machine maintenance and replacement, problems of optimal consumption of natural resources, and applications of control theory to economics. The book contains new results that were not available when the first edition was published, as well as an expansion of the material on stochastic optimal control theory.




Optimal Control


Book Description

A NEW EDITION OF THE CLASSIC TEXT ON OPTIMAL CONTROL THEORY As a superb introductory text and an indispensable reference, this new edition of Optimal Control will serve the needs of both the professional engineer and the advanced student in mechanical, electrical, and aerospace engineering. Its coverage encompasses all the fundamental topics as well as the major changes that have occurred in recent years. An abundance of computer simulations using MATLAB and relevant Toolboxes is included to give the reader the actual experience of applying the theory to real-world situations. Major topics covered include: Static Optimization Optimal Control of Discrete-Time Systems Optimal Control of Continuous-Time Systems The Tracking Problem and Other LQR Extensions Final-Time-Free and Constrained Input Control Dynamic Programming Optimal Control for Polynomial Systems Output Feedback and Structured Control Robustness and Multivariable Frequency-Domain Techniques Differential Games Reinforcement Learning and Optimal Adaptive Control




Linear Systems Theory


Book Description

A fully updated textbook on linear systems theory Linear systems theory is the cornerstone of control theory and a well-established discipline that focuses on linear differential equations from the perspective of control and estimation. This updated second edition of Linear Systems Theory covers the subject's key topics in a unique lecture-style format, making the book easy to use for instructors and students. João Hespanha looks at system representation, stability, controllability and state feedback, observability and state estimation, and realization theory. He provides the background for advanced modern control design techniques and feedback linearization and examines advanced foundational topics, such as multivariable poles and zeros and LQG/LQR. The textbook presents only the most essential mathematical derivations and places comments, discussion, and terminology in sidebars so that readers can follow the core material easily and without distraction. Annotated proofs with sidebars explain the techniques of proof construction, including contradiction, contraposition, cycles of implications to prove equivalence, and the difference between necessity and sufficiency. Annotated theoretical developments also use sidebars to discuss relevant commands available in MATLAB, allowing students to understand these tools. This second edition contains a large number of new practice exercises with solutions. Based on typical problems, these exercises guide students to succinct and precise answers, helping to clarify issues and consolidate knowledge. The book's balanced chapters can each be covered in approximately two hours of lecture time, simplifying course planning and student review. Easy-to-use textbook in unique lecture-style format Sidebars explain topics in further detail Annotated proofs and discussions of MATLAB commands Balanced chapters can each be taught in two hours of course lecture New practice exercises with solutions included