A Primer on the Calculus of Variations and Optimal Control Theory


Book Description

The calculus of variations is used to find functions that optimize quantities expressed in terms of integrals. Optimal control theory seeks to find functions that minimize cost integrals for systems described by differential equations. This book is an introduction to both the classical theory of the calculus of variations and the more modern developments of optimal control theory from the perspective of an applied mathematician. It focuses on understanding concepts and how to apply them. The range of potential applications is broad: the calculus of variations and optimal control theory have been widely used in numerous ways in biology, criminology, economics, engineering, finance, management science, and physics. Applications described in this book include cancer chemotherapy, navigational control, and renewable resource harvesting. The prerequisites for the book are modest: the standard calculus sequence, a first course on ordinary differential equations, and some facility with the use of mathematical software. It is suitable for an undergraduate or beginning graduate course, or for self study. It provides excellent preparation for more advanced books and courses on the calculus of variations and optimal control theory.




Calculus of Variations and Optimal Control Theory


Book Description

This textbook offers a concise yet rigorous introduction to calculus of variations and optimal control theory, and is a self-contained resource for graduate students in engineering, applied mathematics, and related subjects. Designed specifically for a one-semester course, the book begins with calculus of variations, preparing the ground for optimal control. It then gives a complete proof of the maximum principle and covers key topics such as the Hamilton-Jacobi-Bellman theory of dynamic programming and linear-quadratic optimal control. Calculus of Variations and Optimal Control Theory also traces the historical development of the subject and features numerous exercises, notes and references at the end of each chapter, and suggestions for further study. Offers a concise yet rigorous introduction Requires limited background in control theory or advanced mathematics Provides a complete proof of the maximum principle Uses consistent notation in the exposition of classical and modern topics Traces the historical development of the subject Solutions manual (available only to teachers) Leading universities that have adopted this book include: University of Illinois at Urbana-Champaign ECE 553: Optimum Control Systems Georgia Institute of Technology ECE 6553: Optimal Control and Optimization University of Pennsylvania ESE 680: Optimal Control Theory University of Notre Dame EE 60565: Optimal Control




Primer on Optimal Control Theory


Book Description

A rigorous introduction to optimal control theory, which will enable engineers and scientists to put the theory into practice.




Classical Mechanics with Calculus of Variations and Optimal Control


Book Description

This is an intuitively motivated presentation of many topics in classical mechanics and related areas of control theory and calculus of variations. All topics throughout the book are treated with zero tolerance for unrevealing definitions and for proofs which leave the reader in the dark. Some areas of particular interest are: an extremely short derivation of the ellipticity of planetary orbits; a statement and an explanation of the "tennis racket paradox"; a heuristic explanation (and a rigorous treatment) of the gyroscopic effect; a revealing equivalence between the dynamics of a particle and statics of a spring; a short geometrical explanation of Pontryagin's Maximum Principle, and more. In the last chapter, aimed at more advanced readers, the Hamiltonian and the momentum are compared to forces in a certain static problem. This gives a palpable physical meaning to some seemingly abstract concepts and theorems. With minimal prerequisites consisting of basic calculus and basic undergraduate physics, this book is suitable for courses from an undergraduate to a beginning graduate level, and for a mixed audience of mathematics, physics and engineering students. Much of the enjoyment of the subject lies in solving almost 200 problems in this book.




The Calculus of Variations and Optimal Control


Book Description

When the Tyrian princess Dido landed on the North African shore of the Mediterranean sea she was welcomed by a local chieftain. He offered her all the land that she could enclose between the shoreline and a rope of knotted cowhide. While the legend does not tell us, we may assume that Princess Dido arrived at the correct solution by stretching the rope into the shape of a circular arc and thereby maximized the area of the land upon which she was to found Carthage. This story of the founding of Carthage is apocryphal. Nonetheless it is probably the first account of a problem of the kind that inspired an entire mathematical discipline, the calculus of variations and its extensions such as the theory of optimal control. This book is intended to present an introductory treatment of the calculus of variations in Part I and of optimal control theory in Part II. The discussion in Part I is restricted to the simplest problem of the calculus of variations. The topic is entirely classical; all of the basic theory had been developed before the turn of the century. Consequently the material comes from many sources; however, those most useful to me have been the books of Oskar Bolza and of George M. Ewing. Part II is devoted to the elementary aspects of the modern extension of the calculus of variations, the theory of optimal control of dynamical systems.




A Primer on Pontryagin's Principle in Optimal Control


Book Description

EDITORIAL REVIEW: This book provides a guided tour in introducing optimal control theory from a practitioner's point of view. As in the first edition, Ross takes the contrarian view that it is not necessary to prove Pontryagin's Principle before using it. Using the same philosophy, the second edition expands the ideas over four chapters: In Chapter 1, basic principles related to problem formulation via a structured approach are introduced: What is a state variable? What is a control variable? What is state space? And so on. In Chapter 2, Pontryagin's Principle is introduced using intuitive ideas from everyday life: Like the process of "measuring" a sandwich and how it relates to costates. A vast number of illustrations are used to explain the concepts without going into the minutia of obscure mathematics. Mnemonics are introduced to help a beginner remember the collection of conditions that constitute Pontryagin's Principle. In Chapter 3, several examples are worked out in detail to illustrate a step-by-step process in applying Pontryagin's Principle. Included in this example is Kalman's linear-quadratic optimal control problem. In Chapter 4, a large number of problems from applied mathematics to management science are solved to illustrate how Pontryagin's Principle is used across the disciplines. Included in this chapter are test problems and solutions. The style of the book is easygoing and engaging. The classical calculus of variations is an unnecessary prerequisite for understanding optimal control theory. Ross uses original references to weave an entertaining historical account of various events. Students, particularly beginners, will embark on a minimum-time trajectory to applying Pontryagin's Principle.




Calculus of Variations


Book Description

This textbook provides a comprehensive introduction to the classical and modern calculus of variations, serving as a useful reference to advanced undergraduate and graduate students as well as researchers in the field. Starting from ten motivational examples, the book begins with the most important aspects of the classical theory, including the Direct Method, the Euler-Lagrange equation, Lagrange multipliers, Noether’s Theorem and some regularity theory. Based on the efficient Young measure approach, the author then discusses the vectorial theory of integral functionals, including quasiconvexity, polyconvexity, and relaxation. In the second part, more recent material such as rigidity in differential inclusions, microstructure, convex integration, singularities in measures, functionals defined on functions of bounded variation (BV), and Γ-convergence for phase transitions and homogenization are explored. While predominantly designed as a textbook for lecture courses on the calculus of variations, this book can also serve as the basis for a reading seminar or as a companion for self-study. The reader is assumed to be familiar with basic vector analysis, functional analysis, Sobolev spaces, and measure theory, though most of the preliminaries are also recalled in the appendix.




Functional Analysis, Calculus of Variations and Optimal Control


Book Description

Functional analysis owes much of its early impetus to problems that arise in the calculus of variations. In turn, the methods developed there have been applied to optimal control, an area that also requires new tools, such as nonsmooth analysis. This self-contained textbook gives a complete course on all these topics. It is written by a leading specialist who is also a noted expositor. This book provides a thorough introduction to functional analysis and includes many novel elements as well as the standard topics. A short course on nonsmooth analysis and geometry completes the first half of the book whilst the second half concerns the calculus of variations and optimal control. The author provides a comprehensive course on these subjects, from their inception through to the present. A notable feature is the inclusion of recent, unifying developments on regularity, multiplier rules, and the Pontryagin maximum principle, which appear here for the first time in a textbook. Other major themes include existence and Hamilton-Jacobi methods. The many substantial examples, and the more than three hundred exercises, treat such topics as viscosity solutions, nonsmooth Lagrangians, the logarithmic Sobolev inequality, periodic trajectories, and systems theory. They also touch lightly upon several fields of application: mechanics, economics, resources, finance, control engineering. Functional Analysis, Calculus of Variations and Optimal Control is intended to support several different courses at the first-year or second-year graduate level, on functional analysis, on the calculus of variations and optimal control, or on some combination. For this reason, it has been organized with customization in mind. The text also has considerable value as a reference. Besides its advanced results in the calculus of variations and optimal control, its polished presentation of certain other topics (for example convex analysis, measurable selections, metric regularity, and nonsmooth analysis) will be appreciated by researchers in these and related fields.




Control Theory and Systems Biology


Book Description

A survey of how engineering techniques from control and systems theory can be used to help biologists understand the behavior of cellular systems.




Optimal Control


Book Description

Geared toward advanced undergraduate and graduate engineering students, this text introduces the theory and applications of optimal control. It serves as a bridge to the technical literature, enabling students to evaluate the implications of theoretical control work, and to judge the merits of papers on the subject. Rather than presenting an exhaustive treatise, Optimal Control offers a detailed introduction that fosters careful thinking and disciplined intuition. It develops the basic mathematical background, with a coherent formulation of the control problem and discussions of the necessary conditions for optimality based on the maximum principle of Pontryagin. In-depth examinations cover applications of the theory to minimum time, minimum fuel, and to quadratic criteria problems. The structure, properties, and engineering realizations of several optimal feedback control systems also receive attention. Special features include numerous specific problems, carried through to engineering realization in block diagram form. The text treats almost all current examples of control problems that permit analytic solutions, and its unified approach makes frequent use of geometric ideas to encourage students' intuition.