Hamilton-Jacobi Equations: Approximations, Numerical Analysis and Applications


Book Description

These Lecture Notes contain the material relative to the courses given at the CIME summer school held in Cetraro, Italy from August 29 to September 3, 2011. The topic was "Hamilton-Jacobi Equations: Approximations, Numerical Analysis and Applications". The courses dealt mostly with the following subjects: first order and second order Hamilton-Jacobi-Bellman equations, properties of viscosity solutions, asymptotic behaviors, mean field games, approximation and numerical methods, idempotent analysis. The content of the courses ranged from an introduction to viscosity solutions to quite advanced topics, at the cutting edge of research in the field. We believe that they opened perspectives on new and delicate issues. These lecture notes contain four contributions by Yves Achdou (Finite Difference Methods for Mean Field Games), Guy Barles (An Introduction to the Theory of Viscosity Solutions for First-order Hamilton-Jacobi Equations and Applications), Hitoshi Ishii (A Short Introduction to Viscosity Solutions and the Large Time Behavior of Solutions of Hamilton-Jacobi Equations) and Grigory Litvinov (Idempotent/Tropical Analysis, the Hamilton-Jacobi and Bellman Equations).




Hamilton-Jacobi-Bellman Equations


Book Description

Optimal feedback control arises in different areas such as aerospace engineering, chemical processing, resource economics, etc. In this context, the application of dynamic programming techniques leads to the solution of fully nonlinear Hamilton-Jacobi-Bellman equations. This book presents the state of the art in the numerical approximation of Hamilton-Jacobi-Bellman equations, including post-processing of Galerkin methods, high-order methods, boundary treatment in semi-Lagrangian schemes, reduced basis methods, comparison principles for viscosity solutions, max-plus methods, and the numerical approximation of Monge-Ampère equations. This book also features applications in the simulation of adaptive controllers and the control of nonlinear delay differential equations. Contents From a monotone probabilistic scheme to a probabilistic max-plus algorithm for solving Hamilton–Jacobi–Bellman equations Improving policies for Hamilton–Jacobi–Bellman equations by postprocessing Viability approach to simulation of an adaptive controller Galerkin approximations for the optimal control of nonlinear delay differential equations Efficient higher order time discretization schemes for Hamilton–Jacobi–Bellman equations based on diagonally implicit symplectic Runge–Kutta methods Numerical solution of the simple Monge–Ampere equation with nonconvex Dirichlet data on nonconvex domains On the notion of boundary conditions in comparison principles for viscosity solutions Boundary mesh refinement for semi-Lagrangian schemes A reduced basis method for the Hamilton–Jacobi–Bellman equation within the European Union Emission Trading Scheme




Semi-Lagrangian Approximation Schemes for Linear and Hamilton-Jacobi Equations


Book Description

This largely self-contained book provides a unified framework of semi-Lagrangian strategy for the approximation of hyperbolic PDEs, with a special focus on Hamilton-Jacobi equations. The authors provide a rigorous discussion of the theory of viscosity solutions and the concepts underlying the construction and analysis of difference schemes; they then proceed to high-order semi-Lagrangian schemes and their applications to problems in fluid dynamics, front propagation, optimal control, and image processing. The developments covered in the text and the references come from a wide range of literature.




Numerical Methods for Viscosity Solutions and Applications


Book Description

Geometrical optics and viscosity solutions / A.-P. Blanc, G. T. Kossioris and G. N. Makrakis -- Computation of vorticity evolution for a cylindrical Type-II superconductor subject to parallel and transverse applied magnetic fields / A. Briggs ... [et al.] -- A characterization of the value function for a class of degenerate control problems / F. Camilli -- Some microstructures in three dimensions / M. Chipot and V. Lecuyer -- Convergence of numerical schemes for the approximation of level set solutions to mean curvature flow / K. Deckelnick and G. Dziuk -- Optimal discretization steps in semi-lagrangian approximation of first-order PDEs / M. Falcone, R. Ferretti and T. Manfroni -- Convergence past singularities to the forced mean curvature flow for a modified reaction-diffusion approach / F. Fierro -- The viscosity-duality solutions approach to geometric pptics for the Helmholtz equation / L. Gosse and F. James -- Adaptive grid generation for evolutive Hamilton-Jacobi-Bellman equations / L. Grune -- Solution and application of anisotropic curvature driven evolution of curves (and surfaces) / K. Mikula -- An adaptive scheme on unstructured grids for the shape-from-shading problem / M. Sagona and A. Seghini -- On a posteriori error estimation for constant obstacle problems / A. Veeser.




Hamilton-Jacobi Equations


Book Description

This book gives an extensive survey of many important topics in the theory of Hamilton–Jacobi equations with particular emphasis on modern approaches and viewpoints. Firstly, the basic well-posedness theory of viscosity solutions for first-order Hamilton–Jacobi equations is covered. Then, the homogenization theory, a very active research topic since the late 1980s but not covered in any standard textbook, is discussed in depth. Afterwards, dynamical properties of solutions, the Aubry–Mather theory, and weak Kolmogorov–Arnold–Moser (KAM) theory are studied. Both dynamical and PDE approaches are introduced to investigate these theories. Connections between homogenization, dynamical aspects, and the optimal rate of convergence in homogenization theory are given as well. The book is self-contained and is useful for a course or for references. It can also serve as a gentle introductory reference to the homogenization theory.




Hamilton-Jacobi-Bellman Equations


Book Description

Optimal feedback control arises in different areas such as aerospace engineering, chemical processing, resource economics, etc. In this context, the application of dynamic programming techniques leads to the solution of fully nonlinear Hamilton-Jacobi-Bellman equations. This book presents the state of the art in the numerical approximation of Hamilton-Jacobi-Bellman equations, including post-processing of Galerkin methods, high-order methods, boundary treatment in semi-Lagrangian schemes, reduced basis methods, comparison principles for viscosity solutions, max-plus methods, and the numerical approximation of Monge-Ampère equations. This book also features applications in the simulation of adaptive controllers and the control of nonlinear delay differential equations. Contents From a monotone probabilistic scheme to a probabilistic max-plus algorithm for solving Hamilton–Jacobi–Bellman equations Improving policies for Hamilton–Jacobi–Bellman equations by postprocessing Viability approach to simulation of an adaptive controller Galerkin approximations for the optimal control of nonlinear delay differential equations Efficient higher order time discretization schemes for Hamilton–Jacobi–Bellman equations based on diagonally implicit symplectic Runge–Kutta methods Numerical solution of the simple Monge–Ampere equation with nonconvex Dirichlet data on nonconvex domains On the notion of boundary conditions in comparison principles for viscosity solutions Boundary mesh refinement for semi-Lagrangian schemes A reduced basis method for the Hamilton–Jacobi–Bellman equation within the European Union Emission Trading Scheme




Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations


Book Description

This softcover book is a self-contained account of the theory of viscosity solutions for first-order partial differential equations of Hamilton–Jacobi type and its interplay with Bellman’s dynamic programming approach to optimal control and differential games. It will be of interest to scientists involved in the theory of optimal control of deterministic linear and nonlinear systems. The work may be used by graduate students and researchers in control theory both as an introductory textbook and as an up-to-date reference book.




Stochastic and Differential Games


Book Description

The theory of two-person, zero-sum differential games started at the be­ ginning of the 1960s with the works of R. Isaacs in the United States and L. S. Pontryagin and his school in the former Soviet Union. Isaacs based his work on the Dynamic Programming method. He analyzed many special cases of the partial differential equation now called Hamilton­ Jacobi-Isaacs-briefiy HJI-trying to solve them explicitly and synthe­ sizing optimal feedbacks from the solution. He began a study of singular surfaces that was continued mainly by J. Breakwell and P. Bernhard and led to the explicit solution of some low-dimensional but highly nontriv­ ial games; a recent survey of this theory can be found in the book by J. Lewin entitled Differential Games (Springer, 1994). Since the early stages of the theory, several authors worked on making the notion of value of a differential game precise and providing a rigorous derivation of the HJI equation, which does not have a classical solution in most cases; we mention here the works of W. Fleming, A. Friedman (see his book, Differential Games, Wiley, 1971), P. P. Varaiya, E. Roxin, R. J. Elliott and N. J. Kalton, N. N. Krasovskii, and A. I. Subbotin (see their book Po­ sitional Differential Games, Nauka, 1974, and Springer, 1988), and L. D. Berkovitz. A major breakthrough was the introduction in the 1980s of two new notions of generalized solution for Hamilton-Jacobi equations, namely, viscosity solutions, by M. G. Crandall and P. -L.




Controlled Markov Processes and Viscosity Solutions


Book Description

This book is an introduction to optimal stochastic control for continuous time Markov processes and the theory of viscosity solutions. It covers dynamic programming for deterministic optimal control problems, as well as to the corresponding theory of viscosity solutions. New chapters in this second edition introduce the role of stochastic optimal control in portfolio optimization and in pricing derivatives in incomplete markets and two-controller, zero-sum differential games.




System Modeling and Optimization


Book Description

This book is a collection of thoroughly refereed papers presented at the 25th IFIP TC 7 Conference on System Modeling and Optimization, held in Dresden, Germany, in September 2011. The 55 revised papers were carefully selected from numerous submissions. They are organized in the following topical sections: control of distributed parameter systems; stochastic optimization and control; stabilization, feedback, and model predictive control; flow control; shape and structural optimization; and applications and control of lumped parameter systems.