Introduction to Nonsmooth Optimization


Book Description

This book is the first easy-to-read text on nonsmooth optimization (NSO, not necessarily differentiable optimization). Solving these kinds of problems plays a critical role in many industrial applications and real-world modeling systems, for example in the context of image denoising, optimal control, neural network training, data mining, economics and computational chemistry and physics. The book covers both the theory and the numerical methods used in NSO and provide an overview of different problems arising in the field. It is organized into three parts: 1. convex and nonconvex analysis and the theory of NSO; 2. test problems and practical applications; 3. a guide to NSO software. The book is ideal for anyone teaching or attending NSO courses. As an accessible introduction to the field, it is also well suited as an independent learning guide for practitioners already familiar with the basics of optimization.




Nonsmooth Optimization: Analysis And Algorithms With Applications To Optimal Control


Book Description

This book is a self-contained elementary study for nonsmooth analysis and optimization, and their use in solution of nonsmooth optimal control problems. The first part of the book is concerned with nonsmooth differential calculus containing necessary tools for nonsmooth optimization. The second part is devoted to the methods of nonsmooth optimization and their development. A proximal bundle method for nonsmooth nonconvex optimization subject to nonsmooth constraints is constructed. In the last part nonsmooth optimization is applied to problems arising from optimal control of systems covered by partial differential equations. Several practical problems, like process control and optimal shape design problems are considered.




Nonsmooth Equations in Optimization


Book Description

Many questions dealing with solvability, stability and solution methods for va- ational inequalities or equilibrium, optimization and complementarity problems lead to the analysis of certain (perturbed) equations. This often requires a - formulation of the initial model being under consideration. Due to the specific of the original problem, the resulting equation is usually either not differ- tiable (even if the data of the original model are smooth), or it does not satisfy the assumptions of the classical implicit function theorem. This phenomenon is the main reason why a considerable analytical inst- ment dealing with generalized equations (i.e., with finding zeros of multivalued mappings) and nonsmooth equations (i.e., the defining functions are not c- tinuously differentiable) has been developed during the last 20 years, and that under very different viewpoints and assumptions. In this theory, the classical hypotheses of convex analysis, in particular, monotonicity and convexity, have been weakened or dropped, and the scope of possible applications seems to be quite large. Briefly, this discipline is often called nonsmooth analysis, sometimes also variational analysis. Our book fits into this discipline, however, our main intention is to develop the analytical theory in close connection with the needs of applications in optimization and related subjects. Main Topics of the Book 1. Extended analysis of Lipschitz functions and their generalized derivatives, including ”Newton maps” and regularity of multivalued mappings. 2. Principle of successive approximation under metric regularity and its - plication to implicit functions.




Introduction to Functional Analysis


Book Description

Functional analysis has become one of the essential foundations of modern applied mathematics in the last decades, from the theory and numerical solution of differential equations, from optimization and probability theory to medical imaging and mathematical image processing. This textbook offers a compact introduction to the theory and is designed to be used during one semester, fitting exactly 26 lectures of 90 minutes each. It ranges from the topological fundamentals recalled from basic lectures on real analysis to spectral theory in Hilbert spaces. Special attention is given to the central results on dual spaces and weak convergence.




Nonsmooth Approach to Optimization Problems with Equilibrium Constraints


Book Description

In the early fifties, applied mathematicians, engineers and economists started to pay c10se attention to the optimization problems in which another (lower-Ievel) optimization problem arises as a side constraint. One of the motivating factors was the concept of the Stackelberg solution in game theory, together with its economic applications. Other problems have been encountered in the seventies in natural sciences and engineering. Many of them are of practical importance and have been extensively studied, mainly from the theoretical point of view. Later, applications to mechanics and network design have lead to an extension of the problem formulation: Constraints in form of variation al inequalities and complementarity problems were also admitted. The term "generalized bi level programming problems" was used at first but later, probably in Harker and Pang, 1988, a different terminology was introduced: Mathematical programs with equilibrium constraints, or simply, MPECs. In this book we adhere to MPEC terminology. A large number of papers deals with MPECs but, to our knowledge, there is only one monograph (Luo et al. , 1997). This monograph concentrates on optimality conditions and numerical methods. Our book is oriented similarly, but we focus on those MPECs which can be treated by the implicit programming approach: the equilibrium constraint locally defines a certain implicit function and allows to convert the problem into a mathematical program with a nonsmooth objective.




Nonsmooth Vector Functions and Continuous Optimization


Book Description

Focusing on the study of nonsmooth vector functions, this book presents a comprehensive account of the calculus of generalized Jacobian matrices and their applications to continuous nonsmooth optimization problems, as well as variational inequalities in finite dimensions. The treatment is motivated by a desire to expose an elementary approach to nonsmooth calculus, using a set of matrices to replace the nonexistent Jacobian matrix of a continuous vector function.




Equilibrium Problems: Nonsmooth Optimization and Variational Inequality Models


Book Description

The aim of the book is to cover the three fundamental aspects of research in equilibrium problems: the statement problem and its formulation using mainly variational methods, its theoretical solution by means of classical and new variational tools, the calculus of solutions and applications in concrete cases. The book shows how many equilibrium problems follow a general law (the so-called user equilibrium condition). Such law allows us to express the problem in terms of variational inequalities. Variational inequalities provide a powerful methodology, by which existence and calculation of the solution can be obtained.




Mathematics of Optimization: Smooth and Nonsmooth Case


Book Description

The book is intended for people (graduates, researchers, but also undergraduates with a good mathematical background) involved in the study of (static) optimization problems (in finite-dimensional spaces). It contains a lot of material, from basic tools of convex analysis to optimality conditions for smooth optimization problems, for non smooth optimization problems and for vector optimization problems.The development of the subjects are self-contained and the bibliographical references are usually treated in different books (only a few books on optimization theory deal also with vector problems), so the book can be a starting point for further readings in a more specialized literature.Assuming only a good (even if not advanced) knowledge of mathematical analysis and linear algebra, this book presents various aspects of the mathematical theory in optimization problems. The treatment is performed in finite-dimensional spaces and with no regard to algorithmic questions. After two chapters concerning, respectively, introductory subjects and basic tools and concepts of convex analysis, the book treats extensively mathematical programming problems in the smmoth case, in the nonsmooth case and finally vector optimization problems.· Self-contained· Clear style and results are either proved or stated precisely with adequate references· The authors have several years experience in this field· Several subjects (some of them non usual in books of this kind) in one single book, including nonsmooth optimization and vector optimization problems· Useful long references list at the end of each chapter




Nonsmooth Analysis


Book Description

This book treats various concepts of generalized derivatives and subdifferentials in normed spaces, their geometric counterparts and their application to optimization problems. It starts with the subdifferential of convex analysis, passes to corresponding concepts for locally Lipschitz continuous functions and then presents subdifferentials for general lower semicontinuous functions. All basic tools are presented where they are needed: this concerns separation theorems, variational and extremal principles as well as relevant parts of multifunction theory. Each chapter ends with bibliographic notes and exercises.




An Introduction to Nonlinear Optimization Theory


Book Description

The goal of this book is to present the main ideas and techniques in the field of continuous smooth and nonsmooth optimization. Starting with the case of differentiable data and the classical results on constrained optimization problems, and continuing with the topic of nonsmooth objects involved in optimization theory, the book concentrates on both theoretical and practical aspects of this field. This book prepares those who are engaged in research by giving repeated insights into ideas that are subsequently dealt with and illustrated in detail.




Recent Books