Stochastic Global Optimization


Book Description

Ch. 1. Introduction / Gade Pandu Rangaiah -- ch. 2. Formulation and illustration of Luus-Jaakola optimization procedure / Rein Luus -- ch. 3. Adaptive random search and simulated annealing optimizers : algorithms and application issues / Jacek M. Jezowski, Grzegorz Poplewski and Roman Bochenek -- ch. 4. Genetic algorithms in process engineering : developments and implementation issues / Abdunnaser Younes, Ali Elkamel and Shawki Areibi -- ch. 5. Tabu search for global optimization of problems having continuous variables / Sim Mong Kai, Gade Pandu Rangaiah and Mekapati Srinivas -- ch. 6. Differential evolution : method, developments and chemical engineering applications / Chen Shaoqiang, Gade Pandu Rangaiah and Mekapati Srinivas -- ch. 7. Ant colony optimization : details of algorithms suitable for process engineering / V.K. Jayaraman [und weitere] -- ch. 8. Particle swarm optimization for solving NLP and MINLP in chemical engineering / Bassem Jarboui [und weitere] -- ch. 9. An introduction to the harmony search algorithm / Gordon Ingram and Tonghua Zhang -- ch. 10. Meta-heuristics : evaluation and reporting techniques / Abdunnaser Younes, Ali Elkamel and Shawki Areibi -- ch. 11. A hybrid approach for constraint handling in MINLP optimization using stochastic algorithms / G.A. Durand [und weitere] -- ch. 12. Application of Luus-Jaakola optimization procedure to model reduction, parameter estimation and optimal control / Rein Luus -- ch. 13. Phase stability and equilibrium calculations in reactive systems using differential evolution and tabu search / Adrian Bonilla-Petriciolet [und weitere] -- ch. 14. Differential evolution with tabu list for global optimization : evaluation of two versions on benchmark and phase stability problems / Mekapati Srinivas and Gade Pandu Rangaiah -- ch. 15. Application of adaptive random search optimization for solving industrial water allocation problem / Grzegorz Poplewski and Jacek M. Jezowski -- ch. 16. Genetic algorithms formulation for retrofitting heat exchanger network / Roman Bochenek and Jacek M. Jezowski -- ch. 17. Ant colony optimization for classification and feature selection / V.K. Jayaraman [und weitere] -- ch. 18. Constraint programming and genetic algorithm / Prakash R. Kotecha, Mani Bhushan and Ravindra D. Gudi -- ch. 19. Schemes and implementations of parallel stochastic optimization algorithms application of tabu search to chemical engineering problems / B. Lin and D.C. Miller




Adaptive Stochastic Optimization Techniques with Applications


Book Description

Adaptive Stochastic Optimization Techniques with Applications provides a single, convenient source for state-of-the-art information on optimization techniques used to solve problems with adaptive, dynamic, and stochastic features. Presenting modern advances in static and dynamic optimization, decision analysis, intelligent systems, evolutionary pro




Stochastic Adaptive Search for Global Optimization


Book Description

The field of global optimization has been developing at a rapid pace. There is a journal devoted to the topic, as well as many publications and notable books discussing various aspects of global optimization. This book is intended to complement these other publications with a focus on stochastic methods for global optimization. Stochastic methods, such as simulated annealing and genetic algo rithms, are gaining in popularity among practitioners and engineers be they are relatively easy to program on a computer and may be cause applied to a broad class of global optimization problems. However, the theoretical performance of these stochastic methods is not well under stood. In this book, an attempt is made to describe the theoretical prop erties of several stochastic adaptive search methods. Such a theoretical understanding may allow us to better predict algorithm performance and ultimately design new and improved algorithms. This book consolidates a collection of papers on the analysis and de velopment of stochastic adaptive search. The first chapter introduces random search algorithms. Chapters 2-5 describe the theoretical anal ysis of a progression of algorithms. A main result is that the expected number of iterations for pure adaptive search is linear in dimension for a class of Lipschitz global optimization problems. Chapter 6 discusses algorithms, based on the Hit-and-Run sampling method, that have been developed to approximate the ideal performance of pure random search. The final chapter discusses several applications in engineering that use stochastic adaptive search methods.




Stochastic Optimization Methods


Book Description

This book examines optimization problems that in practice involve random model parameters. It details the computation of robust optimal solutions, i.e., optimal solutions that are insensitive with respect to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures and differentiation formulas for probabilities and expectations. In the third edition, this book further develops stochastic optimization methods. In particular, it now shows how to apply stochastic optimization methods to the approximate solution of important concrete problems arising in engineering, economics and operations research.




Intelligent Control


Book Description

This book discusses systematic designs of stable adaptive fuzzy logic controllers employing hybridizations of Lyapunov strategy-based approaches/H∞ theory-based approaches and contemporary stochastic optimization techniques. The text demonstrates how candidate stochastic optimization techniques like Particle swarm optimization (PSO), harmony search (HS) algorithms, covariance matrix adaptation (CMA) etc. can be utilized in conjunction with the Lyapunov theory/H∞ theory to develop such hybrid control strategies. The goal of developing a series of such hybridization processes is to combine the strengths of both Lyapunov theory/H∞ theory-based local search methods and stochastic optimization-based global search methods, so as to attain superior control algorithms that can simultaneously achieve desired asymptotic performance and provide improved transient responses. The book also demonstrates how these intelligent adaptive control algorithms can be effectively utilized in real-life applications such as in temperature control for air heater systems with transportation delay, vision-based navigation of mobile robots, intelligent control of robot manipulators etc.




Stochastic Learning and Optimization


Book Description

Performance optimization is vital in the design and operation of modern engineering systems, including communications, manufacturing, robotics, and logistics. Most engineering systems are too complicated to model, or the system parameters cannot be easily identified, so learning techniques have to be applied. This book provides a unified framework based on a sensitivity point of view. It also introduces new approaches and proposes new research topics within this sensitivity-based framework. This new perspective on a popular topic is presented by a well respected expert in the field.




Introduction to Stochastic Search and Optimization


Book Description

* Unique in its survey of the range of topics. * Contains a strong, interdisciplinary format that will appeal to both students and researchers. * Features exercises and web links to software and data sets.




Reinforcement Learning and Stochastic Optimization


Book Description

REINFORCEMENT LEARNING AND STOCHASTIC OPTIMIZATION Clearing the jungle of stochastic optimization Sequential decision problems, which consist of “decision, information, decision, information,” are ubiquitous, spanning virtually every human activity ranging from business applications, health (personal and public health, and medical decision making), energy, the sciences, all fields of engineering, finance, and e-commerce. The diversity of applications attracted the attention of at least 15 distinct fields of research, using eight distinct notational systems which produced a vast array of analytical tools. A byproduct is that powerful tools developed in one community may be unknown to other communities. Reinforcement Learning and Stochastic Optimization offers a single canonical framework that can model any sequential decision problem using five core components: state variables, decision variables, exogenous information variables, transition function, and objective function. This book highlights twelve types of uncertainty that might enter any model and pulls together the diverse set of methods for making decisions, known as policies, into four fundamental classes that span every method suggested in the academic literature or used in practice. Reinforcement Learning and Stochastic Optimization is the first book to provide a balanced treatment of the different methods for modeling and solving sequential decision problems, following the style used by most books on machine learning, optimization, and simulation. The presentation is designed for readers with a course in probability and statistics, and an interest in modeling and applications. Linear programming is occasionally used for specific problem classes. The book is designed for readers who are new to the field, as well as those with some background in optimization under uncertainty. Throughout this book, readers will find references to over 100 different applications, spanning pure learning problems, dynamic resource allocation problems, general state-dependent problems, and hybrid learning/resource allocation problems such as those that arose in the COVID pandemic. There are 370 exercises, organized into seven groups, ranging from review questions, modeling, computation, problem solving, theory, programming exercises and a “diary problem” that a reader chooses at the beginning of the book, and which is used as a basis for questions throughout the rest of the book.




Stochastic Recursive Algorithms for Optimization


Book Description

Stochastic Recursive Algorithms for Optimization presents algorithms for constrained and unconstrained optimization and for reinforcement learning. Efficient perturbation approaches form a thread unifying all the algorithms considered. Simultaneous perturbation stochastic approximation and smooth fractional estimators for gradient- and Hessian-based methods are presented. These algorithms: • are easily implemented; • do not require an explicit system model; and • work with real or simulated data. Chapters on their application in service systems, vehicular traffic control and communications networks illustrate this point. The book is self-contained with necessary mathematical results placed in an appendix. The text provides easy-to-use, off-the-shelf algorithms that are given detailed mathematical treatment so the material presented will be of significant interest to practitioners, academic researchers and graduate students alike. The breadth of applications makes the book appropriate for reader from similarly diverse backgrounds: workers in relevant areas of computer science, control engineering, management science, applied mathematics, industrial engineering and operations research will find the content of value.




Derivative-Free and Blackbox Optimization


Book Description

This book is designed as a textbook, suitable for self-learning or for teaching an upper-year university course on derivative-free and blackbox optimization. The book is split into 5 parts and is designed to be modular; any individual part depends only on the material in Part I. Part I of the book discusses what is meant by Derivative-Free and Blackbox Optimization, provides background material, and early basics while Part II focuses on heuristic methods (Genetic Algorithms and Nelder-Mead). Part III presents direct search methods (Generalized Pattern Search and Mesh Adaptive Direct Search) and Part IV focuses on model-based methods (Simplex Gradient and Trust Region). Part V discusses dealing with constraints, using surrogates, and bi-objective optimization. End of chapter exercises are included throughout as well as 15 end of chapter projects and over 40 figures. Benchmarking techniques are also presented in the appendix.