Optimization by the Pattern Search Method


Book Description

An infinite number of mathematical models can be created to describe naturally occurring physical systems. In addition there is a smaller, but large, number of criteria which can be used to measure the goodness of fit of a model to a physical process. Together, a selected criterion and a mathematical model define an objective function to be optimized.




Numerical Optimization


Book Description

Optimization is an important tool used in decision science and for the analysis of physical systems used in engineering. One can trace its roots to the Calculus of Variations and the work of Euler and Lagrange. This natural and reasonable approach to mathematical programming covers numerical methods for finite-dimensional optimization problems. It begins with very simple ideas progressing through more complicated concepts, concentrating on methods for both unconstrained and constrained optimization.




Meta-heuristic and Evolutionary Algorithms for Engineering Optimization


Book Description

A detailed review of a wide range of meta-heuristic and evolutionary algorithms in a systematic manner and how they relate to engineering optimization problems This book introduces the main metaheuristic algorithms and their applications in optimization. It describes 20 leading meta-heuristic and evolutionary algorithms and presents discussions and assessments of their performance in solving optimization problems from several fields of engineering. The book features clear and concise principles and presents detailed descriptions of leading methods such as the pattern search (PS) algorithm, the genetic algorithm (GA), the simulated annealing (SA) algorithm, the Tabu search (TS) algorithm, the ant colony optimization (ACO), and the particle swarm optimization (PSO) technique. Chapter 1 of Meta-heuristic and Evolutionary Algorithms for Engineering Optimization provides an overview of optimization and defines it by presenting examples of optimization problems in different engineering domains. Chapter 2 presents an introduction to meta-heuristic and evolutionary algorithms and links them to engineering problems. Chapters 3 to 22 are each devoted to a separate algorithm— and they each start with a brief literature review of the development of the algorithm, and its applications to engineering problems. The principles, steps, and execution of the algorithms are described in detail, and a pseudo code of the algorithm is presented, which serves as a guideline for coding the algorithm to solve specific applications. This book: Introduces state-of-the-art metaheuristic algorithms and their applications to engineering optimization; Fills a gap in the current literature by compiling and explaining the various meta-heuristic and evolutionary algorithms in a clear and systematic manner; Provides a step-by-step presentation of each algorithm and guidelines for practical implementation and coding of algorithms; Discusses and assesses the performance of metaheuristic algorithms in multiple problems from many fields of engineering; Relates optimization algorithms to engineering problems employing a unifying approach. Meta-heuristic and Evolutionary Algorithms for Engineering Optimization is a reference intended for students, engineers, researchers, and instructors in the fields of industrial engineering, operations research, optimization/mathematics, engineering optimization, and computer science. OMID BOZORG-HADDAD, PhD, is Professor in the Department of Irrigation and Reclamation Engineering at the University of Tehran, Iran. MOHAMMAD SOLGI, M.Sc., is Teacher Assistant for M.Sc. courses at the University of Tehran, Iran. HUGO A. LOÁICIGA, PhD, is Professor in the Department of Geography at the University of California, Santa Barbara, United States of America.




Algorithms for Optimization


Book Description

A comprehensive introduction to optimization with a focus on practical algorithms for the design of engineering systems. This book offers a comprehensive introduction to optimization with a focus on practical algorithms. The book approaches optimization from an engineering perspective, where the objective is to design a system that optimizes a set of metrics subject to constraints. Readers will learn about computational approaches for a range of challenges, including searching high-dimensional spaces, handling problems where there are multiple competing objectives, and accommodating uncertainty in the metrics. Figures, examples, and exercises convey the intuition behind the mathematical approaches. The text provides concrete implementations in the Julia programming language. Topics covered include derivatives and their generalization to multiple dimensions; local descent and first- and second-order methods that inform local descent; stochastic methods, which introduce randomness into the optimization process; linear constrained optimization, when both the objective function and the constraints are linear; surrogate models, probabilistic surrogate models, and using probabilistic surrogate models to guide optimization; optimization under uncertainty; uncertainty propagation; expression optimization; and multidisciplinary design optimization. Appendixes offer an introduction to the Julia language, test functions for evaluating algorithm performance, and mathematical concepts used in the derivation and analysis of the optimization methods discussed in the text. The book can be used by advanced undergraduates and graduate students in mathematics, statistics, computer science, any engineering field, (including electrical engineering and aerospace engineering), and operations research, and as a reference for professionals.




Applied Optimization with MATLAB Programming


Book Description

Technology/Engineering/Mechanical Provides all the tools needed to begin solving optimization problems using MATLAB® The Second Edition of Applied Optimization with MATLAB® Programming enables readers to harness all the features of MATLAB® to solve optimization problems using a variety of linear and nonlinear design optimization techniques. By breaking down complex mathematical concepts into simple ideas and offering plenty of easy-to-follow examples, this text is an ideal introduction to the field. Examples come from all engineering disciplines as well as science, economics, operations research, and mathematics, helping readers understand how to apply optimization techniques to solve actual problems. This Second Edition has been thoroughly revised, incorporating current optimization techniques as well as the improved MATLAB® tools. Two important new features of the text are: Introduction to the scan and zoom method, providing a simple, effective technique that works for unconstrained, constrained, and global optimization problems New chapter, Hybrid Mathematics: An Application, using examples to illustrate how optimization can develop analytical or explicit solutions to differential systems and data-fitting problems Each chapter ends with a set of problems that give readers an opportunity to put their new skills into practice. Almost all of the numerical techniques covered in the text are supported by MATLAB® code, which readers can download on the text's companion Web site www.wiley.com/go/venkat2e and use to begin solving problems on their own. This text is recommended for upper-level undergraduate and graduate students in all areas of engineering as well as other disciplines that use optimization techniques to solve design problems.




Computational Optimization, Methods and Algorithms


Book Description

Computational optimization is an important paradigm with a wide range of applications. In virtually all branches of engineering and industry, we almost always try to optimize something - whether to minimize the cost and energy consumption, or to maximize profits, outputs, performance and efficiency. In many cases, this search for optimality is challenging, either because of the high computational cost of evaluating objectives and constraints, or because of the nonlinearity, multimodality, discontinuity and uncertainty of the problem functions in the real-world systems. Another complication is that most problems are often NP-hard, that is, the solution time for finding the optimum increases exponentially with the problem size. The development of efficient algorithms and specialized techniques that address these difficulties is of primary importance for contemporary engineering, science and industry. This book consists of 12 self-contained chapters, contributed from worldwide experts who are working in these exciting areas. The book strives to review and discuss the latest developments concerning optimization and modelling with a focus on methods and algorithms for computational optimization. It also covers well-chosen, real-world applications in science, engineering and industry. Main topics include derivative-free optimization, multi-objective evolutionary algorithms, surrogate-based methods, maximum simulated likelihood estimation, support vector machines, and metaheuristic algorithms. Application case studies include aerodynamic shape optimization, microwave engineering, black-box optimization, classification, economics, inventory optimization and structural optimization. This graduate level book can serve as an excellent reference for lecturers, researchers and students in computational science, engineering and industry.




Derivative-Free and Blackbox Optimization


Book Description

This book is designed as a textbook, suitable for self-learning or for teaching an upper-year university course on derivative-free and blackbox optimization. The book is split into 5 parts and is designed to be modular; any individual part depends only on the material in Part I. Part I of the book discusses what is meant by Derivative-Free and Blackbox Optimization, provides background material, and early basics while Part II focuses on heuristic methods (Genetic Algorithms and Nelder-Mead). Part III presents direct search methods (Generalized Pattern Search and Mesh Adaptive Direct Search) and Part IV focuses on model-based methods (Simplex Gradient and Trust Region). Part V discusses dealing with constraints, using surrogates, and bi-objective optimization. End of chapter exercises are included throughout as well as 15 end of chapter projects and over 40 figures. Benchmarking techniques are also presented in the appendix.




POWER SYSTEM OPTIMIZATION


Book Description

Power System Optimization is intended to introduce the methods of multi-objective optimization in integrated electric power system operation, covering economic, environmental, security and risk aspects as well. Evolutionary algorithms which mimic natural evolutionary principles to constitute random search and optimization procedures are appended in this new edition to solve generation scheduling problems. Written in a student-friendly style, the book provides simple and understandable basic computational concepts and algorithms used in generation scheduling so that the readers can develop their own programs in any high-level programming language. This clear, logical overview of generation scheduling in electric power systems permits both students and power engineers to understand and apply optimization on a dependable basis. The book is particularly easy-to-use with sound and consistent terminology and perspective throughout. This edition presents systematic coverage of local and global optimization techniques such as binary- and real-coded genetic algorithms, evolutionary algorithms, particle swarm optimization and differential evolutionary algorithms. The economic dispatch problem presented, considers higher-order nonlinearities and discontinuities in input–output characteristics in fossil fuel burning plants due to valve-point loading, ramp-rate limits and prohibited operating zones. Search optimization techniques presented are those which participate efficiently in decision making to solve the multiobjective optimization problems. Stochastic optimal generation scheduling is also updated in the new edition. Generalized Z-bus distribution factors (GZBDF) are presented to compute the active and reactive power flow on transmission lines. The interactive decision making methodology based on fuzzy set theory, in order to determine the optimal generation allocation to committed generating units, is also discussed. This book is intended to meet the needs of a diverse range of groups interested in the application of optimization techniques to power system operation. It requires only an elementary knowledge of numerical techniques and matrix operation to understand most of the topics. It is designed to serve as a textbook for postgraduate electrical engineering students, as well as a reference for faculty, researchers, and power engineers interested in the use of optimization as a tool for reliable and secure economic operation of power systems. Key Features The book discusses : Load flow techniques and economic dispatch—both classical and rigorous Economic dispatch considering valve-point loading, ramp-rate limits and prohibited operating zones Real coded genetic algorithms for economic dispatch Evolutionary programming for economic dispatch Particle swarm optimization for economic dispatch Differential evolutionary algorithm for economic dispatch Stochastic multiobjective thermal power dispatch with security Generalized Z-bus distribution factors to compute line flow Stochastic multiobjective hydrothermal generation scheduling Multiobjective thermal power dispatch using artificial neural networks Fuzzy multiobjective generation scheduling Multiobjective generation scheduling by searching weight pattern




Harmony Search Algorithm


Book Description

The Harmony Search Algorithm (HSA) is one of the most well-known techniques in the field of soft computing, an important paradigm in the science and engineering community. This volume, the proceedings of the 2nd International Conference on Harmony Search Algorithm 2015 (ICHSA 2015), brings together contributions describing the latest developments in the field of soft computing with a special focus on HSA techniques. It includes coverage of new methods that have potentially immense application in various fields. Contributed articles cover aspects of the following topics related to the Harmony Search Algorithm: analytical studies; improved, hybrid and multi-objective variants; parameter tuning; and large-scale applications. The book also contains papers discussing recent advances on the following topics: genetic algorithms; evolutionary strategies; the firefly algorithm and cuckoo search; particle swarm optimization and ant colony optimization; simulated annealing; and local search techniques. This book offers a valuable snapshot of the current status of the Harmony Search Algorithm and related techniques, and will be a useful reference for practising researchers and advanced students in computer science and engineering.




Optimization in Chemical Engineering


Book Description

Optimization is used to determine the most appropriate value of variables under given conditions. The primary focus of using optimisation techniques is to measure the maximum or minimum value of a function depending on the circumstances. This book discusses problem formulation and problem solving with the help of algorithms such as secant method, quasi-Newton method, linear programming and dynamic programming. It also explains important chemical processes such as fluid flow systems, heat exchangers, chemical reactors and distillation systems using solved examples. The book begins by explaining the fundamental concepts followed by an elucidation of various modern techniques including trust-region methods, Levenberg–Marquardt algorithms, stochastic optimization, simulated annealing and statistical optimization. It studies the multi-objective optimization technique and its applications in chemical engineering and also discusses the theory and applications of various optimization software tools including LINGO, MATLAB, MINITAB and GAMS.