Estimation of Distribution Algorithms


Book Description

Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation is devoted to a new paradigm for evolutionary computation, named estimation of distribution algorithms (EDAs). This new class of algorithms generalizes genetic algorithms by replacing the crossover and mutation operators with learning and sampling from the probability distribution of the best individuals of the population at each iteration of the algorithm. Working in such a way, the relationships between the variables involved in the problem domain are explicitly and effectively captured and exploited. This text constitutes the first compilation and review of the techniques and applications of this new tool for performing evolutionary computation. Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation is clearly divided into three parts. Part I is dedicated to the foundations of EDAs. In this part, after introducing some probabilistic graphical models - Bayesian and Gaussian networks - a review of existing EDA approaches is presented, as well as some new methods based on more flexible probabilistic graphical models. A mathematical modeling of discrete EDAs is also presented. Part II covers several applications of EDAs in some classical optimization problems: the travelling salesman problem, the job scheduling problem, and the knapsack problem. EDAs are also applied to the optimization of some well-known combinatorial and continuous functions. Part III presents the application of EDAs to solve some problems that arise in the machine learning field: feature subset selection, feature weighting in K-NN classifiers, rule induction, partial abductive inference in Bayesian networks, partitional clustering, and the search for optimal weights in artificial neural networks. Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation is a useful and interesting tool for researchers working in the field of evolutionary computation and for engineers who face real-world optimization problems. This book may also be used by graduate students and researchers in computer science. `... I urge those who are interested in EDAs to study this well-crafted book today.' David E. Goldberg, University of Illinois Champaign-Urbana.




Theoretical Analyses of Univariate Estimation-of-distribution Algorithms


Book Description

Optimization is a core part of technological advancement and is usually heavily aided by computers. However, since many optimization problems are hard, it is unrealistic to expect an optimal solution within reasonable time. Hence, heuristics are employed, that is, computer programs that try to produce solutions of high quality quickly. One special class are estimation-of-distribution algorithms (EDAs), which are characterized by maintaining a probabilistic model over the problem domain, which they evolve over time. In an iterative fashion, an EDA uses its model in order to generate a set of solutions, which it then uses to refine the model such that the probability of producing good solutions is increased. In this thesis, we theoretically analyze the class of univariate EDAs over the Boolean domain, that is, over the space of all length-n bit strings. In this setting, the probabilistic model of a univariate EDA consists of an n-dimensional probability vector where each component denotes the probability to sample a 1 for that ...




Using Prior Knowledge and Learning from Experience in Estimation of Distribution Algorithms


Book Description

Estimation of distribution algorithms (EDAs) are stochastic optimization techniques that explore the space of potential solutions by building and sampling explicit probabilistic models of promising candidate solutions. One of the primary advantages of EDAs over many other stochastic optimization techniques is that after each run they leave behind a sequence of probabilistic models describing useful decompositions of the problem. This sequence of models can be seen as a roadmap of how the EDA solves the problem. While this roadmap holds a great deal of information about the problem, until recently this information has largely been ignored. My thesis is that it is possible to exploit this information to speed up problem solving in EDAs in a principled way. The main contribution of this dissertation will be to show that there are multiple ways to exploit this problem-specific knowledge. Most importantly, it can be done in a principled way such that these methods lead to substantial speedups without requiring parameter tuning or hand-inspection of models.




Parallel Estimation of Distribution Algorithms


Book Description

This book focuses on the advancements of Estimation of Distribution Algorithms (EDAs) that perform optimization via building and sampling probabilistic models of promising solutions. Initial chapters contain brief introduction to investigated areas - genetic algorithms, probabilistic models, and optimization via probabilistic models. Different disadvantages of classical genetic algorithms are highlighted and the utilization of probabilistic models in evolutionary computation is justified. Main part of the book is devoted to the development of advanced EDAs for application areas where present EDAs are unapplicable or ineffective. Multiple efficiency enhancement techniques are discussed. An advanced tree-based probabilistic model is developed to allow for solving optimization problems with mixed continuous-discrete variables. Coarse-grained and fine-grained parallel EDAs are implemented for time-critical applications. Utilization of prior knowledge about the problem is proposed and empirically investigated. And, the concept of Pareto fronts is employed to design multiobjective EDAs.




New Achievements in Evolutionary Computation


Book Description

Evolutionary computation has been widely used in computer science for decades. Even though it started as far back as the 1960s with simulated evolution, the subject is still evolving. During this time, new metaheuristic optimization approaches, like evolutionary algorithms, genetic algorithms, swarm intelligence, etc., were being developed and new fields of usage in artificial intelligence, machine learning, combinatorial and numerical optimization, etc., were being explored. However, even with so much work done, novel research into new techniques and new areas of usage is far from over. This book presents some new theoretical as well as practical aspects of evolutionary computation. This book will be of great value to undergraduates, graduate students, researchers in computer science, and anyone else with an interest in learning about the latest developments in evolutionary computation.




Parallel Problem Solving from Nature - PPSN VIII


Book Description

This book constitutes the refereed proceedings of the 8th International Conference on Parallel Problem Solving from Nature, PPSN 2004, held in Birmingham, UK, in September 2004. The 119 revised full papers presented were carefully reviewed and selected from 358 submissions. The papers address all current issues in biologically inspired computing; they are organized in topical sections on theoretical and foundational issues, new algorithms, applications, multi-objective optimization, co-evolution, robotics and multi-agent systems, and learning classifier systems and data mining.