Exploration and Exploitation Techniques for High-dimensional Simulation-based Optimization Problems in Urban Transportation


Book Description

Stochastic traffic and mobility simulation models are popular tools for modeling urban transportation networks. However, their use for optimizing urban transportation networks can be challenging due to their computationally intensive nature. This thesis focuses on high-dimensional simulation-based (SO) optimization problems. To find solutions with good performance efficiently, we need to balance exploration and exploitation. We propose techniques for achieving a better balance between exploration and exploitation when tackling high-dimensional SO problems in urban transportation. The first part of the thesis considers a general-purpose exploration mechanism and introduces exploitation components to it. We propose an inverse cumulative distribution function (cdf) sampling mechanism that makes use of problem-specific prior information in the form of an analytical model to efficiently sample for points with good performance. The inverse cdf sampling mechanism can be used in conjunction with any optimization algorithm. We study whether problem-specific prior information should be used in the exploration (i.e., sampling) mechanism and/or the exploitation (i.e., optimization) algorithm when tackling a high-dimensional traffic signal control problem in Midtown Manhattan. The results show that the use of inverse cdf sampling mechanism as part of an optimization framework can help to quickly and efficiently identify solutions with good performance. The second and third parts of the thesis focus on developing a framework to enable high-dimensional Bayesian optimization (BO) for stationary and dynamic transportation SO problems respectively. BO naturally combines exploration and exploitation. In the second part, we consider stationary problems and propose approaches to incorporate problem-specific prior information in the BO prior functions such as to jointly enhance both exploration and exploitation. This is done through the use of a stationary analytical surrogate traffic model. In the third part, we extend the BO framework to tackle dynamic problems by formulating and embedding a computation ally efficient dynamic analytical surrogate traffic model. For both parts, we evaluate their performance with a traffic signal control problems for a congested Midtown Manhattan (New York City) network. The proposed methods enhance the ability of BO to tackle high-dimensional urban transportation SO problems.




Dynamic Exploration-Exploitation Pareto Approach for High-Dimensional Expensive Black-Box Optimization


Book Description

Surrogate-based optimization is commonly used in engineering design problems to determine optimal performance parameters for computationally expensive simulations. The sampling phase of surrogate optimization plays a critical role in identifying the most promising input data points for evaluation. This paper proposes a Pareto sampling approach coupled with a dynamic discretization schema for efficiently optimizing high-dimensional black-box functions. Our proposed Dynamic Exploration-Exploitation Pareto Approach (DEEPA) incorporates dynamic coordinate importance for effective sample generation in solving high-dimensional and complex functions. We employ model-based and model-agnostic feature selection strategies to assign importance probabilities to perturb each coordinate and investigate the impact of importance-based perturbation on the convergence to a near-optimal region. Additionally, we demonstrate the flexibility of DEEPA for fixed-batch evaluation environments. Using complex global optimization test problems with different topological properties, we compare the performance of DEEPA with practical state-of-the-art black-box optimization algorithms. Our experimental results indicate DEEPA's superior performance for complex problems with several local minima.




Fundamentals of Traffic Simulation


Book Description

The increasing power of computer technologies, the evolution of software en- neering and the advent of the intelligent transport systems has prompted traf c simulation to become one of the most used approaches for traf c analysis in s- port of the design and evaluation of traf c systems. The ability of traf c simulation to emulate the time variability of traf c phenomena makes it a unique tool for capturing the complexity of traf c systems. In recent years, traf c simulation – and namely microscopic traf c simulation – has moved from the academic to the professional world. A wide variety of traf- c simulation software is currently available on the market and it is utilized by thousands of users, consultants, researchers and public agencies. Microscopic traf c simulation based on the emulation of traf c ows from the dynamics of individual vehicles is becoming one the most attractive approaches. However, traf c simulation still lacks a uni ed treatment. Dozens of papers on theory and applications are published in scienti c journals every year. A search of simulation-related papers and workshops through the proceedings of the last annual TRB meetings would support this assertion, as would a review of the minutes from speci cally dedicated meetings such as the International Symposiums on Traf c Simulation (Yokohama, 2002; Lausanne, 2006; Brisbane, 2008) or the International Workshops on Traf c Modeling and Simulation (Tucson, 2001; Barcelona, 2003; Sedona, 2005; Graz 2008). Yet, the only comprehensive treatment of the subject to be found so far is in the user’s manuals of various software products.




Nature-Inspired Optimization Algorithms


Book Description

Nature-Inspired Optimization Algorithms provides a systematic introduction to all major nature-inspired algorithms for optimization. The book's unified approach, balancing algorithm introduction, theoretical background and practical implementation, complements extensive literature with well-chosen case studies to illustrate how these algorithms work. Topics include particle swarm optimization, ant and bee algorithms, simulated annealing, cuckoo search, firefly algorithm, bat algorithm, flower algorithm, harmony search, algorithm analysis, constraint handling, hybrid methods, parameter tuning and control, as well as multi-objective optimization. This book can serve as an introductory book for graduates, doctoral students and lecturers in computer science, engineering and natural sciences. It can also serve a source of inspiration for new applications. Researchers and engineers as well as experienced experts will also find it a handy reference. - Discusses and summarizes the latest developments in nature-inspired algorithms with comprehensive, timely literature - Provides a theoretical understanding as well as practical implementation hints - Provides a step-by-step introduction to each algorithm




Evolutionary Machine Learning Techniques


Book Description

This book provides an in-depth analysis of the current evolutionary machine learning techniques. Discussing the most highly regarded methods for classification, clustering, regression, and prediction, it includes techniques such as support vector machines, extreme learning machines, evolutionary feature selection, artificial neural networks including feed-forward neural networks, multi-layer perceptron, probabilistic neural networks, self-optimizing neural networks, radial basis function networks, recurrent neural networks, spiking neural networks, neuro-fuzzy networks, modular neural networks, physical neural networks, and deep neural networks. The book provides essential definitions, literature reviews, and the training algorithms for machine learning using classical and modern nature-inspired techniques. It also investigates the pros and cons of classical training algorithms. It features a range of proven and recent nature-inspired algorithms used to train different types of artificial neural networks, including genetic algorithm, ant colony optimization, particle swarm optimization, grey wolf optimizer, whale optimization algorithm, ant lion optimizer, moth flame algorithm, dragonfly algorithm, salp swarm algorithm, multi-verse optimizer, and sine cosine algorithm. The book also covers applications of the improved artificial neural networks to solve classification, clustering, prediction and regression problems in diverse fields.




Bulletin of the Atomic Scientists


Book Description

The Bulletin of the Atomic Scientists is the premier public resource on scientific and technological developments that impact global security. Founded by Manhattan Project Scientists, the Bulletin's iconic "Doomsday Clock" stimulates solutions for a safer world.




Handbook of Metaheuristics


Book Description

This book provides both the research and practitioner communities with a comprehensive coverage of the metaheuristic methodologies that have proven to be successful in a wide variety of real-world problem settings. Moreover, it is these metaheuristic strategies that hold particular promise for success in the future. The various chapters serve as stand alone presentations giving both the necessary background underpinnings as well as practical guides for implementation.




Approximate Dynamic Programming


Book Description

A complete and accessible introduction to the real-world applications of approximate dynamic programming With the growing levels of sophistication in modern-day operations, it is vital for practitioners to understand how to approach, model, and solve complex industrial problems. Approximate Dynamic Programming is a result of the author's decades of experience working in large industrial settings to develop practical and high-quality solutions to problems that involve making decisions in the presence of uncertainty. This groundbreaking book uniquely integrates four distinct disciplines—Markov design processes, mathematical programming, simulation, and statistics—to demonstrate how to successfully model and solve a wide range of real-life problems using the techniques of approximate dynamic programming (ADP). The reader is introduced to the three curses of dimensionality that impact complex problems and is also shown how the post-decision state variable allows for the use of classical algorithmic strategies from operations research to treat complex stochastic optimization problems. Designed as an introduction and assuming no prior training in dynamic programming of any form, Approximate Dynamic Programming contains dozens of algorithms that are intended to serve as a starting point in the design of practical solutions for real problems. The book provides detailed coverage of implementation challenges including: modeling complex sequential decision processes under uncertainty, identifying robust policies, designing and estimating value function approximations, choosing effective stepsize rules, and resolving convergence issues. With a focus on modeling and algorithms in conjunction with the language of mainstream operations research, artificial intelligence, and control theory, Approximate Dynamic Programming: Models complex, high-dimensional problems in a natural and practical way, which draws on years of industrial projects Introduces and emphasizes the power of estimating a value function around the post-decision state, allowing solution algorithms to be broken down into three fundamental steps: classical simulation, classical optimization, and classical statistics Presents a thorough discussion of recursive estimation, including fundamental theory and a number of issues that arise in the development of practical algorithms Offers a variety of methods for approximating dynamic programs that have appeared in previous literature, but that have never been presented in the coherent format of a book Motivated by examples from modern-day operations research, Approximate Dynamic Programming is an accessible introduction to dynamic modeling and is also a valuable guide for the development of high-quality solutions to problems that exist in operations research and engineering. The clear and precise presentation of the material makes this an appropriate text for advanced undergraduate and beginning graduate courses, while also serving as a reference for researchers and practitioners. A companion Web site is available for readers, which includes additional exercises, solutions to exercises, and data sets to reinforce the book's main concepts.




Genetic Algorithm Essentials


Book Description

This book introduces readers to genetic algorithms (GAs) with an emphasis on making the concepts, algorithms, and applications discussed as easy to understand as possible. Further, it avoids a great deal of formalisms and thus opens the subject to a broader audience in comparison to manuscripts overloaded by notations and equations. The book is divided into three parts, the first of which provides an introduction to GAs, starting with basic concepts like evolutionary operators and continuing with an overview of strategies for tuning and controlling parameters. In turn, the second part focuses on solution space variants like multimodal, constrained, and multi-objective solution spaces. Lastly, the third part briefly introduces theoretical tools for GAs, the intersections and hybridizations with machine learning, and highlights selected promising applications.




Ant Colony Optimization


Book Description

An overview of the rapidly growing field of ant colony optimization that describes theoretical findings, the major algorithms, and current applications. The complex social behaviors of ants have been much studied by science, and computer scientists are now finding that these behavior patterns can provide models for solving difficult combinatorial optimization problems. The attempt to develop algorithms inspired by one aspect of ant behavior, the ability to find what computer scientists would call shortest paths, has become the field of ant colony optimization (ACO), the most successful and widely recognized algorithmic technique based on ant behavior. This book presents an overview of this rapidly growing field, from its theoretical inception to practical applications, including descriptions of many available ACO algorithms and their uses. The book first describes the translation of observed ant behavior into working optimization algorithms. The ant colony metaheuristic is then introduced and viewed in the general context of combinatorial optimization. This is followed by a detailed description and guide to all major ACO algorithms and a report on current theoretical findings. The book surveys ACO applications now in use, including routing, assignment, scheduling, subset, machine learning, and bioinformatics problems. AntNet, an ACO algorithm designed for the network routing problem, is described in detail. The authors conclude by summarizing the progress in the field and outlining future research directions. Each chapter ends with bibliographic material, bullet points setting out important ideas covered in the chapter, and exercises. Ant Colony Optimization will be of interest to academic and industry researchers, graduate students, and practitioners who wish to learn how to implement ACO algorithms.