Swarm-based Algorithms for Neural Network Training


Book Description

The main focus of this thesis is to compare the ability of various swarm intelligence algorithms when applied to the training of artificial neural networks. In order to compare the performance of the selected swarm intelligence algorithms both classification and regression datasets were chosen from the UCI Machine Learning repository. Swarm intelligence algorithms are compared in terms of training loss, training accuracy, testing loss, testing accuracy, hidden unit saturation, and overfitting. Our observations showed that Particle Swarm Optimization (PSO) was the best performing algorithm in terms of Training loss and Training accuracy. However, it was also found that the performance of PSO dropped considerably when examining the testing loss and testing accuracy results. For the classification problems, it was found that firefly algorithm, ant colony optimization, and fish school search outperformed PSO for testing loss and testing accuracy. It was also observed that ant colony optimization was the algorithm that performed the best in terms of hidden unit saturation.




Evolutionary Machine Learning Techniques


Book Description

This book provides an in-depth analysis of the current evolutionary machine learning techniques. Discussing the most highly regarded methods for classification, clustering, regression, and prediction, it includes techniques such as support vector machines, extreme learning machines, evolutionary feature selection, artificial neural networks including feed-forward neural networks, multi-layer perceptron, probabilistic neural networks, self-optimizing neural networks, radial basis function networks, recurrent neural networks, spiking neural networks, neuro-fuzzy networks, modular neural networks, physical neural networks, and deep neural networks. The book provides essential definitions, literature reviews, and the training algorithms for machine learning using classical and modern nature-inspired techniques. It also investigates the pros and cons of classical training algorithms. It features a range of proven and recent nature-inspired algorithms used to train different types of artificial neural networks, including genetic algorithm, ant colony optimization, particle swarm optimization, grey wolf optimizer, whale optimization algorithm, ant lion optimizer, moth flame algorithm, dragonfly algorithm, salp swarm algorithm, multi-verse optimizer, and sine cosine algorithm. The book also covers applications of the improved artificial neural networks to solve classification, clustering, prediction and regression problems in diverse fields.




Integration of Swarm Intelligence and Artificial Neural Network


Book Description

This book provides a new forum for the dissemination of knowledge in both theoretical and applied research on swarm intelligence (SI) and artificial neural network (ANN). It accelerates interaction between the two bodies of knowledge and fosters a unified development in the next generation of computational model for machine learning. To the best of our knowledge, the integration of SI and ANN is the first attempt to integrate various aspects of both the independent research area into a single volume.




2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS)


Book Description

Data driven control and learning has been developed quickly both in theory and applications recently The deep involvement of information science in practical processes poses enormous challenges to the existing control science and engineering due to their size, distributed nature and complexity Modeling these processes accurately using first principles or identification is almost impossible although these plants produce huge amount of operation data in every moment The high tech hardware software and the cloud computing enable us to perform complex real time computation, which makes implementation of data driven control and method for these complex practical plants possible It would be very significant if we can learn the systems behaviors, discover the relationship of system variables by making full use of on line or off line process data, to directly design controller, predict and assess system states, make decisions, perform real time optimization and conduct fault diagnosis




Machine Learning Paradigms


Book Description

At the dawn of the 4th Industrial Revolution, the field of Deep Learning (a sub-field of Artificial Intelligence and Machine Learning) is growing continuously and rapidly, developing both theoretically and towards applications in increasingly many and diverse other disciplines. The book at hand aims at exposing its reader to some of the most significant recent advances in deep learning-based technological applications and consists of an editorial note and an additional fifteen (15) chapters. All chapters in the book were invited from authors who work in the corresponding chapter theme and are recognized for their significant research contributions. In more detail, the chapters in the book are organized into six parts, namely (1) Deep Learning in Sensing, (2) Deep Learning in Social Media and IOT, (3) Deep Learning in the Medical Field, (4) Deep Learning in Systems Control, (5) Deep Learning in Feature Vector Processing, and (6) Evaluation of Algorithm Performance. This research book is directed towards professors, researchers, scientists, engineers and students in computer science-related disciplines. It is also directed towards readers who come from other disciplines and are interested in becoming versed in some of the most recent deep learning-based technological applications. An extensive list of bibliographic references at the end of each chapter guides the readers to probe deeper into their application areas of interest.




Evolutionary Computation 1


Book Description

The field of evolutionary computation is expanding dramatically, fueled by the vast investment that reflects the value of applying its techniques. Culling material from the Handbook of Evolutionary Computation, Evolutionary Computation 1: Basic Algorithms and Operators contains up-to-date information on algorithms and operators used in evolutionary computing. This volume discusses the basic ideas that underlie the main paradigms of evolutionary algorithms, evolution strategies, evolutionary programming, and genetic programming. It is intended to be used by individual researchers, teachers, and students working and studying in this expanding field.




Integration Of Swarm Intelligence And Artificial Neural Network


Book Description

This book provides a new forum for the dissemination of knowledge in both theoretical and applied research on swarm intelligence (SI) and artificial neural network (ANN). It accelerates interaction between the two bodies of knowledge and fosters a unified development in the next generation of computational model for machine learning.To the best of our knowledge, the integration of SI and ANN is the first attempt to integrate various aspects of both the independent research area into a single volume.




Advances in Swarm Intelligence, Part I


Book Description

The two-volume set (LNCS 6728 and 6729) constitutes the refereed proceedings of the International Conference on Swarm Intelligence, ICSI 2011, held in Chongqing, China, in June 2011. The 143 revised full papers presented were carefully reviewed and selected from 298 submissions. The papers are organized in topical sections on theoretical analysis of swarm intelligence algorithms, particle swarm optimization, applications of pso algorithms, ant colony optimization algorithms, bee colony algorithms, novel swarm-based optimization algorithms, artificial immune system, differential evolution, neural networks, genetic algorithms, evolutionary computation, fuzzy methods, and hybrid algorithms - for part I. Topics addressed in part II are such as multi-objective optimization algorithms, multi-robot, swarm-robot, and multi-agent systems, data mining methods, machine learning methods, feature selection algorithms, pattern recognition methods, intelligent control, other optimization algorithms and applications, data fusion and swarm intelligence, as well as fish school search - foundations and applications.




Hybrid Competitive Learning Method Using the Fireworks Algorithm and Artificial Neural Networks


Book Description

This book focuses on the fields of neural networks, swarm optimization algorithms, clustering and fuzzy logic. This book describes a hybrid method with three different techniques of intelligence computation: neural networks, optimization algorithms and fuzzy logic. Within the neural network techniques, competitive neural networks (CNNs) are used, for the optimization algorithms technique, we used the fireworks algorithm (FWA), and in the area of fuzzy logic, the Type-1 Fuzzy Inference Systems (T1FIS) and the Interval Type-2 Fuzzy Inference Systems (IT2FIS) were used, with their variants of Mamdani and Sugeno type, respectively. FWA was adapted for data clustering with the goal to help of competitive neural network to find the optimal number of neurons. It is important to mention that two variants were applied to the FWA: dynamically adjust of parameters with Type-1 Fuzzy Logic (FFWA) as the first one and Interval Type-2 (F2FWA) as the second one. Subsequently, based on the outputs of the CNN and with the goal of classification data, we designed Type-1 and Interval Type-2 Fuzzy Inference Systems of Mamdani and Sugeno type. This book is intended to be a reference for scientists and engineers interested in applying a different metaheuristic or an artificial neural network in order to solve optimization and applied fuzzy logic techniques for solving problems in clustering and classification data. This book is also used as a reference for graduate courses like the following: soft computing, swarm optimization algorithms, clustering data, fuzzy classify and similar ones. We consider that this book can also be used to get novel ideas for new lines of research, new techniques of optimization or to continue the lines of the research proposed by the authors of the book.




Neural Networks and Learning Algorithms in MATLAB


Book Description

This book explains the basic concepts, theory and applications of neural networks in a simple unified approach with clear examples and simulations in the MATLAB programming language. The scripts herein are coded for general purposes to be easily extended to a variety of problems in different areas of application. They are vectorized and optimized to run faster and be applicable to high-dimensional engineering problems. This book will serve as a main reference for graduate and undergraduate courses in neural networks and applications. This book will also serve as a main basis for researchers dealing with complex problems that require neural networks for finding good solutions in areas, such as time series prediction, intelligent control and identification. In addition, the problem of designing neural network by using metaheuristics, such as the genetic algorithms and particle swarm optimization, with one objective and with multiple objectives, is presented.