Constructive Neural Networks


Book Description

This book presents a collection of invited works that consider constructive methods for neural networks, taken primarily from papers presented at a special th session held during the 18 International Conference on Artificial Neural Networks (ICANN 2008) in September 2008 in Prague, Czech Republic. The book is devoted to constructive neural networks and other incremental learning algorithms that constitute an alternative to the standard method of finding a correct neural architecture by trial-and-error. These algorithms provide an incremental way of building neural networks with reduced topologies for classification problems. Furthermore, these techniques produce not only the multilayer topologies but the value of the connecting synaptic weights that are determined automatically by the constructing algorithm, avoiding the risk of becoming trapped in local minima as might occur when using gradient descent algorithms such as the popular back-propagation. In most cases the convergence of the constructing algorithms is guaranteed by the method used. Constructive methods for building neural networks can potentially create more compact and robust models which are easily implemented in hardware and used for embedded systems. Thus a growing amount of current research in neural networks is oriented towards this important topic. The purpose of this book is to gather together some of the leading investigators and research groups in this growing area, and to provide an overview of the most recent advances in the techniques being developed for constructive neural networks and their applications.




Neural Network Learning and Expert Systems


Book Description

presents a unified and in-depth development of neural network learning algorithms and neural network expert systems




Executive Functions and Constructive Neural Networks


Book Description

The present work explores how executive functions can be implemented in neural networks. Computational models such as neural networks allow researchers to develop more sophisticated conceptualizations of how executive functioning could be implemented in the brain. However, most computational models are designed only to solve a single problem rather than to solve multiple problems and integrate new and old knowledge. The problem domain for the models of the present work consists of Boolean logic expressions. These expressions easily lend themselves to implementation in neural networks while at the same time they can represent a range of problems that relate to executive functions, such as learning complementary vs. unrelated information. Network architectures and training regimes are developed that allow neural networks to solve multiple problems constructively while minimizing the impact of interference. The networks illustrate that the constructive learning of multiple problems does not require an executive controller, separate memory systems, or the constructive addition of learning resources.




Neural Network Learning


Book Description

This work explores probabilistic models of supervised learning problems and addresses the key statistical and computational questions. Chapters survey research on pattern classification with binary-output networks, including a discussion of the relevance of the Vapnik Chervonenkis dimension, and of estimates of the dimension for several neural network models. In addition, the authors develop a model of classification by real-output networks, and demonstrate the usefulness of classification...




Neural Network Design


Book Description




Neural Smithing


Book Description

Artificial neural networks are nonlinear mapping systems whose structure is loosely based on principles observed in the nervous systems of humans and animals. The basic idea is that massive systems of simple units linked together in appropriate ways can generate many complex and interesting behaviors. This book focuses on the subset of feedforward artificial neural networks called multilayer perceptrons (MLP). These are the mostly widely used neural networks, with applications as diverse as finance (forecasting), manufacturing (process control), and science (speech and image recognition). This book presents an extensive and practical overview of almost every aspect of MLP methodology, progressing from an initial discussion of what MLPs are and how they might be used to an in-depth examination of technical factors affecting performance. The book can be used as a tool kit by readers interested in applying networks to specific problems, yet it also presents theory and references outlining the last ten years of MLP research.




Proceedings of the International Conference on Soft Computing for Problem Solving (SocProS 2011) December 20-22, 2011


Book Description

The objective is to provide the latest developments in the area of soft computing. These are the cutting edge technologies that have immense application in various fields. All the papers will undergo the peer review process to maintain the quality of work.




Advances in Neural Networks - ISNN 2006


Book Description

This is Volume II of a three volume set constituting the refereed proceedings of the Third International Symposium on Neural Networks, ISNN 2006. 616 revised papers are organized in topical sections on neurobiological analysis, theoretical analysis, neurodynamic optimization, learning algorithms, model design, kernel methods, data preprocessing, pattern classification, computer vision, image and signal processing, system modeling, robotic systems, transportation systems, communication networks, information security, fault detection, financial analysis, bioinformatics, biomedical and industrial applications, and more.




Intelligent Data Engineering and Automated Learning -- IDEAL 2011


Book Description

This book constitutes the refereed proceedings of the 12th International Conference on Intelligent Data Engineering and Automated Learning, IDEAL 2011, held in Norwich, UK, in September 2011. The 59 revised full papers presented were carefully reviewed and selected from numerous submissions for inclusion in the book and present the latest theoretical advances and real-world applications in computational intelligence.




Advances in Neural Information Processing Systems 9


Book Description

The annual conference on Neural Information Processing Systems (NIPS) is the flagship conference on neural computation. It draws preeminent academic researchers from around the world and is widely considered to be a showcase conference for new developments in network algorithms and architectures. The broad range of interdisciplinary research areas represented includes neural networks and genetic algorithms, cognitive science, neuroscience and biology, computer science, AI, applied mathematics, physics, and many branches of engineering. Only about 30% of the papers submitted are accepted for presentation at NIPS, so the quality is exceptionally high. All of the papers presented appear in these proceedings.