Modular Learning in Neural Networks


Book Description

"Modular Learning in Neural Networks covers the full range of conceivable approaches to the modularization of learning, including decomposition of learning into modules using supervised and unsupervised learning types; decomposition of the function to be mapped into linear and nonlinear parts; decomposition of the neural network to minimize harmful interferences between a large number of network parameters during learning; decomposition of the application task into subtasks that are learned separately; decomposition into a knowledge-based part and a learning part. The book attempts to show that modular learning based on these approaches is helpful in improving the learning performance of neural networks. It demonstrates this by applying modular methods to a pair of benchmark cases - a medical classification problem of realistic size, encompassing 7,200 cases of thyroid disorder; and a handwritten digits classification problem, involving several thousand cases. In so doing, the book shows that some of the proposed methods lead to substantial improvements in solution quality and learning speed, as well as enhanced robustness with regard to learning control parameters.".




Learning and Categorization in Modular Neural Networks


Book Description

This book introduces a new neural network model called CALM, for categorization and learning in neural networks. The author demonstrates how this model can learn the word superiority effect for letter recognition, and discusses a series of studies that simulate experiments in implicit and explicit memory, involving normal and amnesic patients. Pathological, but psychologically accurate, behavior is produced by "lesioning" the arousal system of these models. A concise introduction to genetic algorithms, a new computing method based on the biological metaphor of evolution, and a demonstration on how these algorithms can design network architectures with superior performance are included in this volume. The role of modularity in parallel hardware and software implementations is considered, including transputer networks and a dedicated 400-processor neurocomputer built by the developers of CALM in cooperation with Delft Technical University. Concluding with an evaluation of the psychological and biological plausibility of CALM models, the book offers a general discussion of catastrophic interference, generalization, and representational capacity of modular neural networks. Researchers in cognitive science, neuroscience, computer simulation sciences, parallel computer architectures, and pattern recognition will be interested in this volume, as well as anyone engaged in the study of neural networks, neurocomputers, and neurosimulators.




Towards Hybrid and Adaptive Computing


Book Description

Soft Computing today is a very vast field whose extent is beyond measure. The boundaries of this magnificent field are spreading at an enormous rate making it possible to build computationally intelligent systems that can do virtually anything, even after considering the hostile practical limitations. Soft Computing, mainly comprising of Artificial Neural Networks, Evolutionary Computation, and Fuzzy Logic may itself be insufficient to cater to the needs of various kinds of complex problems. In such a scenario, we need to carry out amalgamation of same or different computing approaches, along with heuristics, to make fabulous systems for problem solving. There is further an attempt to make these computing systems as adaptable as possible, where the value of any parameter is set and continuously modified by the system itself. This book first presents the basic computing techniques, draws special attention towards their advantages and disadvantages, and then motivates their fusion, in a manner to maximize the advantages and minimize the disadvantages. Conceptualization is a key element of the book, where emphasis is on visualizing the dynamics going inside the technique of use, and hence noting the shortcomings. A detailed description of different varieties of hybrid and adaptive computing systems is given, paying special attention towards conceptualization and motivation. Different evolutionary techniques are discussed that hold potential for generation of fairly complex systems. The complete book is supported by the application of these techniques to biometrics. This not only enables better understanding of the techniques with the added application base, it also opens new dimensions of possibilities how multiple biometric modalities can be fused together to make effective and scalable systems.




Springer Handbook of Computational Intelligence


Book Description

The Springer Handbook for Computational Intelligence is the first book covering the basics, the state-of-the-art and important applications of the dynamic and rapidly expanding discipline of computational intelligence. This comprehensive handbook makes readers familiar with a broad spectrum of approaches to solve various problems in science and technology. Possible approaches include, for example, those being inspired by biology, living organisms and animate systems. Content is organized in seven parts: foundations; fuzzy logic; rough sets; evolutionary computation; neural networks; swarm intelligence and hybrid computational intelligence systems. Each Part is supervised by its own Part Editor(s) so that high-quality content as well as completeness are assured.




Connectionist Models of Neurons, Learning Processes, and Artificial Intelligence


Book Description

This book constitutes, together with its companion, LNCS 2085, the refereed proceedings of the 6th International Work-Conference on Artificial and Natural Neural Networks, IWANN 2001, held in Granada, Spain, in June 2001. The 200 revised papers presented were carefully reviewed and selected for inclusion in the proceedings. The papers are organized in sections on foundations of connectionism, biophysical models of neurons, structural and functional models of neurons, learning and other plasticity phenomena, complex systems dynamics, artificial intelligence and congnitive processes, methodology for nets design, nets simulation and implementation, bio-inspired systems and engineering, and other applications in a variety of fields.




Interpretable Machine Learning


Book Description

This book is about making machine learning models and their decisions interpretable. After exploring the concepts of interpretability, you will learn about simple, interpretable models such as decision trees, decision rules and linear regression. Later chapters focus on general model-agnostic methods for interpreting black box models like feature importance and accumulated local effects and explaining individual predictions with Shapley values and LIME. All interpretation methods are explained in depth and discussed critically. How do they work under the hood? What are their strengths and weaknesses? How can their outputs be interpreted? This book will enable you to select and correctly apply the interpretation method that is most suitable for your machine learning project.




Machine Learning with Neural Networks


Book Description

This modern and self-contained book offers a clear and accessible introduction to the important topic of machine learning with neural networks. In addition to describing the mathematical principles of the topic, and its historical evolution, strong connections are drawn with underlying methods from statistical physics and current applications within science and engineering. Closely based around a well-established undergraduate course, this pedagogical text provides a solid understanding of the key aspects of modern machine learning with artificial neural networks, for students in physics, mathematics, and engineering. Numerous exercises expand and reinforce key concepts within the book and allow students to hone their programming skills. Frequent references to current research develop a detailed perspective on the state-of-the-art in machine learning research.




Neural Networks


Book Description

Neural networks are a computing paradigm that is finding increasing attention among computer scientists. In this book, theoretical laws and models previously scattered in the literature are brought together into a general theory of artificial neural nets. Always with a view to biology and starting with the simplest nets, it is shown how the properties of models change when more general computing elements and net topologies are introduced. Each chapter contains examples, numerous illustrations, and a bibliography. The book is aimed at readers who seek an overview of the field or who wish to deepen their knowledge. It is suitable as a basis for university courses in neurocomputing.




Pattern Recognition and Neural Networks


Book Description

This 1996 book explains the statistical framework for pattern recognition and machine learning, now in paperback.




Biomimetic Neural Learning for Intelligent Robots


Book Description

This state-of-the-art survey contains selected papers contributed by researchers in intelligent systems, cognitive robotics, and neuroscience including contributions from the MirrorBot project and from the NeuroBotics Workshop 2004. The research work presented demonstrates significant novel developments in biologically inspired neural models for use in intelligent robot environments and biomimetic cognitive behavior.