Self-organizing Map Formation


Book Description

This book provides an overview of self-organizing map formation, including recent developments. Self-organizing maps form a branch of unsupervised learning, which is the study of what can be determined about the statistical properties of input data without explicit feedback from a teacher. The articles are drawn from the journal Neural Computation.The book consists of five sections. The first section looks at attempts to model the organization of cortical maps and at the theory and applications of the related artificial neural network algorithms. The second section analyzes topographic maps and their formation via objective functions. The third section discusses cortical maps of stimulus features. The fourth section discusses self-organizing maps for unsupervised data analysis. The fifth section discusses extensions of self-organizing maps, including two surprising applications of mapping algorithms to standard computer science problems: combinatorial optimization and sorting. Contributors J. J. Atick, H. G. Barrow, H. U. Bauer, C. M. Bishop, H. J. Bray, J. Bruske, J. M. L. Budd, M. Budinich, V. Cherkassky, J. Cowan, R. Durbin, E. Erwin, G. J. Goodhill, T. Graepel, D. Grier, S. Kaski, T. Kohonen, H. Lappalainen, Z. Li, J. Lin, R. Linsker, S. P. Luttrell, D. J. C. MacKay, K. D. Miller, G. Mitchison, F. Mulier, K. Obermayer, C. Piepenbrock, H. Ritter, K. Schulten, T. J. Sejnowski, S. Smirnakis, G. Sommer, M. Svensen, R. Szeliski, A. Utsugi, C. K. I. Williams, L. Wiskott, L. Xu, A. Yuille, J. Zhang




Handbook of Natural Computing


Book Description

Natural Computing is the field of research that investigates both human-designed computing inspired by nature and computing taking place in nature, i.e., it investigates models and computational techniques inspired by nature and also it investigates phenomena taking place in nature in terms of information processing. Examples of the first strand of research covered by the handbook include neural computation inspired by the functioning of the brain; evolutionary computation inspired by Darwinian evolution of species; cellular automata inspired by intercellular communication; swarm intelligence inspired by the behavior of groups of organisms; artificial immune systems inspired by the natural immune system; artificial life systems inspired by the properties of natural life in general; membrane computing inspired by the compartmentalized ways in which cells process information; and amorphous computing inspired by morphogenesis. Other examples of natural-computing paradigms are molecular computing and quantum computing, where the goal is to replace traditional electronic hardware, e.g., by bioware in molecular computing. In molecular computing, data are encoded as biomolecules and then molecular biology tools are used to transform the data, thus performing computations. In quantum computing, one exploits quantum-mechanical phenomena to perform computations and secure communications more efficiently than classical physics and, hence, traditional hardware allows. The second strand of research covered by the handbook, computation taking place in nature, is represented by investigations into, among others, the computational nature of self-assembly, which lies at the core of nanoscience, the computational nature of developmental processes, the computational nature of biochemical reactions, the computational nature of bacterial communication, the computational nature of brain processes, and the systems biology approach to bionetworks where cellular processes are treated in terms of communication and interaction, and, hence, in terms of computation. We are now witnessing exciting interaction between computer science and the natural sciences. While the natural sciences are rapidly absorbing notions, techniques and methodologies intrinsic to information processing, computer science is adapting and extending its traditional notion of computation, and computational techniques, to account for computation taking place in nature around us. Natural Computing is an important catalyst for this two-way interaction, and this handbook is a major record of this important development.




Computational Intelligence Systems in Industrial Engineering


Book Description

Industrial engineering is a branch of engineering dealing with the optimization of complex processes or systems. It is concerned with the development, improvement, implementation and evaluation of production and service systems. Computational Intelligence Systems find a wide application area in industrial engineering: neural networks in forecasting, fuzzy sets in capital budgeting, ant colony optimization in scheduling, Simulated Annealing in optimization, etc. This book will include most of the application areas of industrial engineering through these computational intelligence systems. In the literature, there is no book including many real and practical applications of Computational Intelligence Systems from the point of view of Industrial Engineering. Every chapter will include explanatory and didactic applications. It is aimed that the book will be a main source for MSc and PhD students.




Advances in Self-Organizing Maps


Book Description

This book constitutes the refereed proceedings of the 8th International Workshop on Self-Organizing Maps, WSOM 2011, held in Espoo, Finland, in June 2011. The 36 revised full papers presented were carefully reviewed and selected from numerous submissions. The papers are organized in topical sections on plenaries; financial and societal applications; theory and methodology; applications of data mining and analysis; language processing and document analysis; and visualization and image processing.




Artificial Neural Networks - ICANN 96


Book Description

This book constitutes the refereed proceedings of the sixth International Conference on Artificial Neural Networks - ICANN 96, held in Bochum, Germany in July 1996. The 145 papers included were carefully selected from numerous submissions on the basis of at least three reviews; also included are abstracts of the six invited plenary talks. All in all, the set of papers presented reflects the state of the art in the field of ANNs. Among the topics and areas covered are a broad spectrum of theoretical aspects, applications in various fields, sensory processing, cognitive science and AI, implementations, and neurobiology.




Advances in Self-Organizing Maps


Book Description

Self-organizing maps (SOMs) were developed by Teuvo Kohonen in the early eighties. Since then more than 10,000 works have been based on SOMs. SOMs are unsupervised neural networks useful for clustering and visualization purposes. Many SOM applications have been developed in engineering and science, and other fields. This book contains refereed papers presented at the 9th Workshop on Self-Organizing Maps (WSOM 2012) held at the Universidad de Chile, Santiago, Chile, on December 12-14, 2012. The workshop brought together researchers and practitioners in the field of self-organizing systems. Among the book chapters there are excellent examples of the use of SOMs in agriculture, computer science, data visualization, health systems, economics, engineering, social sciences, text and image analysis, and time series analysis. Other chapters present the latest theoretical work on SOMs as well as Learning Vector Quantization (LVQ) methods.




Self-Organizing Maps


Book Description

The book we have at hand is the fourth monograph I wrote for Springer Verlag. The previous one named "Self-Organization and Associative Mem ory" (Springer Series in Information Sciences, Volume 8) came out in 1984. Since then the self-organizing neural-network algorithms called SOM and LVQ have become very popular, as can be seen from the many works re viewed in Chap. 9. The new results obtained in the past ten years or so have warranted a new monograph. Over these years I have also answered lots of questions; they have influenced the contents of the present book. I hope it would be of some interest and help to the readers if I now first very briefly describe the various phases that led to my present SOM research, and the reasons underlying each new step. I became interested in neural networks around 1960, but could not in terrupt my graduate studies in physics. After I was appointed Professor of Electronics in 1965, it still took some years to organize teaching at the uni versity. In 1968 - 69 I was on leave at the University of Washington, and D. Gabor had just published his convolution-correlation model of autoasso ciative memory. I noticed immediately that there was something not quite right about it: the capacity was very poor and the inherent noise and crosstalk were intolerable. In 1970 I therefore sugge~ted the auto associative correlation matrix memory model, at the same time as J.A. Anderson and K. Nakano.




Applications of Self-Organizing Maps


Book Description

The self-organizing map, first described by the Finnish scientist Teuvo Kohonen, can by applied to a wide range of fields. This book is about such applications, i.e. how the original self-organizing map as well as variants and extensions of it can be applied in different fields. In fourteen chapters, a wide range of such applications is discussed. To name a few, these applications include the analysis of financial stability, the fault diagnosis of plants, the creation of well-composed heterogeneous teams and the application of the self-organizing map to the atmospheric sciences.




Faithful Representations and Topographic Maps


Book Description

A new perspective on topographic map formation and the advantages of information-based learning The study of topographic map formation provides us with important tools for both biological modeling and statistical data modeling. Faithful Representations and Topographic Maps offers a unified, systematic survey of this rapidly evolving field, focusing on current knowledge and available techniques for topographic map formation. The author presents a cutting-edge, information-based learning strategy for developing equiprobabilistic topographic maps--that is, maps in which all neurons have an equal probability to be active--clearly demonstrating how this approach yields faithful representations and how it can be successfully applied in such areas as density estimation, regression, clustering, and feature extraction. The book begins with the standard approach of distortion-based learning, discussing the commonly used Self-Organizing Map (SOM) algorithm and other algorithms, and pointing out their inadequacy for developing equiprobabilistic maps. It then examines the advantages of information-based learning techniques, and finally introduces a new algorithm for equiprobabilistic topographic map formation using neurons with kernel-based response characteristics. The complete learning algorithms and simulation details are given throughout, along with comparative performance analysis tables and extensive references. Faithful Representations and Topographic Maps is an excellent, eye-opening guide for neural network researchers, industrial scientists involved in data mining, and anyone interested in self-organization and topographic maps.




Advances in Self-Organizing Maps and Learning Vector Quantization


Book Description

The book collects the scientific contributions presented at the 10th Workshop on Self-Organizing Maps (WSOM 2014) held at the University of Applied Sciences Mittweida, Mittweida (Germany, Saxony), on July 2–4, 2014. Starting with the first WSOM-workshop 1997 in Helsinki this workshop focuses on newest results in the field of supervised and unsupervised vector quantization like self-organizing maps for data mining and data classification. This 10th WSOM brought together more than 50 researchers, experts and practitioners in the beautiful small town Mittweida in Saxony (Germany) nearby the mountains Erzgebirge to discuss new developments in the field of unsupervised self-organizing vector quantization systems and learning vector quantization approaches for classification. The book contains the accepted papers of the workshop after a careful review process as well as summaries of the invited talks. Among these book chapters there are excellent examples of the use of self-organizing maps in agriculture, computer science, data visualization, health systems, economics, engineering, social sciences, text and image analysis and time series analysis. Other chapters present the latest theoretical work on self-organizing maps as well as learning vector quantization methods, such as relating those methods to classical statistical decision methods. All the contribution demonstrate that vector quantization methods cover a large range of application areas including data visualization of high-dimensional complex data, advanced decision making and classification or data clustering and data compression.