Self-organizing Map Formation


Book Description

This book provides an overview of self-organizing map formation, including recent developments. Self-organizing maps form a branch of unsupervised learning, which is the study of what can be determined about the statistical properties of input data without explicit feedback from a teacher. The articles are drawn from the journal Neural Computation.The book consists of five sections. The first section looks at attempts to model the organization of cortical maps and at the theory and applications of the related artificial neural network algorithms. The second section analyzes topographic maps and their formation via objective functions. The third section discusses cortical maps of stimulus features. The fourth section discusses self-organizing maps for unsupervised data analysis. The fifth section discusses extensions of self-organizing maps, including two surprising applications of mapping algorithms to standard computer science problems: combinatorial optimization and sorting. Contributors J. J. Atick, H. G. Barrow, H. U. Bauer, C. M. Bishop, H. J. Bray, J. Bruske, J. M. L. Budd, M. Budinich, V. Cherkassky, J. Cowan, R. Durbin, E. Erwin, G. J. Goodhill, T. Graepel, D. Grier, S. Kaski, T. Kohonen, H. Lappalainen, Z. Li, J. Lin, R. Linsker, S. P. Luttrell, D. J. C. MacKay, K. D. Miller, G. Mitchison, F. Mulier, K. Obermayer, C. Piepenbrock, H. Ritter, K. Schulten, T. J. Sejnowski, S. Smirnakis, G. Sommer, M. Svensen, R. Szeliski, A. Utsugi, C. K. I. Williams, L. Wiskott, L. Xu, A. Yuille, J. Zhang




Handbook of Natural Computing


Book Description

Natural Computing is the field of research that investigates both human-designed computing inspired by nature and computing taking place in nature, i.e., it investigates models and computational techniques inspired by nature and also it investigates phenomena taking place in nature in terms of information processing. Examples of the first strand of research covered by the handbook include neural computation inspired by the functioning of the brain; evolutionary computation inspired by Darwinian evolution of species; cellular automata inspired by intercellular communication; swarm intelligence inspired by the behavior of groups of organisms; artificial immune systems inspired by the natural immune system; artificial life systems inspired by the properties of natural life in general; membrane computing inspired by the compartmentalized ways in which cells process information; and amorphous computing inspired by morphogenesis. Other examples of natural-computing paradigms are molecular computing and quantum computing, where the goal is to replace traditional electronic hardware, e.g., by bioware in molecular computing. In molecular computing, data are encoded as biomolecules and then molecular biology tools are used to transform the data, thus performing computations. In quantum computing, one exploits quantum-mechanical phenomena to perform computations and secure communications more efficiently than classical physics and, hence, traditional hardware allows. The second strand of research covered by the handbook, computation taking place in nature, is represented by investigations into, among others, the computational nature of self-assembly, which lies at the core of nanoscience, the computational nature of developmental processes, the computational nature of biochemical reactions, the computational nature of bacterial communication, the computational nature of brain processes, and the systems biology approach to bionetworks where cellular processes are treated in terms of communication and interaction, and, hence, in terms of computation. We are now witnessing exciting interaction between computer science and the natural sciences. While the natural sciences are rapidly absorbing notions, techniques and methodologies intrinsic to information processing, computer science is adapting and extending its traditional notion of computation, and computational techniques, to account for computation taking place in nature around us. Natural Computing is an important catalyst for this two-way interaction, and this handbook is a major record of this important development.




Computational Intelligence Systems in Industrial Engineering


Book Description

Industrial engineering is a branch of engineering dealing with the optimization of complex processes or systems. It is concerned with the development, improvement, implementation and evaluation of production and service systems. Computational Intelligence Systems find a wide application area in industrial engineering: neural networks in forecasting, fuzzy sets in capital budgeting, ant colony optimization in scheduling, Simulated Annealing in optimization, etc. This book will include most of the application areas of industrial engineering through these computational intelligence systems. In the literature, there is no book including many real and practical applications of Computational Intelligence Systems from the point of view of Industrial Engineering. Every chapter will include explanatory and didactic applications. It is aimed that the book will be a main source for MSc and PhD students.




Faithful Representations and Topographic Maps


Book Description

A new perspective on topographic map formation and the advantages of information-based learning The study of topographic map formation provides us with important tools for both biological modeling and statistical data modeling. Faithful Representations and Topographic Maps offers a unified, systematic survey of this rapidly evolving field, focusing on current knowledge and available techniques for topographic map formation. The author presents a cutting-edge, information-based learning strategy for developing equiprobabilistic topographic maps--that is, maps in which all neurons have an equal probability to be active--clearly demonstrating how this approach yields faithful representations and how it can be successfully applied in such areas as density estimation, regression, clustering, and feature extraction. The book begins with the standard approach of distortion-based learning, discussing the commonly used Self-Organizing Map (SOM) algorithm and other algorithms, and pointing out their inadequacy for developing equiprobabilistic maps. It then examines the advantages of information-based learning techniques, and finally introduces a new algorithm for equiprobabilistic topographic map formation using neurons with kernel-based response characteristics. The complete learning algorithms and simulation details are given throughout, along with comparative performance analysis tables and extensive references. Faithful Representations and Topographic Maps is an excellent, eye-opening guide for neural network researchers, industrial scientists involved in data mining, and anyone interested in self-organization and topographic maps.




Advances in Self-Organizing Maps


Book Description

Self-organizing maps (SOMs) were developed by Teuvo Kohonen in the early eighties. Since then more than 10,000 works have been based on SOMs. SOMs are unsupervised neural networks useful for clustering and visualization purposes. Many SOM applications have been developed in engineering and science, and other fields. This book contains refereed papers presented at the 9th Workshop on Self-Organizing Maps (WSOM 2012) held at the Universidad de Chile, Santiago, Chile, on December 12-14, 2012. The workshop brought together researchers and practitioners in the field of self-organizing systems. Among the book chapters there are excellent examples of the use of SOMs in agriculture, computer science, data visualization, health systems, economics, engineering, social sciences, text and image analysis, and time series analysis. Other chapters present the latest theoretical work on SOMs as well as Learning Vector Quantization (LVQ) methods.




Advances in Self-Organizing Maps


Book Description

This book constitutes the refereed proceedings of the 8th International Workshop on Self-Organizing Maps, WSOM 2011, held in Espoo, Finland, in June 2011. The 36 revised full papers presented were carefully reviewed and selected from numerous submissions. The papers are organized in topical sections on plenaries; financial and societal applications; theory and methodology; applications of data mining and analysis; language processing and document analysis; and visualization and image processing.




Self-Organizing Maps


Book Description

The book we have at hand is the fourth monograph I wrote for Springer Verlag. The previous one named "Self-Organization and Associative Mem ory" (Springer Series in Information Sciences, Volume 8) came out in 1984. Since then the self-organizing neural-network algorithms called SOM and LVQ have become very popular, as can be seen from the many works re viewed in Chap. 9. The new results obtained in the past ten years or so have warranted a new monograph. Over these years I have also answered lots of questions; they have influenced the contents of the present book. I hope it would be of some interest and help to the readers if I now first very briefly describe the various phases that led to my present SOM research, and the reasons underlying each new step. I became interested in neural networks around 1960, but could not in terrupt my graduate studies in physics. After I was appointed Professor of Electronics in 1965, it still took some years to organize teaching at the uni versity. In 1968 - 69 I was on leave at the University of Washington, and D. Gabor had just published his convolution-correlation model of autoasso ciative memory. I noticed immediately that there was something not quite right about it: the capacity was very poor and the inherent noise and crosstalk were intolerable. In 1970 I therefore sugge~ted the auto associative correlation matrix memory model, at the same time as J.A. Anderson and K. Nakano.




Applications of Self-Organizing Maps


Book Description

The self-organizing map, first described by the Finnish scientist Teuvo Kohonen, can by applied to a wide range of fields. This book is about such applications, i.e. how the original self-organizing map as well as variants and extensions of it can be applied in different fields. In fourteen chapters, a wide range of such applications is discussed. To name a few, these applications include the analysis of financial stability, the fault diagnosis of plants, the creation of well-composed heterogeneous teams and the application of the self-organizing map to the atmospheric sciences.




Artificial Intelligence and Soft Computing


Book Description

The two-volume set LNAI 7894 and LNCS 7895 constitutes the refereed proceedings of the 12th International Conference on Artificial Intelligence and Soft Computing, ICAISC 2013, held in Zakopane, Poland in June 2013. The 112 revised full papers presented together with one invited paper were carefully reviewed and selected from 274 submissions. The 57 papers included in the first volume are organized in the following topical sections: neural networks and their applications; fuzzy systems and their applications; pattern classification; and computer vision, image and speech analysis.




Kohonen Maps


Book Description

The Self-Organizing Map, or Kohonen Map, is one of the most widely used neural network algorithms, with thousands of applications covered in the literature. It was one of the strong underlying factors in the popularity of neural networks starting in the early 80's. Currently this method has been included in a large number of commercial and public domain software packages. In this book, top experts on the SOM method take a look at the state of the art and the future of this computing paradigm. The 30 chapters of this book cover the current status of SOM theory, such as connections of SOM to clustering, classification, probabilistic models, and energy functions. Many applications of the SOM are given, with data mining and exploratory data analysis the central topic, applied to large databases of financial data, medical data, free-form text documents, digital images, speech, and process measurements. Biological models related to the SOM are also discussed.