Pattern Recognition by Self-organizing Neural Networks


Book Description

Pattern Recognition by Self-Organizing Neural Networks presentsthe most recent advances in an area of research that is becoming vitally important in the fields ofcognitive science, neuroscience, artificial intelligence, and neural networks in general. The 19articles take up developments in competitive learning and computational maps, adaptive resonancetheory, and specialized architectures and biological connections. Introductorysurvey articles provide a framework for understanding the many models involved in various approachesto studying neural networks. These are followed in Part 2 by articles that form the foundation formodels of competitive learning and computational mapping, and recent articles by Kohonen, applyingthem to problems in speech recognition, and by Hecht-Nielsen, applying them to problems in designingadaptive lookup tables. Articles in Part 3 focus on adaptive resonance theory (ART) networks,selforganizing pattern recognition systems whose top-down template feedback signals guarantee theirstable learning in response to arbitrary sequences of input patterns. In Part 4, articles describeembedding ART modules into larger architectures and provide experimental evidence fromneurophysiology, event-related potentials, and psychology that support the prediction that ARTmechanisms exist in the brain. Contributors: J.-P. Banquet, G.A. Carpenter, S.Grossberg, R. Hecht-Nielsen, T. Kohonen, B. Kosko, T.W. Ryan, N.A. Schmajuk, W. Singer, D. Stork, C.von der Malsburg, C.L. Winter.




Information and Classification


Book Description

In many fields of science and practice large amounts of data and informationare collected for analyzing and visualizing latent structures as orderings or classifications for example. This volume presents refereed and revised versions of 52 papers selected from the contributions of the 16th AnnualConference of the "German Classification Society". The papers are organized in three major sections on Data Analysis and Classification (1), InformationRetrieval, Knowledge Processing and Software (2), Applications and Special Topics (3). Moreover, the papers were grouped and ordered within the major sections. So, in the first section we find papers on Classification Methods, Fuzzy Classification, Multidimensional Scaling, Discriminant Analysis and Conceptual Analysis. The second section contains papers on Neural Networks and Computational Linguisticsin addition to the mentioned fields. An essential part of the third section attends to Sequence Data and Tree Reconstruction as well as Data Analysis and Informatics in Medicine. As special topics the volume presents applications in Thesauri, Archaeology, Musical Science and Psychometrics.




Self-Organizing Maps


Book Description

The book we have at hand is the fourth monograph I wrote for Springer Verlag. The previous one named "Self-Organization and Associative Mem ory" (Springer Series in Information Sciences, Volume 8) came out in 1984. Since then the self-organizing neural-network algorithms called SOM and LVQ have become very popular, as can be seen from the many works re viewed in Chap. 9. The new results obtained in the past ten years or so have warranted a new monograph. Over these years I have also answered lots of questions; they have influenced the contents of the present book. I hope it would be of some interest and help to the readers if I now first very briefly describe the various phases that led to my present SOM research, and the reasons underlying each new step. I became interested in neural networks around 1960, but could not in terrupt my graduate studies in physics. After I was appointed Professor of Electronics in 1965, it still took some years to organize teaching at the uni versity. In 1968 - 69 I was on leave at the University of Washington, and D. Gabor had just published his convolution-correlation model of autoasso ciative memory. I noticed immediately that there was something not quite right about it: the capacity was very poor and the inherent noise and crosstalk were intolerable. In 1970 I therefore sugge~ted the auto associative correlation matrix memory model, at the same time as J.A. Anderson and K. Nakano.







Self-Organizing Neural Networks


Book Description

The Self-Organizing Map (SOM) is one of the most frequently used architectures for unsupervised artificial neural networks. Introduced by Teuvo Kohonen in the 1980s, SOMs have been developed as a very powerful method for visualization and unsupervised classification tasks by an active and innovative community of interna tional researchers. A number of extensions and modifications have been developed during the last two decades. The reason is surely not that the original algorithm was imperfect or inad equate. It is rather the universal applicability and easy handling of the SOM. Com pared to many other network paradigms, only a few parameters need to be arranged and thus also for a beginner the network leads to useful and reliable results. Never theless there is scope for improvements and sophisticated new developments as this book impressively demonstrates. The number of published applications utilizing the SOM appears to be unending. As the title of this book indicates, the reader will benefit from some of the latest the oretical developments and will become acquainted with a number of challenging real-world applications. Our aim in producing this book has been to provide an up to-date treatment of the field of self-organizing neural networks, which will be ac cessible to researchers, practitioners and graduated students from diverse disciplines in academics and industry. We are very grateful to the father of the SOMs, Professor Teuvo Kohonen for sup porting this book and contributing the first chapter.




Self-organizing Map Formation


Book Description

This book provides an overview of self-organizing map formation, including recent developments. Self-organizing maps form a branch of unsupervised learning, which is the study of what can be determined about the statistical properties of input data without explicit feedback from a teacher. The articles are drawn from the journal Neural Computation.The book consists of five sections. The first section looks at attempts to model the organization of cortical maps and at the theory and applications of the related artificial neural network algorithms. The second section analyzes topographic maps and their formation via objective functions. The third section discusses cortical maps of stimulus features. The fourth section discusses self-organizing maps for unsupervised data analysis. The fifth section discusses extensions of self-organizing maps, including two surprising applications of mapping algorithms to standard computer science problems: combinatorial optimization and sorting. Contributors J. J. Atick, H. G. Barrow, H. U. Bauer, C. M. Bishop, H. J. Bray, J. Bruske, J. M. L. Budd, M. Budinich, V. Cherkassky, J. Cowan, R. Durbin, E. Erwin, G. J. Goodhill, T. Graepel, D. Grier, S. Kaski, T. Kohonen, H. Lappalainen, Z. Li, J. Lin, R. Linsker, S. P. Luttrell, D. J. C. MacKay, K. D. Miller, G. Mitchison, F. Mulier, K. Obermayer, C. Piepenbrock, H. Ritter, K. Schulten, T. J. Sejnowski, S. Smirnakis, G. Sommer, M. Svensen, R. Szeliski, A. Utsugi, C. K. I. Williams, L. Wiskott, L. Xu, A. Yuille, J. Zhang




Competition and Cooperation in Neural Nets


Book Description

The human brain, wi th its hundred billion or more neurons, is both one of the most complex systems known to man and one of the most important. The last decade has seen an explosion of experimental research on the brain, but little theory of neural networks beyond the study of electrical properties of membranes and small neural circuits. Nonetheless, a number of workers in Japan, the United States and elsewhere have begun to contribute to a theory which provides techniques of mathematical analysis and computer simulation to explore properties of neural systems containing immense numbers of neurons. Recently, it has been gradually recognized that rather independent studies of the dynamics of pattern recognition, pattern format::ion, motor control, self-organization, etc. , in neural systems do in fact make use of common methods. We find that a "competition and cooperation" type of interaction plays a fundamental role in parallel information processing in the brain. The present volume brings together 23 papers presented at a U. S. -Japan Joint Seminar on "Competition and Cooperation in Neural Nets" which was designed to catalyze better integration of theory and experiment in these areas. It was held in Kyoto, Japan, February 15-19, 1982, under the joint sponsorship of the U. S. National Science Foundation and the Japan Society for the Promotion of Science. Participants included brain theorists, neurophysiologists, mathematicians, computer scientists, and physicists. There are seven papers from the U. S.




Computational Intelligence Systems in Industrial Engineering


Book Description

Industrial engineering is a branch of engineering dealing with the optimization of complex processes or systems. It is concerned with the development, improvement, implementation and evaluation of production and service systems. Computational Intelligence Systems find a wide application area in industrial engineering: neural networks in forecasting, fuzzy sets in capital budgeting, ant colony optimization in scheduling, Simulated Annealing in optimization, etc. This book will include most of the application areas of industrial engineering through these computational intelligence systems. In the literature, there is no book including many real and practical applications of Computational Intelligence Systems from the point of view of Industrial Engineering. Every chapter will include explanatory and didactic applications. It is aimed that the book will be a main source for MSc and PhD students.




Artificial Neural Networks - ICANN 96


Book Description

This book constitutes the refereed proceedings of the sixth International Conference on Artificial Neural Networks - ICANN 96, held in Bochum, Germany in July 1996. The 145 papers included were carefully selected from numerous submissions on the basis of at least three reviews; also included are abstracts of the six invited plenary talks. All in all, the set of papers presented reflects the state of the art in the field of ANNs. Among the topics and areas covered are a broad spectrum of theoretical aspects, applications in various fields, sensory processing, cognitive science and AI, implementations, and neurobiology.




Self-Organizing Systems


Book Description

Technological systems become organized by commands from outside, as when human intentions lead to the building of structures or machines. But many nat ural systems become structured by their own internal processes: these are the self organizing systems, and the emergence of order within them is a complex phe nomenon that intrigues scientists from all disciplines. Unfortunately, complexity is ill-defined. Global explanatory constructs, such as cybernetics or general sys tems theory, which were intended to cope with complexity, produced instead a grandiosity that has now, mercifully, run its course and died. Most of us have become wary of proposals for an "integrated, systems approach" to complex matters; yet we must come to grips with complexity some how. Now is a good time to reexamine complex systems to determine whether or not various scientific specialties can discover common principles or properties in them. If they do, then a fresh, multidisciplinary attack on the difficulties would be a valid scientific task. Believing that complexity is a proper scientific issue, and that self-organizing systems are the foremost example, R. Tomovic, Z. Damjanovic, and I arranged a conference (August 26-September 1, 1979) in Dubrovnik, Yugoslavia, to address self-organizing systems. We invited 30 participants from seven countries. Included were biologists, geologists, physicists, chemists, mathematicians, bio physicists, and control engineers. Participants were asked not to bring manu scripts, but, rather, to present positions on an assigned topic. Any writing would be done after the conference, when the writers could benefit from their experi ences there.