Pattern Recognition by Self-organizing Neural Networks


Book Description

Pattern Recognition by Self-Organizing Neural Networks presentsthe most recent advances in an area of research that is becoming vitally important in the fields ofcognitive science, neuroscience, artificial intelligence, and neural networks in general. The 19articles take up developments in competitive learning and computational maps, adaptive resonancetheory, and specialized architectures and biological connections. Introductorysurvey articles provide a framework for understanding the many models involved in various approachesto studying neural networks. These are followed in Part 2 by articles that form the foundation formodels of competitive learning and computational mapping, and recent articles by Kohonen, applyingthem to problems in speech recognition, and by Hecht-Nielsen, applying them to problems in designingadaptive lookup tables. Articles in Part 3 focus on adaptive resonance theory (ART) networks,selforganizing pattern recognition systems whose top-down template feedback signals guarantee theirstable learning in response to arbitrary sequences of input patterns. In Part 4, articles describeembedding ART modules into larger architectures and provide experimental evidence fromneurophysiology, event-related potentials, and psychology that support the prediction that ARTmechanisms exist in the brain. Contributors: J.-P. Banquet, G.A. Carpenter, S.Grossberg, R. Hecht-Nielsen, T. Kohonen, B. Kosko, T.W. Ryan, N.A. Schmajuk, W. Singer, D. Stork, C.von der Malsburg, C.L. Winter.




Competition and Cooperation in Neural Nets


Book Description

The human brain, wi th its hundred billion or more neurons, is both one of the most complex systems known to man and one of the most important. The last decade has seen an explosion of experimental research on the brain, but little theory of neural networks beyond the study of electrical properties of membranes and small neural circuits. Nonetheless, a number of workers in Japan, the United States and elsewhere have begun to contribute to a theory which provides techniques of mathematical analysis and computer simulation to explore properties of neural systems containing immense numbers of neurons. Recently, it has been gradually recognized that rather independent studies of the dynamics of pattern recognition, pattern format::ion, motor control, self-organization, etc. , in neural systems do in fact make use of common methods. We find that a "competition and cooperation" type of interaction plays a fundamental role in parallel information processing in the brain. The present volume brings together 23 papers presented at a U. S. -Japan Joint Seminar on "Competition and Cooperation in Neural Nets" which was designed to catalyze better integration of theory and experiment in these areas. It was held in Kyoto, Japan, February 15-19, 1982, under the joint sponsorship of the U. S. National Science Foundation and the Japan Society for the Promotion of Science. Participants included brain theorists, neurophysiologists, mathematicians, computer scientists, and physicists. There are seven papers from the U. S.




Self-Organizing Maps


Book Description

The book we have at hand is the fourth monograph I wrote for Springer Verlag. The previous one named "Self-Organization and Associative Mem ory" (Springer Series in Information Sciences, Volume 8) came out in 1984. Since then the self-organizing neural-network algorithms called SOM and LVQ have become very popular, as can be seen from the many works re viewed in Chap. 9. The new results obtained in the past ten years or so have warranted a new monograph. Over these years I have also answered lots of questions; they have influenced the contents of the present book. I hope it would be of some interest and help to the readers if I now first very briefly describe the various phases that led to my present SOM research, and the reasons underlying each new step. I became interested in neural networks around 1960, but could not in terrupt my graduate studies in physics. After I was appointed Professor of Electronics in 1965, it still took some years to organize teaching at the uni versity. In 1968 - 69 I was on leave at the University of Washington, and D. Gabor had just published his convolution-correlation model of autoasso ciative memory. I noticed immediately that there was something not quite right about it: the capacity was very poor and the inherent noise and crosstalk were intolerable. In 1970 I therefore sugge~ted the auto associative correlation matrix memory model, at the same time as J.A. Anderson and K. Nakano.




Information and Classification


Book Description

In many fields of science and practice large amounts of data and informationare collected for analyzing and visualizing latent structures as orderings or classifications for example. This volume presents refereed and revised versions of 52 papers selected from the contributions of the 16th AnnualConference of the "German Classification Society". The papers are organized in three major sections on Data Analysis and Classification (1), InformationRetrieval, Knowledge Processing and Software (2), Applications and Special Topics (3). Moreover, the papers were grouped and ordered within the major sections. So, in the first section we find papers on Classification Methods, Fuzzy Classification, Multidimensional Scaling, Discriminant Analysis and Conceptual Analysis. The second section contains papers on Neural Networks and Computational Linguisticsin addition to the mentioned fields. An essential part of the third section attends to Sequence Data and Tree Reconstruction as well as Data Analysis and Informatics in Medicine. As special topics the volume presents applications in Thesauri, Archaeology, Musical Science and Psychometrics.




Pattern Recognition Using Neural Networks


Book Description

Pattern recognizers evolve across the sections into perceptrons, a layer of perceptrons, multiple-layered perceptrons, functional link nets, and radial basis function networks. Other networks covered in the process are learning vector quantization networks, self-organizing maps, and recursive neural networks. Backpropagation is derived in complete detail for one and two hidden layers for both unipolar and bipolar sigmoid activation functions.




Neural Networks for Applied Sciences and Engineering


Book Description

In response to the exponentially increasing need to analyze vast amounts of data, Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex Pattern Recognition provides scientists with a simple but systematic introduction to neural networks. Beginning with an introductory discussion on the role of neural networks in




Pattern Recognition and Neural Networks


Book Description

This 1996 book explains the statistical framework for pattern recognition and machine learning, now in paperback.




From Statistics to Neural Networks


Book Description

The NATO Advanced Study Institute From Statistics to Neural Networks, Theory and Pattern Recognition Applications took place in Les Arcs, Bourg Saint Maurice, France, from June 21 through July 2, 1993. The meeting brought to gether over 100 participants (including 19 invited lecturers) from 20 countries. The invited lecturers whose contributions appear in this volume are: L. Almeida (INESC, Portugal), G. Carpenter (Boston, USA), V. Cherkassky (Minnesota, USA), F. Fogelman Soulie (LRI, France), W. Freeman (Berkeley, USA), J. Friedman (Stanford, USA), F. Girosi (MIT, USA and IRST, Italy), S. Grossberg (Boston, USA), T. Hastie (AT&T, USA), J. Kittler (Surrey, UK), R. Lippmann (MIT Lincoln Lab, USA), J. Moody (OGI, USA), G. Palm (U1m, Germany), B. Ripley (Oxford, UK), R. Tibshirani (Toronto, Canada), H. Wechsler (GMU, USA), C. Wellekens (Eurecom, France) and H. White (San Diego, USA). The ASI consisted of lectures overviewing major aspects of statistical and neural network learning, their links to biological learning and non-linear dynamics (chaos), and real-life examples of pattern recognition applications. As a result of lively interactions between the participants, the following topics emerged as major themes of the meeting: (1) Unified framework for the study of Predictive Learning in Statistics and Artificial Neural Networks (ANNs); (2) Differences and similarities between statistical and ANN methods for non parametric estimation from examples (learning); (3) Fundamental connections between artificial learning systems and biological learning systems.




Adaptive Pattern Recognition and Neural Networks


Book Description

A coherent introduction to the basic concepts of pattern recognition, incorporating recent advances from AI, neurobiology, engineering, and other disciplines. Treats specifically the implementation of adaptive pattern recognition to neural networks. Annotation copyright Book News, Inc. Portland, Or.




Progress in Pattern Recognition, Image Analysis and Applications


Book Description

First of all, we want to congratulate two new research communities from M- ico and Brazil that have recently joined the Iberoamerican community and the International Association for Pattern Recognition. We believe that the series of congresses that started as the “Taller Iberoamericano de Reconocimiento de Patrones (TIARP)”, and later became the “Iberoamerican Congress on Pattern Recognition (CIARP)”, has contributed to these groupconsolidatione?orts. We hope that in the near future all the Iberoamerican countries will have their own groups and associations to promote our areas of interest; and that these congresses will serve as the forum for scienti?c research exchange, sharing of - pertise and new knowledge, and establishing contacts that improve cooperation between research groups in pattern recognition and related areas. CIARP 2004 (9th Iberoamerican Congress on Pattern Recognition) was the ninthinaseriesofpioneeringcongressesonpatternrecognitionintheIberoam- ican community. As in the previous year, CIARP 2004 also included worldwide participation. It took place in Puebla, Mexico. The aim of the congress was to promote and disseminate ongoing research and mathematical methods for pattern recognition, image analysis, and applications in such diverse areas as computer vision, robotics, industry, health, entertainment, space exploration, telecommunications, data mining, document analysis,and natural languagep- cessing and recognition, to name a few.