Subspace Learning of Neural Networks


Book Description

Using real-life examples to illustrate the performance of learning algorithms and instructing readers how to apply them to practical applications, this work offers a comprehensive treatment of subspace learning algorithms for neural networks. The authors summarize a decade of high quality research offering a host of practical applications. They demonstrate ways to extend the use of algorithms to fields such as encryption communication, data mining, computer vision, and signal and image processing to name just a few. The brilliance of the work lies with how it coherently builds a theoretical understanding of the convergence behavior of subspace learning algorithms through a summary of chaotic behaviors.




Neural Networks and Statistical Learning


Book Description

This book provides a broad yet detailed introduction to neural networks and machine learning in a statistical framework. A single, comprehensive resource for study and further research, it explores the major popular neural network models and statistical learning approaches with examples and exercises and allows readers to gain a practical working understanding of the content. This updated new edition presents recently published results and includes six new chapters that correspond to the recent advances in computational learning theory, sparse coding, deep learning, big data and cloud computing. Each chapter features state-of-the-art descriptions and significant research findings. The topics covered include: • multilayer perceptron; • the Hopfield network; • associative memory models;• clustering models and algorithms; • t he radial basis function network; • recurrent neural networks; • nonnegative matrix factorization; • independent component analysis; •probabilistic and Bayesian networks; and • fuzzy sets and logic. Focusing on the prominent accomplishments and their practical aspects, this book provides academic and technical staff, as well as graduate students and researchers with a solid foundation and comprehensive reference on the fields of neural networks, pattern recognition, signal processing, and machine learning.




Multilinear Subspace Learning


Book Description

Due to advances in sensor, storage, and networking technologies, data is being generated on a daily basis at an ever-increasing pace in a wide range of applications, including cloud computing, mobile Internet, and medical imaging. This large multidimensional data requires more efficient dimensionality reduction schemes than the traditional techniqu




Artificial Neural Networks


Book Description

This two-volume proceedings compiles a selection of research papers presented at the ICANN-91. The scope of the volumes is interdisciplinary, ranging from mathematics and engineering to cognitive sciences and biology. European research is well represented. Volume 1 contains all the orally presented papers, including both invited talks and submitted papers. Volume 2 contains the plenary talks and the poster presentations.




Tensor Voting


Book Description

This lecture presents research on a general framework for perceptual organization that was conducted mainly at the Institute for Robotics and Intelligent Systems of the University of Southern California. It is not written as a historical recount of the work, since the sequence of the presentation is not in chronological order. It aims at presenting an approach to a wide range of problems in computer vision and machine learning that is data-driven, local and requires a minimal number of assumptions. The tensor voting framework combines these properties and provides a unified perceptual organization methodology applicable in situations that may seem heterogeneous initially. We show how several problems can be posed as the organization of the inputs into salient perceptual structures, which are inferred via tensor voting. The work presented here extends the original tensor voting framework with the addition of boundary inference capabilities; a novel re-formulation of the framework applicable to high-dimensional spaces and the development of algorithms for computer vision and machine learning problems. We show complete analysis for some problems, while we briefly outline our approach for other applications and provide pointers to relevant sources.




Artificial Neural Networks and Machine Learning - ICANN 2011


Book Description

This two volume set (LNCS 6791 and LNCS 6792) constitutes the refereed proceedings of the 21th International Conference on Artificial Neural Networks, ICANN 2011, held in Espoo, Finland, in June 2011. The 106 revised full or poster papers presented were carefully reviewed and selected from numerous submissions. ICANN 2011 had two basic tracks: brain-inspired computing and machine learning research, with strong cross-disciplinary interactions and applications.




ECAI 2020


Book Description

This book presents the proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020), held in Santiago de Compostela, Spain, from 29 August to 8 September 2020. The conference was postponed from June, and much of it conducted online due to the COVID-19 restrictions. The conference is one of the principal occasions for researchers and practitioners of AI to meet and discuss the latest trends and challenges in all fields of AI and to demonstrate innovative applications and uses of advanced AI technology. The book also includes the proceedings of the 10th Conference on Prestigious Applications of Artificial Intelligence (PAIS 2020) held at the same time. A record number of more than 1,700 submissions was received for ECAI 2020, of which 1,443 were reviewed. Of these, 361 full-papers and 36 highlight papers were accepted (an acceptance rate of 25% for full-papers and 45% for highlight papers). The book is divided into three sections: ECAI full papers; ECAI highlight papers; and PAIS papers. The topics of these papers cover all aspects of AI, including Agent-based and Multi-agent Systems; Computational Intelligence; Constraints and Satisfiability; Games and Virtual Environments; Heuristic Search; Human Aspects in AI; Information Retrieval and Filtering; Knowledge Representation and Reasoning; Machine Learning; Multidisciplinary Topics and Applications; Natural Language Processing; Planning and Scheduling; Robotics; Safe, Explainable, and Trustworthy AI; Semantic Technologies; Uncertainty in AI; and Vision. The book will be of interest to all those whose work involves the use of AI technology.




Deep Learning Techniques Applied to Affective Computing


Book Description

Affective computing refers to computing that relates to, arises from, or influences emotions. The goal of affective computing is to bridge the gap between humans and machines and ultimately endow machines with emotional intelligence for improving natural human-machine interaction. In the context of human-robot interaction (HRI), it is hoped that robots can be endowed with human-like capabilities of observation, interpretation, and emotional expression. The research on affective computing has recently achieved extensive progress with many fields contributing including neuroscience, psychology, education, medicine, behavior, sociology, and computer science. Current research in affective computing concentrates on estimating human emotions through different forms of signals such as speech, face, text, EEG, fMRI, and many others. In neuroscience, the neural mechanisms of emotion are explored by combining neuroscience with the psychological study of personality, emotion, and mood. In psychology and philosophy, emotion typically includes a subjective, conscious experience characterized primarily by psychophysiological expressions, biological reactions, and mental states. The multi-disciplinary features of understanding “emotion” result in the fact that inferring the emotion of humans is definitely difficult. As a result, a multi-disciplinary approach is required to facilitate the development of affective computing. One of the challenging problems in affective computing is the affective gap, i.e., the inconsistency between the extracted feature representations and subjective emotions. To bridge the affective gap, various hand-crafted features have been widely employed to characterize subjective emotions. However, these hand-crafted features are usually low-level, and they may hence not be discriminative enough to depict subjective emotions. To address this issue, the recently-emerged deep learning (also called deep neural networks) techniques provide a possible solution. Due to the used multi-layer network structure, deep learning techniques are capable of learning high-level contributing features from a large dataset and have exhibited excellent performance in multiple application domains such as computer vision, signal processing, natural language processing, human-computer interaction, and so on. The goal of this Research Topic is to gather novel contributions on deep learning techniques applied to affective computing across the diverse fields of psychology, machine learning, neuroscience, education, behavior, sociology, and computer science to converge with those active in other research areas, such as speech emotion recognition, facial expression recognition, Electroencephalogram (EEG) based emotion estimation, human physiological signal (heart rate) estimation, affective human-robot interaction, multimodal affective computing, etc. We welcome researchers to contribute their original papers as well as review articles to provide works regarding the neural approach from computation to affective computing systems. This Research Topic aims to bring together research including, but not limited to: • Deep learning architectures and algorithms for affective computing tasks such as emotion recognition from speech, face, text, EEG, fMRI, and many others. • Explainability of deep Learning algorithms for affective computing. • Multi-task learning techniques for emotion, personality and depression detection, etc. • Novel datasets for affective computing • Applications of affective computing in robots, such as emotion-aware human-robot interaction and social robots, etc.




Advances in Neural Networks - ISNN 2006


Book Description

This is Volume II of a three volume set constituting the refereed proceedings of the Third International Symposium on Neural Networks, ISNN 2006. 616 revised papers are organized in topical sections on neurobiological analysis, theoretical analysis, neurodynamic optimization, learning algorithms, model design, kernel methods, data preprocessing, pattern classification, computer vision, image and signal processing, system modeling, robotic systems, transportation systems, communication networks, information security, fault detection, financial analysis, bioinformatics, biomedical and industrial applications, and more.




Modular Learning in Neural Networks


Book Description

"Modular Learning in Neural Networks covers the full range of conceivable approaches to the modularization of learning, including decomposition of learning into modules using supervised and unsupervised learning types; decomposition of the function to be mapped into linear and nonlinear parts; decomposition of the neural network to minimize harmful interferences between a large number of network parameters during learning; decomposition of the application task into subtasks that are learned separately; decomposition into a knowledge-based part and a learning part. The book attempts to show that modular learning based on these approaches is helpful in improving the learning performance of neural networks. It demonstrates this by applying modular methods to a pair of benchmark cases - a medical classification problem of realistic size, encompassing 7,200 cases of thyroid disorder; and a handwritten digits classification problem, involving several thousand cases. In so doing, the book shows that some of the proposed methods lead to substantial improvements in solution quality and learning speed, as well as enhanced robustness with regard to learning control parameters.".