Towards Neuromorphic Machine Intelligence


Book Description

Towards Neuromorphic Machine Intelligence: Spike-Based Representation, Learning, and Applications provides readers with in-depth understanding of Spiking Neural Networks (SNNs), which is a burgeoning research branch of Artificial Neural Networks (ANNs), AI, and Machine Learning that sits at the heart of the integration between Computer Science and Neural Engineering. In recent years, neural networks have re-emerged in relation to AI, representing a well-grounded paradigm rooted in disciplines from physics and psychology to information science and engineering.This book represents one of the established cross-over areas where neurophysiology, cognition, and neural engineering coincide with the development of new Machine Learning and AI paradigms. There are many excellent theoretical achievements in neuron models, learning algorithms, network architecture, and so on. But these achievements are numerous and scattered, with a lack of straightforward systematic integration, making it difficult for researchers to assimilate and apply. As the third generation of Artificial Neural Networks (ANNs), Spiking Neural Networks (SNNs) simulate the neuron dynamics and information transmission in a biological neural system in more detail, which is a cross-product of computer science and neuroscience. The primary target audience of this book is divided into two categories: artificial intelligence researchers who know nothing about SNNs, and researchers who know a lot about SNNs. The former needs to acquire fundamental knowledge of SNNs, but the challenge is that much of the existing literature on SNNs only slightly mentions the basic knowledge of SNNs, or is too superficial, and this book gives a systematic explanation from scratch. The latter needs learning about some novel research achievements in the field of SNNs, and this book introduces the latest research results on different aspects of SNNs and provides detailed simulation processes to facilitate readers' replication. In addition, the book introduces neuromorphic hardware architecture as a further extension of the SNN system.The book starts with the birth and development of SNNs, and then introduces the main research hotspots, including spiking neuron models, learning algorithms, network architectures, and neuromorphic hardware. Therefore, the book provides readers with easy access to both the foundational concepts and recent research findings in SNNs. - Introduces Spiking Neural Networks (SNNs), a new generation of biologically inspired artificial intelligence. - Systematically presents basic concepts of SNNs, neuron and network models, learning algorithms, and neuromorphic hardware. - Introduces the latest research results on various aspects of SNNs and provides detailed simulation processes to facilitate readers' replication.




Neuromorphic Devices for Brain-inspired Computing


Book Description

Explore the cutting-edge of neuromorphic technologies with applications in Artificial Intelligence In Neuromorphic Devices for Brain-Inspired Computing: Artificial Intelligence, Perception, and Robotics, a team of expert engineers delivers a comprehensive discussion of all aspects of neuromorphic electronics designed to assist researchers and professionals to understand and apply all manner of brain-inspired computing and perception technologies. The book covers both memristic and neuromorphic devices, including spintronic, multi-terminal, and neuromorphic perceptual applications. Summarizing recent progress made in five distinct configurations of brain-inspired computing, the authors explore this promising technology’s potential applications in two specific areas: neuromorphic computing systems and neuromorphic perceptual systems. The book also includes: A thorough introduction to two-terminal neuromorphic memristors, including memristive devices and resistive switching mechanisms Comprehensive explorations of spintronic neuromorphic devices and multi-terminal neuromorphic devices with cognitive behaviors Practical discussions of neuromorphic devices based on chalcogenide and organic materials In-depth examinations of neuromorphic computing and perceptual systems with emerging devices Perfect for materials scientists, biochemists, and electronics engineers, Neuromorphic Devices for Brain-Inspired Computing: Artificial Intelligence, Perception, and Robotics will also earn a place in the libraries of neurochemists, neurobiologists, and neurophysiologists.




Mem-elements for Neuromorphic Circuits with Artificial Intelligence Applications


Book Description

Mem-elements for Neuromorphic Circuits with Artificial Intelligence Applications illustrates recent advances in the field of mem-elements (memristor, memcapacitor, meminductor) and their applications in nonlinear dynamical systems, computer science, analog and digital systems, and in neuromorphic circuits and artificial intelligence. The book is mainly devoted to recent results, critical aspects and perspectives of ongoing research on relevant topics, all involving networks of mem-elements devices in diverse applications. Sections contribute to the discussion of memristive materials and transport mechanisms, presenting various types of physical structures that can be fabricated to realize mem-elements in integrated circuits and device modeling. As the last decade has seen an increasing interest in recent advances in mem-elements and their applications in neuromorphic circuits and artificial intelligence, this book will attract researchers in various fields. - Covers a broad range of interdisciplinary topics between mathematics, circuits, realizations, and practical applications related to nonlinear dynamical systems, nanotechnology, analog and digital systems, computer science and artificial intelligence - Presents recent advances in the field of mem-elements (memristor, memcapacitor, meminductor) - Includes interesting applications of mem-elements in nonlinear dynamical systems, analog and digital systems, neuromorphic circuits, computer science and artificial intelligence




Memristors for Neuromorphic Circuits and Artificial Intelligence Applications


Book Description

Artificial Intelligence (AI) has found many applications in the past decade due to the ever increasing computing power. Artificial Neural Networks are inspired in the brain structure and consist in the interconnection of artificial neurons through artificial synapses. Training these systems requires huge amounts of data and, after the network is trained, it can recognize unforeseen data and provide useful information. The so-called Spiking Neural Networks behave similarly to how the brain functions and are very energy efficient. Up to this moment, both spiking and conventional neural networks have been implemented in software programs running on conventional computing units. However, this approach requires high computing power, a large physical space and is energy inefficient. Thus, there is an increasing interest in developing AI tools directly implemented in hardware. The first hardware demonstrations have been based on CMOS circuits for neurons and specific communication protocols for synapses. However, to further increase training speed and energy efficiency while decreasing system size, the combination of CMOS neurons with memristor synapses is being explored. The memristor is a resistor with memory which behaves similarly to biological synapses. This book explores the state-of-the-art of neuromorphic circuits implementing neural networks with memristors for AI applications.




Neuromorphic and Brain-Based Robots


Book Description

Neuromorphic and brain-based robotics have enormous potential for furthering our understanding of the brain. By embodying models of the brain on robotic platforms, researchers can investigate the roots of biological intelligence and work towards the development of truly intelligent machines. This book provides a broad introduction to this groundbreaking area for researchers from a wide range of fields, from engineering to neuroscience. Case studies explore how robots are being used in current research, including a whisker system that allows a robot to sense its environment and neurally inspired navigation systems that show impressive mapping results. Looking to the future, several chapters consider the development of cognitive, or even conscious robots that display the adaptability and intelligence of biological organisms. Finally, the ethical implications of intelligent robots are explored, from morality and Asimov's three laws to the question of whether robots have rights.




Neuromorphic Photonics


Book Description

This book sets out to build bridges between the domains of photonic device physics and neural networks, providing a comprehensive overview of the emerging field of "neuromorphic photonics." It includes a thorough discussion of evolution of neuromorphic photonics from the advent of fiber-optic neurons to today’s state-of-the-art integrated laser neurons, which are a current focus of international research. Neuromorphic Photonics explores candidate interconnection architectures and devices for integrated neuromorphic networks, along with key functionality such as learning. It is written at a level accessible to graduate students, while also intending to serve as a comprehensive reference for experts in the field.




Understanding and Bridging the Gap between Neuromorphic Computing and Machine Learning, volume II


Book Description

Towards the long-standing dream of artificial intelligence, two solution paths have been paved: (i) neuroscience-driven neuromorphic computing; (ii) computer science-driven machine learning. The former targets at harnessing neuroscience to obtain insights for brain-like processing, by studying the detailed implementation of neural dynamics, circuits, coding and learning. Although our understanding of how the brain works is still very limited, this bio-plausible way offers an appealing promise for future general intelligence. In contrast, the latter aims at solving practical tasks typically formulated as a cost function with high accuracy, by eschewing most neuroscience details in favor of brute force optimization and feeding a large volume of data. With the help of big data (e.g. ImageNet), high-performance processors (e.g. GPU, TPU), effective training algorithms (e.g. artificial neural networks with gradient descent training), and easy-to-use design tools (e.g. Pytorch, Tensorflow), machine learning has achieved superior performance in a broad spectrum of scenarios. Although acclaimed for the biological plausibility and the low power advantage (benefit from the spike signals and event-driven processing), there are ongoing debates and skepticisms about neuromorphic computing since it usually performs worse than machine learning in practical tasks especially in terms of the accuracy.




50 Years of Artificial Intelligence


Book Description

This Festschrift volume, published in celebration of the 50th Anniversary of Artificial Intelligence, includes 34 refereed papers written by leading researchers in the field of Artificial Intelligence. The papers were carefully selected from the invited lectures given at the 50th Anniversary Summit of AI, held at the Centro Stefano Franscini, Monte Verità, Ascona, Switzerland, July 9-14, 2006. The summit provided a venue for discussions on a broad range of topics.




Time-Space, Spiking Neural Networks and Brain-Inspired Artificial Intelligence


Book Description

Spiking neural networks (SNN) are biologically inspired computational models that represent and process information internally as trains of spikes. This monograph book presents the classical theory and applications of SNN, including original author’s contribution to the area. The book introduces for the first time not only deep learning and deep knowledge representation in the human brain and in brain-inspired SNN, but takes that further to develop new types of AI systems, called in the book brain-inspired AI (BI-AI). BI-AI systems are illustrated on: cognitive brain data, including EEG, fMRI and DTI; audio-visual data; brain-computer interfaces; personalized modelling in bio-neuroinformatics; multisensory streaming data modelling in finance, environment and ecology; data compression; neuromorphic hardware implementation. Future directions, such as the integration of multiple modalities, such as quantum-, molecular- and brain information processing, is presented in the last chapter. The book is a research book for postgraduate students, researchers and practitioners across wider areas, including computer and information sciences, engineering, applied mathematics, bio- and neurosciences.




Advances in Neuromorphic Hardware Exploiting Emerging Nanoscale Devices


Book Description

This book covers all major aspects of cutting-edge research in the field of neuromorphic hardware engineering involving emerging nanoscale devices. Special emphasis is given to leading works in hybrid low-power CMOS-Nanodevice design. The book offers readers a bidirectional (top-down and bottom-up) perspective on designing efficient bio-inspired hardware. At the nanodevice level, it focuses on various flavors of emerging resistive memory (RRAM) technology. At the algorithm level, it addresses optimized implementations of supervised and stochastic learning paradigms such as: spike-time-dependent plasticity (STDP), long-term potentiation (LTP), long-term depression (LTD), extreme learning machines (ELM) and early adoptions of restricted Boltzmann machines (RBM) to name a few. The contributions discuss system-level power/energy/parasitic trade-offs, and complex real-world applications. The book is suited for both advanced researchers and students interested in the field.