Towards Neuromorphic Machine Intelligence


Book Description

Towards Neuromorphic Machine Intelligence: Spike-Based Representation, Learning, and Applications provides readers with in-depth understanding of Spiking Neural Networks (SNNs), which is a burgeoning research branch of Artificial Neural Networks (ANNs), AI, and Machine Learning that sits at the heart of the integration between Computer Science and Neural Engineering. In recent years, neural networks have re-emerged in relation to AI, representing a well-grounded paradigm rooted in disciplines from physics and psychology to information science and engineering.This book represents one of the established cross-over areas where neurophysiology, cognition, and neural engineering coincide with the development of new Machine Learning and AI paradigms. There are many excellent theoretical achievements in neuron models, learning algorithms, network architecture, and so on. But these achievements are numerous and scattered, with a lack of straightforward systematic integration, making it difficult for researchers to assimilate and apply. As the third generation of Artificial Neural Networks (ANNs), Spiking Neural Networks (SNNs) simulate the neuron dynamics and information transmission in a biological neural system in more detail, which is a cross-product of computer science and neuroscience. The primary target audience of this book is divided into two categories: artificial intelligence researchers who know nothing about SNNs, and researchers who know a lot about SNNs. The former needs to acquire fundamental knowledge of SNNs, but the challenge is that much of the existing literature on SNNs only slightly mentions the basic knowledge of SNNs, or is too superficial, and this book gives a systematic explanation from scratch. The latter needs learning about some novel research achievements in the field of SNNs, and this book introduces the latest research results on different aspects of SNNs and provides detailed simulation processes to facilitate readers' replication. In addition, the book introduces neuromorphic hardware architecture as a further extension of the SNN system.The book starts with the birth and development of SNNs, and then introduces the main research hotspots, including spiking neuron models, learning algorithms, network architectures, and neuromorphic hardware. Therefore, the book provides readers with easy access to both the foundational concepts and recent research findings in SNNs. - Introduces Spiking Neural Networks (SNNs), a new generation of biologically inspired artificial intelligence. - Systematically presents basic concepts of SNNs, neuron and network models, learning algorithms, and neuromorphic hardware. - Introduces the latest research results on various aspects of SNNs and provides detailed simulation processes to facilitate readers' replication.




Neuromorphic Devices for Brain-inspired Computing


Book Description

Explore the cutting-edge of neuromorphic technologies with applications in Artificial Intelligence In Neuromorphic Devices for Brain-Inspired Computing: Artificial Intelligence, Perception, and Robotics, a team of expert engineers delivers a comprehensive discussion of all aspects of neuromorphic electronics designed to assist researchers and professionals to understand and apply all manner of brain-inspired computing and perception technologies. The book covers both memristic and neuromorphic devices, including spintronic, multi-terminal, and neuromorphic perceptual applications. Summarizing recent progress made in five distinct configurations of brain-inspired computing, the authors explore this promising technology’s potential applications in two specific areas: neuromorphic computing systems and neuromorphic perceptual systems. The book also includes: A thorough introduction to two-terminal neuromorphic memristors, including memristive devices and resistive switching mechanisms Comprehensive explorations of spintronic neuromorphic devices and multi-terminal neuromorphic devices with cognitive behaviors Practical discussions of neuromorphic devices based on chalcogenide and organic materials In-depth examinations of neuromorphic computing and perceptual systems with emerging devices Perfect for materials scientists, biochemists, and electronics engineers, Neuromorphic Devices for Brain-Inspired Computing: Artificial Intelligence, Perception, and Robotics will also earn a place in the libraries of neurochemists, neurobiologists, and neurophysiologists.




Memristors for Neuromorphic Circuits and Artificial Intelligence Applications


Book Description

Artificial Intelligence (AI) has found many applications in the past decade due to the ever increasing computing power. Artificial Neural Networks are inspired in the brain structure and consist in the interconnection of artificial neurons through artificial synapses. Training these systems requires huge amounts of data and, after the network is trained, it can recognize unforeseen data and provide useful information. The so-called Spiking Neural Networks behave similarly to how the brain functions and are very energy efficient. Up to this moment, both spiking and conventional neural networks have been implemented in software programs running on conventional computing units. However, this approach requires high computing power, a large physical space and is energy inefficient. Thus, there is an increasing interest in developing AI tools directly implemented in hardware. The first hardware demonstrations have been based on CMOS circuits for neurons and specific communication protocols for synapses. However, to further increase training speed and energy efficiency while decreasing system size, the combination of CMOS neurons with memristor synapses is being explored. The memristor is a resistor with memory which behaves similarly to biological synapses. This book explores the state-of-the-art of neuromorphic circuits implementing neural networks with memristors for AI applications.




Neuromorphic and Brain-Based Robots


Book Description

Neuromorphic and brain-based robotics have enormous potential for furthering our understanding of the brain. By embodying models of the brain on robotic platforms, researchers can investigate the roots of biological intelligence and work towards the development of truly intelligent machines. This book provides a broad introduction to this groundbreaking area for researchers from a wide range of fields, from engineering to neuroscience. Case studies explore how robots are being used in current research, including a whisker system that allows a robot to sense its environment and neurally inspired navigation systems that show impressive mapping results. Looking to the future, several chapters consider the development of cognitive, or even conscious robots that display the adaptability and intelligence of biological organisms. Finally, the ethical implications of intelligent robots are explored, from morality and Asimov's three laws to the question of whether robots have rights.




Neuromorphic Photonics


Book Description

This book sets out to build bridges between the domains of photonic device physics and neural networks, providing a comprehensive overview of the emerging field of "neuromorphic photonics." It includes a thorough discussion of evolution of neuromorphic photonics from the advent of fiber-optic neurons to today’s state-of-the-art integrated laser neurons, which are a current focus of international research. Neuromorphic Photonics explores candidate interconnection architectures and devices for integrated neuromorphic networks, along with key functionality such as learning. It is written at a level accessible to graduate students, while also intending to serve as a comprehensive reference for experts in the field.




Understanding and Bridging the Gap between Neuromorphic Computing and Machine Learning, volume II


Book Description

Towards the long-standing dream of artificial intelligence, two solution paths have been paved: (i) neuroscience-driven neuromorphic computing; (ii) computer science-driven machine learning. The former targets at harnessing neuroscience to obtain insights for brain-like processing, by studying the detailed implementation of neural dynamics, circuits, coding and learning. Although our understanding of how the brain works is still very limited, this bio-plausible way offers an appealing promise for future general intelligence. In contrast, the latter aims at solving practical tasks typically formulated as a cost function with high accuracy, by eschewing most neuroscience details in favor of brute force optimization and feeding a large volume of data. With the help of big data (e.g. ImageNet), high-performance processors (e.g. GPU, TPU), effective training algorithms (e.g. artificial neural networks with gradient descent training), and easy-to-use design tools (e.g. Pytorch, Tensorflow), machine learning has achieved superior performance in a broad spectrum of scenarios. Although acclaimed for the biological plausibility and the low power advantage (benefit from the spike signals and event-driven processing), there are ongoing debates and skepticisms about neuromorphic computing since it usually performs worse than machine learning in practical tasks especially in terms of the accuracy.




50 Years of Artificial Intelligence


Book Description

This Festschrift volume, published in celebration of the 50th Anniversary of Artificial Intelligence, includes 34 refereed papers written by leading researchers in the field of Artificial Intelligence. The papers were carefully selected from the invited lectures given at the 50th Anniversary Summit of AI, held at the Centro Stefano Franscini, Monte Verità, Ascona, Switzerland, July 9-14, 2006. The summit provided a venue for discussions on a broad range of topics.




Advances in Neuromorphic Hardware Exploiting Emerging Nanoscale Devices


Book Description

This book covers all major aspects of cutting-edge research in the field of neuromorphic hardware engineering involving emerging nanoscale devices. Special emphasis is given to leading works in hybrid low-power CMOS-Nanodevice design. The book offers readers a bidirectional (top-down and bottom-up) perspective on designing efficient bio-inspired hardware. At the nanodevice level, it focuses on various flavors of emerging resistive memory (RRAM) technology. At the algorithm level, it addresses optimized implementations of supervised and stochastic learning paradigms such as: spike-time-dependent plasticity (STDP), long-term potentiation (LTP), long-term depression (LTD), extreme learning machines (ELM) and early adoptions of restricted Boltzmann machines (RBM) to name a few. The contributions discuss system-level power/energy/parasitic trade-offs, and complex real-world applications. The book is suited for both advanced researchers and students interested in the field.




Neuromorphic Engineering


Book Description

The brain is not a glorified digital computer. It does not store information in registers, and it does not mathematically transform mental representations to establish perception or behavior. The brain cannot be downloaded to a computer to provide immortality, nor can it destroy the world by having its emerged consciousness traveling in cyberspace. However, studying the brain's core computation architecture can inspire scientists, computer architects, and algorithm designers to think fundamentally differently about their craft. Neuromorphic engineers have the ultimate goal of realizing machines with some aspects of cognitive intelligence. They aspire to design computing architectures that could surpass existing digital von Neumann-based computing architectures' performance. In that sense, brain research bears the promise of a new computing paradigm. As part of a complete cognitive hardware and software ecosystem, neuromorphic engineering opens new frontiers for neuro-robotics, artificial intelligence, and supercomputing applications. The book presents neuromorphic engineering from three perspectives: the scientist, the computer architect, and the algorithm designer. It zooms in and out of the different disciplines, allowing readers with diverse backgrounds to understand and appreciate the field. Overall, the book covers the basics of neuronal modeling, neuromorphic circuits, neural architectures, event-based communication, and the neural engineering framework.




Social Machines


Book Description

Will your next doctor be a human being—or a machine? Will you have a choice? If you do, what should you know before making it?This book introduces the reader to the pitfalls and promises of artificial intelligence (AI) in its modern incarnation and the growing trend of systems to "reach off the Web" into the real world. The convergence of AI, social networking, and modern computing is creating an historic inflection point in the partnership between human beings and machines with potentially profound impacts on the future not only of computing but of our world and species.AI experts and researchers James Hendler—co-originator of the Semantic Web (Web 3.0)—and Alice Mulvehill—developer of AI-based operational systems for DARPA, the Air Force, and NASA—explore the social implications of AI systems in the context of a close examination of the technologies that make them possible. The authors critically evaluate the utopian claims and dystopian counterclaims of AI prognosticators. Social Machines: The Coming Collision of Artificial Intelligence, Social Networking, and Humanity is your richly illustrated field guide to the future of your machine-mediated relationships with other human beings and with increasingly intelligent machines. What Readers Will Learn What the concept of a social machine is and how the activities of non-programmers are contributing to machine intelligence How modern artificial intelligence technologies, such as Watson, are evolving and how they process knowledge from both carefully produced information (such as Wikipedia and journal articles) and from big data collections The fundamentals of neuromorphic computing, knowledge graph search, and linked data, as well as the basic technology concepts that underlie networking applications such as Facebook and Twitter How the change in attitudes towards cooperative work on the Web, especially in the younger demographic, is critical to the future of Web applications Who This Book Is ForGeneral readers and technically engaged developers, entrepreneurs, and technologists interested in the threats and promises of the accelerating convergence of artificial intelligence with social networks and mobile web technologies.