Deep In-memory Computing
Author : Mingu Kang
Publisher :
Page : pages
File Size : 33,32 MB
Release : 2017
Category :
ISBN :
Resistive Random Access Memory (RRAM)
Author : Shimeng Yu
Publisher : Springer Nature
Page : 71 pages
File Size : 48,77 MB
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 3031020308
Book Description
RRAM technology has made significant progress in the past decade as a competitive candidate for the next generation non-volatile memory (NVM). This lecture is a comprehensive tutorial of metal oxide-based RRAM technology from device fabrication to array architecture design. State-of-the-art RRAM device performances, characterization, and modeling techniques are summarized, and the design considerations of the RRAM integration to large-scale array with peripheral circuits are discussed. Chapter 2 introduces the RRAM device fabrication techniques and methods to eliminate the forming process, and will show its scalability down to sub-10 nm regime. Then the device performances such as programming speed, variability control, and multi-level operation are presented, and finally the reliability issues such as cycling endurance and data retention are discussed. Chapter 3 discusses the RRAM physical mechanism, and the materials characterization techniques to observe the conductive filaments and the electrical characterization techniques to study the electronic conduction processes. It also presents the numerical device modeling techniques for simulating the evolution of the conductive filaments as well as the compact device modeling techniques for circuit-level design. Chapter 4 discusses the two common RRAM array architectures for large-scale integration: one-transistor-one-resistor (1T1R) and cross-point architecture with selector. The write/read schemes are presented and the peripheral circuitry design considerations are discussed. Finally, a 3D integration approach is introduced for building ultra-high density RRAM array. Chapter 5 is a brief summary and will give an outlook for RRAM’s potential novel applications beyond the NVM applications.
Memristive Devices for Brain-Inspired Computing
Author : Sabina Spiga
Publisher : Woodhead Publishing
Page : 569 pages
File Size : 31,22 MB
Release : 2020-06-12
Category : Technology & Engineering
ISBN : 0081027877
Book Description
Memristive Devices for Brain-Inspired Computing: From Materials, Devices, and Circuits to Applications—Computational Memory, Deep Learning, and Spiking Neural Networks reviews the latest in material and devices engineering for optimizing memristive devices beyond storage applications and toward brain-inspired computing. The book provides readers with an understanding of four key concepts, including materials and device aspects with a view of current materials systems and their remaining barriers, algorithmic aspects comprising basic concepts of neuroscience as well as various computing concepts, the circuits and architectures implementing those algorithms based on memristive technologies, and target applications, including brain-inspired computing, computational memory, and deep learning. This comprehensive book is suitable for an interdisciplinary audience, including materials scientists, physicists, electrical engineers, and computer scientists. - Provides readers an overview of four key concepts in this emerging research topic including materials and device aspects, algorithmic aspects, circuits and architectures and target applications - Covers a broad range of applications, including brain-inspired computing, computational memory, deep learning and spiking neural networks - Includes perspectives from a wide range of disciplines, including materials science, electrical engineering and computing, providing a unique interdisciplinary look at the field
In-Memory Computing with Emerging Non-volatile Memory for Efficient Processing of Deep Neural Networks
Author :
Publisher :
Page : 0 pages
File Size : 37,22 MB
Release : 2022
Category :
ISBN :
Book Description
Deep In-memory Architectures for Machine Learning
Author : Mingu Kang
Publisher : Springer Nature
Page : 181 pages
File Size : 29,54 MB
Release : 2020-01-30
Category : Technology & Engineering
ISBN : 3030359719
Book Description
This book describes the recent innovation of deep in-memory architectures for realizing AI systems that operate at the edge of energy-latency-accuracy trade-offs. From first principles to lab prototypes, this book provides a comprehensive view of this emerging topic for both the practicing engineer in industry and the researcher in academia. The book is a journey into the exciting world of AI systems in hardware.
Deep Learning
Author : Ian Goodfellow
Publisher : MIT Press
Page : 801 pages
File Size : 22,37 MB
Release : 2016-11-10
Category : Computers
ISBN : 0262337371
Book Description
An introduction to a broad range of topics in deep learning, covering mathematical and conceptual background, deep learning techniques used in industry, and research perspectives. “Written by three experts in the field, Deep Learning is the only comprehensive book on the subject.” —Elon Musk, cochair of OpenAI; cofounder and CEO of Tesla and SpaceX Deep learning is a form of machine learning that enables computers to learn from experience and understand the world in terms of a hierarchy of concepts. Because the computer gathers knowledge from experience, there is no need for a human computer operator to formally specify all the knowledge that the computer needs. The hierarchy of concepts allows the computer to learn complicated concepts by building them out of simpler ones; a graph of these hierarchies would be many layers deep. This book introduces a broad range of topics in deep learning. The text offers mathematical and conceptual background, covering relevant concepts in linear algebra, probability theory and information theory, numerical computation, and machine learning. It describes deep learning techniques used by practitioners in industry, including deep feedforward networks, regularization, optimization algorithms, convolutional networks, sequence modeling, and practical methodology; and it surveys such applications as natural language processing, speech recognition, computer vision, online recommendation systems, bioinformatics, and videogames. Finally, the book offers research perspectives, covering such theoretical topics as linear factor models, autoencoders, representation learning, structured probabilistic models, Monte Carlo methods, the partition function, approximate inference, and deep generative models. Deep Learning can be used by undergraduate or graduate students planning careers in either industry or research, and by software engineers who want to begin using deep learning in their products or platforms. A website offers supplementary material for both readers and instructors.
Efficient Processing of Deep Neural Networks
Author : Vivienne Sze
Publisher : Springer Nature
Page : 254 pages
File Size : 46,77 MB
Release : 2022-05-31
Category : Technology & Engineering
ISBN : 3031017668
Book Description
This book provides a structured treatment of the key principles and techniques for enabling efficient processing of deep neural networks (DNNs). DNNs are currently widely used for many artificial intelligence (AI) applications, including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at the cost of high computational complexity. Therefore, techniques that enable efficient processing of deep neural networks to improve key metrics—such as energy-efficiency, throughput, and latency—without sacrificing accuracy or increasing hardware costs are critical to enabling the wide deployment of DNNs in AI systems. The book includes background on DNN processing; a description and taxonomy of hardware architectural approaches for designing DNN accelerators; key metrics for evaluating and comparing different designs; features of DNN processing that are amenable to hardware/algorithm co-design to improve energy efficiency and throughput; and opportunities for applying new technologies. Readers will find a structured introduction to the field as well as formalization and organization of key concepts from contemporary work that provide insights that may spark new ideas.
Artificial Intelligence Hardware Design
Author : Albert Chun-Chen Liu
Publisher : John Wiley & Sons
Page : 244 pages
File Size : 16,12 MB
Release : 2021-08-23
Category : Computers
ISBN : 1119810477
Book Description
ARTIFICIAL INTELLIGENCE HARDWARE DESIGN Learn foundational and advanced topics in Neural Processing Unit design with real-world examples from leading voices in the field In Artificial Intelligence Hardware Design: Challenges and Solutions, distinguished researchers and authors Drs. Albert Chun Chen Liu and Oscar Ming Kin Law deliver a rigorous and practical treatment of the design applications of specific circuits and systems for accelerating neural network processing. Beginning with a discussion and explanation of neural networks and their developmental history, the book goes on to describe parallel architectures, streaming graphs for massive parallel computation, and convolution optimization. The authors offer readers an illustration of in-memory computation through Georgia Tech’s Neurocube and Stanford’s Tetris accelerator using the Hybrid Memory Cube, as well as near-memory architecture through the embedded eDRAM of the Institute of Computing Technology, the Chinese Academy of Science, and other institutions. Readers will also find a discussion of 3D neural processing techniques to support multiple layer neural networks, as well as information like: A thorough introduction to neural networks and neural network development history, as well as Convolutional Neural Network (CNN) models Explorations of various parallel architectures, including the Intel CPU, Nvidia GPU, Google TPU, and Microsoft NPU, emphasizing hardware and software integration for performance improvement Discussions of streaming graph for massive parallel computation with the Blaize GSP and Graphcore IPU An examination of how to optimize convolution with UCLA Deep Convolutional Neural Network accelerator filter decomposition Perfect for hardware and software engineers and firmware developers, Artificial Intelligence Hardware Design is an indispensable resource for anyone working with Neural Processing Units in either a hardware or software capacity.
In-/Near-Memory Computing
Author : Daichi Fujiki
Publisher : Morgan & Claypool Publishers
Page : 142 pages
File Size : 30,99 MB
Release : 2021-08-12
Category : Computers
ISBN : 1636391877
Book Description
This book provides a structured introduction of the key concepts and techniques that enable in-/near-memory computing. For decades, processing-in-memory or near-memory computing has been attracting growing interest due to its potential to break the memory wall. Near-memory computing moves compute logic near the memory, and thereby reduces data movement. Recent work has also shown that certain memories can morph themselves into compute units by exploiting the physical properties of the memory cells, enabling in-situ computing in the memory array. While in- and near-memory computing can circumvent overheads related to data movement, it comes at the cost of restricted flexibility of data representation and computation, design challenges of compute capable memories, and difficulty in system and software integration. Therefore, wide deployment of in-/near-memory computing cannot be accomplished without techniques that enable efficient mapping of data-intensive applications to such devices, without sacrificing accuracy or increasing hardware costs excessively. This book describes various memory substrates amenable to in- and near-memory computing, architectural approaches for designing efficient and reliable computing devices, and opportunities for in-/near-memory acceleration of different classes of applications.
In-Memory Computing Hardware Accelerators for Data-Intensive Applications
Author : Baker Mohammad
Publisher : Springer Nature
Page : 145 pages
File Size : 49,94 MB
Release : 2023-10-27
Category : Technology & Engineering
ISBN : 303134233X
Book Description
This book describes the state-of-the-art of technology and research on In-Memory Computing Hardware Accelerators for Data-Intensive Applications. The authors discuss how processing-centric computing has become insufficient to meet target requirements and how Memory-centric computing may be better suited for the needs of current applications. This reveals for readers how current and emerging memory technologies are causing a shift in the computing paradigm. The authors do deep-dive discussions on volatile and non-volatile memory technologies, covering their basic memory cell structures, operations, different computational memory designs and the challenges associated with them. Specific case studies and potential applications are provided along with their current status and commercial availability in the market.
