Compact and Fast Machine Learning Accelerator for IoT Devices


Book Description

This book presents the latest techniques for machine learning based data analytics on IoT edge devices. A comprehensive literature review on neural network compression and machine learning accelerator is presented from both algorithm level optimization and hardware architecture optimization. Coverage focuses on shallow and deep neural network with real applications on smart buildings. The authors also discuss hardware architecture design with coverage focusing on both CMOS based computing systems and the new emerging Resistive Random-Access Memory (RRAM) based systems. Detailed case studies such as indoor positioning, energy management and intrusion detection are also presented for smart buildings.




Machine Learning in IoT Systems


Book Description

With the emergence of the Internet of Things (IoT), devices are generating massive amounts of data. Running machine learning algorithms on IoT devices poses substantial technical challenges due to their limited resources. The focus of this dissertation is to dramatically increase computing efficiency as well as the learning capability of today's IoT systems by accelerating existing algorithms in hardware and designing new classes of light-weight machine learning algorithms. Our design makes a modification to storage-class memory to support search-based and vector-based computation in memory. We show how this architecture can be used to accelerate deep neural networks in both training and inference phases, resulting in 303x faster and 48x more energy efficient training as compared to the state-of-the-art GPU. Hardware acceleration alone does not provide all the efficiency and robustness that we need. Therefore, we present Hyperdimensional (HD) computing, an alternative method of learning that implements principles of the functionality in the brain: (i) fast learning, (ii) robustness to noise/error, and (iii) intertwined memory and logic. These features make HD computing a promising solution for today's embedded devices with limited resources as well as future computing systems in deep nanoscaled technology that have issues of high noise and variability. We exploit emerging technologies to enable processing in-memory which is capable of highly-parallel computation and data movement reduction. Our evaluations show that HD computing provides 39X faster and 56X more energy efficiency as compared to state-of-the-art deep learning accelerator.







Deep Learning for Internet of Things Infrastructure


Book Description

This book promotes and facilitates exchanges of research knowledge and findings across different disciplines on the design and investigation of deep learning (DL)–based data analytics of IoT (Internet of Things) infrastructures. Deep Learning for Internet of Things Infrastructure addresses emerging trends and issues on IoT systems and services across various application domains. The book investigates the challenges posed by the implementation of deep learning on IoT networking models and services. It provides fundamental theory, model, and methodology in interpreting, aggregating, processing, and analyzing data for intelligent DL-enabled IoT. The book also explores new functions and technologies to provide adaptive services and intelligent applications for different end users. FEATURES Promotes and facilitates exchanges of research knowledge and findings across different disciplines on the design and investigation of DL-based data analytics of IoT infrastructures Addresses emerging trends and issues on IoT systems and services across various application domains Investigates the challenges posed by the implementation of deep learning on IoT networking models and services Provides fundamental theory, model, and methodology in interpreting, aggregating, processing, and analyzing data for intelligent DL-enabled IoT Explores new functions and technologies to provide adaptive services and intelligent applications for different end users Uttam Ghosh is an Assistant Professor in the Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, Tennessee, USA. Mamoun Alazab is an Associate Professor in the College of Engineering, IT and Environment at Charles Darwin University, Australia. Ali Kashif Bashir is a Senior Lecturer/Associate Professor and Program Leader of BSc (H) Computer Forensics and Security at the Department of Computing and Mathematics, Manchester Metropolitan University, United Kingdom. Al-Sakib Khan Pathan is an Adjunct Professor of Computer Science and Engineering at the Independent University, Bangladesh.




TinyML


Book Description

Deep learning networks are getting smaller. Much smaller. The Google Assistant team can detect words with a model just 14 kilobytes in size—small enough to run on a microcontroller. With this practical book you’ll enter the field of TinyML, where deep learning and embedded systems combine to make astounding things possible with tiny devices. Pete Warden and Daniel Situnayake explain how you can train models small enough to fit into any environment. Ideal for software and hardware developers who want to build embedded systems using machine learning, this guide walks you through creating a series of TinyML projects, step-by-step. No machine learning or microcontroller experience is necessary. Build a speech recognizer, a camera that detects people, and a magic wand that responds to gestures Work with Arduino and ultra-low-power microcontrollers Learn the essentials of ML and how to train your own models Train models to understand audio, image, and accelerometer data Explore TensorFlow Lite for Microcontrollers, Google’s toolkit for TinyML Debug applications and provide safeguards for privacy and security Optimize latency, energy usage, and model and binary size




Federated Learning for IoT Applications


Book Description

This book presents how federated learning helps to understand and learn from user activity in Internet of Things (IoT) applications while protecting user privacy. The authors first show how federated learning provides a unique way to build personalized models using data without intruding on users’ privacy. The authors then provide a comprehensive survey of state-of-the-art research on federated learning, giving the reader a general overview of the field. The book also investigates how a personalized federated learning framework is needed in cloud-edge architecture as well as in wireless-edge architecture for intelligent IoT applications. To cope with the heterogeneity issues in IoT environments, the book investigates emerging personalized federated learning methods that are able to mitigate the negative effects caused by heterogeneities in different aspects. The book provides case studies of IoT based human activity recognition to demonstrate the effectiveness of personalized federated learning for intelligent IoT applications, as well as multiple controller design and system analysis tools including model predictive control, linear matrix inequalities, optimal control, etc. This unique and complete co-design framework will benefit researchers, graduate students and engineers in the fields of control theory and engineering.







Hands-On Deep Learning for IoT


Book Description




Handbook of Research on Machine Learning-Enabled IoT for Smart Applications Across Industries


Book Description

Machine learning (ML) and the internet of things (IoT) are the top technologies used by businesses to increase efficiency, productivity, and competitiveness in this fast-paced digital era transformation. ML is the key tool for fast processing and decision making applied to smart city applications and next-generation IoT devices, which require ML to satisfy their working objective. IoT technology has proven efficient in solving many real-world problems, and ML algorithms combined with IoT means the fusion of product and intelligence to achieve better automation, efficiency, productivity, and connectivity. The Handbook of Research on Machine Learning-Enabled IoT for Smart Applications Across Industries highlights the importance of ML for IoT’s success and diverse ML-powered IoT applications. This book addresses the problems and challenges in energy, industry, and healthcare and solutions proposed for ML-enabled IoT and new algorithms in ML. It further addresses their accuracy for existing real-time applications. Covering topics such as agriculture, pattern recognition, and smart applications, this premier reference source is an essential resource for engineers, scientists, educators, students, researchers, and academicians.




Intelligent Internet of Things Networks


Book Description

This book provides an overview of the Internet of Things Network and Machine Learning and introduces Internet of Things architecture. It designs a new intelligent IoT network architecture and introduces different machine learning approaches to investigate solutions. It discusses how machine learning can help network awareness and achieve network intelligent control. It also dicusses the emerging network techniques that can enable the development of intelligent IoT networks. This book applies several intelligent approaches for efficient resource scheduling in networks. It discusses Mobile Edge Computing aided intelligent IoT and focuses mainly on the resource sharing and edge computation offloading problems in mobile edge networks. The blockchain-based IoT (which allows fairly and securely renting resources and establishing contracts) is discussed as well. The Internet of Things refers to the billions of physical devices that are now connected to and transfer data through the Internet without requiring human-to-human or human-to-computer interaction. According to Gartner's prediction, there will be more than 37 billion IoT connections in the future year of 2025. However, with large-scale IoT deployments, IoT networks are facing challenges in the aspects of scalability, privacy, and security. The ever-increasing complexity of the IoT makes effective monitoring, overall control, optimization, and auditing of the network difficult. Recently, artificial intelligence (AI) and machine learning (ML) approaches have emerged as a viable solution to address this challenge. Machine learning can automatically learn and optimize strategy directly from experience without following pre-defined rules. Therefore, it is promising to apply machine learning in IoT network control and management to leverage powerful machine learning adaptive abilities for higher network performance. This book targets researchers working in the Internet of Things networks as well as graduate students and undergraduate students focused on this field. Industry managers, and government research agencies in the fields of the IoT networks will also want to purchase this book.