Neural Networks with Model Compression


Book Description

Deep learning has achieved impressive results in image classification, computer vision and natural language processing. To achieve better performance, deeper and wider networks have been designed, which increase the demand for computational resources. The number of floating-point operations (FLOPs) has increased dramatically with larger networks, and this has become an obstacle for convolutional neural networks (CNNs) being developed for mobile and embedded devices. In this context, our book will focus on CNN compression and acceleration, which are important for the research community. We will describe numerous methods, including parameter quantization, network pruning, low-rank decomposition and knowledge distillation. More recently, to reduce the burden of handcrafted architecture design, neural architecture search (NAS) has been used to automatically build neural networks by searching over a vast architecture space. Our book will also introduce NAS due to its superiority and state-of-the-art performance in various applications, such as image classification and object detection. We also describe extensive applications of compressed deep models on image classification, speech recognition, object detection and tracking. These topics can help researchers better understand the usefulness and the potential of network compression on practical applications. Moreover, interested readers should have basic knowledge about machine learning and deep learning to better understand the methods described in this book.




Algorithms and Architectures for Parallel Processing


Book Description

This three-volume set LNCS 12452, 12453, and 12454 constitutes the proceedings of the 20th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2020, in New York City, NY, USA, in October 2020. The total of 142 full papers and 5 short papers included in this proceedings volumes was carefully reviewed and selected from 495 submissions. ICA3PP is covering the many dimensions of parallel algorithms and architectures, encompassing fundamental theoretical approaches, practical experimental projects, and commercial components and systems. As applications of computing systems have permeated in every aspects of daily life, the power of computing system has become increasingly critical. This conference provides a forum for academics and practitioners from countries around the world to exchange ideas for improving the efficiency, performance, reliability, security and interoperability of computing systems and applications. ICA3PP 2020 focus on two broad areas of parallel and distributed computing, i.e. architectures, algorithms and networks, and systems and applications.




Efficient Processing of Deep Neural Networks


Book Description

This book provides a structured treatment of the key principles and techniques for enabling efficient processing of deep neural networks (DNNs). DNNs are currently widely used for many artificial intelligence (AI) applications, including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at the cost of high computational complexity. Therefore, techniques that enable efficient processing of deep neural networks to improve key metrics—such as energy-efficiency, throughput, and latency—without sacrificing accuracy or increasing hardware costs are critical to enabling the wide deployment of DNNs in AI systems. The book includes background on DNN processing; a description and taxonomy of hardware architectural approaches for designing DNN accelerators; key metrics for evaluating and comparing different designs; features of DNN processing that are amenable to hardware/algorithm co-design to improve energy efficiency and throughput; and opportunities for applying new technologies. Readers will find a structured introduction to the field as well as formalization and organization of key concepts from contemporary work that provide insights that may spark new ideas.




Deep Learning Applications, Volume 2


Book Description

This book presents selected papers from the 18th IEEE International Conference on Machine Learning and Applications (IEEE ICMLA 2019). It focuses on deep learning networks and their application in domains such as healthcare, security and threat detection, fault diagnosis and accident analysis, and robotic control in industrial environments, and highlights novel ways of using deep neural networks to solve real-world problems. Also offering insights into deep learning architectures and algorithms, it is an essential reference guide for academic researchers, professionals, software engineers in industry, and innovative product developers.




Modern Deep Learning Design and Application Development


Book Description

Learn how to harness modern deep-learning methods in many contexts. Packed with intuitive theory, practical implementation methods, and deep-learning case studies, this book reveals how to acquire the tools you need to design and implement like a deep-learning architect. It covers tools deep learning engineers can use in a wide range of fields, from biology to computer vision to business. With nine in-depth case studies, this book will ground you in creative, real-world deep learning thinking. You’ll begin with a structured guide to using Keras, with helpful tips and best practices for making the most of the framework. Next, you’ll learn how to train models effectively with transfer learning and self-supervised pre-training. You will then learn how to use a variety of model compressions for practical usage. Lastly, you will learn how to design successful neural network architectures and creatively reframe difficult problems into solvable ones. You’ll learn not only to understand and apply methods successfully but to think critically about it. Modern Deep Learning Design and Methods is ideal for readers looking to utilize modern, flexible, and creative deep-learning design and methods. Get ready to design and implement innovative deep-learning solutions to today’s difficult problems. What You’ll Learn Improve the performance of deep learning models by using pre-trained models, extracting rich features, and automating optimization. Compress deep learning models while maintaining performance. Reframe a wide variety of difficult problems and design effective deep learning solutions to solve them. Use the Keras framework, with some help from libraries like HyperOpt, TensorFlow, and PyTorch, to implement a wide variety of deep learning approaches. Who This Book Is For Data scientists with some familiarity with deep learning to deep learning engineers seeking structured inspiration and direction on their next project. Developers interested in harnessing modern deep learning methods to solve a variety of difficult problems.




Intelligent Computing Theories and Application


Book Description

This two-volume set of LNCS 12836 and LNCS 12837 constitutes - in conjunction with the volume LNAI 12838 - the refereed proceedings of the 17th International Conference on Intelligent Computing, ICIC 2021, held in Shenzhen, China in August 2021. The 192 full papers of the three proceedings volumes were carefully reviewed and selected from 458 submissions. The ICIC theme unifies the picture of contemporary intelligent computing techniques as an integral concept that highlights the trends in advanced computational intelligence and bridges theoretical research with applications. The theme for this conference is “Advanced Intelligent Computing Methodologies and Applications.” The papers are organized in the following subsections: Evolutionary Computation and Learning, Image and signal Processing, Information Security, Neural Networks, Pattern Recognition Swarm Intelligence and Optimization, and Virtual Reality and Human-Computer Interaction.




Research Anthology on Artificial Neural Network Applications


Book Description

Artificial neural networks (ANNs) present many benefits in analyzing complex data in a proficient manner. As an effective and efficient problem-solving method, ANNs are incredibly useful in many different fields. From education to medicine and banking to engineering, artificial neural networks are a growing phenomenon as more realize the plethora of uses and benefits they provide. Due to their complexity, it is vital for researchers to understand ANN capabilities in various fields. The Research Anthology on Artificial Neural Network Applications covers critical topics related to artificial neural networks and their multitude of applications in a number of diverse areas including medicine, finance, operations research, business, social media, security, and more. Covering everything from the applications and uses of artificial neural networks to deep learning and non-linear problems, this book is ideal for computer scientists, IT specialists, data scientists, technologists, business owners, engineers, government agencies, researchers, academicians, and students, as well as anyone who is interested in learning more about how artificial neural networks can be used across a wide range of fields.




Artificial Intelligence and Security


Book Description

This two-volume set LNCS 12239-12240 constitutes the refereed proceedings of the 6th International Conference on Artificial Intelligence and Security, ICAIS 2020, which was held in Hohhot, China, in July 2020. The conference was formerly called “International Conference on Cloud Computing and Security” with the acronym ICCCS. The total of 142 full papers presented in this two-volume proceedings was carefully reviewed and selected from 1064 submissions. The papers were organized in topical sections as follows: Part I: Artificial intelligence and internet of things. Part II: Internet of things, information security, big data and cloud computing, and information processing.




Artificial Neural Networks and Machine Learning – ICANN 2016


Book Description

The two volume set, LNCS 9886 + 9887, constitutes the proceedings of the 25th International Conference on Artificial Neural Networks, ICANN 2016, held in Barcelona, Spain, in September 2016. The 121 full papers included in this volume were carefully reviewed and selected from 227 submissions. They were organized in topical sections named: from neurons to networks; networks and dynamics; higher nervous functions; neuronal hardware; learning foundations; deep learning; classifications and forecasting; and recognition and navigation. There are 47 short paper abstracts that are included in the back matter of the volume.




Intelligent Computing Theories and Application


Book Description

This two-volume set of LNCS 12836 and LNCS 12837 constitutes - in conjunction with the volume LNAI 12838 - the refereed proceedings of the 17th International Conference on Intelligent Computing, ICIC 2021, held in Shenzhen, China in August 2021. The 192 full papers of the three proceedings volumes were carefully reviewed and selected from 458 submissions. The ICIC theme unifies the picture of contemporary intelligent computing techniques as an integral concept that highlights the trends in advanced computational intelligence and bridges theoretical research with applications. The theme for this conference is “Advanced Intelligent Computing Methodologies and Applications.” The papers are organized in the following subsections: Intelligent Computing in Computer Vision, Intelligent Control and Automation, Intelligent Modeling Technologies for Smart Cities, Machine Learning, and Theoretical Computational Intelligence and Applications.