› › Deep Learning At Scale

Deep Learning at Scale

Author : Suneeta Mall

Publisher : "O'Reilly Media, Inc."

Page : 404 pages

File Size : 12,75 MB

Release : 2024-06-18

Category : Computers

ISBN : 1098145240

Get eBook

Book Description

Bringing a deep-learning project into production at scale is quite challenging. To successfully scale your project, a foundational understanding of full stack deep learning, including the knowledge that lies at the intersection of hardware, software, data, and algorithms, is required. This book illustrates complex concepts of full stack deep learning and reinforces them through hands-on exercises to arm you with tools and techniques to scale your project. A scaling effort is only beneficial when it's effective and efficient. To that end, this guide explains the intricate concepts and techniques that will help you scale effectively and efficiently. You'll gain a thorough understanding of: How data flows through the deep-learning network and the role the computation graphs play in building your model How accelerated computing speeds up your training and how best you can utilize the resources at your disposal How to train your model using distributed training paradigms, i.e., data, model, and pipeline parallelism How to leverage PyTorch ecosystems in conjunction with NVIDIA libraries and Triton to scale your model training Debugging, monitoring, and investigating the undesirable bottlenecks that slow down your model training How to expedite the training lifecycle and streamline your feedback loop to iterate model development A set of data tricks and techniques and how to apply them to scale your training model How to select the right tools and techniques for your deep-learning project Options for managing the compute infrastructure when running at scale



Scaling Up Machine Learning

Author : Ron Bekkerman

Publisher : Cambridge University Press

Page : 493 pages

File Size : 22,72 MB

Release : 2012

Category : Computers

ISBN : 0521192242

Get eBook

Book Description

This integrated collection covers a range of parallelization platforms, concurrent programming frameworks and machine learning settings, with case studies.



MLOps Engineering at Scale

Author : Carl Osipov

Publisher : Simon and Schuster

Page : 497 pages

File Size : 16,89 MB

Release : 2022-03-22

Category : Computers

ISBN : 1638356505

Get eBook

Book Description

Dodge costly and time-consuming infrastructure tasks, and rapidly bring your machine learning models to production with MLOps and pre-built serverless tools! In MLOps Engineering at Scale you will learn: Extracting, transforming, and loading datasets Querying datasets with SQL Understanding automatic differentiation in PyTorch Deploying model training pipelines as a service endpoint Monitoring and managing your pipeline’s life cycle Measuring performance improvements MLOps Engineering at Scale shows you how to put machine learning into production efficiently by using pre-built services from AWS and other cloud vendors. You’ll learn how to rapidly create flexible and scalable machine learning systems without laboring over time-consuming operational tasks or taking on the costly overhead of physical hardware. Following a real-world use case for calculating taxi fares, you will engineer an MLOps pipeline for a PyTorch model using AWS server-less capabilities. About the technology A production-ready machine learning system includes efficient data pipelines, integrated monitoring, and means to scale up and down based on demand. Using cloud-based services to implement ML infrastructure reduces development time and lowers hosting costs. Serverless MLOps eliminates the need to build and maintain custom infrastructure, so you can concentrate on your data, models, and algorithms. About the book MLOps Engineering at Scale teaches you how to implement efficient machine learning systems using pre-built services from AWS and other cloud vendors. This easy-to-follow book guides you step-by-step as you set up your serverless ML infrastructure, even if you’ve never used a cloud platform before. You’ll also explore tools like PyTorch Lightning, Optuna, and MLFlow that make it easy to build pipelines and scale your deep learning models in production. What's inside Reduce or eliminate ML infrastructure management Learn state-of-the-art MLOps tools like PyTorch Lightning and MLFlow Deploy training pipelines as a service endpoint Monitor and manage your pipeline’s life cycle Measure performance improvements About the reader Readers need to know Python, SQL, and the basics of machine learning. No cloud experience required. About the author Carl Osipov implemented his first neural net in 2000 and has worked on deep learning and machine learning at Google and IBM. Table of Contents PART 1 - MASTERING THE DATA SET 1 Introduction to serverless machine learning 2 Getting started with the data set 3 Exploring and preparing the data set 4 More exploratory data analysis and data preparation PART 2 - PYTORCH FOR SERVERLESS MACHINE LEARNING 5 Introducing PyTorch: Tensor basics 6 Core PyTorch: Autograd, optimizers, and utilities 7 Serverless machine learning at scale 8 Scaling out with distributed training PART 3 - SERVERLESS MACHINE LEARNING PIPELINE 9 Feature selection 10 Adopting PyTorch Lightning 11 Hyperparameter optimization 12 Machine learning pipeline



Deep Learning Systems

Author : Andres Rodriguez

Publisher : Springer Nature

Page : 245 pages

File Size : 37,21 MB

Release : 2022-05-31

Category : Technology & Engineering

ISBN : 3031017692

Get eBook

Book Description

This book describes deep learning systems: the algorithms, compilers, and processor components to efficiently train and deploy deep learning models for commercial applications. The exponential growth in computational power is slowing at a time when the amount of compute consumed by state-of-the-art deep learning (DL) workloads is rapidly growing. Model size, serving latency, and power constraints are a significant challenge in the deployment of DL models for many applications. Therefore, it is imperative to codesign algorithms, compilers, and hardware to accelerate advances in this field with holistic system-level and algorithm solutions that improve performance, power, and efficiency. Advancing DL systems generally involves three types of engineers: (1) data scientists that utilize and develop DL algorithms in partnership with domain experts, such as medical, economic, or climate scientists; (2) hardware designers that develop specialized hardware to accelerate the components in the DL models; and (3) performance and compiler engineers that optimize software to run more efficiently on a given hardware. Hardware engineers should be aware of the characteristics and components of production and academic models likely to be adopted by industry to guide design decisions impacting future hardware. Data scientists should be aware of deployment platform constraints when designing models. Performance engineers should support optimizations across diverse models, libraries, and hardware targets. The purpose of this book is to provide a solid understanding of (1) the design, training, and applications of DL algorithms in industry; (2) the compiler techniques to map deep learning code to hardware targets; and (3) the critical hardware features that accelerate DL systems. This book aims to facilitate co-innovation for the advancement of DL systems. It is written for engineers working in one or more of these areas who seek to understand the entire system stack in order to better collaborate with engineers working in other parts of the system stack. The book details advancements and adoption of DL models in industry, explains the training and deployment process, describes the essential hardware architectural features needed for today's and future models, and details advances in DL compilers to efficiently execute algorithms across various hardware targets. Unique in this book is the holistic exposition of the entire DL system stack, the emphasis on commercial applications, and the practical techniques to design models and accelerate their performance. The author is fortunate to work with hardware, software, data scientist, and research teams across many high-technology companies with hyperscale data centers. These companies employ many of the examples and methods provided throughout the book.



Practical Deep Learning at Scale with MLflow

Author : Yong Liu

Publisher : Packt Publishing Ltd

Page : 288 pages

File Size : 36,24 MB

Release : 2022-07-08

Category : Computers

ISBN : 1803242221

Get eBook

Book Description

Train, test, run, track, store, tune, deploy, and explain provenance-aware deep learning models and pipelines at scale with reproducibility using MLflow Key Features • Focus on deep learning models and MLflow to develop practical business AI solutions at scale • Ship deep learning pipelines from experimentation to production with provenance tracking • Learn to train, run, tune and deploy deep learning pipelines with explainability and reproducibility Book Description The book starts with an overview of the deep learning (DL) life cycle and the emerging Machine Learning Ops (MLOps) field, providing a clear picture of the four pillars of deep learning: data, model, code, and explainability and the role of MLflow in these areas. From there onward, it guides you step by step in understanding the concept of MLflow experiments and usage patterns, using MLflow as a unified framework to track DL data, code and pipelines, models, parameters, and metrics at scale. You'll also tackle running DL pipelines in a distributed execution environment with reproducibility and provenance tracking, and tuning DL models through hyperparameter optimization (HPO) with Ray Tune, Optuna, and HyperBand. As you progress, you'll learn how to build a multi-step DL inference pipeline with preprocessing and postprocessing steps, deploy a DL inference pipeline for production using Ray Serve and AWS SageMaker, and finally create a DL explanation as a service (EaaS) using the popular Shapley Additive Explanations (SHAP) toolbox. By the end of this book, you'll have built the foundation and gained the hands-on experience you need to develop a DL pipeline solution from initial offline experimentation to final deployment and production, all within a reproducible and open source framework. What you will learn • Understand MLOps and deep learning life cycle development • Track deep learning models, code, data, parameters, and metrics • Build, deploy, and run deep learning model pipelines anywhere • Run hyperparameter optimization at scale to tune deep learning models • Build production-grade multi-step deep learning inference pipelines • Implement scalable deep learning explainability as a service • Deploy deep learning batch and streaming inference services • Ship practical NLP solutions from experimentation to production Who this book is for This book is for machine learning practitioners including data scientists, data engineers, ML engineers, and scientists who want to build scalable full life cycle deep learning pipelines with reproducibility and provenance tracking using MLflow. A basic understanding of data science and machine learning is necessary to grasp the concepts presented in this book.



The Principles of Deep Learning Theory

Author : Daniel A. Roberts

Publisher : Cambridge University Press

Page : 473 pages

File Size : 41,55 MB

Release : 2022-05-26

Category : Computers

ISBN : 1316519333

Get eBook

Book Description

This volume develops an effective theory approach to understanding deep neural networks of practical relevance.



Deep Learning at Scale

Author : Suneeta Mall

Publisher : "O'Reilly Media, Inc."

Page : 448 pages

File Size : 18,48 MB

Release : 2024-06-18

Category : Computers

ISBN : 1098145259

Get eBook

Book Description

Bringing a deep-learning project into production at scale is quite challenging. To successfully scale your project, a foundational understanding of full stack deep learning, including the knowledge that lies at the intersection of hardware, software, data, and algorithms, is required. This book illustrates complex concepts of full stack deep learning and reinforces them through hands-on exercises to arm you with tools and techniques to scale your project. A scaling effort is only beneficial when it's effective and efficient. To that end, this guide explains the intricate concepts and techniques that will help you scale effectively and efficiently. You'll gain a thorough understanding of: How data flows through the deep-learning network and the role the computation graphs play in building your model How accelerated computing speeds up your training and how best you can utilize the resources at your disposal How to train your model using distributed training paradigms, i.e., data, model, and pipeline parallelism How to leverage PyTorch ecosystems in conjunction with NVIDIA libraries and Triton to scale your model training Debugging, monitoring, and investigating the undesirable bottlenecks that slow down your model training How to expedite the training lifecycle and streamline your feedback loop to iterate model development A set of data tricks and techniques and how to apply them to scale your training model How to select the right tools and techniques for your deep-learning project Options for managing the compute infrastructure when running at scale



Introducing MLOps

Author : Mark Treveil

Publisher : "O'Reilly Media, Inc."

Page : 171 pages

File Size : 16,43 MB

Release : 2020-11-30

Category : Computers

ISBN : 1098116429

Get eBook

Book Description

More than half of the analytics and machine learning (ML) models created by organizations today never make it into production. Some of the challenges and barriers to operationalization are technical, but others are organizational. Either way, the bottom line is that models not in production can't provide business impact. This book introduces the key concepts of MLOps to help data scientists and application engineers not only operationalize ML models to drive real business change but also maintain and improve those models over time. Through lessons based on numerous MLOps applications around the world, nine experts in machine learning provide insights into the five steps of the model life cycle--Build, Preproduction, Deployment, Monitoring, and Governance--uncovering how robust MLOps processes can be infused throughout. This book helps you: Fulfill data science value by reducing friction throughout ML pipelines and workflows Refine ML models through retraining, periodic tuning, and complete remodeling to ensure long-term accuracy Design the MLOps life cycle to minimize organizational risks with models that are unbiased, fair, and explainable Operationalize ML models for pipeline deployment and for external business systems that are more complex and less standardized



Machine Learning Systems

Author : Jeffrey Smith

Publisher : Simon and Schuster

Page : 339 pages

File Size : 40,63 MB

Release : 2018-05-21

Category : Computers

ISBN : 1638355363

Get eBook

Book Description

Summary Machine Learning Systems: Designs that scale is an example-rich guide that teaches you how to implement reactive design solutions in your machine learning systems to make them as reliable as a well-built web app. Foreword by Sean Owen, Director of Data Science, Cloudera Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the Technology If you’re building machine learning models to be used on a small scale, you don't need this book. But if you're a developer building a production-grade ML application that needs quick response times, reliability, and good user experience, this is the book for you. It collects principles and practices of machine learning systems that are dramatically easier to run and maintain, and that are reliably better for users. About the Book Machine Learning Systems: Designs that scale teaches you to design and implement production-ready ML systems. You'll learn the principles of reactive design as you build pipelines with Spark, create highly scalable services with Akka, and use powerful machine learning libraries like MLib on massive datasets. The examples use the Scala language, but the same ideas and tools work in Java, as well. What's Inside Working with Spark, MLlib, and Akka Reactive design patterns Monitoring and maintaining a large-scale system Futures, actors, and supervision About the Reader Readers need intermediate skills in Java or Scala. No prior machine learning experience is assumed. About the Author Jeff Smith builds powerful machine learning systems. For the past decade, he has been working on building data science applications, teams, and companies as part of various teams in New York, San Francisco, and Hong Kong. He blogs (https: //medium.com/@jeffksmithjr), tweets (@jeffksmithjr), and speaks (www.jeffsmith.tech/speaking) about various aspects of building real-world machine learning systems. Table of Contents PART 1 - FUNDAMENTALS OF REACTIVE MACHINE LEARNING Learning reactive machine learning Using reactive tools PART 2 - BUILDING A REACTIVE MACHINE LEARNING SYSTEM Collecting data Generating features Learning models Evaluating models Publishing models Responding PART 3 - OPERATING A MACHINE LEARNING SYSTEM Delivering Evolving intelligence



Machine Learning at Scale with H2O

Author : Gregory Keys

Publisher : Packt Publishing Ltd

Page : 396 pages

File Size : 47,50 MB

Release : 2022-07-29

Category : Computers

ISBN : 1800569297

Get eBook

Book Description

Build predictive models using large data volumes and deploy them to production using cutting-edge techniques Key Features • Build highly accurate state-of-the-art machine learning models against large-scale data • Deploy models for batch, real-time, and streaming data in a wide variety of target production systems • Explore all the new features of the H2O AI Cloud end-to-end machine learning platform Book Description H2O is an open source, fast, and scalable machine learning framework that allows you to build models using big data and then easily productionalize them in diverse enterprise environments. Machine Learning at Scale with H2O begins with an overview of the challenges faced in building machine learning models on large enterprise systems, and then addresses how H2O helps you to overcome them. You'll start by exploring H2O's in-memory distributed architecture and find out how it enables you to build highly accurate and explainable models on massive datasets using your favorite ML algorithms, language, and IDE. You'll also get to grips with the seamless integration of H2O model building and deployment with Spark using H2O Sparkling Water. You'll then learn how to easily deploy models with H2O MOJO. Next, the book shows you how H2O Enterprise Steam handles admin configurations and user management, and then helps you to identify different stakeholder perspectives that a data scientist must understand in order to succeed in an enterprise setting. Finally, you'll be introduced to the H2O AI Cloud platform and explore the entire machine learning life cycle using multiple advanced AI capabilities. By the end of this book, you'll be able to build and deploy advanced, state-of-the-art machine learning models for your business needs. What you will learn • Build and deploy machine learning models using H2O • Explore advanced model-building techniques • Integrate Spark and H2O code using H2O Sparkling Water • Launch self-service model building environments • Deploy H2O models in a variety of target systems and scoring contexts • Expand your machine learning capabilities on the H2O AI Cloud Who this book is for This book is for data scientists and machine learning engineers who want to gain hands-on machine learning experience by building and deploying state-of-the-art models with advanced techniques using H2O technology. An understanding of the data science process and experience in Python programming is recommended. This book will also benefit students by helping them understand how machine learning works in real-world enterprise scenarios.