› › Practical Deep Learning At Scale With Mlflow

Practical Deep Learning at Scale with MLflow

Author : Yong Liu

Publisher : Packt Publishing Ltd

Page : 288 pages

File Size : 34,25 MB

Release : 2022-07-08

Category : Computers

ISBN : 1803242221

Get eBook

Book Description

Train, test, run, track, store, tune, deploy, and explain provenance-aware deep learning models and pipelines at scale with reproducibility using MLflow Key Features • Focus on deep learning models and MLflow to develop practical business AI solutions at scale • Ship deep learning pipelines from experimentation to production with provenance tracking • Learn to train, run, tune and deploy deep learning pipelines with explainability and reproducibility Book Description The book starts with an overview of the deep learning (DL) life cycle and the emerging Machine Learning Ops (MLOps) field, providing a clear picture of the four pillars of deep learning: data, model, code, and explainability and the role of MLflow in these areas. From there onward, it guides you step by step in understanding the concept of MLflow experiments and usage patterns, using MLflow as a unified framework to track DL data, code and pipelines, models, parameters, and metrics at scale. You'll also tackle running DL pipelines in a distributed execution environment with reproducibility and provenance tracking, and tuning DL models through hyperparameter optimization (HPO) with Ray Tune, Optuna, and HyperBand. As you progress, you'll learn how to build a multi-step DL inference pipeline with preprocessing and postprocessing steps, deploy a DL inference pipeline for production using Ray Serve and AWS SageMaker, and finally create a DL explanation as a service (EaaS) using the popular Shapley Additive Explanations (SHAP) toolbox. By the end of this book, you'll have built the foundation and gained the hands-on experience you need to develop a DL pipeline solution from initial offline experimentation to final deployment and production, all within a reproducible and open source framework. What you will learn • Understand MLOps and deep learning life cycle development • Track deep learning models, code, data, parameters, and metrics • Build, deploy, and run deep learning model pipelines anywhere • Run hyperparameter optimization at scale to tune deep learning models • Build production-grade multi-step deep learning inference pipelines • Implement scalable deep learning explainability as a service • Deploy deep learning batch and streaming inference services • Ship practical NLP solutions from experimentation to production Who this book is for This book is for machine learning practitioners including data scientists, data engineers, ML engineers, and scientists who want to build scalable full life cycle deep learning pipelines with reproducibility and provenance tracking using MLflow. A basic understanding of data science and machine learning is necessary to grasp the concepts presented in this book.



Machine Learning Engineering with MLflow

Author : Natu Lauchande

Publisher : Packt Publishing Ltd

Page : 249 pages

File Size : 22,82 MB

Release : 2021-08-27

Category : Computers

ISBN : 1800561695

Get eBook

Book Description

Get up and running, and productive in no time with MLflow using the most effective machine learning engineering approach Key FeaturesExplore machine learning workflows for stating ML problems in a concise and clear manner using MLflowUse MLflow to iteratively develop a ML model and manage it Discover and work with the features available in MLflow to seamlessly take a model from the development phase to a production environmentBook Description MLflow is a platform for the machine learning life cycle that enables structured development and iteration of machine learning models and a seamless transition into scalable production environments. This book will take you through the different features of MLflow and how you can implement them in your ML project. You will begin by framing an ML problem and then transform your solution with MLflow, adding a workbench environment, training infrastructure, data management, model management, experimentation, and state-of-the-art ML deployment techniques on the cloud and premises. The book also explores techniques to scale up your workflow as well as performance monitoring techniques. As you progress, you'll discover how to create an operational dashboard to manage machine learning systems. Later, you will learn how you can use MLflow in the AutoML, anomaly detection, and deep learning context with the help of use cases. In addition to this, you will understand how to use machine learning platforms for local development as well as for cloud and managed environments. This book will also show you how to use MLflow in non-Python-based languages such as R and Java, along with covering approaches to extend MLflow with Plugins. By the end of this machine learning book, you will be able to produce and deploy reliable machine learning algorithms using MLflow in multiple environments. What you will learnDevelop your machine learning project locally with MLflow's different featuresSet up a centralized MLflow tracking server to manage multiple MLflow experimentsCreate a model life cycle with MLflow by creating custom modelsUse feature streams to log model results with MLflowDevelop the complete training pipeline infrastructure using MLflow featuresSet up an inference-based API pipeline and batch pipeline in MLflowScale large volumes of data by integrating MLflow with high-performance big data librariesWho this book is for This book is for data scientists, machine learning engineers, and data engineers who want to gain hands-on machine learning engineering experience and learn how they can manage an end-to-end machine learning life cycle with the help of MLflow. Intermediate-level knowledge of the Python programming language is expected.



Modern Time Series Forecasting with Python

Author : Manu Joseph

Publisher : Packt Publishing Ltd

Page : 552 pages

File Size : 43,97 MB

Release : 2022-11-24

Category : Computers

ISBN : 1803232048

Get eBook

Book Description

Build real-world time series forecasting systems which scale to millions of time series by applying modern machine learning and deep learning concepts Key Features Explore industry-tested machine learning techniques used to forecast millions of time series Get started with the revolutionary paradigm of global forecasting models Get to grips with new concepts by applying them to real-world datasets of energy forecasting Book DescriptionWe live in a serendipitous era where the explosion in the quantum of data collected and a renewed interest in data-driven techniques such as machine learning (ML), has changed the landscape of analytics, and with it, time series forecasting. This book, filled with industry-tested tips and tricks, takes you beyond commonly used classical statistical methods such as ARIMA and introduces to you the latest techniques from the world of ML. This is a comprehensive guide to analyzing, visualizing, and creating state-of-the-art forecasting systems, complete with common topics such as ML and deep learning (DL) as well as rarely touched-upon topics such as global forecasting models, cross-validation strategies, and forecast metrics. You’ll begin by exploring the basics of data handling, data visualization, and classical statistical methods before moving on to ML and DL models for time series forecasting. This book takes you on a hands-on journey in which you’ll develop state-of-the-art ML (linear regression to gradient-boosted trees) and DL (feed-forward neural networks, LSTMs, and transformers) models on a real-world dataset along with exploring practical topics such as interpretability. By the end of this book, you’ll be able to build world-class time series forecasting systems and tackle problems in the real world.What you will learn Find out how to manipulate and visualize time series data like a pro Set strong baselines with popular models such as ARIMA Discover how time series forecasting can be cast as regression Engineer features for machine learning models for forecasting Explore the exciting world of ensembling and stacking models Get to grips with the global forecasting paradigm Understand and apply state-of-the-art DL models such as N-BEATS and Autoformer Explore multi-step forecasting and cross-validation strategies Who this book is for The book is for data scientists, data analysts, machine learning engineers, and Python developers who want to build industry-ready time series models. Since the book explains most concepts from the ground up, basic proficiency in Python is all you need. Prior understanding of machine learning or forecasting will help speed up your learning. For experienced machine learning and forecasting practitioners, this book has a lot to offer in terms of advanced techniques and traversing the latest research frontiers in time series forecasting.



Introducing MLOps

Author : Mark Treveil

Publisher : "O'Reilly Media, Inc."

Page : 171 pages

File Size : 47,69 MB

Release : 2020-11-30

Category : Computers

ISBN : 1098116429

Get eBook

Book Description

More than half of the analytics and machine learning (ML) models created by organizations today never make it into production. Some of the challenges and barriers to operationalization are technical, but others are organizational. Either way, the bottom line is that models not in production can't provide business impact. This book introduces the key concepts of MLOps to help data scientists and application engineers not only operationalize ML models to drive real business change but also maintain and improve those models over time. Through lessons based on numerous MLOps applications around the world, nine experts in machine learning provide insights into the five steps of the model life cycle--Build, Preproduction, Deployment, Monitoring, and Governance--uncovering how robust MLOps processes can be infused throughout. This book helps you: Fulfill data science value by reducing friction throughout ML pipelines and workflows Refine ML models through retraining, periodic tuning, and complete remodeling to ensure long-term accuracy Design the MLOps life cycle to minimize organizational risks with models that are unbiased, fair, and explainable Operationalize ML models for pipeline deployment and for external business systems that are more complex and less standardized



Deep Learning for Genomics

Author : Upendra Kumar Devisetty

Publisher : Packt Publishing Ltd

Page : 270 pages

File Size : 14,80 MB

Release : 2022-11-11

Category : Computers

ISBN : 1804613010

Get eBook

Book Description

Learn concepts, methodologies, and applications of deep learning for building predictive models from complex genomics data sets to overcome challenges in the life sciences and biotechnology industries Key FeaturesApply deep learning algorithms to solve real-world problems in the field of genomicsExtract biological insights from deep learning models built from genomic datasetsTrain, tune, evaluate, deploy, and monitor deep learning models for enabling predictions in genomicsBook Description Deep learning has shown remarkable promise in the field of genomics; however, there is a lack of a skilled deep learning workforce in this discipline. This book will help researchers and data scientists to stand out from the rest of the crowd and solve real-world problems in genomics by developing the necessary skill set. Starting with an introduction to the essential concepts, this book highlights the power of deep learning in handling big data in genomics. First, you'll learn about conventional genomics analysis, then transition to state-of-the-art machine learning-based genomics applications, and finally dive into deep learning approaches for genomics. The book covers all of the important deep learning algorithms commonly used by the research community and goes into the details of what they are, how they work, and their practical applications in genomics. The book dedicates an entire section to operationalizing deep learning models, which will provide the necessary hands-on tutorials for researchers and any deep learning practitioners to build, tune, interpret, deploy, evaluate, and monitor deep learning models from genomics big data sets. By the end of this book, you'll have learned about the challenges, best practices, and pitfalls of deep learning for genomics. What you will learnDiscover the machine learning applications for genomicsExplore deep learning concepts and methodologies for genomics applicationsUnderstand supervised deep learning algorithms for genomics applicationsGet to grips with unsupervised deep learning with autoencodersImprove deep learning models using generative modelsOperationalize deep learning models from genomics datasetsVisualize and interpret deep learning modelsUnderstand deep learning challenges, pitfalls, and best practicesWho this book is for This deep learning book is for machine learning engineers, data scientists, and academicians practicing in the field of genomics. It assumes that readers have intermediate Python programming knowledge, basic knowledge of Python libraries such as NumPy and Pandas to manipulate and parse data, Matplotlib, and Seaborn for visualizing data, along with a base in genomics and genomic analysis concepts.



Journey to Become a Google Cloud Machine Learning Engineer

Author : Dr. Logan Song

Publisher : Packt Publishing Ltd

Page : 330 pages

File Size : 10,14 MB

Release : 2022-09-20

Category : Computers

ISBN : 1803239417

Get eBook

Book Description

Prepare for the GCP ML certification exam along with exploring cloud computing and machine learning concepts and gaining Google Cloud ML skills Key FeaturesA comprehensive yet easy-to-follow Google Cloud machine learning study guideExplore full-spectrum and step-by-step practice examples to develop hands-on skillsRead through and learn from in-depth discussions of Google ML certification exam questionsBook Description This book aims to provide a study guide to learn and master machine learning in Google Cloud: to build a broad and strong knowledge base, train hands-on skills, and get certified as a Google Cloud Machine Learning Engineer. The book is for someone who has the basic Google Cloud Platform (GCP) knowledge and skills, and basic Python programming skills, and wants to learn machine learning in GCP to take their next step toward becoming a Google Cloud Certified Machine Learning professional. The book starts by laying the foundations of Google Cloud Platform and Python programming, followed the by building blocks of machine learning, then focusing on machine learning in Google Cloud, and finally ends the studying for the Google Cloud Machine Learning certification by integrating all the knowledge and skills together. The book is based on the graduate courses the author has been teaching at the University of Texas at Dallas. When going through the chapters, the reader is expected to study the concepts, complete the exercises, understand and practice the labs in the appendices, and study each exam question thoroughly. Then, at the end of the learning journey, you can expect to harvest the knowledge, skills, and a certificate. What you will learnProvision Google Cloud services related to data science and machine learningProgram with the Python programming language and data science librariesUnderstand machine learning concepts and model development processesExplore deep learning concepts and neural networksBuild, train, and deploy ML models with Google BigQuery ML, Keras, and Google Cloud Vertex AIDiscover the Google Cloud ML Application Programming Interface (API)Prepare to achieve Google Cloud Professional Machine Learning Engineer certificationWho this book is for Anyone from the cloud computing, data analytics, and machine learning domains, such as cloud engineers, data scientists, data engineers, ML practitioners, and engineers, will be able to acquire the knowledge and skills and achieve the Google Cloud professional ML Engineer certification with this study guide. Basic knowledge of Google Cloud Platform and Python programming is required to get the most out of this book.



Beginning MLOps with MLFlow

Author : Sridhar Alla

Publisher : Apress

Page : 330 pages

File Size : 32,72 MB

Release : 2020-12-08

Category : Computers

ISBN : 9781484265482

Get eBook

Book Description

Integrate MLOps principles into existing or future projects using MLFlow, operationalize your models, and deploy them in AWS SageMaker, Google Cloud, and Microsoft Azure. ​This book guides you through the process of data analysis, model construction, and training. The authors begin by introducing you to basic data analysis on a credit card data set and teach you how to analyze the features and their relationships to the target variable. You will learn how to build logistic regression models in scikit-learn and PySpark, and you will go through the process of hyperparameter tuning with a validation data set. You will explore three different deployment setups of machine learning models with varying levels of automation to help you better understand MLOps. MLFlow is covered and you will explore how to integrate MLOps into your existing code, allowing you to easily track metrics, parameters, graphs, and models. You will be guided through the process of deploying and querying your models with AWS SageMaker, Google Cloud, and Microsoft Azure. And you will learn how to integrate your MLOps setups using Databricks. What You Will Learn Perform basic data analysis and construct models in scikit-learn and PySpark Train, test, and validate your models (hyperparameter tuning) Know what MLOps is and what an ideal MLOps setup looks like Easily integrate MLFlow into your existing or future projects Deploy your models and perform predictions with them on the cloud Who This Book Is For Data scientists and machine learning engineers who want to learn MLOps and know how to operationalize their models



MLOps Engineering at Scale

Author : Carl Osipov

Publisher : Simon and Schuster

Page : 497 pages

File Size : 19,95 MB

Release : 2022-03-22

Category : Computers

ISBN : 1638356505

Get eBook

Book Description

Dodge costly and time-consuming infrastructure tasks, and rapidly bring your machine learning models to production with MLOps and pre-built serverless tools! In MLOps Engineering at Scale you will learn: Extracting, transforming, and loading datasets Querying datasets with SQL Understanding automatic differentiation in PyTorch Deploying model training pipelines as a service endpoint Monitoring and managing your pipeline’s life cycle Measuring performance improvements MLOps Engineering at Scale shows you how to put machine learning into production efficiently by using pre-built services from AWS and other cloud vendors. You’ll learn how to rapidly create flexible and scalable machine learning systems without laboring over time-consuming operational tasks or taking on the costly overhead of physical hardware. Following a real-world use case for calculating taxi fares, you will engineer an MLOps pipeline for a PyTorch model using AWS server-less capabilities. About the technology A production-ready machine learning system includes efficient data pipelines, integrated monitoring, and means to scale up and down based on demand. Using cloud-based services to implement ML infrastructure reduces development time and lowers hosting costs. Serverless MLOps eliminates the need to build and maintain custom infrastructure, so you can concentrate on your data, models, and algorithms. About the book MLOps Engineering at Scale teaches you how to implement efficient machine learning systems using pre-built services from AWS and other cloud vendors. This easy-to-follow book guides you step-by-step as you set up your serverless ML infrastructure, even if you’ve never used a cloud platform before. You’ll also explore tools like PyTorch Lightning, Optuna, and MLFlow that make it easy to build pipelines and scale your deep learning models in production. What's inside Reduce or eliminate ML infrastructure management Learn state-of-the-art MLOps tools like PyTorch Lightning and MLFlow Deploy training pipelines as a service endpoint Monitor and manage your pipeline’s life cycle Measure performance improvements About the reader Readers need to know Python, SQL, and the basics of machine learning. No cloud experience required. About the author Carl Osipov implemented his first neural net in 2000 and has worked on deep learning and machine learning at Google and IBM. Table of Contents PART 1 - MASTERING THE DATA SET 1 Introduction to serverless machine learning 2 Getting started with the data set 3 Exploring and preparing the data set 4 More exploratory data analysis and data preparation PART 2 - PYTORCH FOR SERVERLESS MACHINE LEARNING 5 Introducing PyTorch: Tensor basics 6 Core PyTorch: Autograd, optimizers, and utilities 7 Serverless machine learning at scale 8 Scaling out with distributed training PART 3 - SERVERLESS MACHINE LEARNING PIPELINE 9 Feature selection 10 Adopting PyTorch Lightning 11 Hyperparameter optimization 12 Machine learning pipeline



Neural Search - From Prototype to Production with Jina

Author : Bo Wang

Publisher : Packt Publishing Ltd

Page : 188 pages

File Size : 24,59 MB

Release : 2022-10-14

Category : Computers

ISBN : 1801818800

Get eBook

Book Description

Implement neural search systems on the cloud by leveraging Jina design patterns Key FeaturesIdentify the different search techniques and discover applications of neural searchGain a solid understanding of vector representation and apply your knowledge in neural searchUnlock deeper levels of knowledge of Jina for neural searchBook Description Search is a big and ever-growing part of the tech ecosystem. Traditional search, however, has limitations that are hard to overcome because of the way it is designed. Neural search is a novel approach that uses the power of machine learning to retrieve information using vector embeddings as first-class citizens, opening up new possibilities of improving the results obtained through traditional search. Although neural search is a powerful tool, it is new and finetuning it can be tedious as it requires you to understand the several components on which it relies. Jina fills this gap by providing an infrastructure that reduces the time and complexity involved in creating deep learning–powered search engines. This book will enable you to learn the fundamentals of neural networks for neural search, its strengths and weaknesses, as well as how to use Jina to build a search engine. With the help of step-by-step explanations, practical examples, and self-assessment questions, you'll become well-versed with the basics of neural search and core Jina concepts, and learn to apply this knowledge to build your own search engine. By the end of this deep learning book, you'll be able to make the most of Jina's neural search design patterns to build an end-to-end search solution for any modality. What you will learnUnderstand how neural search and legacy search workGrasp the machine learning and math fundamentals needed for neural searchGet to grips with the foundation of vector representationExplore the basic components of JinaAnalyze search systems with different modalitiesUncover the capabilities of Jina with the help of practical examplesWho this book is for If you are a machine learning, deep learning, or artificial intelligence engineer interested in building a search system of any kind (text, QA, image, audio, PDF, 3D models, or others) using modern software architecture, this book is for you. This book is perfect for Python engineers who are interested in building a search system of any kind using state-of-the-art deep learning techniques.



Intelligent Document Processing with AWS AI/ML

Author : Sonali Sahu

Publisher : Packt Publishing Ltd

Page : 246 pages

File Size : 39,13 MB

Release : 2022-10-21

Category : Computers

ISBN : 1803233532

Get eBook

Book Description

Build real-world artificial intelligence applications across industries with the help of intelligent document processing Key FeaturesTackle common document processing problems to extract value from any type of documentUnlock deeper levels of insights on IDP in a more structured and accelerated way using AWS AI/MLApply your knowledge to solve real document analysis problems in various industry applicationsBook Description With the volume of data growing exponentially in this digital era, it has become paramount for professionals to process this data in an accelerated and cost-effective manner to get value out of it. Data that organizations receive is usually in raw document format, and being able to process these documents is critical to meeting growing business needs. This book is a comprehensive guide to helping you get to grips with AI/ML fundamentals and their application in document processing use cases. You'll begin by understanding the challenges faced in legacy document processing and discover how you can build end-to-end document processing pipelines with AWS AI services. As you advance, you'll get hands-on experience with popular Python libraries to process and extract insights from documents. This book starts with the basics, taking you through real industry use cases for document processing to deliver value-based care in the healthcare industry and accelerate loan application processing in the financial industry. Throughout the chapters, you'll find out how to apply your skillset to solve practical problems. By the end of this AWS book, you'll have mastered the fundamentals of document processing with machine learning through practical implementation. What you will learnUnderstand the requirements and challenges in deriving insights from a documentExplore common stages in the intelligent document processing pipelineDiscover how AWS AI/ML can successfully automate IDP pipelinesFind out how to write clean and elegant Python code by leveraging AIGet to grips with the concepts and functionalities of AWS AI servicesExplore IDP across industries such as insurance, healthcare, finance, and the public sectorDetermine how to apply business rules in IDPBuild, train, and deploy models with serverless architecture for IDPWho this book is for This book is for technical professionals and thought leaders who want to understand and solve business problems by leveraging insights from their documents. If you want to learn about machine learning and artificial intelligence, and work with real-world use cases such as document processing with technology, this book is for you. To make the most of this book, you should have basic knowledge of AI/ML and python programming concepts. This book is also especially useful for developers looking to explore AI/ML with industry use cases.