Advanced Deep Learning for Engineers and Scientists


Book Description

This book provides a complete illustration of deep learning concepts with case-studies and practical examples useful for real time applications. This book introduces a broad range of topics in deep learning. The authors start with the fundamentals, architectures, tools needed for effective implementation for scientists. They then present technical exposure towards deep learning using Keras, Tensorflow, Pytorch and Python. They proceed with advanced concepts with hands-on sessions for deep learning. Engineers, scientists, researches looking for a practical approach to deep learning will enjoy this book. Presents practical basics to advanced concepts in deep learning and how to apply them through various projects; Discusses topics such as deep learning in smart grids and renewable energy & sustainable development; Explains how to implement advanced techniques in deep learning using Pytorch, Keras, Python programming.




Machine Learning


Book Description

"This book introduces machine learning for readers with some background in basic linear algebra, statistics, probability, and programming. In a coherent statistical framework it covers a selection of supervised machine learning methods, from the most fundamental (k-NN, decision trees, linear and logistic regression) to more advanced methods (deep neural networks, support vector machines, Gaussian processes, random forests and boosting), plus commonly-used unsupervised methods (generative modeling, k-means, PCA, autoencoders and generative adversarial networks). Careful explanations and pseudo-code are presented for all methods. The authors maintain a focus on the fundamentals by drawing connections between methods and discussing general concepts such as loss functions, maximum likelihood, the bias-variance decomposition, ensemble averaging, kernels and the Bayesian approach along with generally useful tools such as regularization, cross validation, evaluation metrics and optimization methods. The final chapters offer practical advice for solving real-world supervised machine learning problems and on ethical aspects of modern machine learning"--




Data-Driven Science and Engineering


Book Description

A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.




Deep Learning in Science


Book Description

Rigorous treatment of the theory of deep learning from first principles, with applications to beautiful problems in the natural sciences.




Advanced Deep Learning with Python


Book Description

Gain expertise in advanced deep learning domains such as neural networks, meta-learning, graph neural networks, and memory augmented neural networks using the Python ecosystem Key FeaturesGet to grips with building faster and more robust deep learning architecturesInvestigate and train convolutional neural network (CNN) models with GPU-accelerated libraries such as TensorFlow and PyTorchApply deep neural networks (DNNs) to computer vision problems, NLP, and GANsBook Description In order to build robust deep learning systems, you’ll need to understand everything from how neural networks work to training CNN models. In this book, you’ll discover newly developed deep learning models, methodologies used in the domain, and their implementation based on areas of application. You’ll start by understanding the building blocks and the math behind neural networks, and then move on to CNNs and their advanced applications in computer vision. You'll also learn to apply the most popular CNN architectures in object detection and image segmentation. Further on, you’ll focus on variational autoencoders and GANs. You’ll then use neural networks to extract sophisticated vector representations of words, before going on to cover various types of recurrent networks, such as LSTM and GRU. You’ll even explore the attention mechanism to process sequential data without the help of recurrent neural networks (RNNs). Later, you’ll use graph neural networks for processing structured data, along with covering meta-learning, which allows you to train neural networks with fewer training samples. Finally, you’ll understand how to apply deep learning to autonomous vehicles. By the end of this book, you’ll have mastered key deep learning concepts and the different applications of deep learning models in the real world. What you will learnCover advanced and state-of-the-art neural network architecturesUnderstand the theory and math behind neural networksTrain DNNs and apply them to modern deep learning problemsUse CNNs for object detection and image segmentationImplement generative adversarial networks (GANs) and variational autoencoders to generate new imagesSolve natural language processing (NLP) tasks, such as machine translation, using sequence-to-sequence modelsUnderstand DL techniques, such as meta-learning and graph neural networksWho this book is for This book is for data scientists, deep learning engineers and researchers, and AI developers who want to further their knowledge of deep learning and build innovative and unique deep learning projects. Anyone looking to get to grips with advanced use cases and methodologies adopted in the deep learning domain using real-world examples will also find this book useful. Basic understanding of deep learning concepts and working knowledge of the Python programming language is assumed.




Probabilistic Machine Learning for Civil Engineers


Book Description

An introduction to key concepts and techniques in probabilistic machine learning for civil engineering students and professionals; with many step-by-step examples, illustrations, and exercises. This book introduces probabilistic machine learning concepts to civil engineering students and professionals, presenting key approaches and techniques in a way that is accessible to readers without a specialized background in statistics or computer science. It presents different methods clearly and directly, through step-by-step examples, illustrations, and exercises. Having mastered the material, readers will be able to understand the more advanced machine learning literature from which this book draws. The book presents key approaches in the three subfields of probabilistic machine learning: supervised learning, unsupervised learning, and reinforcement learning. It first covers the background knowledge required to understand machine learning, including linear algebra and probability theory. It goes on to present Bayesian estimation, which is behind the formulation of both supervised and unsupervised learning methods, and Markov chain Monte Carlo methods, which enable Bayesian estimation in certain complex cases. The book then covers approaches associated with supervised learning, including regression methods and classification methods, and notions associated with unsupervised learning, including clustering, dimensionality reduction, Bayesian networks, state-space models, and model calibration. Finally, the book introduces fundamental concepts of rational decisions in uncertain contexts and rational decision-making in uncertain and sequential contexts. Building on this, the book describes the basics of reinforcement learning, whereby a virtual agent learns how to make optimal decisions through trial and error while interacting with its environment.




Applied Artificial Neural Network Methods For Engineers And Scientists: Solving Algebraic Equations


Book Description

The aim of this book is to handle different application problems of science and engineering using expert Artificial Neural Network (ANN). As such, the book starts with basics of ANN along with different mathematical preliminaries with respect to algebraic equations. Then it addresses ANN based methods for solving different algebraic equations viz. polynomial equations, diophantine equations, transcendental equations, system of linear and nonlinear equations, eigenvalue problems etc. which are the basic equations to handle the application problems mentioned in the content of the book. Although there exist various methods to handle these problems, but sometimes those may be problem dependent and may fail to give a converge solution with particular discretization. Accordingly, ANN based methods have been addressed here to solve these problems. Detail ANN architecture with step by step procedure and algorithm have been included. Different example problems are solved with respect to various application and mathematical problems. Convergence plots and/or convergence tables of the solutions are depicted to show the efficacy of these methods. It is worth mentioning that various application problems viz. Bakery problem, Power electronics applications, Pole placement, Electrical Network Analysis, Structural engineering problem etc. have been solved using the ANN based methods.




Deep Learning


Book Description

An introduction to a broad range of topics in deep learning, covering mathematical and conceptual background, deep learning techniques used in industry, and research perspectives. “Written by three experts in the field, Deep Learning is the only comprehensive book on the subject.” —Elon Musk, cochair of OpenAI; cofounder and CEO of Tesla and SpaceX Deep learning is a form of machine learning that enables computers to learn from experience and understand the world in terms of a hierarchy of concepts. Because the computer gathers knowledge from experience, there is no need for a human computer operator to formally specify all the knowledge that the computer needs. The hierarchy of concepts allows the computer to learn complicated concepts by building them out of simpler ones; a graph of these hierarchies would be many layers deep. This book introduces a broad range of topics in deep learning. The text offers mathematical and conceptual background, covering relevant concepts in linear algebra, probability theory and information theory, numerical computation, and machine learning. It describes deep learning techniques used by practitioners in industry, including deep feedforward networks, regularization, optimization algorithms, convolutional networks, sequence modeling, and practical methodology; and it surveys such applications as natural language processing, speech recognition, computer vision, online recommendation systems, bioinformatics, and videogames. Finally, the book offers research perspectives, covering such theoretical topics as linear factor models, autoencoders, representation learning, structured probabilistic models, Monte Carlo methods, the partition function, approximate inference, and deep generative models. Deep Learning can be used by undergraduate or graduate students planning careers in either industry or research, and by software engineers who want to begin using deep learning in their products or platforms. A website offers supplementary material for both readers and instructors.




Grokking Deep Learning


Book Description

Summary Grokking Deep Learning teaches you to build deep learning neural networks from scratch! In his engaging style, seasoned deep learning expert Andrew Trask shows you the science under the hood, so you grok for yourself every detail of training neural networks. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the Technology Deep learning, a branch of artificial intelligence, teaches computers to learn by using neural networks, technology inspired by the human brain. Online text translation, self-driving cars, personalized product recommendations, and virtual voice assistants are just a few of the exciting modern advancements possible thanks to deep learning. About the Book Grokking Deep Learning teaches you to build deep learning neural networks from scratch! In his engaging style, seasoned deep learning expert Andrew Trask shows you the science under the hood, so you grok for yourself every detail of training neural networks. Using only Python and its math-supporting library, NumPy, you'll train your own neural networks to see and understand images, translate text into different languages, and even write like Shakespeare! When you're done, you'll be fully prepared to move on to mastering deep learning frameworks. What's inside The science behind deep learning Building and training your own neural networks Privacy concepts, including federated learning Tips for continuing your pursuit of deep learning About the Reader For readers with high school-level math and intermediate programming skills. About the Author Andrew Trask is a PhD student at Oxford University and a research scientist at DeepMind. Previously, Andrew was a researcher and analytics product manager at Digital Reasoning, where he trained the world's largest artificial neural network and helped guide the analytics roadmap for the Synthesys cognitive computing platform. Table of Contents Introducing deep learning: why you should learn it Fundamental concepts: how do machines learn? Introduction to neural prediction: forward propagation Introduction to neural learning: gradient descent Learning multiple weights at a time: generalizing gradient descent Building your first deep neural network: introduction to backpropagation How to picture neural networks: in your head and on paper Learning signal and ignoring noise:introduction to regularization and batching Modeling probabilities and nonlinearities: activation functions Neural learning about edges and corners: intro to convolutional neural networks Neural networks that understand language: king - man + woman == ? Neural networks that write like Shakespeare: recurrent layers for variable-length data Introducing automatic optimization: let's build a deep learning framework Learning to write like Shakespeare: long short-term memory Deep learning on unseen data: introducing federated learning Where to go from here: a brief guide




Machine Learning for Engineers


Book Description

All engineers and applied scientists will need to harness the power of machine learning to solve the highly complex and data intensive problems now emerging. This text teaches state-of-the-art machine learning technologies to students and practicing engineers from the traditionally “analog” disciplines—mechanical, aerospace, chemical, nuclear, and civil. Dr. McClarren examines these technologies from an engineering perspective and illustrates their specific value to engineers by presenting concrete examples based on physical systems. The book proceeds from basic learning models to deep neural networks, gradually increasing readers’ ability to apply modern machine learning techniques to their current work and to prepare them for future, as yet unknown, problems. Rather than taking a black box approach, the author teaches a broad range of techniques while conveying the kinds of problems best addressed by each. Examples and case studies in controls, dynamics, heat transfer, and other engineering applications are implemented in Python and the libraries scikit-learn and tensorflow, demonstrating how readers can apply the most up-to-date methods to their own problems. The book equally benefits undergraduate engineering students who wish to acquire the skills required by future employers, and practicing engineers who wish to expand and update their problem-solving toolkit.