Deep Learning-Based Forward Modeling and Inversion Techniques for Computational Physics Problems


Book Description

This book investigates in detail the emerging deep learning (DL) technique in computational physics, assessing its promising potential to substitute conventional numerical solvers for calculating the fields in real-time. After good training, the proposed architecture can resolve both the forward computing and the inverse retrieve problems. Pursuing a holistic perspective, the book includes the following areas. The first chapter discusses the basic DL frameworks. Then, the steady heat conduction problem is solved by the classical U-net in Chapter 2, involving both the passive and active cases. Afterwards, the sophisticated heat flux on a curved surface is reconstructed by the presented Conv-LSTM, exhibiting high accuracy and efficiency. Additionally, a physics-informed DL structure along with a nonlinear mapping module are employed to obtain the space/temperature/time-related thermal conductivity via the transient temperature in Chapter 4. Finally, in Chapter 5, a series of the latest advanced frameworks and the corresponding physics applications are introduced. As deep learning techniques are experiencing vigorous development in computational physics, more people desire related reading materials. This book is intended for graduate students, professional practitioners, and researchers who are interested in DL for computational physics.




Deep Learning For Physics Research


Book Description

A core principle of physics is knowledge gained from data. Thus, deep learning has instantly entered physics and may become a new paradigm in basic and applied research.This textbook addresses physics students and physicists who want to understand what deep learning actually means, and what is the potential for their own scientific projects. Being familiar with linear algebra and parameter optimization is sufficient to jump-start deep learning. Adopting a pragmatic approach, basic and advanced applications in physics research are described. Also offered are simple hands-on exercises for implementing deep networks for which python code and training data can be downloaded.




Deep Learning and Physics


Book Description

What is deep learning for those who study physics? Is it completely different from physics? Or is it similar? In recent years, machine learning, including deep learning, has begun to be used in various physics studies. Why is that? Is knowing physics useful in machine learning? Conversely, is knowing machine learning useful in physics? This book is devoted to answers of these questions. Starting with basic ideas of physics, neural networks are derived naturally. And you can learn the concepts of deep learning through the words of physics. In fact, the foundation of machine learning can be attributed to physical concepts. Hamiltonians that determine physical systems characterize various machine learning structures. Statistical physics given by Hamiltonians defines machine learning by neural networks. Furthermore, solving inverse problems in physics through machine learning and generalization essentially provides progress and even revolutions in physics. For these reasons, in recent years interdisciplinary research in machine learning and physics has been expanding dramatically. This book is written for anyone who wants to learn, understand, and apply the relationship between deep learning/machine learning and physics. All that is needed to read this book are the basic concepts in physics: energy and Hamiltonians. The concepts of statistical mechanics and the bracket notation of quantum mechanics, which are explained in columns, are used to explain deep learning frameworks. We encourage you to explore this new active field of machine learning and physics, with this book as a map of the continent to be explored.




Deep Learning in Computational Mechanics


Book Description

This book provides a first course on deep learning in computational mechanics. The book starts with a short introduction to machine learning’s fundamental concepts before neural networks are explained thoroughly. It then provides an overview of current topics in physics and engineering, setting the stage for the book’s main topics: physics-informed neural networks and the deep energy method. The idea of the book is to provide the basic concepts in a mathematically sound manner and yet to stay as simple as possible. To achieve this goal, mostly one-dimensional examples are investigated, such as approximating functions by neural networks or the simulation of the temperature’s evolution in a one-dimensional bar. Each chapter contains examples and exercises which are either solved analytically or in PyTorch, an open-source machine learning framework for python.




Knowledge Guided Machine Learning


Book Description

Given their tremendous success in commercial applications, machine learning (ML) models are increasingly being considered as alternatives to science-based models in many disciplines. Yet, these "black-box" ML models have found limited success due to their inability to work well in the presence of limited training data and generalize to unseen scenarios. As a result, there is a growing interest in the scientific community on creating a new generation of methods that integrate scientific knowledge in ML frameworks. This emerging field, called scientific knowledge-guided ML (KGML), seeks a distinct departure from existing "data-only" or "scientific knowledge-only" methods to use knowledge and data at an equal footing. Indeed, KGML involves diverse scientific and ML communities, where researchers and practitioners from various backgrounds and application domains are continually adding richness to the problem formulations and research methods in this emerging field. Knowledge Guided Machine Learning: Accelerating Discovery using Scientific Knowledge and Data provides an introduction to this rapidly growing field by discussing some of the common themes of research in KGML using illustrative examples, case studies, and reviews from diverse application domains and research communities as book chapters by leading researchers. KEY FEATURES First-of-its-kind book in an emerging area of research that is gaining widespread attention in the scientific and data science fields Accessible to a broad audience in data science and scientific and engineering fields Provides a coherent organizational structure to the problem formulations and research methods in the emerging field of KGML using illustrative examples from diverse application domains Contains chapters by leading researchers, which illustrate the cutting-edge research trends, opportunities, and challenges in KGML research from multiple perspectives Enables cross-pollination of KGML problem formulations and research methods across disciplines Highlights critical gaps that require further investigation by the broader community of researchers and practitioners to realize the full potential of KGML




Physics of Data Science and Machine Learning


Book Description

Physics of Data Science and Machine Learning links fundamental concepts of physics to data science, machine learning, and artificial intelligence for physicists looking to integrate these techniques into their work. This book is written explicitly for physicists, marrying quantum and statistical mechanics with modern data mining, data science, and machine learning. It also explains how to integrate these techniques into the design of experiments, while exploring neural networks and machine learning, building on fundamental concepts of statistical and quantum mechanics. This book is a self-learning tool for physicists looking to learn how to utilize data science and machine learning in their research. It will also be of interest to computer scientists and applied mathematicians, alongside graduate students looking to understand the basic concepts and foundations of data science, machine learning, and artificial intelligence. Although specifically written for physicists, it will also help provide non-physicists with an opportunity to understand the fundamental concepts from a physics perspective to aid in the development of new and innovative machine learning and artificial intelligence tools. Key Features: Introduces the design of experiments and digital twin concepts in simple lay terms for physicists to understand, adopt, and adapt. Free from endless derivations; instead, equations are presented and it is explained strategically why it is imperative to use them and how they will help in the task at hand. Illustrations and simple explanations help readers visualize and absorb the difficult-to-understand concepts. Ijaz A. Rauf is an adjunct professor at the School of Graduate Studies, York University, Toronto, Canada. He is also an associate researcher at Ryerson University, Toronto, Canada and president of the Eminent-Tech Corporation, Bradford, ON, Canada.




AI for Physics


Book Description

Written in accessible language without mathematical formulas, this short book provides an overview of the wide and varied applications of artificial intelligence (AI) across the spectrum of physical sciences. Focusing in particular on AI's ability to extract patterns from data, known as machine learning (ML), the book includes a chapter on important machine learning algorithms and their respective applications in physics. It then explores the use of ML across a number of important sub-fields in more detail, ranging from particle, molecular and condensed matter physics, to astrophysics, cosmology and the theory of everything. The book covers such applications as the search for new particles and the detection of gravitational waves from the merging of black holes, and concludes by discussing what the future may hold.







The Principles of Deep Learning Theory


Book Description

This volume develops an effective theory approach to understanding deep neural networks of practical relevance.