Introduction to Tensor Network Methods


Book Description

This volume of lecture notes briefly introduces the basic concepts needed in any computational physics course: software and hardware, programming skills, linear algebra, and differential calculus. It then presents more advanced numerical methods to tackle the quantum many-body problem: it reviews the numerical renormalization group and then focuses on tensor network methods, from basic concepts to gauge invariant ones. Finally, in the last part, the author presents some applications of tensor network methods to equilibrium and out-of-equilibrium correlated quantum matter. The book can be used for a graduate computational physics course. After successfully completing such a course, a student should be able to write a tensor network program and can begin to explore the physics of many-body quantum systems. The book can also serve as a reference for researchers working or starting out in the field.




Tensor Network Contractions


Book Description

Tensor network is a fundamental mathematical tool with a huge range of applications in physics, such as condensed matter physics, statistic physics, high energy physics, and quantum information sciences. This open access book aims to explain the tensor network contraction approaches in a systematic way, from the basic definitions to the important applications. This book is also useful to those who apply tensor networks in areas beyond physics, such as machine learning and the big-data analysis. Tensor network originates from the numerical renormalization group approach proposed by K. G. Wilson in 1975. Through a rapid development in the last two decades, tensor network has become a powerful numerical tool that can efficiently simulate a wide range of scientific problems, with particular success in quantum many-body physics. Varieties of tensor network algorithms have been proposed for different problems. However, the connections among different algorithms are not well discussed or reviewed. To fill this gap, this book explains the fundamental concepts and basic ideas that connect and/or unify different strategies of the tensor network contraction algorithms. In addition, some of the recent progresses in dealing with tensor decomposition techniques and quantum simulations are also represented in this book to help the readers to better understand tensor network. This open access book is intended for graduated students, but can also be used as a professional book for researchers in the related fields. To understand most of the contents in the book, only basic knowledge of quantum mechanics and linear algebra is required. In order to fully understand some advanced parts, the reader will need to be familiar with notion of condensed matter physics and quantum information, that however are not necessary to understand the main parts of the book. This book is a good source for non-specialists on quantum physics to understand tensor network algorithms and the related mathematics.







Tensor Spaces and Numerical Tensor Calculus


Book Description

Special numerical techniques are already needed to deal with n × n matrices for large n. Tensor data are of size n × n ×...× n=nd, where nd exceeds the computer memory by far. They appear for problems of high spatial dimensions. Since standard methods fail, a particular tensor calculus is needed to treat such problems. This monograph describes the methods by which tensors can be practically treated and shows how numerical operations can be performed. Applications include problems from quantum chemistry, approximation of multivariate functions, solution of partial differential equations, for example with stochastic coefficients, and more. In addition to containing corrections of the unavoidable misprints, this revised second edition includes new parts ranging from single additional statements to new subchapters. The book is mainly addressed to numerical mathematicians and researchers working with high-dimensional data. It also touches problems related to Geometric Algebra.




Tensors: Geometry and Applications


Book Description

Tensors are ubiquitous in the sciences. The geometry of tensors is both a powerful tool for extracting information from data sets, and a beautiful subject in its own right. This book has three intended uses: a classroom textbook, a reference work for researchers in the sciences, and an account of classical and modern results in (aspects of) the theory that will be of interest to researchers in geometry. For classroom use, there is a modern introduction to multilinear algebra and to the geometry and representation theory needed to study tensors, including a large number of exercises. For researchers in the sciences, there is information on tensors in table format for easy reference and a summary of the state of the art in elementary language. This is the first book containing many classical results regarding tensors. Particular applications treated in the book include the complexity of matrix multiplication, P versus NP, signal processing, phylogenetics, and algebraic statistics. For geometers, there is material on secant varieties, G-varieties, spaces with finitely many orbits and how these objects arise in applications, discussions of numerous open questions in geometry arising in applications, and expositions of advanced topics such as the proof of the Alexander-Hirschowitz theorem and of the Weyman-Kempf method for computing syzygies.




Tensors for Data Processing


Book Description

Tensors for Data Processing: Theory, Methods and Applications presents both classical and state-of-the-art methods on tensor computation for data processing, covering computation theories, processing methods, computing and engineering applications, with an emphasis on techniques for data processing. This reference is ideal for students, researchers and industry developers who want to understand and use tensor-based data processing theories and methods. As a higher-order generalization of a matrix, tensor-based processing can avoid multi-linear data structure loss that occurs in classical matrix-based data processing methods. This move from matrix to tensors is beneficial for many diverse application areas, including signal processing, computer science, acoustics, neuroscience, communication, medical engineering, seismology, psychometric, chemometrics, biometric, quantum physics and quantum chemistry. - Provides a complete reference on classical and state-of-the-art tensor-based methods for data processing - Includes a wide range of applications from different disciplines - Gives guidance for their application




Tensor Networks for Dimensionality Reduction and Large-scale Optimization


Book Description

Modern applications in engineering and data science are increasingly based on multidimensional data of exceedingly high volume, variety, and structural richness. However, standard machine learning algorithms typically scale exponentially with data volume and complexity of cross-modal couplings - the so called curse of dimensionality - which is prohibitive to the analysis of large-scale, multi-modal and multi-relational datasets. Given that such data are often efficiently represented as multiway arrays or tensors, it is therefore timely and valuable for the multidisciplinary machine learning and data analytic communities to review low-rank tensor decompositions and tensor networks as emerging tools for dimensionality reduction and large scale optimization problems. Our particular emphasis is on elucidating that, by virtue of the underlying low-rank approximations, tensor networks have the ability to alleviate the curse of dimensionality in a number of applied areas. In Part 1 of this monograph we provide innovative solutions to low-rank tensor network decompositions and easy to interpret graphical representations of the mathematical operations on tensor networks. Such a conceptual insight allows for seamless migration of ideas from the flat-view matrices to tensor network operations and vice versa, and provides a platform for further developments, practical applications, and non-Euclidean extensions. It also permits the introduction of various tensor network operations without an explicit notion of mathematical expressions, which may be beneficial for many research communities that do not directly rely on multilinear algebra. Our focus is on the Tucker and tensor train (TT) decompositions and their extensions, and on demonstrating the ability of tensor networks to provide linearly or even super-linearly (e.g., logarithmically) scalable solutions, as illustrated in detail in Part 2 of this monograph.




Holographic Entanglement Entropy


Book Description

This book provides a comprehensive overview of developments in the field of holographic entanglement entropy. Within the context of the AdS/CFT correspondence, it is shown how quantum entanglement is computed by the area of certain extremal surfaces. The general lessons one can learn from this connection are drawn out for quantum field theories, many-body physics, and quantum gravity. An overview of the necessary background material is provided together with a flavor of the exciting open questions that are currently being discussed. The book is divided into four main parts. In the first part, the concept of entanglement, and methods for computing it, in quantum field theories is reviewed. In the second part, an overview of the AdS/CFT correspondence is given and the holographic entanglement entropy prescription is explained. In the third part, the time-dependence of entanglement entropy in out-of-equilibrium systems, and applications to many body physics are explored using holographic methods. The last part focuses on the connection between entanglement and geometry. Known constraints on the holographic map, as well as, elaboration of entanglement being a fundamental building block of geometry are explained. The book is a useful resource for researchers and graduate students interested in string theory and holography, condensed matter and quantum information, as it tries to connect these different subjects linked by the common theme of quantum entanglement.




Quantum Chemistry and Dynamics of Excited States


Book Description

An introduction to the rapidly evolving methodology of electronic excited states For academic researchers, postdocs, graduate and undergraduate students, Quantum Chemistry and Dynamics of Excited States: Methods and Applications reports the most updated and accurate theoretical techniques to treat electronic excited states. From methods to deal with stationary calculations through time-dependent simulations of molecular systems, this book serves as a guide for beginners in the field and knowledge seekers alike. Taking into account the most recent theory developments and representative applications, it also covers the often-overlooked gap between theoretical and computational chemistry. An excellent reference for both researchers and students, Excited States provides essential knowledge on quantum chemistry, an in-depth overview of the latest developments, and theoretical techniques around the properties and nonadiabatic dynamics of chemical systems. Readers will learn: ● Essential theoretical techniques to describe the properties and dynamics of chemical systems ● Electronic Structure methods for stationary calculations ● Methods for electronic excited states from both a quantum chemical and time-dependent point of view ● A breakdown of the most recent developments in the past 30 years For those searching for a better understanding of excited states as they relate to chemistry, biochemistry, industrial chemistry, and beyond, Quantum Chemistry and Dynamics of Excited States provides a solid education in the necessary foundations and important theories of excited states in photochemistry and ultrafast phenomena.




An Introduction to Neural Network Methods for Differential Equations


Book Description

This book introduces a variety of neural network methods for solving differential equations arising in science and engineering. The emphasis is placed on a deep understanding of the neural network techniques, which has been presented in a mostly heuristic and intuitive manner. This approach will enable the reader to understand the working, efficiency and shortcomings of each neural network technique for solving differential equations. The objective of this book is to provide the reader with a sound understanding of the foundations of neural networks and a comprehensive introduction to neural network methods for solving differential equations together with recent developments in the techniques and their applications. The book comprises four major sections. Section I consists of a brief overview of differential equations and the relevant physical problems arising in science and engineering. Section II illustrates the history of neural networks starting from their beginnings in the 1940s through to the renewed interest of the 1980s. A general introduction to neural networks and learning technologies is presented in Section III. This section also includes the description of the multilayer perceptron and its learning methods. In Section IV, the different neural network methods for solving differential equations are introduced, including discussion of the most recent developments in the field. Advanced students and researchers in mathematics, computer science and various disciplines in science and engineering will find this book a valuable reference source.