Fast Algorithms for Structured Matrices


Book Description

One of the best known fast computational algorithms is the fast Fourier transform method. Its efficiency is based mainly on the special structure of the discrete Fourier transform matrix. Recently, many other algorithms of this type were discovered, and the theory of structured matrices emerged. This volume contains 22 survey and research papers devoted to a variety of theoretical and practical aspects of the design of fast algorithms for structured matrices and related issues. Included are several papers containing various affirmative and negative results in this direction. The theory of rational interpolation is one of the excellent sources providing intuition and methods to design fast algorithms. The volume contains several computational and theoretical papers on the topic. There are several papers on new applications of structured matrices, e.g., to the design of fast decoding algorithms, computing state-space realizations, relations to Lie algebras, unconstrained optimization, solving matrix equations, etc. The book is suitable for mathematicians, engineers, and numerical analysts who design, study, and use fast computational algorithms based on the theory of structured matrices.




Fast Reliable Algorithms for Matrices with Structure


Book Description

This book is the first to pay special attention to the combined issues of speed and numerical reliability in algorithm development. These two requirements have often been regarded as competitive, so much so that the design of fast and numerically reliable algorithms for large-scale structured systems of linear equations, in many cases, remains a significant open issue. Fast Reliable Algorithms for Matrices with Structure helps bridge this gap by providing the reader with recent contributions written by leading experts in the field. The authors deal with both the theory and the practice of fast numerical algorithms for large-scale structured linear systems. Each chapter covers in detail different aspects of the most recent trends in the theory of fast algorithms, with emphasis on implementation and application issues. Both direct and iterative methods are covered. This book is not merely a collection of articles. The editors have gone to considerable lengths to blend the individual papers into a consistent presentation. Each chapter exposes the reader to some of the most recent research while providing enough background material to put the work into proper context.




Hierarchical Matrices: Algorithms and Analysis


Book Description

This self-contained monograph presents matrix algorithms and their analysis. The new technique enables not only the solution of linear systems but also the approximation of matrix functions, e.g., the matrix exponential. Other applications include the solution of matrix equations, e.g., the Lyapunov or Riccati equation. The required mathematical background can be found in the appendix. The numerical treatment of fully populated large-scale matrices is usually rather costly. However, the technique of hierarchical matrices makes it possible to store matrices and to perform matrix operations approximately with almost linear cost and a controllable degree of approximation error. For important classes of matrices, the computational cost increases only logarithmically with the approximation error. The operations provided include the matrix inversion and LU decomposition. Since large-scale linear algebra problems are standard in scientific computing, the subject of hierarchical matrices is of interest to scientists in computational mathematics, physics, chemistry and engineering.




Randomized Algorithms for Matrices and Data


Book Description

Randomized Algorithms for Matrices and Data provides a detailed overview, appropriate for both students and researchers from all of these areas, of recent work on the theory of randomized matrix algorithms as well as the application of those ideas to the solution of practical problems in large-scale data analysis




The Random Matrix Theory of the Classical Compact Groups


Book Description

This is the first book to provide a comprehensive overview of foundational results and recent progress in the study of random matrices from the classical compact groups, drawing on the subject's deep connections to geometry, analysis, algebra, physics, and statistics. The book sets a foundation with an introduction to the groups themselves and six different constructions of Haar measure. Classical and recent results are then presented in a digested, accessible form, including the following: results on the joint distributions of the entries; an extensive treatment of eigenvalue distributions, including the Weyl integration formula, moment formulae, and limit theorems and large deviations for the spectral measures; concentration of measure with applications both within random matrix theory and in high dimensional geometry; and results on characteristic polynomials with connections to the Riemann zeta function. This book will be a useful reference for researchers and an accessible introduction for students in related fields.




A Dynamical Approach to Random Matrix Theory


Book Description

A co-publication of the AMS and the Courant Institute of Mathematical Sciences at New York University This book is a concise and self-contained introduction of recent techniques to prove local spectral universality for large random matrices. Random matrix theory is a fast expanding research area, and this book mainly focuses on the methods that the authors participated in developing over the past few years. Many other interesting topics are not included, and neither are several new developments within the framework of these methods. The authors have chosen instead to present key concepts that they believe are the core of these methods and should be relevant for future applications. They keep technicalities to a minimum to make the book accessible to graduate students. With this in mind, they include in this book the basic notions and tools for high-dimensional analysis, such as large deviation, entropy, Dirichlet form, and the logarithmic Sobolev inequality. This manuscript has been developed and continuously improved over the last five years. The authors have taught this material in several regular graduate courses at Harvard, Munich, and Vienna, in addition to various summer schools and short courses. Titles in this series are co-published with the Courant Institute of Mathematical Sciences at New York University.




Asymptotic Statistics


Book Description

This book is an introduction to the field of asymptotic statistics. The treatment is both practical and mathematically rigorous. In addition to most of the standard topics of an asymptotics course, including likelihood inference, M-estimation, the theory of asymptotic efficiency, U-statistics, and rank procedures, the book also presents recent research topics such as semiparametric models, the bootstrap, and empirical processes and their applications. The topics are organized from the central idea of approximation by limit experiments, which gives the book one of its unifying themes. This entails mainly the local approximation of the classical i.i.d. set up with smooth parameters by location experiments involving a single, normally distributed observation. Thus, even the standard subjects of asymptotic statistics are presented in a novel way. Suitable as a graduate or Master s level statistics text, this book will also give researchers an overview of the latest research in asymptotic statistics.




Spectral Algorithms


Book Description

Spectral methods refer to the use of eigenvalues, eigenvectors, singular values and singular vectors. They are widely used in Engineering, Applied Mathematics and Statistics. More recently, spectral methods have found numerous applications in Computer Science to "discrete" as well as "continuous" problems. Spectral Algorithms describes modern applications of spectral methods, and novel algorithms for estimating spectral parameters. The first part of the book presents applications of spectral methods to problems from a variety of topics including combinatorial optimization, learning and clustering. The second part of the book is motivated by efficiency considerations. A feature of many modern applications is the massive amount of input data. While sophisticated algorithms for matrix computations have been developed over a century, a more recent development is algorithms based on "sampling on the fly" from massive matrices. Good estimates of singular values and low rank approximations of the whole matrix can be provably derived from a sample. The main emphasis in the second part of the book is to present these sampling methods with rigorous error bounds. It also presents recent extensions of spectral methods from matrices to tensors and their applications to some combinatorial optimization problems.




Matrix Methods: Theory, Algorithms And Applications - Dedicated To The Memory Of Gene Golub


Book Description

Compared to other books devoted to matrices, this volume is unique in covering the whole of a triptych consisting of algebraic theory, algorithmic problems and numerical applications, all united by the essential use and urge for development of matrix methods. This was the spirit of the 2nd International Conference on Matrix Methods and Operator Equations from 23-27 July 2007 in Moscow that was organized by Dario Bini, Gene Golub, Alexander Guterman, Vadim Olshevsky, Stefano Serra-Capizzano, Gilbert Strang and Eugene Tyrtyshnikov.Matrix methods provide the key to many problems in pure and applied mathematics. However, linear algebra theory, numerical algorithms and matrices in FEM/BEM applications usually live as if in three separate worlds. In this volume, maybe for the first time ever, they are compiled together as one entity as it was at the Moscow meeting, where the algebraic part was impersonated by Hans Schneider, algorithms by Gene Golub, and applications by Guri Marchuk. All topics intervened in plenary sessions are specially categorized into three sections of this volume.The soul of the meeting was Gene Golub, who rendered a charming “Golub's dimension” to the three main axes of the conference topics. This volume is dedicated in gratitude to his memory.




Toeplitz Operators and Random Matrices


Book Description

This volume is dedicated to the memory of Harold Widom (1932–2021), an outstanding mathematician who has enriched mathematics with his ideas and ground breaking work since the 1950s until the present time. It contains a biography of Harold Widom, personal notes written by his former students or colleagues, and also his last, previously unpublished paper on domain walls in a Heisenberg–Ising chain. Widom's most famous contributions were made to Toeplitz operators and random matrices. While his work on random matrices is part of almost all the present-day research activities in this field, his work in Toeplitz operators and matrices was done mainly before 2000 and is therefore described in a contribution devoted to his achievements in just this area. The volume contains 18 invited and refereed research and expository papers on Toeplitz operators and random matrices. These present new results or new perspectives on topics related to Widom's work.