Introduction to Large Truncated Toeplitz Matrices


Book Description

Applying functional analysis and operator theory to some concrete asymptotic problems of linear algebra, this book contains results on the stability of projection methods, deals with asymptotic inverses and Moore-Penrose inversion of large Toeplitz matrices, and embarks on the asymptotic behaviour of the norms of inverses, the pseudospectra, the singular values, and the eigenvalues of large Toeplitz matrices. The approach is heavily based on Banach algebra techniques and nicely demonstrates the usefulness of C*-algebras and local principles in numerical analysis, including classical topics as well as results and methods from the last few years. Though employing modern tools, the exposition is elementary and points out the mathematical background behind some interesting phenomena encountered with large Toeplitz matrices. Accessible to readers with basic knowledge in functional analysis, the book addresses graduates, teachers, and researchers and should be of interest to everyone who has to deal with infinite matrices (Toeplitz or not) and their large truncations.




Toeplitz and Circulant Matrices


Book Description

The fundamental theorems on the asymptotic behavior of eigenvalues, inverses, and products of banded Toeplitz matrices and Toeplitz matrices with absolutely summable elements are derived in a tutorial manner. Mathematical elegance and generality are sacrificed for conceptual simplicity and insight in the hope of making these results available to engineers lacking either the background or endurance to attack the mathematical literature on the subject. By limiting the generality of the matrices considered, the essential ideas and results can be conveyed in a more intuitive manner without the mathematical machinery required for the most general cases. As an application the results are applied to the study of the covariance matrices and their factors of linear models of discrete time random processes. The fundamental theorems on the asymptotic behavior of eigenvalues, inverses, and products of banded Toeplitz matrices and Toeplitz matrices with absolutely summable elements are derived in a tutorial manner. Mathematical elegance and generality are sacrificed for conceptual simplicity and insight in the hope of making these results available to engineers lacking either the background or endurance to attack the mathematical literature on the subject. By limiting the generality of the matrices considered, the essential ideas and results can be conveyed in a more intuitive manner without the mathematical machinery required for the most general cases. As an application the results are applied to the study of the covariance matrices and their factors of linear models of discrete time random processes.




Block Toeplitz Matrices


Book Description

Block Toeplitz Matrices: Asymptotic Results and Applications provides a tutorial introduction and in-depth expose of this important mathematical technique used in Communications, Information Theory, and Signal Processing. The matrix representations of discrete-time causal finite impulse response (FIR), multiple-input multiple-output (MIMO) filters, and correlation matrices of vector wide sense stationary (WSS) processes are all block Toeplitz. The monograph deals with the asymptotic behaviour of eigenvalues, products and inverses of block Toeplitz matrices, with the concept of asymptotically equivalent sequences of matrices being the key concept. However, since the blocks of block Toeplitz matrices are, in general, not square, the definition of asymptotically equivalent sequences of matrices are extended to sequences of non-square matrices. Furthermore, the monograph covers any function of block Toeplitz matrices and considers block Toeplitz matrices generated by the Fourier coefficients of any continuous matrix-valued function. Block Toeplitz Matrices is an advanced level tutorial on a mathematical technique with applications in many engineering disciplines.




Spectra and Pseudospectra


Book Description

Pure and applied mathematicians, physicists, scientists, and engineers use matrices and operators and their eigenvalues in quantum mechanics, fluid mechanics, structural analysis, acoustics, ecology, numerical analysis, and many other areas. However, in some applications the usual analysis based on eigenvalues fails. For example, eigenvalues are often ineffective for analyzing dynamical systems such as fluid flow, Markov chains, ecological models, and matrix iterations. That's where this book comes in. This is the authoritative work on nonnormal matrices and operators, written by the authorities who made them famous. Each of the sixty sections is written as a self-contained essay. Each document is a lavishly illustrated introductory survey of its topic, complete with beautiful numerical experiments and all the right references. The breadth of included topics and the numerous applications that provide links between fields will make this an essential reference in mathematics and related sciences.




High Performance Algorithms to Solve Toeplitz and Block Toeplitz Matrices


Book Description

Fast algorithms to factor Toeplitz matrices have existed since the beginning of this century. The two most notable algorithms to factor Toeplitz matrices are the Schur and the Levinson-Durbin. The former factors the Toeolitz matrix itself while the latter factors the inverse. In this thesis, we present several high performance variants of the classical Schur algorithm to factor various Toeplitz matrices. For positive definite block Toeplitz matrices, we show how hyperbolic Householder transformations may be blocked to yield a block Schur algorithm. This algorithm uses BLAS3 primitives and makes efficient use of a memory hierarchy. We present three algorithms for indefinite Toeplitz matrices. Two of these are based on look-ahead strategies and produce an exact factorization of the Toeplitz matrix. The third produces an inexact factorization via perturbations of singular principal minors. We also present an analysis of the numerical behavior of the third algorithm and derive a bound for the number of iterations to improve the accuracy of the solution. Recently, there have been several algorithms suggested to incorporate pivoting into the factorization of indefinite Toeplitz matrices by converting them to Cauchy-like matrices. We compare these algorithms from a computational standpoint and suggest a few algorithms that exploit properties such as realness and symmetry in the Toeplitz matrix while converting them to Cauchy-like matrices. In particular, we show how a Hermitian Toeplitz matrix may be converted to a real symmetric Cauchy-like matrix prior to factorization, yielding substantial savings in computation. For rank-deficient Toeplitz least-squares problems, we present a variant of the generalized Schur algorithm that avoids breakdown due to an exact rank deficiency. In the presence of a near rank deficiency, an approximate rank factorization of the Toeplitz matrix is produced. Algorithms to solve real Toeplitz least-squares problems and to obtain rank-revealing QR factorizations of real Toeplitz matrices are also presented. We demonstrate the use of the Schur algorithm in the construction of preconditioners to solve the problem of image deconvolution.




Generalized Locally Toeplitz Sequences: Theory and Applications


Book Description

Based on their research experience, the authors propose a reference textbook in two volumes on the theory of generalized locally Toeplitz sequences and their applications. This first volume focuses on the univariate version of the theory and the related applications in the unidimensional setting, while the second volume, which addresses the multivariate case, is mainly devoted to concrete PDE applications. This book systematically develops the theory of generalized locally Toeplitz (GLT) sequences and presents some of its main applications, with a particular focus on the numerical discretization of differential equations (DEs). It is the first book to address the relatively new field of GLT sequences, which occur in numerous scientific applications and are especially dominant in the context of DE discretizations. Written for applied mathematicians, engineers, physicists, and scientists who (perhaps unknowingly) encounter GLT sequences in their research, it is also of interest to those working in the fields of Fourier and functional analysis, spectral analysis of DE discretization matrices, matrix analysis, measure and operator theory, numerical analysis and linear algebra. Further, it can be used as a textbook for a graduate or advanced undergraduate course in numerical analysis.







An Introduction to Iterative Toeplitz Solvers


Book Description

Toeplitz systems arise in a variety of applications in mathematics, scientific computing, and engineering, including numerical partial and ordinary differential equations, numerical solutions of convolution-type integral equations, stationary autoregressive time series in statistics, minimal realization problems in control theory, system identification problems in signal processing, and image restoration problems in image processing.




Developments and Applications of Block Toeplitz Iterative Solvers


Book Description

This volume contains the latest developments in the use of iterative methods to block Toeplitz systems. These systems arise in a variety of applications in mathematics, scientific computing, and engineering, such as image processing, numerical differential equations and integral equations, time series analysis, and control theory. Iterative methods such as Krylov subspace methods and multigrid methods are proposed to solve block Toeplitz systems. One of the main advantages of these iterative methods is that the operation cost of solving a large class of mn × mn block Toeplitz systems only requires O (mn log mn) operations. This book is the first book on Toeplitz iterative solvers and it includes recent research results. The author belongs to one of the most important groups in the field of structured matrix computation. The book is accessible to readers with a working knowledge of numerical linear algebra. It should be of interest to everyone who deals with block Toeplitz systems, numerical linear algebra, partial differential equations, ordinary differential equations, image processing, and approximation theory.




Analysis of Toeplitz Operators


Book Description

A revised introduction to the advanced analysis of block Toeplitz operators including recent research. This book builds on the success of the first edition which has been used as a standard reference for fifteen years. Topics range from the analysis of locally sectorial matrix functions to Toeplitz and Wiener-Hopf determinants. This will appeal to both graduate students and specialists in the theory of Toeplitz operators.