Matrix Inequalities for Iterative Systems


Book Description

The book reviews inequalities for weighted entry sums of matrix powers. Applications range from mathematics and CS to pure sciences. It unifies and generalizes several results for products and powers of sesquilinear forms derived from powers of Hermitian, positive-semidefinite, as well as nonnegative matrices. It shows that some inequalities are valid only in specific cases. How to translate the Hermitian matrix results into results for alternating powers of general rectangular matrices? Inequalities that compare the powers of the row and column sums to the row and column sums of the matrix powers are refined for nonnegative matrices. Lastly, eigenvalue bounds and derive results for iterated kernels are improved.




Iterative Solution Methods


Book Description

This book deals primarily with the numerical solution of linear systems of equations by iterative methods. The first part of the book is intended to serve as a textbook for a numerical linear algebra course. The material assumes the reader has a basic knowledge of linear algebra, such as set theory and matrix algebra, however it is demanding for students who are not afraid of theory. To assist the reader, the more difficult passages have been marked, the definitions for each chapter are collected at the beginning of the chapter, and numerous exercises are included throughout the text. The second part of the book serves as a monograph introducing recent results in the iterative solution of linear systems, mainly using preconditioned conjugate gradient methods. This book should be a valuable resource for students and researchers alike wishing to learn more about iterative methods.




Iterative Methods for Sparse Linear Systems


Book Description

Since the first edition of this book was published in 1996, tremendous progress has been made in the scientific and engineering disciplines regarding the use of iterative methods for linear systems. The size and complexity of the new generation of linear and nonlinear systems arising in typical applications has grown. Solving the three-dimensional models of these problems using direct solvers is no longer effective. At the same time, parallel computing has penetrated these application areas as it became less expensive and standardized. Iterative methods are easier than direct solvers to implement on parallel computers but require approaches and solution algorithms that are different from classical methods. Iterative Methods for Sparse Linear Systems, Second Edition gives an in-depth, up-to-date view of practical algorithms for solving large-scale linear systems of equations. These equations can number in the millions and are sparse in the sense that each involves only a small number of unknowns. The methods described are iterative, i.e., they provide sequences of approximations that will converge to the solution.




Linear Matrix Inequalities in System and Control Theory


Book Description

In this book the authors reduce a wide variety of problems arising in system and control theory to a handful of convex and quasiconvex optimization problems that involve linear matrix inequalities. These optimization problems can be solved using recently developed numerical algorithms that not only are polynomial-time but also work very well in practice; the reduction therefore can be considered a solution to the original problems. This book opens up an important new research area in which convex optimization is combined with system and control theory, resulting in the solution of a large number of previously unsolved problems.




Iterative Solution of Symmetric Quasi-definite Linear Systems


Book Description

Numerous applications, including computational optimization and fluid dynamics, give rise to block linear systems of equations said to have the quasi-definite structure. In practical situations, the size or density of those systems can preclude a factorization approach, leaving only iterative methods as the solution technique. Known iterative methods, however, are not specifically designed to take advantage of the quasi-definite structure.? This book discusses the connection between quasi-definite systems and linear least-squares problems, the most common and best understood problems in applied mathematics, and explains how quasi-definite systems can be solved using tailored iterative methods for linear least squares (with half as much work!). To encourage researchers and students to use the software, it is provided in MATLAB, Python, and Julia.? The authors provide a concise account of the most well-known methods for symmetric systems and least-squares problems, research-level advances in the solution of problems with specific illustrations in optimization and fluid dynamics, and a website that hosts software in three languages.?




Iterative Solution of Large Linear Systems


Book Description

Iterative Solution of Large Linear Systems describes the systematic development of a substantial portion of the theory of iterative methods for solving large linear systems, with emphasis on practical techniques. The focal point of the book is an analysis of the convergence properties of the successive overrelaxation (SOR) method as applied to a linear system where the matrix is "consistently ordered". Comprised of 18 chapters, this volume begins by showing how the solution of a certain partial differential equation by finite difference methods leads to a large linear system with a sparse matrix. The next chapter reviews matrix theory and the properties of matrices, as well as several theorems of matrix theory without proof. A number of iterative methods, including the SOR method, are then considered. Convergence theorems are also given for various iterative methods under certain assumptions on the matrix A of the system. Subsequent chapters deal with the eigenvalues of the SOR method for consistently ordered matrices; the optimum relaxation factor; nonstationary linear iterative methods; and semi-iterative methods. This book will be of interest to students and practitioners in the fields of computer science and applied mathematics.




Matrix Iterative Analysis


Book Description

This book is a revised version of the first edition, regarded as a classic in its field. In some places, newer research results have been incorporated in the revision, and in other places, new material has been added to the chapters in the form of additional up-to-date references and some recent theorems to give readers some new directions to pursue.




Iterative Methods for Linear Systems


Book Description

Iterative Methods for Linear Systems?offers a mathematically rigorous introduction to fundamental iterative methods for systems of linear algebraic equations. The book distinguishes itself from other texts on the topic by providing a straightforward yet comprehensive analysis of the Krylov subspace methods, approaching the development and analysis of algorithms from various algorithmic and mathematical perspectives, and going beyond the standard description of iterative methods by connecting them in a natural way to the idea of preconditioning.??




Matrix Inequalities


Book Description

The main purpose of this monograph is to report on recent developments in the field of matrix inequalities, with emphasis on useful techniques and ingenious ideas. Among other results this book contains the affirmative solutions of eight conjectures. Many theorems unify or sharpen previous inequalities. The author's aim is to streamline the ideas in the literature. The book can be read by research workers, graduate students and advanced undergraduates.




Iterative Methods and Preconditioners for Systems of Linear Equations


Book Description

Iterative methods use successive approximations to obtain more accurate solutions. This book gives an introduction to iterative methods and preconditioning for solving discretized elliptic partial differential equations and optimal control problems governed by the Laplace equation, for which the use of matrix-free procedures is crucial. All methods are explained and analyzed starting from the historical ideas of the inventors, which are often quoted from their seminal works. Iterative Methods and Preconditioners for Systems of Linear Equations grew out of a set of lecture notes that were improved and enriched over time, resulting in a clear focus for the teaching methodology, which derives complete convergence estimates for all methods, illustrates and provides MATLAB codes for all methods, and studies and tests all preconditioners first as stationary iterative solvers. This textbook is appropriate for undergraduate and graduate students who want an overview or deeper understanding of iterative methods. Its focus on both analysis and numerical experiments allows the material to be taught with very little preparation, since all the arguments are self-contained, and makes it appropriate for self-study as well. It can be used in courses on iterative methods, Krylov methods and preconditioners, and numerical optimal control. Scientists and engineers interested in new topics and applications will also find the text useful.