Conjugate Gradient Type Methods for Ill-Posed Problems


Book Description

The conjugate gradient method is a powerful tool for the iterative solution of self-adjoint operator equations in Hilbert space.This volume summarizes and extends the developments of the past decade concerning the applicability of the conjugate gradient method (and some of its variants) to ill posed problems and their regularization. Such problems occur in applications from almost all natural and technical sciences, including astronomical and geophysical imaging, signal analysis, computerized tomography, inverse heat transfer problems, and many more This Research Note presents a unifying analysis of an entire family of conjugate gradient type methods. Most of the results are as yet unpublished, or obscured in the Russian literature. Beginning with the original results by Nemirovskii and others for minimal residual type methods, equally sharp convergence results are then derived with a different technique for the classical Hestenes-Stiefel algorithm. In the final chapter some of these results are extended to selfadjoint indefinite operator equations. The main tool for the analysis is the connection of conjugate gradient type methods to real orthogonal polynomials, and elementary properties of these polynomials. These prerequisites are provided in a first chapter. Applications to image reconstruction and inverse heat transfer problems are pointed out, and exemplarily numerical results are shown for these applications.




Conjugate Gradient Type Methods for Ill-Posed Problems


Book Description

The conjugate gradient method is a powerful tool for the iterative solution of self-adjoint operator equations in Hilbert space.This volume summarizes and extends the developments of the past decade concerning the applicability of the conjugate gradient method (and some of its variants) to ill posed problems and their regularization. Such problems occur in applications from almost all natural and technical sciences, including astronomical and geophysical imaging, signal analysis, computerized tomography, inverse heat transfer problems, and many more This Research Note presents a unifying analysis of an entire family of conjugate gradient type methods. Most of the results are as yet unpublished, or obscured in the Russian literature. Beginning with the original results by Nemirovskii and others for minimal residual type methods, equally sharp convergence results are then derived with a different technique for the classical Hestenes-Stiefel algorithm. In the final chapter some of these results are extended to selfadjoint indefinite operator equations. The main tool for the analysis is the connection of conjugate gradient type methods to real orthogonal polynomials, and elementary properties of these polynomials. These prerequisites are provided in a first chapter. Applications to image reconstruction and inverse heat transfer problems are pointed out, and exemplarily numerical results are shown for these applications.




Operator Theory and Its Applications


Book Description

Together with the papers on the abstract operator theory are many papers on the theory of differential operators, boundary value problems, inverse scattering and other inverse problems, and on applications to biology, chemistry, wave propagation, and many other areas."--BOOK JACKET.




Regularization of Ill-Posed Problems by Iteration Methods


Book Description

Iteration regularization, i.e., utilization of iteration methods of any form for the stable approximate solution of ill-posed problems, is one of the most important but still insufficiently developed topics of the new theory of ill-posed problems. In this monograph, a general approach to the justification of iteration regulari zation algorithms is developed, which allows us to consider linear and nonlinear methods from unified positions. Regularization algorithms are the 'classical' iterative methods (steepest descent methods, conjugate direction methods, gradient projection methods, etc.) complemented by the stopping rule depending on level of errors in input data. They are investigated for solving linear and nonlinear operator equations in Hilbert spaces. Great attention is given to the choice of iteration index as the regularization parameter and to estimates of errors of approximate solutions. Stabilizing properties such as smoothness and shape constraints imposed on the solution are used. On the basis of these investigations, we propose and establish efficient regularization algorithms for stable numerical solution of a wide class of ill-posed problems. In particular, descriptive regularization algorithms, utilizing a priori information about the qualitative behavior of the sought solution and ensuring a substantial saving in computational costs, are considered for model and applied problems in nonlinear thermophysics. The results of calculations for important applications in various technical fields (a continuous casting, the treatment of materials and perfection of heat-protective systems using laser and composite technologies) are given.




Surveys on Solution Methods for Inverse Problems


Book Description

Inverse problems are concerned with determining causes for observed or desired effects. Problems of this type appear in many application fields both in science and in engineering. The mathematical modelling of inverse problems usually leads to ill-posed problems, i.e., problems where solutions need not exist, need not be unique or may depend discontinuously on the data. For this reason, numerical methods for solving inverse problems are especially difficult, special methods have to be developed which are known under the term "regularization methods". This volume contains twelve survey papers about solution methods for inverse and ill-posed problems and about their application to specific types of inverse problems, e.g., in scattering theory, in tomography and medical applications, in geophysics and in image processing. The papers have been written by leading experts in the field and provide an up-to-date account of solution methods for inverse problems.




Rank-Deficient and Discrete Ill-Posed Problems


Book Description

Here is an overview of modern computational stabilization methods for linear inversion, with applications to a variety of problems in audio processing, medical imaging, tomography, seismology, astronomy, and other areas. Rank-deficient problems involve matrices that are either exactly or nearly rank deficient. Such problems often arise in connection with noise suppression and other problems where the goal is to suppress unwanted disturbances of the given measurements. Discrete ill-posed problems arise in connection with the numerical treatment of inverse problems, where one typically wants to compute information about some interior properties using exterior measurements. Examples of inverse problems are image restoration and tomography, where one needs to improve blurred images or reconstruct pictures from raw data. This book describes, in a common framework, new and existing numerical methods for the analysis and solution of rank-deficient and discrete ill-posed problems. The emphasis is on insight into the stabilizing properties of the algorithms and on the efficiency and reliability of the computations. The setting is that of numerical linear algebra rather than abstract functional analysis, and the theoretical development is complemented with numerical examples and figures that illustrate the features of the various algorithms.




Problems and Methods in Mathematical Physics


Book Description

This volume presents the proceedings of the 11th Conference on Problems and Methods in Mathematical Physics (11th TMP), held in Chemnitz, March 25-28, 1999. The conference was dedicated to the memory of Siegfried Prössdorf, who made important contributions to the theory and numerical analysis of operator equations and their applications in mathematical physics and mechanics. The main part of the book comprises original research papers. The topics are ranging from integral and pseudodifferential equations, boundary value problems, operator theory, boundary element and wavelet methods, approximation theory and inverse problems to various concrete problems and applications in physics and engineering, and reflect Prössdorf's broad spectrum of research activities. The volume also contains articles describing the life and mathematical achievements of Siegfried Prössdorf and includes a list of his publications. The book is addressed to a wide audience in the mathematical and engineering sciences.




Academic Press Library in Signal Processing


Book Description

This fourth volume, edited and authored by world leading experts, gives a review of the principles, methods and techniques of important and emerging research topics and technologies in Image, Video Processing and Analysis, Hardware, Audio, Acoustic and Speech Processing. With this reference source you will: - Quickly grasp a new area of research - Understand the underlying principles of a topic and its application - Ascertain how a topic relates to other areas and learn of the research issues yet to be resolved - Quick tutorial reviews of important and emerging topics of research in Image, Video Processing and Analysis, Hardware, Audio, Acoustic and Speech Processing - Presents core principles and shows their application - Reference content on core principles, technologies, algorithms and applications - Comprehensive references to journal articles and other literature on which to build further, more specific and detailed knowledge - Edited by leading people in the field who, through their reputation, have been able to commission experts to write on a particular topic




Numerical Methods for the Solution of Ill-Posed Problems


Book Description

Many problems in science, technology and engineering are posed in the form of operator equations of the first kind, with the operator and RHS approximately known. But such problems often turn out to be ill-posed, having no solution, or a non-unique solution, and/or an unstable solution. Non-existence and non-uniqueness can usually be overcome by settling for `generalised' solutions, leading to the need to develop regularising algorithms. The theory of ill-posed problems has advanced greatly since A. N. Tikhonov laid its foundations, the Russian original of this book (1990) rapidly becoming a classical monograph on the topic. The present edition has been completely updated to consider linear ill-posed problems with or without a priori constraints (non-negativity, monotonicity, convexity, etc.). Besides the theoretical material, the book also contains a FORTRAN program library. Audience: Postgraduate students of physics, mathematics, chemistry, economics, engineering. Engineers and scientists interested in data processing and the theory of ill-posed problems.




The Limits of Resolution


Book Description

"This beautiful book can be read as a novel presenting carefully our quest to get more and more information from our observations and measurements. Its authors are particularly good at relating it." --Pierre C. Sabatier "This is a unique text - a labor of love pulling together for the first time the remarkably large array of mathematical and statistical techniques used for analysis of resolution in many systems of importance today – optical, acoustical, radar, etc.... I believe it will find widespread use and value." --Dr. Robert G.W. Brown, Chief Executive Officer, American Institute of Physics "The mix of physics and mathematics is a unique feature of this book which can be basic not only for PhD students but also for researchers in the area of computational imaging." --Mario Bertero, Professor, University of Geneva "a tour-de-force covering aspects of history, mathematical theory and practical applications. The authors provide a penetrating insight into the often confused topic of resolution and in doing offer a unifying approach to the subject that is applicable not only to traditional optical systems but also modern day, computer-based systems such as radar and RF communications." --Prof. Ian Proudler, Loughborough University "a ‘must have’ for anyone interested in imaging and the spatial resolution of images. This book provides detailed and very readable account of resolution in imaging and organizes the recent history of the subject in excellent fashion.... I strongly recommend it." --Michael A.? Fiddy, Professor, University of North Carolina at Charlotte This book brings together the concept of resolution, which limits what we can determine about our physical world, with the theory of linear inverse problems, emphasizing practical applications. The book focuses on methods for solving illposed problems that do not have unique stable solutions. After introducing basic concepts, the contents address problems with "continuous" data in detail before turning to cases of discrete data sets. As one of the unifying principles of the text, the authors explain how non-uniqueness is a feature of measurement problems in science where precision and resolution is essentially always limited by some kind of noise.