Error Norm Estimation in the Conjugate Gradient Algorithm

Error Norm Estimation in the Conjugate Gradient Algorithm PDF Author: Gérard Meurant
Publisher: SIAM
ISBN: 161197786X
Category : Mathematics
Languages : en
Pages : 138

Get Book Here

Book Description
The conjugate gradient (CG) algorithm is almost always the iterative method of choice for solving linear systems with symmetric positive definite matrices. This book describes and analyzes techniques based on Gauss quadrature rules to cheaply compute bounds on norms of the error. The techniques can be used to derive reliable stopping criteria. How to compute estimates of the smallest and largest eigenvalues during CG iterations is also shown. The algorithms are illustrated by many numerical experiments, and they can be easily incorporated into existing CG codes. The book is intended for those in academia and industry who use the conjugate gradient algorithm, including the many branches of science and engineering in which symmetric linear systems have to be solved.

Error Norm Estimation in the Conjugate Gradient Algorithm

Error Norm Estimation in the Conjugate Gradient Algorithm PDF Author: Gérard Meurant
Publisher: SIAM
ISBN: 161197786X
Category : Mathematics
Languages : en
Pages : 138

Get Book Here

Book Description
The conjugate gradient (CG) algorithm is almost always the iterative method of choice for solving linear systems with symmetric positive definite matrices. This book describes and analyzes techniques based on Gauss quadrature rules to cheaply compute bounds on norms of the error. The techniques can be used to derive reliable stopping criteria. How to compute estimates of the smallest and largest eigenvalues during CG iterations is also shown. The algorithms are illustrated by many numerical experiments, and they can be easily incorporated into existing CG codes. The book is intended for those in academia and industry who use the conjugate gradient algorithm, including the many branches of science and engineering in which symmetric linear systems have to be solved.

The Lanczos and Conjugate Gradient Algorithms

The Lanczos and Conjugate Gradient Algorithms PDF Author: Gerard Meurant
Publisher: SIAM
ISBN: 0898716160
Category : Computers
Languages : en
Pages : 374

Get Book Here

Book Description
The most comprehensive and up-to-date discussion available of the Lanczos and CG methods for computing eigenvalues and solving linear systems.

Walter Gautschi, Volume 3

Walter Gautschi, Volume 3 PDF Author: Claude Brezinski
Publisher: Springer Science & Business Media
ISBN: 146147132X
Category : Mathematics
Languages : en
Pages : 770

Get Book Here

Book Description
Walter Gautschi has written extensively on topics ranging from special functions, quadrature and orthogonal polynomials to difference and differential equations, software implementations, and the history of mathematics. He is world renowned for his pioneering work in numerical analysis and constructive orthogonal polynomials, including a definitive textbook in the former, and a monograph in the latter area. This three-volume set, Walter Gautschi: Selected Works with Commentaries, is a compilation of Gautschi’s most influential papers and includes commentaries by leading experts. The work begins with a detailed biographical section and ends with a section commemorating Walter’s prematurely deceased twin brother. This title will appeal to graduate students and researchers in numerical analysis, as well as to historians of science. Selected Works with Commentaries, Vol. 1 Numerical Conditioning Special Functions Interpolation and Approximation Selected Works with Commentaries, Vol. 2 Orthogonal Polynomials on the Real Line Orthogonal Polynomials on the Semicircle Chebyshev Quadrature Kronrod and Other Quadratures Gauss-type Quadrature Selected Works with Commentaries, Vol. 3 Linear Difference Equations Ordinary Differential Equations Software History and Biography Miscellanea Works of Werner Gautschi

Matrix Computations

Matrix Computations PDF Author: Gene H. Golub
Publisher: JHU Press
ISBN: 1421407949
Category : Mathematics
Languages : en
Pages : 781

Get Book Here

Book Description
This revised edition provides the mathematical background and algorithmic skills required for the production of numerical software. It includes rewritten and clarified proofs and derivations, as well as new topics such as Arnoldi iteration, and domain decomposition methods.

Krylov Methods for Nonsymmetric Linear Systems

Krylov Methods for Nonsymmetric Linear Systems PDF Author: Gérard Meurant
Publisher: Springer Nature
ISBN: 3030552519
Category : Mathematics
Languages : en
Pages : 686

Get Book Here

Book Description
This book aims to give an encyclopedic overview of the state-of-the-art of Krylov subspace iterative methods for solving nonsymmetric systems of algebraic linear equations and to study their mathematical properties. Solving systems of algebraic linear equations is among the most frequent problems in scientific computing; it is used in many disciplines such as physics, engineering, chemistry, biology, and several others. Krylov methods have progressively emerged as the iterative methods with the highest efficiency while being very robust for solving large linear systems; they may be expected to remain so, independent of progress in modern computer-related fields such as parallel and high performance computing. The mathematical properties of the methods are described and analyzed along with their behavior in finite precision arithmetic. A number of numerical examples demonstrate the properties and the behavior of the described methods. Also considered are the methods’ implementations and coding as Matlab®-like functions. Methods which became popular recently are considered in the general framework of Q-OR (quasi-orthogonal )/Q-MR (quasi-minimum) residual methods. This book can be useful for both practitioners and for readers who are more interested in theory. Together with a review of the state-of-the-art, it presents a number of recent theoretical results of the authors, some of them unpublished, as well as a few original algorithms. Some of the derived formulas might be useful for the design of possible new methods or for future analysis. For the more applied user, the book gives an up-to-date overview of the majority of the available Krylov methods for nonsymmetric linear systems, including well-known convergence properties and, as we said above, template codes that can serve as the base for more individualized and elaborate implementations.

Milestones in Matrix Computation : The selected works of Gene H. Golub with commentaries

Milestones in Matrix Computation : The selected works of Gene H. Golub with commentaries PDF Author: Raymond Chan
Publisher: OUP Oxford
ISBN: 9780199206810
Category : Mathematics
Languages : en
Pages : 584

Get Book Here

Book Description
The text presents and discusses some of the most influential papers in Matrix Computation authored by Gene H. Golub, one of the founding fathers of the field. The collection of 21 papers is divided into five main areas: iterative methods for linear systems, solution of least squares problems, matrix factorizations and applications, orthogonal polynomials and quadrature, and eigenvalue problems. Commentaries for each area are provided by leading experts: Anne Greenbaum, Ake Bjorck, Nicholas Higham, Walter Gautschi, and G. W. (Pete) Stewart. Comments on each paper are also included by the original authors, providing the reader with historical information on how the paper came to be written and under what circumstances the collaboration was undertaken. Including a brief biography and facsimiles of the original papers, this text will be of great interest to students and researchers in numerical analysis and scientific computation.

Milestones in Matrix Computation

Milestones in Matrix Computation PDF Author: Gene Howard Golub
Publisher: Oxford University Press
ISBN: 0199206813
Category : Mathematics
Languages : en
Pages : 581

Get Book Here

Book Description
The text presents and discusses some of the most influential papers in Matrix Computation authored by Gene H. Golub, one of the founding fathers of the field. Including commentaries by leading experts and a brief biography, this text will be of great interest to students and researchers in numerical analysis and scientific computation.

Accuracy and Stability of Numerical Algorithms

Accuracy and Stability of Numerical Algorithms PDF Author: Nicholas J. Higham
Publisher: SIAM
ISBN: 9780898718027
Category : Mathematics
Languages : en
Pages : 710

Get Book Here

Book Description
Accuracy and Stability of Numerical Algorithms gives a thorough, up-to-date treatment of the behavior of numerical algorithms in finite precision arithmetic. It combines algorithmic derivations, perturbation theory, and rounding error analysis, all enlivened by historical perspective and informative quotations. This second edition expands and updates the coverage of the first edition (1996) and includes numerous improvements to the original material. Two new chapters treat symmetric indefinite systems and skew-symmetric systems, and nonlinear systems and Newton's method. Twelve new sections include coverage of additional error bounds for Gaussian elimination, rank revealing LU factorizations, weighted and constrained least squares problems, and the fused multiply-add operation found on some modern computer architectures.

Numerical Algebra, Matrix Theory, Differential-Algebraic Equations and Control Theory

Numerical Algebra, Matrix Theory, Differential-Algebraic Equations and Control Theory PDF Author: Peter Benner
Publisher: Springer
ISBN: 3319152602
Category : Mathematics
Languages : en
Pages : 635

Get Book Here

Book Description
This edited volume highlights the scientific contributions of Volker Mehrmann, a leading expert in the area of numerical (linear) algebra, matrix theory, differential-algebraic equations and control theory. These mathematical research areas are strongly related and often occur in the same real-world applications. The main areas where such applications emerge are computational engineering and sciences, but increasingly also social sciences and economics. This book also reflects some of Volker Mehrmann's major career stages. Starting out working in the areas of numerical linear algebra (his first full professorship at TU Chemnitz was in "Numerical Algebra," hence the title of the book) and matrix theory, Volker Mehrmann has made significant contributions to these areas ever since. The highlights of these are discussed in Parts I and II of the present book. Often the development of new algorithms in numerical linear algebra is motivated by problems in system and control theory. These and his later major work on differential-algebraic equations, to which he together with Peter Kunkel made many groundbreaking contributions, are the topic of the chapters in Part III. Besides providing a scientific discussion of Volker Mehrmann's work and its impact on the development of several areas of applied mathematics, the individual chapters stand on their own as reference works for selected topics in the fields of numerical (linear) algebra, matrix theory, differential-algebraic equations and control theory.

Matrices, Moments and Quadrature with Applications

Matrices, Moments and Quadrature with Applications PDF Author: Gene H. Golub
Publisher: Princeton University Press
ISBN: 1400833884
Category : Mathematics
Languages : en
Pages : 376

Get Book Here

Book Description
This computationally oriented book describes and explains the mathematical relationships among matrices, moments, orthogonal polynomials, quadrature rules, and the Lanczos and conjugate gradient algorithms. The book bridges different mathematical areas to obtain algorithms to estimate bilinear forms involving two vectors and a function of the matrix. The first part of the book provides the necessary mathematical background and explains the theory. The second part describes the applications and gives numerical examples of the algorithms and techniques developed in the first part. Applications addressed in the book include computing elements of functions of matrices; obtaining estimates of the error norm in iterative methods for solving linear systems and computing parameters in least squares and total least squares; and solving ill-posed problems using Tikhonov regularization. This book will interest researchers in numerical linear algebra and matrix computations, as well as scientists and engineers working on problems involving computation of bilinear forms.