I'm studying iterative methods for solving linear system, and I find the following setting in Wikipedia:
Consider a matrix splitting $A = M-N$, where $A,M,N$ are all symmetric and positive definite matrices. Define iteration matrix $C=I-M^{-1}A$. We aim to show that the condition number $\kappa(I-C)=\kappa(M^{-1}A)$ is not too large, which ensures that iterative method converges fairly fast. Wikipedia gives the following bound on $\kappa(M^{-1}A)$:
$$\kappa(M^{-1}A) \leq \frac{1+\rho(C)}{1-\rho(C)}$$
where $\rho(C)$ denotes the spectral radius of matrix $C$. Here we are taking the condition number with respect to the Euclidean 2-norm. That is to say, we have $\kappa(M^{-1}A) = \frac{\sigma_{max}(M^{-1}A)}{\sigma_{min}(M^{-1}A)}$, where $\sigma_{max},\sigma_{min}$ denote the largest/smallest singular value of any matrix, respectively.
Any ideas on proving this upper bound? Any help/hint would be greatly appreciated!
(Link for reference: https://en.wikipedia.org/wiki/Preconditioner)
2026-03-25 22:30:02.1774477802
Upper bound on condition number in linear preconditioning
226 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail AtRelated Questions in LINEAR-ALGEBRA
- An underdetermined system derived for rotated coordinate system
- How to prove the following equality with matrix norm?
- Alternate basis for a subspace of $\mathcal P_3(\mathbb R)$?
- Why the derivative of $T(\gamma(s))$ is $T$ if this composition is not a linear transformation?
- Why is necessary ask $F$ to be infinite in order to obtain: $ f(v)=0$ for all $ f\in V^* \implies v=0 $
- I don't understand this $\left(\left[T\right]^B_C\right)^{-1}=\left[T^{-1}\right]^C_B$
- Summation in subsets
- $C=AB-BA$. If $CA=AC$, then $C$ is not invertible.
- Basis of span in $R^4$
- Prove if A is regular skew symmetric, I+A is regular (with obstacles)
Related Questions in NUMERICAL-METHODS
- The Runge-Kutta method for a system of equations
- How to solve the exponential equation $e^{a+bx}+e^{c+dx}=1$?
- Is the calculated solution, if it exists, unique?
- Modified conjugate gradient method to minimise quadratic functional restricted to positive solutions
- Minimum of the 2-norm
- Is method of exhaustion the same as numerical integration?
- Prove that Newton's Method is invariant under invertible linear transformations
- Initial Value Problem into Euler and Runge-Kutta scheme
- What are the possible ways to write an equation in $x=\phi(x)$ form for Iteration method?
- Numerical solution for a two dimensional third order nonlinear differential equation
Related Questions in NUMERICAL-LINEAR-ALGEBRA
- sources about SVD complexity
- Showing that the Jacobi method doesn't converge with $A=\begin{bmatrix}2 & \pm2\sqrt2 & 0 \\ \pm2\sqrt2&8&\pm2\sqrt2 \\ 0&\pm2\sqrt2&2 \end{bmatrix}$
- Finding $Ax=b$ iteratively using residuum vectors
- Pack two fractional values into a single integer while preserving a total order
- Use Gershgorin's theorem to show that a matrix is nonsingular
- Rate of convergence of Newton's method near a double root.
- Linear Algebra - Linear Combinations Question
- Proof of an error estimation/inequality for a linear $Ax=b$.
- How to find a set of $2k-1$ vectors such that each element of set is an element of $\mathcal{R}$ and any $k$ elements of set are linearly independent?
- Understanding iterative methods for solving $Ax=b$ and why they are iterative
Related Questions in CONDITION-NUMBER
- Connection between singular values, condition and well-posedness
- Does it hold that $\kappa(A^2) = \kappa(A)^2$?
- Condition number of a polynomial root problem
- Is Schur complement better conditioned than the original matrix?
- Condition number for a nonlinear matrix
- Condition number of the indefinite Hessian
- Condition Number and Sensitivity of Matrix-Vector Multiplication
- Why is the condition number of a matrix given by these eigenvalues?
- Finding the condition number of a matrix
- Compute the condition number of a $3 \times 3$ matrix.
Related Questions in SPECTRAL-RADIUS
- Spectral radius inequality for non-abelian Banach algebras
- Prove or disprove that $\rho(A) = \| A \|_2$ for any real symmetric matrix $A$
- Spectral radius Volterra operator with an arbitrary kernel from $L^2$
- Proof of spectral radius bound $\min_i \sum_j a_{ij} \le \rho(A) \le \max_i \sum_j a_{ij}$
- Spectral norm of block and square matrices
- if $||AB||_\infty<1$ is I-AB is positive definite ? provided A,B are symmetric and A+B is positive definite
- Square of spectral radius and Frobenius norm
- Upper bound on the spectral radius of summation of two matrices one symmetric one diagonal
- Spectral radius of a matrix
- Gradient of largest eigenvalue of matrix, with respect to individual elements of the matrix
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Find $E[XY|Y+Z=1 ]$
- Refuting the Anti-Cantor Cranks
- What are imaginary numbers?
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- How do we know that the number $1$ is not equal to the number $-1$?
- What are the Implications of having VΩ as a model for a theory?
- Defining a Galois Field based on primitive element versus polynomial?
- Can't find the relationship between two columns of numbers. Please Help
- Is computer science a branch of mathematics?
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- Generator of inertia group in function field extension
Popular # Hahtags
second-order-logic
numerical-methods
puzzle
logic
probability
number-theory
winding-number
real-analysis
integration
calculus
complex-analysis
sequences-and-series
proof-writing
set-theory
functions
homotopy-theory
elementary-number-theory
ordinary-differential-equations
circles
derivatives
game-theory
definite-integrals
elementary-set-theory
limits
multivariable-calculus
geometry
algebraic-number-theory
proof-verification
partial-derivative
algebra-precalculus
Popular Questions
- What is the integral of 1/x?
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- Is a matrix multiplied with its transpose something special?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- How to tell if a set of vectors spans a space?
- Calculus question taking derivative to find horizontal tangent line
- How to determine if a function is one-to-one?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- Is this Batman equation for real?
- How to find perpendicular vector to another vector?
- How to find mean and median from histogram
- How many sides does a circle have?