Given a set of linear equations $AX=B$, say $A$ is an ill posed matrix (has a few singular values equal or very close to zero), which numerical algorithm (conjugate gradient, least squares or steepest decent etc ) should be used to obtain the best solution? More specifically, is there a concrete comparison between these methods?
2026-03-28 01:04:09.1774659849
Solving ill posed linear equations
596 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail At
1
There are 1 best solutions below
Related Questions in LINEAR-ALGEBRA
- An underdetermined system derived for rotated coordinate system
- How to prove the following equality with matrix norm?
- Alternate basis for a subspace of $\mathcal P_3(\mathbb R)$?
- Why the derivative of $T(\gamma(s))$ is $T$ if this composition is not a linear transformation?
- Why is necessary ask $F$ to be infinite in order to obtain: $ f(v)=0$ for all $ f\in V^* \implies v=0 $
- I don't understand this $\left(\left[T\right]^B_C\right)^{-1}=\left[T^{-1}\right]^C_B$
- Summation in subsets
- $C=AB-BA$. If $CA=AC$, then $C$ is not invertible.
- Basis of span in $R^4$
- Prove if A is regular skew symmetric, I+A is regular (with obstacles)
Related Questions in LINEAR-PROGRAMMING
- Proving dual convex cone property
- Linear algebra: what is the purpose of passive transformation matrix?
- Building the model for a Linear Programming Problem
- Show that $ \ x_ 0 \ $ cannot be an optimal solution
- Is there any way to model this situation in integer programming?
- How to Solve a Linear Programming Problem in $n$ Dimension Space?
- How to solve a linear program without any given data?
- Constraints for continuous path within graph with at least one obligatory node in path
- Select the smallest strict positive value from a list of variables in a linear program.
- How to add nonnegative constraint to an LP problem
Related Questions in IMAGE-PROCESSING
- Defintion Ideally sampled image
- Show that a periodic function $f(t)$ with period $T$ can be written as $ f(t) = f_T (t) \star \frac{1}{T} \text{comb}\bigg(\frac{t}{T}\bigg) $
- Apply affine heat equation on images
- Are there analogues to orthogonal transformations in non-orientable surfaces?
- How does Fourier transform convert from time domain to frequency domain
- Increasing the accuracy with techniques of interpolation
- How to interpret probability density function of transformed variable?
- Why are median filters non-separable?
- Solving Deconvolution using Conjugate Gradient
- How to deblur a image matrix blured by two circulant matrix?
Related Questions in NUMERICAL-OPTIMIZATION
- Modified conjugate gradient method to minimise quadratic functional restricted to positive solutions
- Bouncing ball optimization
- Minimization of a convex quadratic form
- What is the purpose of an oracle in optimization?
- What do you call iteratively optimizing w.r.t. various groups of variables?
- ProxASAGA: compute and use the support of $\Delta f$
- Can every semidefinite program be solved in polynomial time?
- In semidefinite programming we don't have a full dimensional convex set to use ellipsoid method
- How to generate a large PSD matrix $A \in \mathbb{R}^{n \times n}$, where $\mathcal{O}(n) \sim 10^3$
- Gram matrices in the Rayleigh-Ritz algorithm
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Find $E[XY|Y+Z=1 ]$
- Refuting the Anti-Cantor Cranks
- What are imaginary numbers?
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- How do we know that the number $1$ is not equal to the number $-1$?
- What are the Implications of having VΩ as a model for a theory?
- Defining a Galois Field based on primitive element versus polynomial?
- Can't find the relationship between two columns of numbers. Please Help
- Is computer science a branch of mathematics?
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- Generator of inertia group in function field extension
Popular # Hahtags
second-order-logic
numerical-methods
puzzle
logic
probability
number-theory
winding-number
real-analysis
integration
calculus
complex-analysis
sequences-and-series
proof-writing
set-theory
functions
homotopy-theory
elementary-number-theory
ordinary-differential-equations
circles
derivatives
game-theory
definite-integrals
elementary-set-theory
limits
multivariable-calculus
geometry
algebraic-number-theory
proof-verification
partial-derivative
algebra-precalculus
Popular Questions
- What is the integral of 1/x?
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- Is a matrix multiplied with its transpose something special?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- How to tell if a set of vectors spans a space?
- Calculus question taking derivative to find horizontal tangent line
- How to determine if a function is one-to-one?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- Is this Batman equation for real?
- How to find perpendicular vector to another vector?
- How to find mean and median from histogram
- How many sides does a circle have?
What do you mean by "best solution"?
If your problem is ill-posed, then you need regularization. In this case, conjugate gradient provides a form of regularization. Also, you may wish to consider using Truncated Singular Value Decomposition, consisting into filtering out, during the matrix inversion, the less relevant singular values which are responsible for the ill-posedness. You may also wish to consider Tikhonov regularization (leading, under the SVD approach, to a particular shaping of the singular values).
As reference on inverse problems (especially linear inverse problems) and related (regularized) solution strategies, a good book is M.Bertero, P.Boccacci, Introduction to Inverse Problems in Imaging, IOP Publishing, Bristol.