Consider a linear measurement process with some noise: $$y=Hx+v$$ with $$v \sim \mathcal{N}(0,\Sigma)$$ the covariance matrix $\Sigma$ is not a diagonal matrix. As we know, using LS, the $\hat{x}$ is $$\hat{x} = (H^T H)^{-1} H^T y$$ Does it change when $\Sigma$ is not a diagonal matrix?
2025-01-13 02:37:00.1736735820
Does the correlation between the measurement noise influence the result of the LS?
36 Views Asked by SandyX https://math.techqa.club/user/sandyx/detail At
1
There are 1 best solutions below
Related Questions in LINEAR-ALGEBRA
- Proving a set S is linearly dependent or independent
- An identity regarding linear operators and their adjoint between Hilbert spaces
- Show that $f(0)=f(-1)$ is a subspace
- Find the Jordan Normal From of a Matrix $A$
- Show CA=CB iff A=B
- Set of linear transformations which always produce a basis (generalising beyond $\mathbb{R}^2$)
- Linear Algebra minimal Polynomial
- Non-singularity of a matrix
- Finding a subspace such that a bilinear form is an inner product.
- Is the row space of a matrix (order n by m, m < n) of full column rank equal to $\mathbb{R}^m$?
Related Questions in ESTIMATION
- Estimate of a (integral) function
- Finding the closest vector to an observation
- on a step of a proof of the Levinson density theorem
- Finding number pattern
- problem using MLE on gamma distributed variable
- An asymptotic estimate for density of eigenvalues
- Upper bound for the error on the Fourier series for $e^{x}$
- When does it make sense to build a confidence interval for the mean with known standard deviation?
- When to we accept a hypothesis when using Wald test statistic?
- How do you determine how many digits of pi are necessary?
Related Questions in LEAST-SQUARES
- What does the subscript after euclidean distance notation mean?
- Nonlinear Least Squares vs. Extended Kalman Filter
- Moore-Penrose Inverse as least-squares solution
- Least squares fitting of an iterative function
- Least-squares fit of a nonlinear (polar) system
- Rounding in the method of least squares for linear regression analysis?
- Least Square Approximation for Exponential Functions
- Redundant optimization parameters?
- $2$-norm of a matrix &$ 2$-norm of a vector
- Example for nonzero covariance when expectation of product of two random variables is zero?
Related Questions in PARAMETER-ESTIMATION
- problem using MLE on gamma distributed variable
- Kalman Filter with State Constrained to a Surface
- Least squares fitting of an iterative function
- Sample Geometric Mean as an estimator for a Gamma Distribution
- Method of moments estimator and the maximum likelihood estimator for a sample from Gamma distribution
- Statistics application problem - estimate number of items by weight
- Estimating the parameters of stochastic asset price models using Matlab
- How do you show that the estimator for the covariance matrix is unbiased?
- How do I compute a realization of h(x) given its PDF and covariance?
- Does the correlation between the measurement noise influence the result of the LS?
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Refuting the Anti-Cantor Cranks
- Find $E[XY|Y+Z=1 ]$
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- What are the Implications of having VΩ as a model for a theory?
- How do we know that the number $1$ is not equal to the number $-1$?
- Defining a Galois Field based on primitive element versus polynomial?
- Is computer science a branch of mathematics?
- Can't find the relationship between two columns of numbers. Please Help
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- A community project: prove (or disprove) that $\sum_{n\geq 1}\frac{\sin(2^n)}{n}$ is convergent
- Alternative way of expressing a quantied statement with "Some"
Popular # Hahtags
real-analysis
calculus
linear-algebra
probability
abstract-algebra
integration
sequences-and-series
combinatorics
general-topology
matrices
functional-analysis
complex-analysis
geometry
group-theory
algebra-precalculus
probability-theory
ordinary-differential-equations
limits
analysis
number-theory
measure-theory
elementary-number-theory
statistics
multivariable-calculus
functions
derivatives
discrete-mathematics
differential-geometry
inequality
trigonometry
Popular Questions
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- How to find mean and median from histogram
- Difference between "≈", "≃", and "≅"
- Easy way of memorizing values of sine, cosine, and tangent
- How to calculate the intersection of two planes?
- What does "∈" mean?
- If you roll a fair six sided die twice, what's the probability that you get the same number both times?
- Probability of getting exactly 2 heads in 3 coins tossed with order not important?
- Fourier transform for dummies
- Limit of $(1+ x/n)^n$ when $n$ tends to infinity
Sorry, I eventually realize it is a simple question. Here is the answer of mine.
first, for a semi-definite matrix $\Sigma$, we can find $\Lambda$ so that $$\Sigma = \Lambda \Lambda^T$$
Then, we have $$\Lambda^{-1} v ∼ \mathcal{N}(0,I) $$
So, we can apply the conventional LS to modified measurement process: $$ \Lambda^{-1}y =\Lambda^{-1}Hx+\Lambda^{-1}v$$ then $$\hat{x} = ((\Lambda^{-1}H)^T \Lambda^{-1}H)^{-1} (\Lambda^{-1}H)^T \Lambda^{-1} y$$ $$\hat{x} = (H^T \Sigma ^{-1}H)^{-1} H^T \Sigma ^{-1} y$$