I am trying to estimate the path of a random described by the following SSM \begin{align} x_{t+1} = x_{t} + q_{t+1} \newline y_{t+1} = h(x_{t+1}) + r_{t+1} \end{align} where $h(x_{t+1}) = \sqrt{(x_{t+1}(1) - A(1))^2 + (x_{t+1}(2) - A(2))^2}$ and $q_{t+1} \sim \mathcal{N}(0,Q)$ , $r_{t+1} \sim \mathcal{N}(0,R)$ with $R$ and $Q$ both equal to $0.1 \mathcal{I}$. We generate data for $L$ steps through the above State-Space Model and then try to estimate $x_{t}$ at each time-step by minimizing the following $l_p$ norm cost function.We minimize this function through Gradient Descent. \begin{align} \lVert y_{t} - h(x_{t}) \rVert_{p} \end{align} But it seems that minimizing this $l_{p}$ does not lead to the latent $x_{t}$ we were hoping to obtain. In addition to this we tried several regularizers, like L2 and L1 Norm regularizers. The function is minimized (we have observed this) as our gradient descent goes through its iterations but the $x_t$ that we ultimately reach is not the correct one. We suspect that we get stuck in some local minima close to, at first, the initial guess and then close to each subsequent estimate for the gradient descent. Is there some form of regularization or some alterations we could make to our objective function that could lead us to a unique solution, which could get us the correct $x_{t}$. We tried this exact procedure with a more minimalistic, toy problem where our $h(x_{t+1}) = \sqrt{(x_{t+1} - A)^2}$with $p = 2$. Here we observed that we get the exact value for $x_{t}$ until $x_{t}$ gets very close to $A$ where we observed that the estimate for $x_{t}$ gets mirrored around $A$. Is there a way that we can direct our optimization problem to be solved for the $x_{t}$ close to the one, for which the incoming measurements $y_{t}$ were generated through the above State Space Model.
2026-04-06 18:07:21.1775498841
Uniquene solution to minimisation of a Non Linear Objective Function
23 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail AtRelated Questions in DYNAMICAL-SYSTEMS
- Stability of system of parameters $\kappa, \lambda$ when there is a zero eigenvalue
- Stability of stationary point $O(0,0)$ when eigenvalues are zero
- Determine $ \ a_{\max} \ $ and $ \ a_{\min} \ $ so that the above difference equation is well-defined.
- Question on designing a state observer for discrete time system
- How to analyze a dynamical system when $t\to\infty?$
- The system $x' = h(y), \space y' = ay + g(x)$ has no periodic solutions
- Existence of unique limit cycle for $r'=r(μ-r^2), \space θ' = ρ(r^2)$
- Including a time delay term for a differential equation
- Doubts in proof of topologically transitive + dense periodic points = Devaney Chaotic
- Condition for symmetric part of $A$ for $\|x(t)\|$ monotonically decreasing ($\dot{x} = Ax(t)$)
Related Questions in NONLINEAR-OPTIMIZATION
- Prove that Newton's Method is invariant under invertible linear transformations
- set points in 2D interval with optimality condition
- Finding a mixture of 1st and 0'th order Markov models that is closest to an empirical distribution
- Sufficient condition for strict minimality in infinite-dimensional spaces
- Weak convergence under linear operators
- Solving special (simple?) system of polynomial equations (only up to second degree)
- Smallest distance to point where objective function value meets a given threshold
- KKT Condition and Global Optimal
- What is the purpose of an oracle in optimization?
- Prove that any Nonlinear program can be written in the form...
Related Questions in NONLINEAR-SYSTEM
- Solving special (simple?) system of polynomial equations (only up to second degree)
- Determination of Invertibility
- Question about stability of a nonlinear dynamical system
- The equation $x^T A x = (x^2)^T A x^2$
- 1D viscous flow upwards against gravity
- Convergence of fixed-point in a gauss-seidel style
- Intuition behind dense orbits
- Determine the stability properties and convergence in the origin using Lyapunov Direct Method
- Is $x(t/2)$ a causal/memoryless system?
- Why this field with non-zero curl has closed orbit?
Related Questions in SIGNAL-PROCESSING
- What is the result of $x(at) * δ(t-k)$
- How is $\int_{-T_0/2}^{+T_0/2} \delta(t) \cos(n\omega_0 t)dt=1$ and $\int_{-T_0/2}^{+T_0/2} \delta(t) \sin(n\omega_0 t)=0$?
- Show that a periodic function $f(t)$ with period $T$ can be written as $ f(t) = f_T (t) \star \frac{1}{T} \text{comb}\bigg(\frac{t}{T}\bigg) $
- Taking the Discrete Inverse Fourier Transform of a Continuous Forward Transform
- Is $x(t) = \sin(3t) + \cos\left({2\over3}t\right) + \cos(\pi t)$ periodic?
- Fast moving object, how to remove noise from observations?
- Computing convolution using the Fourier transform
- Find Fourier Transform of $\cos^2(ωt)x(t)$
- Finding closed expression for the output of an LTI system
- Is there an intuitive way to see that $\mathbb{E}[X|Y]$ is the least squares estimator of $X$ given $Y$?
Related Questions in GRADIENT-DESCENT
- Gradient of Cost Function To Find Matrix Factorization
- Can someone explain the calculus within this gradient descent function?
- Established results on the convergence rate of iterates for Accelerated Gradient Descent?
- Sensitivity (gradient) of function solved using RK4
- Concerning the sequence of gradients in Nesterov's Accelerated Descent
- Gradient descent proof: justify $\left(\dfrac{\kappa - 1}{\kappa + 1}\right)^2 \leq \exp(-\dfrac{4t}{\kappa+1})$
- If the gradient of the logistic loss is never zero, does that mean the minimum can never be achieved?
- How does one show that the likelihood solution for logistic regression has a magnitude of infinity for separable data (Bishop exercise 4.14)?
- How to determinate that a constrained inequality system is not empty?
- How to show that the gradient descent for unconstrained optimization can be represented as the argmin of a quadratic?
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Find $E[XY|Y+Z=1 ]$
- Refuting the Anti-Cantor Cranks
- What are imaginary numbers?
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- How do we know that the number $1$ is not equal to the number $-1$?
- What are the Implications of having VΩ as a model for a theory?
- Defining a Galois Field based on primitive element versus polynomial?
- Can't find the relationship between two columns of numbers. Please Help
- Is computer science a branch of mathematics?
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- Generator of inertia group in function field extension
Popular # Hahtags
second-order-logic
numerical-methods
puzzle
logic
probability
number-theory
winding-number
real-analysis
integration
calculus
complex-analysis
sequences-and-series
proof-writing
set-theory
functions
homotopy-theory
elementary-number-theory
ordinary-differential-equations
circles
derivatives
game-theory
definite-integrals
elementary-set-theory
limits
multivariable-calculus
geometry
algebraic-number-theory
proof-verification
partial-derivative
algebra-precalculus
Popular Questions
- What is the integral of 1/x?
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- Is a matrix multiplied with its transpose something special?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- How to tell if a set of vectors spans a space?
- Calculus question taking derivative to find horizontal tangent line
- How to determine if a function is one-to-one?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- Is this Batman equation for real?
- How to find perpendicular vector to another vector?
- How to find mean and median from histogram
- How many sides does a circle have?