Quadratic Forms in Non-Linear Optimization

177 Views Asked by At

This is a rather trivial question but I am having a great deal of trouble:

Let $f(x) = (1/2)xQx-xb$

and $E(x) = (1/2)(x-x^*)Q(x-x^*)$

then $E(x) = f(x) + (1/2)x^*Qx^*$

where $x,x^*,b$ are vectors and $Q$ is a symmetric positive definite matrix.

Question: Why is this equivalence true?

1

There are 1 best solutions below

0
On BEST ANSWER

Your notations are very confusing. Presumably your $x^\ast$ just denotes a vector, but not the conjugate transpose of $x$ (which is usually denoted as $x^\ast$ or $x^H$). So, to avoid confusion, I will change your $x^\ast$ into $x_0$. And I assume that $f$ and $E$ are defined as follows: \begin{align*} f(x) &= \frac12x^HQx-x^Hb,\\ E(x) &= \frac12(x-x_0)^HQ(x-x_0). \end{align*} Now the question is why $$E(x) = f(x) + \frac12x_0^HQx_0.\tag{1}$$ The short answer is: no, this is not necessarily true. However, you may note that $$ E(x)=\frac12(x-x_0)^HQ(x-x_0)=f(x) + x^Hb - x^HQx_0 + \frac12x_0^HQx_0. $$ So, when $Qx_0=b$, equality holds in $(1)$. The $x_0$ then is the solution to the least-square problem $\min_{u\in\mathbb{R}^n}f(u)$.