If I have $x\in R^n , C\in R^{m\times n}, d\in R^m$, $m<n$, then $Cx=d$ is a linear manifold.
And $P\in R^{n\times n}$, $P>0$, the quadratic form is $y=x^TPx$
Is there an analytical expression of the minimum value of $y$ for $Cx=d$ ?
For $n=3, m=2$, it's like the minimum distance from points on a line to the original point.
I want to use this as a constraint in convex optimization.
Apply lagrange multiplier method. The augmented function looks like: $$ f(x)=x^TPx+\lambda^T(Cx-d) $$ Note that here $\lambda\in\mathbb R^m$ is a vector since you have $m$ constraints. The minimum is acquired when: $$ \begin{cases} \partial f/\partial x=2Px+C^T\lambda=0\\ \partial f/\partial\lambda=Cx-d=0 \end{cases} $$ Since $P>0$ and therefore invertible, we have: $$ x=-\frac{1}{2}P^{-1}C^T\lambda\Rightarrow Cx=-\frac{1}{2}(CP^{-1}C^T)\lambda=d $$ Assume $C$ has full row rank, then: $$ \lambda^*=-2(CP^{-1}C^T)^{-1}d $$ Now the argument minimum $x^*$ is given by: $$ x^*=-\frac{1}{2}P^{-1}C^T\lambda^*=P^{-1}C^T(CP^{-1}C^T)^{-1}d $$ and the minimum value is given by: $$ y^*=x^{*T}Px^* $$