I am reading a tutorial about Convex Optimization and it defines the general Convex Optimization problem as:
$$ minimize_x f(x)$$ where $g_1(x) \leq 0, ... , g_m(x) \leq 0$ and $Ax=b$ and $x \in \mathbb{R}^n$. The cost function $f(x)$ and all constraint functions $g_1(x), ..., g_m(x)$ are convex functions.
I clearly see the following: The domain of the convex function $f$ is convex. Each $g_i$ defines a level set at $0$ with $\left\{x|g_i(x) \leq 0\right\}$. These sets are convex as well and the intersection of all of these are convex.
What I don't get exactly is the affine set $\left\{x|Ax = 0\right\}$. I have the following intuition: If we do not use an affine set to constrain the feasible region produced by $f$ and $g_i$ functions, then this region is always $n$ dimensional (has a basis of $n$ vectors). An affine set of $n-1$ dimensions is a hyperplane, an affine set with a dimension lesser than $n-1$ is an intersection of some hyperplanes. Additionally, an affine set is always convex. So, if we further constrain the feasible region generated by $f$ and $g_i$ functions with such an affine set, then we kind of "reduce" the dimensionality of the feasible region, without damaging its convexity (since the affine set is convex).
Is my idea correct? If not, what role does the affine set play here? Why do we need it in the determination of the feasible region?
The constraints of optimization problems are typically written as a system of equations and inequalities.
In order to ensure that the feasible region is convex, one assumes that the $g_i$ are convex, and the equation constraints are affine linear. That said, linear affine equations always yield a convex feasible set. Nonlinear equations as constraints might yield non-convex (and even disconnected) feasible sets.