If we have a polyhedron $P = \{x\in\mathbb{R}^n \mid Ax \leq b \}$, and we find a point $x\in P$ such that $x$ satisfies at least $n$ of the $Ax\leq b$ (linearly independent) inequalities strictly, then does that mean that the dimension of $P$ is $n$?
More generally, if we can find a point $x\in P$ such that $x$ satisfies at least $k$ of the $Ax\leq b$ (linearly independent) inequalities strictly, then does that mean that the dimension of $P$ is at least $k$?
The answer is no, as the following examples show.
The preceding example is somewhat contrived, because the last $2n$ inequalities are redundant and can be removed. The following example shows that your statement might still fail if no single inequality can be removed.
In the second example, I don't think there is another half-space representation of the same polytope such that every point of $P$ satisfies at most one inequality strictly. However, you can replace the inequality $x_2 \leq 1$ by the inequality $x_1 \leq 1$, and then the two inequalities that are strict for the point $(\frac{1}{2},\frac{1}{2})$ are linearly dependent. I think you can do something similar for a general polyhedron. In any case, my examples show that the answer depends on the halfspace-representation of $P$.