I've just started doing simplices, where the $n$-simplex has been defined to be $$\Delta^n = \{x \in \mathbb{R}^{n+1}\mid x_i \geq 0, \sum x_i=1\}.$$
It's easy to see that the $0$-simplex is the point $1$ in $\mathbb{R}^1$, the $1$-simplex is the line from $(1,0)$ to $(0,1)$ in $\mathbb{R}^2$, and the $2$-simplex is the triangle, including the interior, with vertices $(1,0,0), (0,1,0), (0, 0, 1)$ in $\mathbb{R}^3$.
But how do we justify that the $3$-simplex is a tetrahedron, including the interior, with points $(1,0,0,0), (0,1,0,0), (0,0,1,0), (0,0,0,1)$ in $\mathbb{R}^4$?
Even worse, why is a $4$-simplex a pentachoron?

Let's take a look at the definition of a simplex: $$\Delta^n = \{x \in \mathbb{R}^{n+1}\mid x_i \geq 0, \sum x_i=1\}.$$ Two aspects of this definition are important:
There are no other restrictions on the point $P$. So it holds that $P\in\Delta^n$ if and only if $$P\in[0,1]^{n+1}\cap h,$$ or - in other notation - that $$\Delta^n =[0,1]^{n+1}\cap h.$$ So to visualize a simplex, you can visualize the hypercube, visualize the affine hyperplane and visualize their cut-set, which is the simplex. Here is a visualization of $\Delta^2$:
For $\Delta^2$, you are in a three-dimensional vector space. The hypercube is a cube and the hyperplane is a plane. In the above picture, the cube is visualized in green color and the cut-set of the cube with the plane (i.e. the simplex) is visualized in red.
Visualization in higher dimensions is difficult, but the concept that the simplex is the cut-set of a hypercube with an affine hyperplane also holds, so the geometrical situation is basically the same.
Please note: In the above geometrical description I have implicitly used the canonical basis vectors. You can visualize the simplex using another basis, too. When using another basis, replace hypercube with parallelepiped in the above description.