Find the tangent plane to a parametric curve $$\vec r(u) = x(u)\mathbf i + y(u)\mathbf j + z(u)\mathbf k$$
I know that the tangent line at a point $u = u_0$ is given by $$\vec \ell(t) = \vec r(u_0) + \vec r'(u_0)(t - u_0)$$ but what about the plane, though?
There is no tangent plane, just a tangent line. The reason is that the your curve is a 1-dimensional manifold and the tangent space has the same dimension as the manifold.
Intuitively, a tangent vector $v$ represents the speed and direction of a body moving on the manifold while remaining "on" that manifold. For example, if you're walking on earth while remaining with your feet on the ground, you can only move tangent to the ground. In your case you have a curve, which is like a path, so you can only move forward or backward with different speeds, so the tangent space is a line.