Inverse Function Theorem If the derivative $df_x : \mathbb{R}^k \to \mathbb{R}^k$ is nonsingular, then $f$ maps any suffiiciently small open set $U'$ about $x$ diffeomorphically onto an open set $f[U']$
Now my question is what is rigorously meant by suffciently small open set? Certainly $U'$ can't be any open set, since if $U' = \mathbb{R}^k$, that would need the extra assertion that $f$ must be bijective.
Since $U'$ is open in $\mathbb{R}^k$, $U'$ must be the open ball centered at $x$ with radius $\epsilon$, thus $U' = B_{(\mathbb{R}^k, d)}(x, \epsilon)$ for some $\epsilon > 0$. (and $d$ is that standard euclidean metric).
"Sufficiently small" in the above theorem must mean that there is some upper bound on $\epsilon$, if that's correct, then what would that upper bound be?
If $U'$ is any such open ball around $x$ of radius $\epsilon$, then $f$ maps maps any open ball around $x$ of radius $\delta<\epsilon$ diffeomorphically onto its image as well. So "sufficiently small" in this case means "smaller than $\epsilon$", once you have some value of $\epsilon$ that works.