Is the punctured $3d$ space, $\mathbb{R}^3\setminus\{(0,0,0)\}$ homeomorphic to $\mathbb{R}^3\setminus B_{\epsilon}$, where $B_{\epsilon}$ is a closed ball of radius $\epsilon$?
I don't think so. This is because the origin and the ball are not homeomorphic, so I think their complements must also not be. Any hints? Thanks beforehand.
Yes. You can map $\mathbb R^3\setminus\{(0,0,0)\}$ continuously to $\mathbb R^3\setminus B_\epsilon$ by means of $r\mapsto r+\epsilon$ provided $B_\epsilon$ is the closed ball and $r$ denotes the radial component of polar coordinates in $\mathbb R^3$. The inverse mapping is obviously $r\mapsto r-\epsilon$.
Moreover, similar applies to any dimension, i.e. to $\mathbb R^n$.
The origin and the ball are not in your (open) sets; hence it does not matter. Would be different if their borders were part of the sets, because the first one would be just $\mathbb R^3$ in that case which is a open set whereas the second one would be neither open nor close.
Note: $r\mapsto r+\epsilon$ is short for $(r,\varphi,\theta)\mapsto (r+\epsilon,\varphi,\theta)$.