In the solution of the one-dimensional heat equation the following step is made:
Because
$$ X(x) T'(t) = \alpha X'' (x) T(t)$$
we have
$$ \frac{X''}{X} = \frac{T'}{T}$$
Why is it ok, to assume that both $X(x)$ and $T(t)$ are non-zero for all $t$ and all $x$?
That's the assumption that has to be made to do this, right?
This is an important question because it is glossed over in some texts. You are assuming (hoping, guessing) that there is a product solution. Unless $X$ and $T$ are identically zero, there is a point $x_1$ and a point $t_1$ where $X(x_1) \ne 0$ and $T(t_1)\ne 0$. A basic fact about any continuous function is that if it is nonzero at some point, then it is nonzero in some neighborhood of that point. Therefore you can do the division in at least some intervals of $x$ and $t$, and find possible functions $X$ and $T$ in those intervals.
Finally you have to check your function $X(x)T(t)$ in the PDE to see whether it really is a solution. That is when you find out that your product works (or not) even for places where some factor is zero.