Is CW complex unique if skeletons are fixed?

Question

Let $(X,E),(X,E')$ be CW-complexes. ($E,E'$ are collections of cells in $X$)

If $n$-skeleton of $(X,E)$ is equal to $n$-skeleton of $(X,E')$ for all $n$, is $E=E'$?

Thank you in advance!