Suppose I generate a random variable by first selecting from $Y \sim \operatorname{Beta}(\alpha, \beta)$
I then use the result to generate a random variable distributed as $X \sim \operatorname{Normal}(NY,NY(1-Y))$ for some fixed $N$.
Clearly $X$ is a mixture of normals, but is $X$ itself a normal distribution, or any other well known distribution?
Below is an attempt using MGF as per comment suggestion.
We have: $M_x = E_Y[M_{x|y}]$
Now $$M_{x|y}(t) = \exp(Ny t + \frac{1}{2}Ny(1-y) t^2) = \exp(Nyt(1 + \frac{(1-y)t}{2}))$$
Now presumably $$E_Y[M_{x|y}] = \int_{0}^{1} M_{x|y} f(y)dy = \int_{0}^{1} exp(Nyt(1 + \frac{(1-y)t}{2})) \frac{\Gamma(\alpha + \beta)}{\Gamma(\alpha)\Gamma(\beta)} y^{\alpha-1}(1-y)^{\beta-1}dy$$
Now the moment generating function of the beta distribution is given by,
$$M_b(t,\alpha,\beta) = \frac{\Gamma(\alpha + \beta)}{\Gamma(\alpha)\Gamma(\beta))}\int_{0}^{1}e^{ty}y^{\alpha-1}(1-y)^{\beta-1}dy$$
Thus,
$$M_b(Nt(1 + \frac{t}{2}),\alpha,\beta) = \frac{\Gamma(\alpha + \beta)}{\Gamma(\alpha)\Gamma(\beta))}\int_{0}^{1}e^{Nt(1 + \frac{t}{2})y}y^{\alpha-1}(1-y)^{\beta-1}dy$$
As you have already pointed out $X$ cannot be normal as it is a normal mixture; however, conditioning $X$ on $Y$ does give a normally distributed random variable since $$ X|Y\sim\mathcal N(nY,nY(1-y)). $$
The random variable $X$ is an example of a normal location-scale mixture. The Wikipedia article in the link gives some examples of well-known examples of this type of mixture model; however, none of the given examples match your specific model.
As for the moments of $X$ note that since $X|Y\sim\mathcal N(nY,nY(1-y))$ we can write the moments of $X$ as $$ \mathsf EX^k=\mathsf E(\mathsf E(X^k|Y)). $$ Using equation (18) in this arXiv article allows us to write this expression as $$ \mathsf EX^k=\mathsf E\left(\left(\frac{i\sqrt{nY(1-Y)}}{\sqrt 2}\right)^kH_k\left(-i\frac{nY}{\sqrt{2nY(1-Y)}}\right)\right), $$ where the expectation is taken w.r.t. $Y\sim\operatorname{Beta}(\alpha,\beta)$. Using the explicit expression for the Hermite polynomial this becomes $$ \begin{aligned} \mathsf EX^k &=\mathsf E\left(\left(\frac{i\sqrt{nY(1-Y)}}{\sqrt 2}\right)^kk!\sum_{\ell=0}^{\lfloor k/2\rfloor}\frac{(-1)^\ell}{\ell!(k-2\ell)!}2^{k-2\ell}\left(-i\frac{nY}{\sqrt{2nY(1-Y)}}\right)^{k-2\ell}\right)\\ &=k!\sum_{\ell=0}^{\lfloor k/2\rfloor}\frac{2^{-\ell}n^{k-\ell}}{\ell!(k-2\ell)!} \mathsf E\left(Y^{k-\ell}(1-Y)^\ell\right)\\ &=k!\sum_{\ell=0}^{\lfloor k/2\rfloor}\frac{2^{-\ell}n^{k-\ell}}{\ell!(k-2\ell)!} \mathsf E\left(Y^{k-\ell}(1-Y)^\ell\right). \end{aligned} $$ Knowing the moments of the beta distribution we obtain the final result $$ \mathsf EX^k =k!\sum_{\ell=0}^{\lfloor k/2\rfloor}\frac{2^{-\ell}n^{k-\ell}}{\ell!(k-2\ell)!} \frac{\operatorname B(\alpha+k-\ell,\beta+\ell)}{\operatorname B(\alpha,\beta)}, $$ which may (possibly) be written in terms of hypergeometric functions.
The analytical expression for the moments can be implemented in Mathematica as
Here is a table of the first several
$$ \left( \begin{array}{cc} k & \mathsf EX^k \\ 0 & 1 \\ 1 & \frac{\alpha n}{\alpha +\beta } \\ 2 & \frac{\alpha n (\beta +\alpha n+n)}{(\alpha +\beta ) (\alpha +\beta +1)} \\ 3 & \frac{\alpha (\alpha +1) n^2 (3 \beta +(\alpha +2) n)}{(\alpha +\beta ) (\alpha +\beta +1) (\alpha +\beta +2)} \\ \end{array} \right) $$