I am trying to derive the generating function for $H(x,p) = \sum_{n=0}^{\infty} n^p x^n$
I am trying to solve it with the following logic:
(Edited now, trying a new framing)
Base case:
$$H(x,0) = \sum_{n=0}^{\infty} x^n = \dfrac{1}{1-x}$$
And
$$H(x,p) = x \dfrac{\partial}{\partial x} H(x,p-1)$$
Implying
$$H(x,p) = \left(x \dfrac{\partial}{\partial x}\right)^p \dfrac{1}{1-x}$$
Here's one way of describing the answer. First, the Stirling numbers of the second kind $S(m, k)$ have the property that
$$n^m = \sum_k S(m, k) (n)_k$$
where $(n)_k = n(n-1) \dots (n-(k-1))$. Second, the generating function of $(n)_k$ turns out to be relatively straightforward to write down: it is
$$\sum_n (n)_k x^n = k! \frac{x^k}{(1 - x)^{k+1}}.$$
You can derive this by repeatedly differentiating $\frac{1}{1 - x}$. It follows that
$$\sum_n n^m x^n = \sum_k S(m, k) k! \frac{x^k}{(1 - x)^{k+1}}.$$
This is in fact equivalent to a claim about how the differential operator $\left( x \frac{d}{dx} \right)^n$ expands, as mentioned in the comments.