As far as every question I've seen concerning "what is $\sum_{k=1}^nk^p$" is always answered with "Faulhaber's formula" and that is just about the only answer. In an attempt to make more interesting answers, I ask that this question concern the problem of "Methods to compute $\sum_{k=1}^nk^p$ without Faulhaber's formula for fixed $p\in\mathbb N$". I've even checked this post of common questions without finding what I want.
Rule #1: Any method to compute the sum in question for arbitrary $p$ is good, either recursively or in some manner that is not in itself a closed form solution. Even algorithms will suffice.
Rule #2: I don't want answers confined to "only some values of $p$". (A good challenge I have on the side is a generalized geometric proof, as that I have not yet seen)
Exception: If your answer does not generalize to arbitrary $p$, but it still generalizes to an infinite amount of special $p$'s, that is acceptable.
Preferably, the method is to be easily applied, unique, and interesting.
To start us off, I have given my answer below and I hope you all enjoy.
Feel free to skip to the highlighted parts and the ending to see the formula in action.
Suppose we had a continuous and differentiable function that satisfied the following equation:
$$f(x,p)=f(x-1,p)+x^p,\quad f(0,p)=0$$
Differentiating with respect to $x$, we get
$$f'(x,p)=f'(x-1,p)+px^{p-1}$$
Now notice that when $x\in\mathbb N$
$$f'(x,p)=f'(0,p)+p\sum_{k=1}^xk^{p-1}=f'(0,p)+pf(x,p-1)$$
Integrating both sides from $0$ to $x$, we have
$$f(x,p)=\int_0^xf'(t,p)dt=\int_0^xf'(0,p)+pf(t,p-1)dt=xf'(0,p)+p\int_0^xf(t,p-1)dt$$
When $x=1$, it is easy enough to see that
Combining all of this, we have
And with $p=0$, it is trivial to see that
$$a_0=1\implies f(x,0)=x$$
Further,
$$a_1=1-\int_0^1t\ dt=\frac12$$
$$f(x,1)=\frac12x+\int_0^xt\ dt=\frac12x+\frac12x^2$$
$$a_2=1-2\int_0^1\frac12t+\frac12t^2dt=\frac16$$
$$f(x,2)=\frac16x+\frac12x^2+\frac13x^3$$
Indeed, these are the solutions to the sum in question found by a recursive formula involving integrals.
This method is described here.