There exist geometrical proofs for the calculation of the sums $S_p(n):=\sum_{k=1}^nk^p$ for $p=1$ and $p=2$ (e.g. compilation of proofs for sum of squares and cubes, understanding some PWoWs).
The core question of this thread is: Does there exist a geometry-based method to proof the formulas of the above given summations, which is applicable for all integers $n$ and $k$?
I found geometrical proofs for $p=2$ and $p=3$, which I find beautiful. (I am sure other persons found these visualizations before, there are hints on this e.g. in the video Power sum master class.)
The method of this proof for $p=2$ consists in interpreting the sum $1^2+2^2+3^3+...$ as the volume of a shape built by square plates stacked on top of each other thus forming a kind of pyramid. The task is then to calculate the volume of this pseudo-pyramid. The method of the proof for $p=3$ is analogous, but now the 2d squares are replaced by 3d cubes and the 3d pseudo-pyramid is replaced by a 4d pseudo-pyramid. I will show these two proofs as answers to the question. I will also show a nice geometric proof for $p=1$ (which is also contained in the video mentioned above Power sum master class).
Remarks: I am convinced that I can generalize the method to $p=4$. And I am confident, that the method can be generalized to any number of $p$. I guess one has to find and write down quantities of and relations between the geometric features of the $(p+1)$-dimensional pyramids such as (hyper-)faces and sort out how many unit-hyper-cubes touch which faces. If the quantities and relations are written down in a systematic way, one can start generalizing the found rules in an algebraic way. Nevertheless the proof will still be of geometric kind, because the quantities will be connected to geometry in $(p+1)$ dimensions.
While showering, I found a geometrical proof for $p=2$, which can easily be transfered to $p=1$. I am convinced it can be generalized to $p=3$ - if one is familar with 4-dimensional geometry - and I am confident, that it can also be generalized to higher values of $p$ in $(p+1)$-dimensional geometry.
I will show the idea for the case $n=4$ and then generalize it to arbitrary $n$. Fig. 1 shows that the sum $1^2+2^2+3^2+4^2$ can be visualized by a shape in 3d, which is similar to a pyramid. Each square number of the sum is represented by a square which has been augmented to 3d by "pulling it up" by a length of 1. Hence each square number $i^2$ $(i=1, 2, 3, 4)$ is represented by a number of $i^2$ unit cubes, arranged in the pattern of a square. The desired sum corresponds to the volume of the 3d shape "pseudopyramid".
This volume can easily be approximated as $V_{pyr}=\frac{1}{3} \cdot base \cdot height=\frac{1}{3} \cdot n^2 \cdot n=\frac{1}{3}n^3=\frac{64}{3}=21\frac{1}{3}$. However, compared to the exact result $1^2+2^2+3^2+4^2=30$ something is missing. The missing volume is due to the parts of the cubes on the two front side-areas of the "pseudopyramid" which extend further than a similar real pyramide with base $4^2$ and height $4$ would do. The cubes on these areas are cut by these two side faces of the pyramid in parts.
In order to obtain the exact result one has to add these missing pieces. Some of the cubes are cut fifty-fifty into two pieces. These are marked in blue color in Fig. 2. Others are dissected by two side faces of the real pyramid such that inside the real pyramid only a rest pyramid of volume $\frac{1}{3}$ remains of each such unit cube. These are marked orange in Fig. 2. For the case $n=4$ one has to add $2 \cdot (1+2+3) \cdot \frac{1}{2}=6$ (blue) and $4 \cdot \frac{2}{3}=2\frac{2}{3}$ (orange). Hence, one arrives at the correct sum $21\frac{1}{3}+6+2\frac{2}{3}=30$.
This procedure can be generalized to the case $n$ to obtain the sum $S_n=1^2+2^2+3^2+...+n^2$. The volume of the real pyramid here is $V_{pyr}=\frac{1}{3} \cdot n^3$. The missing "blue" parts are $V_{blue}=2 \cdot (1+2+3+...+(n-1)) \cdot \frac{1}{2} = \frac{1}{2} (n-1) \cdot n$ (having applied the "Gauß-Formula"). The missing "orange" parts add up to $V_{orange}=n \cdot \frac{2}{3}$.
In total one obtains
$V_{pyr}+V_{blue}+V_{orange}=\frac{1}{3} \cdot n^3 + \frac{1}{2} (n-1) \cdot n + \frac{2}{3} \cdot n = \frac{1}{3} \cdot n^3 + \frac{1}{2} n^2 + \frac{1}{6} = \frac{1}{6}n(n+1)(2n+1)n$,
q.e.d.
Remark 1: I am quite sure that somebody else has already found this geometric view before, but so far I have not yet found it on math.stackexchange.com.
Remark 2: This proof is similar to https://math.stackexchange.com/a/2371512/930508. However, I think it is simpler and more straightforward and can be generalized easier.
Remark 3: At https://www.felixvoigt.de/wp-content/uploads/2023/07/summe_der_quadratzahlen_kompr.pdf you can find a more clear version of this geometric idea in German language.