I am suspicious about the validity of the following proof. I have two doubts that are bugging me:

1) If the proof, is it true that $\psi \in D_0^1([a,b];\mathbb{R}^n)$? I mean $\psi$ is the integral of $u$ : $\psi = \int_a^x (u(s)-c)ds$ which is is piecewise-continuous, so in the eventual discontinuity points, also the integral is discontinuous, isn't it? So why would the $\psi$ be necessarily continuous?
Note : $D_0^1([a,b];\mathbb{R}^n)$ means functions in $D^1([a,b];\mathbb{R}^n)$ that vanish the endpoints. And $D^1([a,b];\mathbb{R}^n)$ is the class of piecewise continuously differentiable functions (which are continuous by definition):
2) Is the statement actually correct? I mean,everywhere I look I can just find a version of the lemma for $u$ continuous and not a single one for $u$ piecewise continuous as in my case. Where exactly in the proof is that hypothesis used? (I guess only in the step regarding my first question only?) Do you know where can I find the proof for my case?(In case this one is correct, it is missing the first step that they argue follows by an approximation argument) Or can you provide one?

As the link provided by @Lorago answers your first question, I only comment on your second one.
Yes, the statement is true. Here, the hypothesis makes sure that $u$ is actually integrable and simplifies the proof. Using more machinery, we can proof the statement even with less regularity:
$\textbf{Theorem:}$ Suppose that $f\in L^1_{\text{loc}}(a,b)$ for some $a<b\in\mathbb{R}$ and $$ \int_a^b f\eta' \, \text{d}x = 0$$ for all $\eta\in C_c^\infty(a,b)$. Then $f\equiv \text{const.}$ almost everywhere.
A proof can be found in "One-dimensional Variational Problems: An Introduction" by Buttazzo, Giaquinta and Hildebrandt, Lemma 1.8. Alternatively you can find the proof here https://mccuan.math.gatech.edu/courses/7581/notes/lecture3.pdf, lemma 4.