It is my understanding that Gödel's second incompleteness theorem says roughly that
there exists a sentence $\varphi$ such that neither $\varphi$ nor $\neg\varphi$ is provable in Peano's arithmetic. However one of them is true (in the structure $\mathbb{N}$).
If $\varphi$ is a formula in the style : "for all integers $n$, then $\psi(n)$". For me, if $\varphi$ is false, proving it false is simply exhibing a counterexemple $n_f$ such that $\neg\psi(n_f)$. Therefore if it is false, then it must provably false, doesn't it?
Therefore, it someone manage to prove that it not provable, does it mean that $\varphi$ must be true?
Is this reasoning correct?
No, because you may not be able to prove that the counterexample is false in Peano arithmetic. In other words, $\neg\psi(n_f)$ itself may be another statement that is true but not provable in PA.
However, if for every $n$, you know that either $\psi(n)$ or $\neg\psi(n)$ is provable in Peano arithmetic, then your conclusion is correct. For example, this will be the case if $\psi$ is quantifier-free, because then $\psi$ is a Boolean combination of purely numerical statements like 2+2=4 and you can always prove or refute such a statement in Peano Arithmetic.