This is somewhat of a minor point about the incompletness theorem, but I'm always a little unsure:
So one proves that there is a formula which is unprovable in the theory of consideration. Okay, at this point one is done.
Then, as that unproven sentence contains the claim that this (the unprovable-ness) would happen, one is in some sense justified to say "So the statement really is true, but still, it's unprovable within the theory". Now here is my problem: I'm very unsure in which sense this notion of truth which somewhat comes from outside the theory is sensible. There is a note on that point on the wikipedia page but I don't really comprehend it.
The word "true" is used disquotationally here: the Gödel sentence is true in this sense because it "asserts its own unprovability and it is indeed unprovable" (Smoryński 1977 p. 825; also see Franzén 2005 pp. 28–33). It is also possible to read "GT is true" in the formal sense that primitive recursive arithmetic proves the implication Con(T)→GT, where Con(T) is a canonical sentence asserting the consistency of T (Smoryński 1977 p. 840, Kikuchi and Tanaka 1994 p. 403)
So I can see that if one is technically aware that one is now talking in a meta language, that one has introduced a new "true". But then again (a) if one reflects on the fact that one draws such technicals conclusions outside of the initial freamework, then it seems to me one should really introduce another meta-meta-language. And (b) isn't it really just a little ambiguous to say "Gödels incompleteness theorems says that there are true statements, which can't be proven within a certain strong theory"?
I'd be thankful if someone could elaborate on that.
There might be a bit of a chicken-and-egg happening here. For the common proofs of Gödel's Incompleteness Theorem, we put special priority on the structure $( \mathbb{N} , 0, S, + , \cdot , \mathrm{exp} )$ of elementary arithmetic. If something is true in this structure, then we often refer to that statement as true.
Peano Arithmetic is one attempt to axiomatize all truths of this structure. In more modern terms, it was perhaps hoped that the statement $$\mathbb{N} \models \phi \;\Leftrightarrow\; \text{PA} \vdash \phi$$ would have been true (or true). Gödel's Theorem tells us that this is impossible, and, more, that any attempt to "nicely" axiomatize truth in $\mathbb{N}$ is doomed to fail, by being either inconsistent, or incomplete.
As the structure $\mathbb{N}$ "exists" outside of the formal system PA (and "existed" well before this system was devised), we can argue about truth within the structure $\mathbb{N}$ using methods outside the formal system PA. In fact, there are several truths about $\mathbb{N}$ that we know cannot be proved within PA (e.g., Goodstein's Theorem and a certain strengthening of the finite Ramsey's Theorem). As long as there is no real controversy about these extra-PA methods used, the truth of these results is similarly uncontroversial. It is by using such methods outside of PA that we argue that if PA is consistent, then $G_{\text{PA}}$ is true (in $\mathbb{N}$).
While perhaps a bit ambiguous, this consequence of Gödel's Theorem could be restated (somewhat awkwardly) as "Given any "nice" consistent axiom system capable of expressing elementary arithmetic, there are number-theoretic statements which are true in $\mathbb{N}$ that cannot be proved within that system."