Gödel's completeness theorem: Given a set of axioms, if we cannot derive a contradiction, then the system of axioms must be consistent.
Gödel's incompleteness theorem:'Given any consistent, computable set of axioms, there's a true statement about the integers that can never be proved from those axioms'.
Since the incompleteness theorem assumes that the given set of axioms is consistent, then, by using the completeness theorem shouldn't all statements derived from this set of axioms be true thereby rendering the claim that 'there exists a true statement that cannot be proved' false?
No. You seem to confuse between "true" and "derivable" (or "provable"). The incompleteness theorem tells us that givens a theory with certain constraints, if it is consistent then there are things it cannot prove.
Furthermore, the completeness theorem tells us that a statement is provable from a theory if and only if it is true in all the models of the theory. So by combining these two we simply have the following statement:
Given a theory which satisfies the requirements of the incompleteness theorem, there will be a statement about the integers which is true in some models, but false in other models.
One finer point here is that when we say that a statement about the integers is "true", we mean to say that it is true in their standard model, $\Bbb N$. But the integers have other models, which are called non-standard models. So if a statement is true in the standard model of the integers it tell us nothing about its truth value in other models. In fact, if the statement is not provable it will be false in some of these models.