If all entries of an invertible matrix $A$ are rational, then all the entries of $A^{-1}$ are also rational. Now suppose that all entries of an invertible matrix $A$ are integers. Then it's not necessary that all the entries of $A^{-1}$ are integers. My question is:
What are all the invertible integer matrices such that their inverses are also integer matrices?

Exactly those whose determinant is $1$ or $-1$.
See the previous question about the $2\times 2$ case. The determinant map gives necessity, the adjugate formula for the inverse gives sufficiency.