This is a rather vague or maybe philosophical question. Basically I want to have a deeper understanding on the motivation of syntax-semantics separation in mathematical logic, since it struck me when I first know people treat mathematical proofs as symbol manipulations purely.
Specifically, there are several aspects that I would like to know about:
Why does viewing proofs purely syntactically helps with mathematical rigour? Examples?
Why do people want a logic language independent of the models it represents?
Why does axiomatic method get more and more emphasised in the history of mathematical development?
I have some vague impressions for the answers of these questions, but I don't know how to elaborate them precisely. Therefore I would like to learn your knowledge and opinions on this topic.
The distinction you mentioned between language and models is crucial to understanding model theory. Already in the 1920s and 1930s it was clearly understood that Peano arithmetic does not uniquely characterize the natural numbers. Notably in 1933 Skolem constructed exotic models of the "natural numbers" in ZF (Zermelo-Fraenkel set theory without the axiom of choice). Similarly the distinction is crucial to understanding Lowenheim-Skolem phenomema. To mention another example close to my interests, one can show that the existence of a strictly positive function with zero Lebesgue integral is consistent with ZF. Such a claim is probably incomprehensible if one thinks of sets as being "out there" in a literal realist sense, a viewpoint challenged by the syntactic/semantic distinction.
Some mathematicians find such dualities troubling on philosophical grounds and reject them. Thus, Paul Halmos adhered to the view that mathematics is one splendid architecture and sought to reformulate logic in a way that would not involve the aforementioned duality; for details see this article.