The current article on Metalanguage on Wikipedia states in the section In Natural Language:
Metalanguages of formal systems all resolve ultimately to natural language, the 'common parlance' in which mathematicians and logicians converse to define their terms and operations and 'read out' their formulae.[6]
Where [6] is the reference:
Borel, Félix Édouard Justin Émile (1928). Leçons sur la theorie des fonctions (in French) (3 ed.). Paris: Gauthier-Villars & Cie. p. 160.
I was able to find titles of the notes added in the 3rd edition:
NOTE DE LA TROISIÈME ÉDITION
VII - Pour ou contre la logique empirique.
- Logique formelle et logique empiriste, par Rolin Wavre.
- Sur le principe du tiers exclu et sur les théorèmes non susceptibles de démonstration, par Paul Lévy.
- Sur le principe du tiers exclu, par Rolin Wavre.
- Critique de la logique empirique, par Paul Lévy.
- A propos de la récente discussion entre Rolin Wavre et Paul Lévy, par Émile Borel.
- Sur la logique de Brouwer, par Barzin et A. Errera.
- Logique classique, logique brouwerienne et logique mixte, par Paul Lévy.
but I'm not able to find the document itself.
I guess my question is: where can I find some modern discourse on this notion that all metalanguage must eventually devolve into an informal natural language?
You can see every mathematical logic textbook : the formal systems that are the "object" of the study are described with "standard" mathematical jargon : natural language plus mathematical symbols used as abbreviations.
See e.g. R.Kaye, The Mathematics of Logic (2007), page 28:
For a subtler discussion, see Yuri Manin, A Course in Mathematical Logic for Mathematicians (Springer, 2010), Ch.I Introduction to Formal Languages.