We observe that almost all physical phenomena (which has been explained) can eventually be explained by the laws of mathematics. Mathematics seems ubiquitous- for example the form of the differential equation that governs the simple harmonic motion of a helical spring has the exact same form to explain the current in a RLC circuit. The parallels are endless virtually. But it does not mean necessarily that the 'next to be discovered phenomenon' has to follow the laws of mathematics provided that there is a theorem out there which proves that every physical mechanism has to abide by the laws of maths.
Could anyone answer with a philosophical insight on this matter and has the Godel's Incompleteness theorem anything to say on this?
If you haven't already read Eugene Wigner's essay "On the unreasonable effectiveness of mathematics in the natural sciences". It addresses most of what you mentioned.
https://www.dartmouth.edu/~matc/MathDrama/reading/Wigner.html