Having in mind that the error function is a function such that: $$\text{erf}(x)=\displaystyle\int_0^{x}\frac{2}{\sqrt{\pi}}e^{-u^2}du$$
Graphically I can see that for $x>0$
$$\text{erf}\left(\frac{x}{\sqrt{2}}\right)\geq\left(1-\frac{1}{x^2}\right)$$
But how can that be proven mathematically?
Is there some particular result (something I should already detect from what I am given) to use or is the "differentiating on both sides approach" to be used? I have tried to differentiate on both sides wrt $x$ but this doesn't help me permorm further steps and I get stuck again.
Or is the fact that both r.h.s. and l.h.s. are non-decreasing, but at a different rate (second derivative), influential? That is, r.h.s. seems to grow at a faster rate but anyway not sufficient to 'go above' l.h.s.
Disclaimer: This is not a complete answer, but I believe the methods could perhaps be tweaked to give the desired inequality.
I assume that you are interested in the case where $x \geq 0$. The tail-CDF of a standard normal distribution $Z$ is given by $$\frac{1}{2} - \frac12 \text{erf} \left( \frac{x}{\sqrt 2} \right)$$ and represents the probability that $Z$ is greater than $x$. By Chebyshev's Inequalities for higher moments, $$\frac{1}{2} - \frac12 \text{erf} \left( \frac{x}{\sqrt 2} \right) =\mathbb{P}(Z > x) \leq \frac{\mathbb{E}[(Z - \mathbb{E}[Z])^4]}{x^4} = \frac{3}{x^4}$$ Here we have used the fact that the fourth moment of the standard normal is $3$. This inequality implies that $$\text{erf}\left(\frac{x}{\sqrt 2}\right) \geq 1 - \frac{6}{x^4} > 1 - \frac{1}{x^2}$$ whenever $x \geq 2.5$. It seems that the harder part of the problem is to show that for small $x$ the inequality holds.
Note that direct application of Chebyshev's Inequality on the standard normal distribution gives the inequality $$\text{erf}\left(\frac{x}{\sqrt 2}\right) \geq 1 - \frac{2}{x^2}$$ which is not quite the inequality that we want.