I am trying to bound a function of the form \begin{align} f(x,y) &= \operatorname{erf}(x+y) - 2\operatorname{erf}(x) + \operatorname{erf}(x-y), \end{align} for small values of $y$ and all (sufficiently large) $x$. Obviously this form is rather reminiscent of the symmetric way of writing the second derivative \begin{align} g''(x) = \lim_{y\to 0} \frac{g(x+y) - 2g(x) + g(x-y)}{y^2}, \end{align} so we are motivated to seek a bound that looks like \begin{align} f(x,y) \leq y^2 \frac{d^2}{dx^2} \operatorname{erf}(x) = -\frac{4}{\sqrt{\pi}} xy^2 \exp(-x^2). \end{align} It appears (just numerically plotting it) that this bound is indeed true, as long as $x \geq y$ and $x\geq\sqrt{2}$, which is relevant as the point where the Gaussian $\exp(-x^2)$ switches from being concave to convex.
Unfortunately I have not been able to prove such a bound. I think that such a basic thing should be known somewhere, so hopefully someone here has seen it before!
Denote $G(x) = \text{erf}(x)$. By Taylor's approximation, we have: $$G(x+y) = G(x) +yG'(x)+\frac{y^2}{2}G''(x)+\frac{y^3}{3!}G^{(3)}(x)+\frac{y^4}{4!}G^{(4)}(x) + \mathcal{o}(y^4)$$ $$G(x-y) = G(x) -yG'(x)+\frac{y^2}{2}G''(x)-\frac{y^3}{3!}G^{(3)}(x)+\frac{y^4}{4!}G^{(4)}(x) + \mathcal{o}(y^4)$$ Then we can easily deduce $$\begin{align} f(x,y)&=y^2G''(x)+2\frac{y^4}{4!}G^{(4)}(x) +\mathcal{o}(y^4)\\ &=-\frac{4xy^2}{\sqrt{\pi}}e^{-x^2} \underbrace{-\frac{y^4}{12}\cdot \underbrace{\frac{8x(2x^2-3)}{\sqrt{\pi}}e^{-x^2}}_{\ge0 \text{ for $x\ge \sqrt{3/2}$}}+\underbrace{\mathcal{o}(y^4)}_{\text{dominated by }y^4}}_{\text{negative for $x\ge \sqrt{3/2}$ and $y$ sufficiently small}} \end{align}$$
By consequence, $$f(x,y) \le -\frac{4xy^2}{\sqrt{\pi}}e^{-x^2} \hspace{1cm} \text{for all $x\ge \sqrt{3/2}$ and $y$ sufficiently small}$$