\begin{align}f(x) &= x^2\\ g(x)&=\int_0^xt^2dt = \frac{x^3}{3}\\ \end{align}
$(2,4)$ is a point on $f(x)$, therefore $(4,2)$ must exist on its inverse.
However $g(4) = 64/3\ne 2$.
Also clearly $x^2$ and $\frac{x^3}{3}$ are not inverses. What am I missing?
You seem to mix the concepts of inverse functions and inverse operations:
for the functions $\mathbb{R^+}\to\mathbb{R^+}$ given by $f(x)=x^2$ and $g(x)=\sqrt{x}$, you have: $$\color{blue}{2} \xrightarrow{f} \color{red}{4} \xrightarrow{g} \color{blue}{2}$$ so in your wording: $(2,4)$ belongs to $f$ and $(4,2)$ belongs to $g$;
for the operations "integrate" $\int$ (indefinite; i.e. get an antiderivative) and "differentiate" $\frac{d}{dx}$, you have: $$\color{blue}{x^2} \xrightarrow{\displaystyle\int} \color{red}{\frac{x^3}{3} \;(\,+\,C\,)}\xrightarrow{\displaystyle\frac{d}{dx}} \color{blue}{x^2}$$ so in your wording you could say that $(x^2,\frac{x^3}{3})$ belongs to (the operation) $\int$ and $(\frac{x^3}{3},x^2)$ belongs to (the operation) $\frac{d}{dx}$.
So it's similar in a way, but the functions act on numbers while the operations above act on functions.