The following sentence is from "Calculus Fourth Edition" by Michael Spivak.
The symbol $$\int f\text{ or }\int f(x)dx$$ means "a primitive of $f$" or, more precisely, "the collection of all primitives of $f$."
Why do mathematicians use and write theorems about $\int f(x)dx$ ?
When we use $\int f(x)dx$, I think we always assume $f$ is continuous.
When $f$ is continuous on $[a,b]$, the collection of all primitives of $f$ is $\{g:[a,b]\to\mathbb{R}:g(x)=\int_c^x f(t)dt+C, C\in\mathbb{R}
\}$, where $c$ is an arbitrary fixed point in $[a,b]$.
So, I think we don't need to invent the new symbol $\int f(x) dx$ and we don't need to write theorems about $\int f(x) dx$.
We already have the notion of definite integrals $\int_a^b f(x) dx$ and we already have theorems about $\int_a^b f(x)dx$.
No, not at all. The class of integrable functions is a lot bigger than just continuous functions. And discontinuous functions are considered.
It is correct that if $F,G$ are such that $F'=G'$ then indeed they differ by a constant. And indeed, if $f$ is continuous then by the fundamental theorem of calculus every antiderivative is of the form $x\mapsto \int_0^x f(t)dt + C$. However it is no longer guaranteed to be true if we drop the "continuity" assumption, see this.
And so this:
$$\{g:[a,b]\to\mathbb{R}:g(x)=\int_c^x f(t)dt+C, C\in\mathbb{R} \}$$
is not the collection of antiderivatives in general.
Of course we could write
$$\{g:[a,b]\to\mathbb{R}:g'(x)=f(x)\}$$
but $\int f(x)$ is simply shorter. That's literally what symbols are used for: to make definitions shorter.
It's the same question as: why do we use $\int_{a}^{b} f(t)dt$ if I can simply copy-paste definition here? It is shorter.