Why do we treat a certain $C$ as adding nothing?
take $\sin(x)$. It's usually agreed that: $$\int\sin(x)dx=-\cos(x)+C$$
But I could define a function like: $$\mathrm{sock}(x) = \cos(x)-1$$ And rightfully claim that $\int\sin(x)=-\mathrm{sock}(x)+C.$
And then $C=0$ is a different function, and in addition when integrating twice the result is very different, going to infinity instead of being bounded by $-1$ and $1$.
Basically, is there a reason that we choose $C=0$ to be the point that it is? This is also confusing from a physics standpoint, since even when choosing initial conditions yourself they will get you completely different effects/motions depending on the function that is considered the integral with $C=0$.
To understand this, go back to the basic definition of what an integral is. An indefinite integral (one with no limits) basically asks you to consider what function when differentiated will yield the function in the integral. That is the very heart of what an indefinite integral is.
But, we are then left with the following problem. If I was looking for the integral of cos(x), that could be any of the following
The point here is any constant simply disapears when we integrate. Try it! all of the above function when differentiated will yield cos(x). So therefore, in order to represent all of the possible constants, we simply represent them with the letter C. The actual number that C represents in completely unimportant.