When we take a limit, we say that the value is never equals that number, but approaches it, like in $$\lim_{n\to\infty}\frac{1}{n} = 0.$$ It never reaches $0$, but becomes closer and closer to $0$.
In this case, isn't it wrong to say things like:
$$2 = 1 + \frac{1}{2} + \frac{1}{4}+\frac{1}{8} + \frac{1}{16}+\cdots $$ Or that a derivative of $\sin(x)$ is $\cos(x)$ since the limit of $$\frac{\sin(x+\Delta x)-\sin(x)}{\Delta x}$$ with $\Delta x$ approaching $0$ is never equal to $\cos(x)$ but infinitely closer?
Is there a good article about this that I can read and understand it better?
The point is that the limit is exactly the operation that takes a sequence $x_n$ approaching $x$ and gives you $x$. That is, when we say $$\lim_{n \to \infty} x_n = x,$$ we mean that $x_n$ converges to $x$ as $n\to \infty$; this does not claim that $x_n = x$ for any $n$. In your sum, the ellipsis $\cdots$ implies a limiting process: this equation could be more formally written
$$ 1 = \lim_{N \to \infty} \sum_{n=1}^N \frac 1 {2^n}.$$
Note that none of these finite sums is equal to $1$, but they approach $1$, so we say their limit is 1.