Using $\zeta(2)$ as an example.
$\sum_{n=0}^\infty \frac{1}{n^2}=1+\frac{1}{2^2}+\frac{1}{3^2}+...=\frac{\pi^2}{6} $
When alternating the values gave -$\frac{\zeta(2)}{2}$
$\sum_{n=0}^\infty \frac{(-1)^n}{n^2}=-1+\frac{1}{2^2}-\frac{1}{3^2}+...=-\frac{\pi^2}{12} $
and changing the negative gave $\frac{\zeta(2)}{2}$
$\sum_{n=0}^\infty \frac{(-1)^n}{n^2}=1-\frac{1}{2^2}+\frac{1}{3^2}-...=\frac{\pi^2}{12} $
This seems to only work on convergent series, since something like the Harmonic Series continues to infinity while the Alternating Harmonic Series converges to ln(2)
So why do the alternating versions produce these values so similar to the non alternating version?
Note that we have in general
$$\begin{align} \sum_{n=1}^{2N} (-1)^na_n&=\sum_{n=1}^N a_{2n}-\sum_{n=1}^Na_{2n-1}\\\\ &=\sum_{n=1}^N a_{2n}-\left(\sum_{n=1}^{2N}a_n-\sum_{n=1}^Na_{2n}\right)\\\\ &=2\sum_{n=1}^N a_{2n}-\sum_{n=1}^{2N} a_n\tag1 \end{align}$$
We can use $(1)$ to evaluate the series of interest. Using $(1)$, for $a_n=\frac1{n^2}$ we have
$$\begin{align}\sum_{n=1}^{2N}\frac{(-1)^n}{n^2}&=2\sum_{n=1}^N \frac1{(2n)^2}-\sum_{n=1}^{2N}\frac1{n^2}\\\\ &=-\frac12\sum_{n=1}^N \frac1{n^2}-\sum_{n=N+1}^{2N}\frac1{n^2}\tag2 \end{align}$$
Since the first term on the right-hand side of $(2)$ converges to $-\frac{\pi^2}{12}$ while the second term converges to $0$, we obtain the expected result
$$\sum_{n=1}^\infty \frac{(-1)^n}{n^2}=-\frac{\pi^2}{12}$$
Note that the expression in $(1)$ can be useful in evaluating other series.
EXAMPLE $1$:
For example, in THIS ANSWER, I used $(1)$ with $a_n=\frac{\log(n)}{n}$ to show that
$$\sum_{n=1}^\infty \frac{(-1)^n\log(n)}{n}=\gamma\log(2)-\frac12\log^2(2)$$
EXAMPLE $2$:
As another example of $(1)$, let $a_n=\frac1n$. Then, we see that
$$\begin{align} \sum_{n=1}^{2N}\frac{(-1)^n}{n}&=2\sum_{n=1}^N \frac1{2n}-\sum_{n=1}^{2N}\frac1{n}\\\\ &=-\sum_{n=N+1}^{2N}\frac1n\\\\ &=-\frac1N\sum_{n=1}^N \frac1{1+(n/N)}\tag3 \end{align}$$
The right-hand side of $(3)$ is the Riemann sum for $-\int_0^1\frac1{1+x}\,dx=-\log(2)$. Therefore, we find that
$$\sum_{n=1}^\infty \frac{(-1)^n}{n}=-\log(2)$$