Let $f : \mathbb{R} \to \mathbb{R}$ be a continuous function. We say that the improper integral $$ \int_{-\infty}^{+\infty} f \,\ dx $$ converges if the improper integrals $$ \int_{-\infty}^{0} f \,\ dx \text{ and } \int_{0}^{+\infty} f \,\ dx $$ both converge and in that case we define $$ \int_{-\infty}^{+\infty} f \,\ dx := \int_{-\infty}^{0} f \,\ dx + \int_{0}^{+\infty} f \,\ dx. $$ I would like to know : when $\int_{-\infty}^{+\infty} f \,\ dx$ is defined, is the Cauchy principal value $$ \lim_{a \to \infty} \int_{-a}^{a} f \,\ dx $$ equal to $\int_{-\infty}^{+\infty} f \,\ dx$ ?
My guess : I think it is. In that case, haven't we \begin{align*} \int_{-a}^{a} f \,\ dx - \int_{-\infty}^{\infty} f \,\ dx = - \int_{a}^{\infty} f \,\ dx - \int_{-\infty}^{-a} f \,\ dx \to 0 + 0 = 0 \quad (a \to \infty) \space ? \end{align*}
Yes, you are correct. And, as you realize, the converse is, in general, false.