In a typical Calculus class, the improper integral $$\int_{-1}^{3}x^{-3}dx$$ is to be split up as $$\lim_{b \rightarrow 0^{-}}\int_{-1}^{b} x^{-3} dx + \lim_{b \rightarrow 0^{-}} \int_{b}^{3} x^{-3} dx,$$ and we arrive at the sum-of-limits $$\lim_{b \rightarrow 0^{-}}\big( -\frac{1}{2b^{2}} + \frac{1}{2} \big) + \lim_{b \rightarrow 0^{+}}\big( -\frac{1}{18} + \frac{1}{2b^{2}} \big).$$ Now, in each of these limits, it seems to me that the "$+$" and "$-$" don't matter on the $0$ since $b^{2}$ is a square. So we can write these limits as $\lim_{b \rightarrow 0}$ instead, and "pulling out the limit", we get $$\lim_{b \rightarrow 0}\big( -\frac{1}{2b^{2}} + \frac{1}{2} - \frac{1}{18} + \frac{1}{2b^{2}} \big) = \lim_{b \rightarrow 0} \frac{4}{9} = \frac{4}{9}.$$
My instructor says that the integrals have to be convergent independently in order for the whole improper integral to converge, and so this whole integral diverges. But the problem I have is that one limit is $\infty$ while the other is $-\infty$. So we get something like $\infty - \infty$, which I guess doesn't make much sense. And the fact that we have a $b^{2}$ in both limits makes me think that we don't have to worry about which side the limit is coming from.
Am I missing anything?
The fact that $\infty-\infty$ doesn't make sense is precisely why we say that the integral is divergent.
Note that you should use different variable names for both limits. You should write $$ \lim_{a \rightarrow 0^{-}}\bigg(-\frac{1}{2a^{2}} + \frac{1}{2} \bigg) + \lim_{b \rightarrow 0^{+}}\bigg( -\frac{1}{18} + \frac{1}{2b^{2}} \bigg) $$ and now it is clear that you can't "pull out the limit".
What you are calculating has a name though. It is the Cauchy principal value.