I know that the sum of positive integers will diverge and that the sum of negative integers will diverge. I also know that "the sum of all integers" will likely be meaningless (it depends on the order of sequence).
But let us consider the following case:
Let us first add all positive integers in order from 1 to forever. Then add all negative integers in order from -1 to -infinity. Then what would sum be? Would this be indeterminate?
In general, when you've got a divergent series, by reordering the terms, you can make it appear to converge to almost anything. And when you say "Let's us first add the positive integers from 1 to forever," you've started off by saying "Let's compute a limit that does not exist." Anything else you say after that is pretty much meaningless from the point of view of formal mathematics.
Sorry to be disappointing here, but that's the way it is.
As an exercise, you might consider this: the sum $1 + (1/2) + (1/3) + ... $ diverges. $1 - (1/2) + (1/3) - (1/4) + ... $ converges. In fact, you can show that by placing "+" and "-" signs in the right places, you can arrange for these terms to sum up to any positive irrational number. (The algorithm is pretty easy: if your number is $r$, sum up terms until you get larger than r; then subtract terms until you're less than $r$. Then add terms until you're greater, and so on. Proving convergence takes a little work. :)