Previously, I'd been taught that convergent series "converge" to a certain number. Taking a convergent improper integral as an example, the value of the integral would be "definite" and not infinity.
However, every time I think about this, it doesn't make sense to me (I suspect it's probably because of a flaw in some basic understanding).
Anyway, my thinking is that since we are adding infinitely many values (as we do with convergent series), the sum of infinitely many values would be infinite. However, according to the accepted answer for this question,
[That is] incorrect. As long as the positive values an you are summing decrease to 0 fast enough, the sum... will be finite.
While I don't doubt this, it still doesn't give me any intuition. My thinking is still that, regardless of how fast you approach zero, since you have "infinite time" to sum "infinite numbers", your speed at which you approach zero wouldn't matter. The analogy doesn't really convince me. Could someone help clear up (conceptually) whatever misunderstanding I may be having?

I think this is the root of your problem.
It took mathematicians many centuries (from Zeno to the rigorization of analysis) to learn how to deal with infinity. Along the way some ideas that seem intuitive had to be discarded.
When you sum an infinite series you are not actually adding together infinitely many numbers. The only additions you ever perform are finite sums. Moreover, whatever adding you do, you don't do one after another in real time.
Instead you look ("all at once") at the sequence of all (finite) partial sums. If that sequence has a limit, you define that limit as the sum of the series.
Note that asserting that the sequence has limit $L$ is not saying it "gets closer and closer to $L$". There is no "closer and closer", which again suggests the passage of time. The limit is $L$ if the partial sums are (not get) as close to $L$ as you might wish as long as you add up sufficiently many terms. Never all the terms.