$\lim_{s \rightarrow \infty} \zeta(s) = 1$
I have seen a proof using the fact $1 \leq \zeta(s) \leq \frac{1}{1-2^{1-s}}$ but this relies on proving the inequality first which is quite cumbersome.
I was looking for a proof which is short but easy to understand.
Despite your aversion(?) to integrals, I think they give the quickest and easiest argument. The function $n \mapsto n^{-s}$ is decreasing in $n$ (for $s > 1$), so $$ 1 \le \zeta(s) = \sum_{n=1}^\infty \frac1{n^s} = 1 + \sum_{n=2}^\infty \frac1{n^s} \le 1 + \int_1^\infty \frac{1}{x^s}\,ds = 1 + \frac{1}{s-1}. $$ To see why the inequality between the series and the integral is valid, draw a picture! Finish off by letting $s \to \infty$ using the squeeze theorem. (This argument assumes that $s$ is real.)