Here is a symmetric rational double series giving Apery's constant:
$$ \frac13 \sum_{j=1}^{\infty}\sum_{i=1}^{\infty} \displaystyle \frac{(i-1)! (j-1)!}{(i+j)!} H_{i+j} = \zeta(3) $$
where $\displaystyle H_{n}:=\sum_{1}^{n} \frac{1}{k}$, $n=1,2,\cdots,$ are the harmonic numbers.
How would you prove it?
Edit. In 2005, I sent this result to Wolfram MathWorld (see equation 25), I built it as an echo of
$$ \sum_{j=1}^{\infty}\sum_{i=1}^{\infty} \displaystyle \frac{(i-1)! (j-1)!}{(i+j)!} = \zeta(2). $$
See Jack's pretty answer and see my answer below.
Summation by parts seems to work fine. For $j=1$ we have: $$\sum_{i=1}^{+\infty}\frac{H_{i+1}}{i(i+1)}=2,$$ since $\sum_{i=1}^{N}\frac{1}{i(i+1)}=1-\frac{1}{1+N}$ and so: $$\begin{eqnarray*}\sum_{i=1}^{N}\frac{H_{i+1}}{i(i+1)}&=&H_{N+1}\left(1-\frac{1}{N+1}\right)-\sum_{i=1}^{N-1}\left(1-\frac{1}{i+1}\right)\frac{1}{i+2}\\&=&H_2+\sum_{i=1}^{N-1}\frac{1}{(i+1)(i+2)}+O\left(\frac{\log N}{N}\right)\\&=&H_2+\frac{1}{2}+O\left(\frac{\log N}{N}\right),\end{eqnarray*}$$ since: $$\sum_{i=1}^{+\infty}\frac{1}{(i+1)\cdot\ldots\cdot(i+k)}=\frac{1}{(k-1)k!}.$$ For $j=2$ we have: $$\begin{eqnarray*}1!\sum_{i=1}^{N}\frac{H_{i+2}}{i(i+1)(i+2)}&=&H_{N+1}\left(\frac{1}{4}-\frac{1}{2(N+1)(N+2)}\right)-\sum_{i=1}^{N-1}\left(\frac{1}{4}-\frac{1}{2(i+1)(i+2)}\right)\frac{1}{i+3}\\&=&\frac{H_3}{4}+\frac{1}{4\cdot 3!}+O\left(\frac{\log N}{N}\right)\end{eqnarray*}$$ and in the general case we have: $$(j-1)!\sum_{i=1}^{+\infty}\frac{H_{i+j}}{i\cdot\ldots\cdot(i+j)}=(j-1)!\left(\frac{H_{j+1}}{j^2(j-1)!}+\frac{1}{j^2(j+1)!}\right)=\frac{H_{j+1}}{j^2}+\frac{1}{j^3(j+1)},$$ so the original sum equals: $$\sum_{j=1}^{+\infty}\frac{H_{j+1}}{j^2}+\sum_{j=1}^{+\infty}\frac{1}{j^3(j+1)}=\sum_{j=1}^{+\infty}\frac{H_j}{j^2}+\sum_{j=1}^{+\infty}\frac{1}{j^3}=2\zeta(3)+\zeta(3)=3\zeta(3).$$