According to Gamma Summation & Zeta Summation: $$ \sum_{n=0}^{\infty} {(-1)^n \frac{\Gamma(n+s) \zeta(n+s)}{(n+1)!}}=\Gamma(s-1) \quad : \space Re\{s\}<2 $$
Show that: $$ \sum_{n=0}^{\infty} {\frac{\Gamma(n+s) \zeta(n+s)}{(n+1)!}}=0 \quad : \space Re\{s\}<1 $$
In other words, the Even & Odd parts are convergent series, equaling sums, and different signs: $$ \sum_{n=0}^{\infty} {\frac{\Gamma(2n+s) \zeta(2n+s)}{(2n+1)!}}=-\sum_{n=0}^{\infty} {\frac{\Gamma(2n+1+s) \zeta(2n+1+s)}{(2n+1+1)!}}=\frac{\Gamma(s-1)}{2} \space : \space Re\{s\}<1 $$
The proposer wants $R(1,s-1)$ of the function defined below: $$R(x,a)=\sum_{n=1}^\infty \dfrac{x^n}{n!}\Gamma(n+a)\,\zeta(n+a).$$ The $\Gamma\cdot\zeta$ product has a well-known integral relationship, as alluded to by Jack D'Aurizio. Switch integration and summation $-$ the summation is an exponential $-$ and one gets $$R(x,a)=\int_0^\infty du \,u^{a-1} \,\dfrac{e^{x\,u}-1}{e^{u}-1 }=\Gamma(a)(\zeta(a,1-x)-\zeta(a)). $$ (Need $a>0$ for the integral to converge, but the right-hand side is an analytic continuation.)
The Hurwitz $\zeta$ reduces to the Riemann $\zeta$ for $x=1,$ and the formula is proved. Incidentally, the Hurwitz $\zeta$ also has closed forms in terms of the Riemann $\zeta$ for $x=-1,$ as the proposer has noted, but also for $x=1/2.$