We have the following identity: (where $\mu$ is Mobius function) $$\frac{\zeta(s)}{\zeta(2s)} = \sum_{n=1}^{\infty} \frac{|\mu(n)|}{n^s} \quad (\sigma > 1, s = \sigma+it )$$
The proof I read (Titchmarsh p5) is given by the following line:
$$\frac{\zeta (s) }{ \zeta(2s) } \stackrel{*}{=} \prod_p \frac{1-p^{-2s}}{1-p^{-s}} = \prod_p \big( 1 + \frac{1}{p^s} \big) \stackrel{**}{=} \sum_{n=1}^\infty \frac{|\mu(n)|}{n^s}$$
My question is how do we justify $*$ and $**$ rigorously? Below is what I think:
$(*):$ We note that the partial products, $\hat{f_n} = f_1 \cdots f_n$ where $f_i = \big( 1 - \frac{1}{p_i^s} \big)^{-1}$ converges compactly in region $\sigma >1$. $\zeta(s) = \lim_{n \rightarrow \infty} \hat{f}_n(s)$ (by Euler Product formula). Similarly, $\zeta(2s) = \lim_{n \rightarrow \infty} \hat{g}_n(s)$ where $\hat{g}_n = \hat{f}_n (2s)$. We note that $|\zeta(s)| > 0$ for all $\sigma >1 $.
$\frac{1}{\zeta(2s)} = \lim_{n \rightarrow \infty} \frac{1}{\hat{g}_n(s)}$ is well-defined, and so by basic algebra of limits, $$\frac{\zeta(s) }{ \zeta(2s)} = \lim_{n \rightarrow \infty} \frac{\hat{f}_n(s)} { \hat{g}_n(s) } $$
$(**):$ Here we argue by taking a prime $P$, and we have,
$$ \Big| \sum \frac{|\mu(n)| }{n^s} - \prod_{p \le P} (1+ \frac{1}{p^s} ) \Big| \le \sum \frac{1}{(P+n)^s} \rightarrow 0 $$ as $P \rightarrow \infty$.
In general, when do we know we can just expand infinite products like this?
For instance, we also have the identity:
$$ \frac{\zeta^2(s)}{\zeta(2s)} = \sum \frac{2^{v(n)}}{n^s} $$ the proof then utilizes infinite product of infinite sums:
$$ \frac{\zeta^2(s)}{\zeta(2s)} = \prod_p (1 + 2p^{-s} + 2p^{-2s} + \cdots ) = \sum \frac{2^{v(s)}}{n} $$
How do we know the last two equalities coincide?
For the first equality $(*)$ we have the Euler product representation of the zeta function \begin{eqnarray*} \zeta(s)= \prod_{p \in \mathbb{P}} (1-p^{-s})^{-1}. \end{eqnarray*} From your last comment you seem happy now that \begin{eqnarray*} \frac{\zeta(s)}{\zeta(2s)}= \prod_{p \in \mathbb{P}} (1+\frac{1}{p^{s}}). \end{eqnarray*} Now consider the terms created by expanding this product \begin{eqnarray*} \left(1+\frac{1}{2^{s}}\right)\left(1+\frac{1}{3^{s}}\right)\left(1+\frac{1}{5^{s}}\right) \cdots &=& 1+\frac{1}{2^{s}}+\frac{1}{3^{s}}+\frac{1}{5^{s}}+\frac{1}{6^{s}}+\frac{1}{7^{s}} \cdots \\ &=& \sum_{n=1}^{\infty} \frac{\chi(n)}{n^s} \end{eqnarray*} where $\chi(n)=1$ if $n$ is the product of distinct primes (in other words, $n$ is square-free) and $\chi(n)=0$ otherwise. It is easy to see that $\chi$ is essentially the Mobuis $\mu$ function without the powers of $-1$ to count the parity of the number of distinct primes.