My attempt:
Factor the denominator: The denominator can be factored as $(x + 1)(x + 3)$.
Substitution: Let's substitute $u = x + 1$. Notice that $du = dx$.
Rewrite the integral: Substitute $x$ and $dx$ in terms of $u: \displaystyle\int\dfrac{1}{(x+1)(x+3)\sqrt{x}}~dx$ becomes $\displaystyle\int\dfrac{1}{u(u+2)(\sqrt{u-1})}~du$.
I could go further. Please help me.
Your factorization of the quadratic in the denominator is incorrect: In fact, the quadratic is irreducible over $\Bbb R$, since its discriminant is negative: $2^2 - 4 \cdot 1 \cdot 3 = -8$.
Hint Changing variables via $u = \sqrt x$ rationalizes the integral, so that it can be handled in the usual way: $$\int \frac{du}{u^4 + 2 u^2 + 3} .$$ Now see this problem, which is identical except for the constants.