How can I evaluate this integral $$\int (x^2-1)(x^3-3x)^{4/3} \mathop{dx}=\;\;?$$
My attempt:
I tried using substitution $x=\sec\theta$, $dx=\sec\theta\ \tan\theta d\theta$,
$$\int (\sec^2\theta-1)(\sec^3\theta-3\sec\theta)^{4/3} \sec\theta\ \tan\theta d\theta $$
$$=\int \tan^2\theta \sec^4\theta(1-3\cos^2\theta)^{4/3} \sec\theta\ \tan\theta d\theta $$ $$=\int \tan^3\theta \sec^5\theta(1-3\cos^2\theta)^{4/3}\ d\theta $$
$$=\int\dfrac{ \sin^3\theta}{ \cos^8\theta}(1-3\cos^2\theta)^{4/3}\ d\theta $$
I can't see if this substitution will work or not. This has become so complicated.
Please help me solve this integral.
I agree with the other answers. My response is long-winded so...
Often when attacking indefinite integrals, you will immediately suspect that a substitution [i.e. $u = g(x)$] is needed, but won't be sure which substitution to try.
I have to ask the OP:
Why did you think that $x = \sec \theta$ was the right substitution? Had you recently been exposed to problems that seemed similar where $x = \sec \theta$ was the right substitution?
The point of my response/rant is to develop the OP's intuition. Since the integral contains $(x^3 - 3x)^{(4/3)},$ my first guess as to the right substitution to try would be $u = (x^3 - 3x).$ This would convert this portion of the integral to $u^{(4/3)}.$
The idea is that (as a first guess for the right substitution), I would be hoping that (except for the $u^{(4/3)}$ factor), the remainder of the integral would be a polynomial in $u$, where each term has an integer exponent.
As I say, the point of my response is simply to expand the OP's intuition (and perspective).