I have to find the particular solution of the ODE $y''-6y'+10y=e^{3x}$ using, what our professor calls The Integration Formula which is:
For the non-homogeneous ODE: $$p_0(x)y''+p_1(x)y'+p_2(x)y=r(x)$$
The Integration Formula is: $$\int_{}^{x} H(x,t)\frac{r(t)}{p_0(t)} \,dt,$$
Where $$H(x,t)=\frac{\begin{vmatrix} y_1(t) & y_2(t) \\ y_1(x) & y_2(x) \end{vmatrix}}{\begin{vmatrix} y_1(t) & y_2(t) \\ y_1'(t) & y_2'(t) \end{vmatrix}}.$$
where $y_1$ and $y_2$ are the solutions of $y''-6y'+10y=0$, namely $y_1(x)=\cos x$ and $y_2(x)=\sin x$.
My Approach:
$$\int_{}^{x} H(x,t)\frac{r(t)}{p_0(t)} \,dt=\int_{}^{x}e^{3t}(\cos t \sin x-\sin t \cos x)\,dt$$
I Break this Integral into two: $$\int_{}^{x}e^{3t}\cos t \sin x\,dt +\int_{}^{x}-e^{3t}\sin t \cos x \, dt$$
Integrating both integrals by parts and then replacing with $x$ wherever I have $t$, gives: $$\frac{e^{3x}(\sin x+3\cos x) \sin x}{10}-\frac{e^{3x}(3\sin x-\cos x)\cos x}{10}=\frac{e^{3x}}{10}$$
Thus I find that the Particular Solution is $\frac{e^{3x}}{10}$. However, I know for a fact that the particular solution is $e^{3x}$ (verified by calculators as well). I am pretty sure that my integral calculations are correct, however I have my doubts for the original formula I had to use, namely, $$\int_{}^{x} H(x,t)\frac{r(t)}{p_0(t)} \,dt.$$
Can someone point out my mistake?
Edit:
My solutions for $y''-6y'+10y=0$ were wrong and in fact they were $y_1(x)=e^{3x}\cos x$ and $y_2(x)=e^{3x}\sin x$. Thus,
$$H(x,t)=\frac{e^{3x}(\cos t \sin x - \sin t \cos x)}{e^{3t}}$$.
The Integral is then: $$\int_{}^{x} H(x,t)\frac{r(t)}{p_0(t)} \,dt=\int_{}^{x}e^{3x}(\cos t \sin x-\sin t \cos x)\,dt=e^{3x}(\sin^2 x+\cos^2 x)=e^{3x}$$.
Thus indeed the particular solution is $$y_0=e^{3x}$$.
The formula you wrote is a correct way of writing down what is usually called the method of variation of parameters. When you write it like that, the name seems rather mysterious. The idea behind the name is that the solution is of the form $y_p(x)=c_1(x) y_1(x) + c_2(x) y_2(x)$ (so you "take the homogeneous solution but let the parameters vary"). The method chooses these functions $c_1,c_2$.
Anyway, the actual problem with your solution is simply that you solved the homogeneous equation incorrectly: $i^2-6i+10 \neq 0$.