Firstly, I think this can be done with equivalent infinitesimal, but it seems so much complicated. I'm not very brave to do L'Hospital's rule on this question. And I don't think trig formulas can simplify this..
$$\lim _{x\rightarrow0}\frac{1-\cos\left(\frac{1-\cos x \cos 2x}{x^2}-\frac {5}{2}\right)\cos2x}{x^2} $$
$$\lim _{x\rightarrow0}\frac{1-\cos\left(\frac{1-\cos x \cos 2x}{x^2}-\frac {5}{2}\right)\cos2x}{x^2}=$$ $$=\lim _{x\rightarrow0}\frac{1-\cos2x+\cos2x\left(1-\cos\left(\frac{(1-\cos x)(2\cos^2x+2\cos{x}+1)}{x^2}-\frac {5}{2}\right)\right)}{x^2}=$$ $$=\lim _{x\rightarrow0}\frac{2\sin^2x+\cos2x\left(1-\cos\left(\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1)}{2\left(\frac{x}{2}\right)^2}-\frac {5}{2}\right)\right)}{x^2}=$$ $$=2+\lim _{x\rightarrow0}\frac{1-\cos\left(\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1)}{2\left(\frac{x}{2}\right)^2}-\frac {5}{2}\right)}{x^2}=$$ $$=2+\lim _{x\rightarrow0}\frac{2\sin^2\left(\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1)}{2\left(\frac{x}{2}\right)^2}-\frac {5}{2}\right)}{x^2}=$$ $$=2+2\lim _{x\rightarrow0}\frac{\left(\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1)}{2\left(\frac{x}{2}\right)^2}-\frac {5}{2}\right)^2}{x^2}=2$$ because $$\lim _{x\rightarrow0}\frac{\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1)}{\left(\frac{x}{2}\right)^2}-5}{x^2}=$$ $$=\lim _{x\rightarrow0}\frac{\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1-5)}{\left(\frac{x}{2}\right)^2}+5\left(\left(\frac{\sin\frac{x}{2}}{\frac{x}{2}}\right)^2-1\right)}{x^2}=$$ $$=\lim_{x\rightarrow0}\frac{2(\cos^2x+\cos{x}-2)}{x^2}+\frac{5}{4}\lim _{x\rightarrow0}\frac{\left(\frac{\sin\frac{x}{2}}{\frac{x}{2}}\right)^2-1}{\frac{x^2}{4}}=$$ $$=-\lim_{x\rightarrow0}\frac{2(1-\cos{x})(2+\cos{x})}{x^2}+\frac{5}{4}\lim _{x\rightarrow0}\frac{\left(\frac{\sin{x}}{x}\right)^2-1}{x^2}=$$ $$=-3\lim_{x\rightarrow0}\frac{4\sin^2\frac{x}{2}}{4\left(\frac{x}{2}\right)^2}+\frac{5}{4}\lim _{x\rightarrow0}\frac{\left(\frac{\sin{x}}{x}-1\right)\left(\frac{\sin{x}}{x}+1\right)}{x^2}=$$ $$=-3+\frac{5}{2}\lim_{x\rightarrow0}\frac{\sin{x}-x}{x^3}=-3-\frac{5}{6}\lim_{x\rightarrow0}\frac{1-\cos{x}}{x^2}=-3-\frac{5}{12}=-\frac{41}{12}$$ and $$\lim _{x\rightarrow0}\left(\frac{\sin^2\frac{x}{2}(2\cos^2x+2\cos{x}+1)}{2\left(\frac{x}{2}\right)^2}-\frac {5}{2}\right)=0.$$