The equation $2x^2-2(2a+1)x+a^2+a=0$ has one root less than $a$ and other root greater than $a$,if
$(A)0<a<1\hspace{1 cm}(B)-1<a<0\hspace{1 cm}(C)a>0\hspace{1 cm}(D)a<-1$
As one root is less than $a$ and other root greater than $a$,so $f(a)<0$
$$2a^2-2(2a+1)a+a^2+a<0\implies a>0 or a<-1$$
But the book says answer is $(A),(C),(D)$,i dont know how $(A)$ is possible as answer.
Your solution is right and from your solution follows that $B$ is impossible because for $A$ $$(0,1)\subset (-\infty,-1)\cup(0,\infty),$$ for $C$ $$(0,+\infty)\subset (-\infty,-1)\cup(0,\infty),$$ for $D$ $$(-\infty,-1)\subset (-\infty,-1)\cup(0,\infty),$$ but for $B$ $$(-1,0)\cap\left((-\infty,-1)\cup(0,\infty)\right)=\oslash$$