If $f$ is an even function such that $\lim_{h \to 0} \frac{f(h)-f(0)}{h}$ has a finite non zero value , then is $f(x)$ continuous , differentiable , or neither continuous nor differentiable at $x=0$?
I think that the function is continuous , and it is easy to prove that too. But it would not be differentiable. This is because , the above expression represents the derivative of the function at $x=0$ and and the derivative of an even function at $0$ is always zero however according to the given question , the derivative of the function is not zero. So it is not differentiable. Do you think I have reasoned it correctly ?

By the Principle of Explosion, all answers are correct. There are two contradictory statements in the question:
These two statements are contradictory, therefore any conclusion follows. The correct answer, then, is to mark all of the multiple choice options. ;)
While it is impossible to know, it is likely that (as has been pointed out in the comments) the author(s) intended to consider the one sided limit. It is reasonable to conclude that the question should have read
In this case, there is no contradiction. Then, by the reasoning above, we know that the function cannot be differentiable at $x=0$. If it were, then the derivative would be zero, but we know that it is not.
On the other hand, suppose that the one-sided limit is $L$, i.e. that $\lim_{h\to 0^+} (f(h)-f(0))/h = L$. Then $$ |f(h) - f(0)| = \left| h \frac{f(h) - f(0)}{h} \right| = |h| \left| \frac{f(h) - f(0)}{h} \right| = |h| |L|. $$ We can make this as small as we like by choosing $h$ sufficiently small. The limit from the left will be the same (the sign of the limits will differ, but this is absorbed into the absolute value). This implies that $f$ is continuous at zero. Therefore, assuming that the question was supposed to read as indicated above, the correct answer would be (b).