According to the answers in my book, the series converges.
I know I should use Alternating Series Test and the limit of ln (n)/(sqrt n) approaches 0.
And the derivative is negative after n=8, but the derivative is positive when 1<=n<=8, is that ok to use Alternating Series Test? I remember the condition is that it should decrease for all n>=1.
It seems to be you mean the series $\;\displaystyle\sum\limits_{n=1}^\infty\frac{(-1)^n\log n}{\sqrt n}\;$ . Now, we have
$$f(x):=\frac{\log x}{\sqrt x}\implies f'(x)=\frac{\frac1{\sqrt x}-\frac{\log x}{2\sqrt x}}{x}=\frac{2-\log x}{2x\sqrt x}<0\iff\log x>2\iff x>e^2$$
and then the sequence $\;\left\{\,\frac{\log n}{\sqrt n}\,\right\}_{n\in\Bbb N}\;$ is mononotonic decreasing ( and clearly positive for all $\;n>1\;$) for $\;n>e^2\implies n\ge8\;$ , and thus we have here a Leibniz series which converges (conditionally, though)