I have a linearized time-delay system as follows:
$$\frac{\mathrm d X}{\mathrm d t} = a[X(t)-X^*] + b [X(t-R) - X^*], $$ where $a$, $b$ are constants, $R$ is the constant delay, and $X^*$ is the equilibrium point.
How do I konw if, and under what condtion, this system is stable?

After replacing $\lambda$ with $\lambda/R$, $a$ with $a/R$ and $b$ with $b/R$, it may be assumed that $R = 1$.
Set $u(t) = X(t) - X^\ast$, write down the equation for $u$, and try $u(t) = e^{\lambda t}$. This results in the characteristic equation $$ \lambda = a + be^{-\lambda} $$ The system is stable if this transcendental equation has only solutions with negative real parts. A sufficient condition is $a + |b| < 0$.
To find a relation between $a$ and $b$ that separates stable and unstable solutions, consider a purely imaginary $\lambda = i \omega$. The real and imaginary parts of the equation then become $$ 0 = a + b \cos \omega, \quad \omega = - b \sin \omega $$
implying $\tan \omega = \frac{\omega}{a}$ and $ b = - \frac{\omega}{\sin \omega} = - a \sec \omega$.
You can now find marginally stable solutions for any $a$ by solving the first equation for $\omega$ and then finding $b$ from the second equation.