Need to find range of values of $\epsilon$ for which $$\begin{bmatrix} A+\epsilon B & \epsilon C \\ \epsilon C^\top & \epsilon D \end{bmatrix} \prec 0$$ given that $A,D \prec 0$ and $\epsilon > 0$.
The way I am going about it is using Schur Complement Lemma whereby this matrix is negative definite iff $ \epsilon D \prec 0$ and $A+\epsilon B-\epsilon CD^{-1}C^\top \prec 0$. Should the value of $\epsilon$ depend on the maximum eigenvalue of $A-\epsilon CD^{-1}C^\top$? What is the right way to go about it?
Please correct me if I made any mistake in the following:
You can use the Rayleigh Quotient to establish that $\lambda_{\text{max}}(M+N) \leq \lambda_{\text{max}}(M) + \lambda_{\text{max}}(N)$ for any symmetric matrices $M,N$ with the same size.
From the comments above one can infer that each element of the Schur Complement must be symmetric. Since $\lambda_{\text{max}}(A) < 0$ (true with the given condition that $A \prec 0$), one can find a small enough $\epsilon > 0$ such that $$ \begin{align*} \lambda_{\text{max}}(A + \epsilon(B - CD^{-1}C^T)) &\leq \lambda_{\text{max}}(A) + \lambda_{\text{max}}(\epsilon(B - CD^{-1}C^T))\\ &= \lambda_{\text{max}}(A) + \epsilon\cdot\lambda_{\text{max}}(B - CD^{-1}C^T) \\ &< 0, \end{align*} $$ since $A,B,C,D$ are all known. So a feasible set of $\epsilon > 0$ is simply the ones that satisfy the inequality above, but note that the inequality is simply sufficient and the result may only be a subset of all feasible $\epsilon$'s.