I asked a related question on Physics SE, but it hasn't received much attention and I think it may be more of a mathematical problem than a physical one.
Suppose I wish to solve $$det(x\mathbb{I}-\mathbb{A})=0$$ for $x$ assuming the matrix $\mathbb{A}$ is not diagonal in general and $\mathbb{I}$ is the identity. What error do I incur by ignoring the off-diagonal elements of $\mathbb{A}$ to approximate the solution? Is there a general way to know, based on properties of the matrix, how good/poor this approximation is (for example, some sort of error bound)?
This is related to the derivative of the determinant: Wikipedia: Jacobi's formula
This is how I interpret your post in Physic SE:
If your matrix $A=D+hB$ where $D$ is diagonal, and $h\ll 1$.
To simplify, let assume $A$ contains no zero diagonal element, so $D$ is invertible.
$$\det(A)=\det(D)+h\det(D)\operatorname{tr}(D^{-1}B)+o(h)$$
So when the diagonal is dominant and the rest of the matrix $hB$ is of lower order (i.e. negligible compared to the diagonal) then the determinant is approximable by $\det(D)$.
When $D$ is not invertible, the formula is a little bit more complicated (see Wiki's page), but I think you get the principle.