I could not obtain an explicit formula for the eigenvalues of matrix $$ \begin{pmatrix} a & b & 0 & 0 & 0 & \cdots & 0 \\ c & a & b & 0 & 0 & \cdots & 0 \\ 0 & c & a & b & 0 & \cdots & 0 \\ \vdots & \vdots & \vdots & \vdots & \vdots & \ddots & b \\ 0 & 0 & 0 & \cdots & 0 & c & a \end{pmatrix} $$
It has been claimed that its eigenvalues are $a + 2\sqrt{bc}\cos(\frac{n\pi}{M+1}) \quad n = 1, 2, ..., M$
Any help?
If a matrix has constant diagonals it is called Toeplitz matrix and if a matrix that has nonzero elements only on the main diagonal, the first diagonal below this, and the first diagonal above the main diagonal called tridiagonal matrix. So this matrixclass called tridiagonal Toeplitz matrices.
As you have written there is a special form for eigenvalues of tridiagonal Toeplitz matrices.
You can find the proof in
at pages 514–516. You can find a pdf version the book here.