Let $s(n,k)$ be the Stirling numbers of first kind: $$\prod_{k=0}^{k=n-1}(x-k) =\sum_{k=0}^{k=n}s(n,k)x^k$$
$p$ is prime $\iff$ for all $k\in\{2,..,p-1\}$, $s(p,k)\equiv0\ mod\ p $
How can this be demonstrated?
There is an analogous statement for the Stirling numbers of second kind ${n \brace k}$ which is quite easy to prove from the explicit formula $$k!{n \brace k}=(-1)^k\sum_{j=0}^{j=k}(-1)^j\binom{k}{j}j^n $$ But I do not know of an analogous explicit formula for the first kind...
Work in the polynomial ring $(\Bbb Z/p\Bbb Z)[x]$: in that ring $x^{\underline p}=x^p-x$, since both polynomials are monic of degree $p$ and have roots $0,\ldots,p-1$. Now just equate coefficients to get the positive part of the result.
For the negative result, suppose that $n$ is not prime, let $p$ be a prime dividing $n$, and let $m=\frac{n}p$. Then
$$\begin{align*} x^{\underline n}&=\prod_{i=0}^{n-1}(x-i)=\prod_{k=0}^{m-1}\prod_{\ell=0}^{p-1}(x-kp-\ell)=\prod_{k=0}^{m-1}\prod_{\ell=0}^{p-1}(x-\ell)\\\\ &=\left(x^{\underline p}\right)^m=\left(x^p-x\right)^m=x^m\left(x^{p-1}-1\right)^m\;, \end{align*}$$
and it follows that $s(n,m)\equiv(-1)^m\not\equiv 0\pmod p$.
For many more results on congruences involving Stirling numbers of the first kind see Rhodes Peele, A.J. Radcliffe, and Herbert S. Wilf, Congruence problems involving Stirling numbers of the first kind [PDF]. What I did here is a special case of results there.