This symbols are used to describe left recursion :
$A\to B\,\alpha\,|\,C$
$B\to A\,\beta\,|\,D,$
It is taken from : http://en.wikipedia.org/wiki/Left_recursion
How can these symbols be explained to a non-mathematician ? Can provide an explanation for these statements in image ?
First of all, uppercase letters mean something which must still be worked out, while Greek letters mean actual symbols for the language. The arrow $\rightarrow$ means "if you find something like the symbols on my left, you may substitute them with the symbols on my right", and the vertical bar | means "or".
Now the first line says that if you find an $A$ you may either substitute it with $B\alpha$ or with $C$. Suppose to choose the first one; now $\alpha$ is fixed, while $B$ may be substituted with $A\beta$ (or $D$, but we won't do it).
This means that if you start with $A$ you may - note, not must - transform it to $B\alpha$ first and $A\beta\alpha$ then. It's like you have left something on your right ($\beta\alpha$) and now you are ready to start it over like if nothing happened. It's left recursion because you are going "left", and is indirect because you need more than one step.