The problem is to find all $f : \mathbb{R} \to \mathbb{C}$ that is continuous and has a period of $1$ (not necessarily smallest period) such that the following equality holds:
$$f(x) = \int_0^1 f(x-t)f(t) dt \quad \forall x \in \mathbb{R}$$
I believe the only answer is $f=0$ and $f=1$, but I don't know how to go about proving it.
Quick look: since $f$ is continuous and periodic, it has a (unique) Fourier series of the form $f(x) = \sum_{k\in\mathbb Z} c_k e^{i2\pi kx}$.
Inject this form in the integral and you get (I don't even care about switching sums and integrals at this stage):
$$f(x) = \int_0^1 \sum_{k,m\in\mathbb Z} c_k c_m e^{i2\pi k(x-t)}e^{i2\pi mt}dt = \sum_{k,m\in\mathbb Z} c_k c_m e^{i2\pi kx} \int_0^1 e^{i2\pi(m-k)t}dt$$
the term under the integral is nil unless $m=k$, hence:
$$f(x) = \sum_{k\in\mathbb Z} c_k e^{i2\pi kx} = \sum_{k\in\mathbb Z} c_k^2 e^{i2\pi kx}$$
And you get: $\forall k, c_k = c_k^2$, i.e. $c_k \in \{0,1\}$.
As stated in the other (better) answer, Plancherel theorem then implies $\sum |c_k|^2 < \infty$, which can only happen if $c_k=0$ for all but a finite number of $k$. So $f$ is of the form $\displaystyle f(x) = \sum_{m=1}^N e^{i2\pi k_m x}$ with $k_m\in \mathbb Z$ all distinct.