I'm trying to understand Willie Wong's answer which shows that for each $t\in \mathbb{R}$, $g(\tau , t - \tau)$ has a compact support, i.e., the set $A_t = \{ \tau \in \mathbb{R}: g(\tau , t - \tau) = 1\}$ is bounded. Let $S = \{ (-2)^k : k \in \mathbb{N} \}$ and choose $0 < \epsilon \ll 1$. Define $$\chi(t) = \begin{cases} 1 & \exists s\in S, \quad |t-s| < \epsilon \\ 0 & \text{otherwise} \end{cases}$$ and $g(x,y) = \chi(x) \chi(y)$. It's clear that $g(\tau , t - \tau) = 1$ is equivalent to $$\exists k \in \mathbb{N}: |\tau - (-2)^k| \lt \epsilon \ \ \text{and} \ \ \exists l \in \mathbb{N}:|t-\tau - (-2)^l|\lt \epsilon.$$ So we have the implication, $$g(\tau , t - \tau) = 1 \implies \exists k,l \in \mathbb{N}: |t - ((-2)^k+(-2)^l)| \lt 2\epsilon$$ and its contraposition $$\forall k,l \in \mathbb{N}: |t - ((-2)^k+(-2)^l)| \ge 2\epsilon \implies g(\tau , t - \tau) = 0.$$ So we should suppose that $$\exists k_0,l_0 \in \mathbb{N}: |t - ((-2)^{k_0}+(-2)^{l_0})| \lt 2\epsilon \tag{1}$$ and check when $g(\tau , t - \tau) = 1$ occurs or equivalently, $$\exists k \in \mathbb{N}: |\tau - (-2)^k| \lt \epsilon \ \ \text{and} \ \ \exists l \in \mathbb{N}:|t-\tau - (-2)^l|\lt \epsilon. \tag{2}$$ I don't know how to proceed further. It's obvious that we should use $(1)$ and $(2)$ to prove that the set of $\tau$'s is bounded but I don't see how to do it. It seems that Willie Wong has used the following fact for that purpose:
$(-2)^k + (-2)^l = (-2)^m + (-2)^n$ if and only if either $\{k,\ell\} = \{m,n\}$ or $k = \ell = \min(m,n) - 1 = \max(m,n) - 2$ or vice versa.

Now, the formal write up actually doesn't 100% correspond to the intuition in the picture. But it is close enough. (See my other answer for the intuition.)
Case 1: $t$ is such that $g(\tau, t-\tau)\equiv 0$
Nothing to do here
Case 2: $t$ is such that for some $\tau$, $g(\tau,t-\tau) = 1$
By your equation (1), you have $| t - ((-2)^{k_0} + (-2)^{\ell_0})| < 2 \epsilon$. You are looking for $\tau$ such that equation (2) holds, which using equation (1) would require
$$ |\tau - (-2)^{k}| < \epsilon, \quad | (-2)^{k_0} + (-2)^{\ell_0} - \tau - (-2)^\ell| < 3 \epsilon $$
which implies (by triangle inequality)
$$ | (-2)^{k_0} + (-2)^{\ell_0} - (-2)^\ell - (-2)^k | < 4 \epsilon $$
Now suppose $\epsilon < \frac14$, then as we are looking on the LHS at differences between integers, for the difference to be less than 1 the term has to be zero. Hence we must have
$$ (-2)^{k_0} + (-2)^{\ell_0} - (-2)^\ell - (-2)^k = 0 \tag{A}$$
By the "fact" about powers of $(-2)$ I proved for you, for a fixed $(k_0,\ell_0)$ this equation has finitely many (in fact at most 3) solutions.
Hence a necessary condition for both equations (1) and (2) to hold is that $\tau$ is within $\epsilon < \frac14$ of $(-2)^k$, where $(k,\ell)$ is one of the no more than 3 solutions to equation $A$.
This shows that the set of $\tau$ satisfying the requirement is bounded.