I need to prove by induction that if $x, y \in\mathbb{Q}$ with $x < y$, then there is an infinite increasing sequence $\{z_n\}_n$ in $\mathbb{Q}$ such that $x < z_1 < z_2 < \dots < z_n < \dots < y$.
I have tried to use $a_n = x + \frac{y-x}{2^n}$ but am not being able to proceed.
You are on the right track! However, if you need an increasing sequence take $$z_n = y - \frac{y-x}{2^n}.$$ (note that your sequence stays between $x$ and $y$ but it is decreasing).
Now try to verify that this sequence satisfies the required conditions.
Basic step. Verify $x<z_1<y$.
Inductive step. Verify that for $n\geq 1$, $z_n<z_{n+1}<y$.