Let $X$ and $Y$ be algebraic varieties, with $X$ complete, and let $\pi: X\times Y \to Y$ be the projection onto $Y$. Let $L$ be a line bundle over $X\times Y$ and consider the natural map $$ \alpha: \pi^* \pi_* L \to L. $$
Suppose that over every fiber of $\pi$ the map $$ \alpha_y: (\pi^* \pi_* L)_y \to L_y $$ is an isomorphism. Then an application of Nakayama's lemma shows that $\alpha$ is surjective.
Could you please make it explicit (with as much details as you can) how Nakayama's lemma is used in the above argument?
The cokernel $F$ of $\alpha$ is an $\mathcal{O}_{X \times Y}$-module of finite type whose fibers vanish. Now Nakayama's Lemma exactly states that such a module has to vanish.