Suppose $f:X\to Y$ is a morphism of schemes over a field $k$. For any point $y\in Y$, we have the fiber of $f$ over $y$ defined as the fiber product $X_y=X\times_Y\mathrm{Spec }\;k(y)$, where $k(y)\cong \mathcal{O}_y/\mathfrak{m}_y$ is the residue field of $y$.
If $A$ is a commutative $k(y)$-algebra, I'd like to describe the $A$-points of $X_y$, which means I'm interested in maps of schemes $\mathrm{Spec}\;A\to X_y$. Using the universal property of the fiber product, is this equivalent to the $A$-points of $X$ where $A$ is a commutative $k$-algebra via $k\hookrightarrow k(y)$?
My intuition for algebraic geometry is horrible. I'd certainly appreciate any illuminating description of how to view the $A$-points of the fiber $X_y$. Thank you.

$\newcommand{\spec}{\operatorname{Spec}}$I just want to expand on Pece's answer a bit to try to make it more explicit. Consider some affine open subset $U = \operatorname{Spec} B \subseteq X$ intersecting the fiber $X_y$ nontrivially and some affine open $V = \operatorname{Spec} R \subseteq Y$ containing $y$. By possibly shrinking $\operatorname{Spec} B$ we can assume that the morphism $f$ sends $U$ to $V$. Finally, suppose that $y$ corresponds to the prime ideal $\mathfrak{p}$.
Then the inclusion $y \hookrightarrow Y$ corresponds to the composition $R \to R_{\mathfrak{p}} \to R_{\mathfrak{p}}/\mathfrak{p}R_{\mathfrak{p}}$. Similarly, the morphism $f: U \to V$ corresponds to a ring homomorphism $R \to B$ making $B$ an $R$ algebra. Then the fiber product $U_y$ corresponds to the tensor product of rings, i.e., the pushout diagram
$$ \require{AMScd} \begin{CD} B_{\mathfrak{p}}/\mathfrak{p}B_{\mathfrak{p}} @<<< R_\mathfrak{p}/\mathfrak{p}R_\mathfrak{p}; \\ @AAA @AAA \\ B @<<< R \end{CD} $$
The nice thing here is that we can usually compute this ring to get an explicit handle of the fiber. Then an $A$-valued point of the fiber $U_y$ is explicitly a ring homomorphism $B \to A$ that factors as $B \to B_{\mathfrak{p}}/\mathfrak{p}B_{\mathfrak{p}} \to A$ and is compatible with the diagram above. Stated differently, it is just an $R$-algebra morphism $B_{\mathfrak{p}}/\mathfrak{p}B_{\mathfrak{p}} \to A$.
For the general case, we just find affine $U_i = \operatorname{Spec} B_i$ in $X$ whose union contains $X_y$ and whose image under $f$ is contained in $\operatorname{Spec} R$. The above argument goes through for each $U_i$ so that
$$ (U_i)_y = \operatorname{Spec} {B_i}_{\mathfrak{p}}/\mathfrak{p}{B_i}_{\mathfrak{p}} \enspace \enspace \text{and} \enspace \enspace X_y = \bigcup_i (U_i)_y. $$
Then an $A$ valued point of $X_y$ is just a map of schemes $g: \spec A \to X$ such that $g^{-1}(U_i)$ cover $\spec A$ and for each affine $\spec A' \subset g^{-1}(U_i)$, the induced ring homomorphism $B_i \to A'$ lifts to an $R-$algebra homomorphism ${B_i}_{\mathfrak{p}}/\mathfrak{p}{B_i}_{\mathfrak{p}} \to A'$.