Are there functors $F,G:\textbf{Set}^{\operatorname{op}}\to\textbf{Set}$ such that the collection $\operatorname{Hom}(F,G)$ is not a set?
Same question for $F,G:\textbf{Set}\to\textbf{Set}$.
[$\textbf{Set}$ is the category of sets, $\textbf{Set}^{\operatorname{op}}$ is the opposite category, and $\operatorname{Hom}(F,G)$ is the collection of all morphisms from $F$ to $G$.]
By a theorem of Freyd and Street, a category $\mathcal{C}$ is esentially small if and only if both $\mathcal{C}$ and the presheaf category of $\mathcal{C}$ are locally small. Since $\mathbf{Set}$ is not essentially small, its presheaf category cannot be locally small, hence the $F$ and $G$ that you desire must exist.