Let $p$ be prime and $G$ a group such that $|G| = p^n k$, where $p \nmid k$. We want to show that $G$ has at least one Sylow $p$-subgroup.
Let $\mathcal{S} := \{ S \subset G \mid \, |S| = p^n\}, |\mathcal{S}| := N$. Then, $N = \binom{p^n k}{p^n} \equiv k \text{ (mod } p)$. Let $G$ act on $\mathcal{S}$ by $(g, S) \mapsto gS = \{gs\mid \, s \in S\}$. Let $S_1, \dots, S_r$ represent the disjoint orbits of $\mathcal{S}$. Then, $p$ cannot be a divisor of the cardinality of all orbits, because $N \equiv k \text{ (mod } p)$. Choose $S_i$ such that $p \nmid |GS_i|$. Then, $\operatorname{Stab}_G(S_i) = S_i$ and thus $S_i$ is a Sylow $p$-subgroup.
Why is $\operatorname{Stab}_G(S_i) = S$? We defined the stabilizer as follows:
$$\operatorname{Stab}_G(x) := \{g \in G\mid\, gx = x\}$$
Maybe I'm just confusing things, but if we take $g \in G \setminus S_i$, isn't still $gS_i = S_i$?
You are confusing yourself by the notation. Also observe that the proof requires the notion of stabilizers of sets not points. But let's use your notation. Let $T \in S_i$, where the cardinality of orbit $S_i$ is not divisible by $p$. Put $H=Stab_G(T) = \{g \in G | gT=T\}$. We are going to argue that $H$ is a Sylow $p$-subgroup.
First, since $p$ does not divide $|S_i| = [G:H]$, it follows that $p^n | |H|$, hence $p^n \leq |H|$. Since $H$ stabilizes $T$ by left multiplication, for any $t \in T$ we have $Ht \subseteq T$. Hence $|H| = |Ht| \leq |T| = p^n$. We conclude that $|H| = p^n$ and we are done.