This is related to the post, but a simplified version of the problem. However, the form of $P_x,P_y,P_z$ are different and richer.
Let $$G=U(2),$$ be the unitary group. Here we consider $G$ in terms of the fundamental representation of U(2). Namely, all of $g \in G$ can be written as a rank-2 (2 by 2) matrices.
Can we find some subgroup of Lie group, $$k \in K \subset G= U(2) $$ such that
$$ k^T \{P_x, P_y, P_z, -P_x, - P_y, - P_z\} k =\{P_x, P_y, P_z, -P_x, - P_y, - P_z\}. $$ This means that set $\{P_x, P_y, P_z, -P_x, - P_y, - P_z\}$ is invariant under the transformation by $k$. Here $k^T$ is the transpose of $k$. What is the full subset (or subgroup) of $K$?
Here we define: $$ P_x = \left( \begin{array}{ccc} 0 & 1 \\ 1 & 0 \\ \end{array} \right),\;\;\;\; P_y = \left( \begin{array}{ccc} -1 & 0 \\ 0 & 1 \\ \end{array} \right),\;\;\;\; P_z = \left( \begin{array}{ccc} -i & 0 \\ 0 & -i \\ \end{array} \right).$$
This means that $k^T P_a k= \pm P_b$ which may transform $a$ to a different value $b$, where $a,b \in \{x,y,z \}$. But overall the full set $ \{P_x, P_y, P_z, -P_x, - P_y, - P_z\}$ is invariant under the transformation by $k$.
There must be a trivial element $k=$ the rank-2 identity matrix. But what else can it allow?
How could we determine the complete $K$?
For whom is interested, I list the all $96=24\times 4$ invariant matricies of $K$: $$ \begin{gather*} \begin{pmatrix} 1 & 0 \\ 0 & 1 \end{pmatrix}, \begin{pmatrix} 1 & 0 \\ 0 & -1 \end{pmatrix}, \frac{(1+i)}{\sqrt{2}} \begin{pmatrix} 1 & 0 \\ 0 & -i \end{pmatrix}, \frac{(1-i)}{\sqrt{2}} \begin{pmatrix} 1 & 0 \\ 0 & i \end{pmatrix}, \\ \begin{pmatrix} 0 & 1 \\ 1 & 0 \end{pmatrix}, \begin{pmatrix} 0 & 1 \\ -1 & 0 \end{pmatrix}, \frac{(1+i)}{\sqrt{2}} \begin{pmatrix} 0 & 1 \\ -i & 0 \end{pmatrix}, \frac{(1-i)}{\sqrt{2}} \begin{pmatrix} 0 & 1 \\ i & 0 \end{pmatrix}, \\ \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & 1 \\ -1 & 1 \end{pmatrix}, \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & 1 \\ 1 & -1 \end{pmatrix}, \frac{(1+i)}{2} \begin{pmatrix} 1 & 1 \\ i & -i \end{pmatrix}, \frac{(1-i)}{2} \begin{pmatrix} 1 & 1 \\ -i & i \end{pmatrix}, \\ \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & -1 \\ -1 & -1 \end{pmatrix}, \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & -1 \\ 1 & 1 \end{pmatrix}, \frac{(1+i)}{2} \begin{pmatrix} 1 & -1 \\ i & i \end{pmatrix}, \frac{(1-i)}{2} \begin{pmatrix} 1 & -1 \\ -i & -i \end{pmatrix}, \\ \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & -i \\ -i & 1 \end{pmatrix}, \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & -i \\ i & -1 \end{pmatrix}, \frac{(1+i)}{2} \begin{pmatrix} 1 & -i \\ -1 & -i \end{pmatrix}, \frac{(1-i)}{2} \begin{pmatrix} 1 & -i \\ 1 & i \end{pmatrix}, \\ \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & i \\ -i & -1 \end{pmatrix}, \frac{1}{\sqrt{2}} \begin{pmatrix} 1 & i \\ i & 1 \end{pmatrix}, \frac{(1+i)}{2} \begin{pmatrix} 1 & i \\ -1 & i \end{pmatrix}, \frac{(1-i)}{2} \begin{pmatrix} 1 & i \\ 1 & -i \end{pmatrix} \end{gather*} $$ product with $\langle i\rangle=\{\pm I,\pm iI\}$.
For given orders, the numbers of elements in $K$ and $\mathbb{Z}_4\times S_4$ are as follows: