I know that "for all" $(\forall)$ and "there exists" $(\exists)$ are dual, in the sense that $$\neg \forall \neg = \exists,\quad \neg \exists \neg = \forall$$
What is dual to "there exists unique"? In other words, how should we interpret $$\neg (\exists !) \neg$$
???
I suppose you could define $\forall!$ by $$\forall!x \psi(x) \leftrightarrow \forall x[\psi(x) \vee \exists y(\neg \psi(y) \wedge y \ne x)]$$ ("Either $\psi$ holds here or it fails somewhere else too" / "Either $\psi$ is true everywhere or there are at least two counterexamples")
Then $\exists ! = \neg \forall ! \neg$ and $\forall ! = \neg \exists ! \neg$ in the same sense that $\exists = \neg \forall \neg$ and so on: really $\exists = \neg \forall \neg$ is just shorthand for $\exists x \phi(x) \leftrightarrow \neg \forall x \neg \phi(x)$.
Why? Well, $\exists ! x\ \phi(x)$ is shorthand for $$\exists x [\phi(x) \wedge \forall y (\phi(y) \to y=x)]$$ Dualising the quantifiers gives $$\neg \forall x \neg [\phi(x) \wedge \neg \exists y\neg(\phi(y) \to y=x)]$$ which is equivalent to $$\neg\forall x[\neg \phi(x) \vee \exists y (\phi(y) \wedge y \ne x)]$$ So we have $$\exists ! x \phi(x) \leftrightarrow \neg \forall ! x \neg \phi(x)$$ And so on.