I recall reading (on this very site, in fact) that there is a mathematician whom argues that we ought to switch from "set" to "order" in the foundations, so as to "recover duality" or some such.
Does anyone know who this is? And/or where they've argued this?
John Baez once argued that $0$-categories should be preorders rather than sets, but the argument was based on higher category theory. Specifically, that the hierarchy of categories should start at $-2$, and goes:
Then, we recover sets as being analogous to groupoids: they are preorders whose arrows are all isomorphisms. Actually, this gives setoids -- sets with an equivalence relation -- but setoids are equivalent to sets.
(IMO, the rationale that preorders are a better basic notion that set is not implausible even without trying to imagine $(-2)$- and $(-1)$-categories. And I definitely think setoid is a better basic notion than set)
I don't recall him saying anything about duality, though, so this may have nothing to do with what you're remembering.