There is this quote by Hermann Weyl:
"… classical logic was abstracted from the mathematics of finite sets and their subsets …. Forgetful of this limited origin, one afterwards mistook that logic for something above and prior to all mathematics, and finally applied it, without justification, to the mathematics of infinite sets. This is the Fall and original sin of [Cantor's] set theory …." (Weyl, 1946)
Does this imply that at the invention of quantifiers "$\exists, \forall$", they were merely used for finite domains of discourse?
In that case, I think that would mean they can be viewed as merely abbreviating the connectives "$\land$, $\lor$". For example, if the domain conists of $3$ elements $a,b,c$, then merely
$\exists x\ \phi(x)\equiv\phi(a)\lor\phi(b)\lor\phi(c)$
and
$\forall x\ \phi(x)\equiv\phi(a)\land\phi(b)\land\phi(c).$
A motivation is to understand if I can think of quantifier rules as just induced by rules for connectives. For example, for finde domains, I figured that using only De Morgan's laws
$\neg\exists x\ \phi(x)=\neg((\phi(a)\lor\phi(b))\lor\phi(c))=\neg(\phi(a)\lor\phi(b))\land\neg\phi(c)=(\neg\phi(a)\land\neg\phi(b))\land\neg\phi(c)=\forall x\ \neg\phi(x).$
At a time were people haven't come up with the quantifiers, I guess they didn't even think about things like finitely axiomatizing arithmetic yet.
Since I came across the quote in the article discussing the controversy behind cardinalities:
Once we got quantifier for infinite domains (like the natural numbers), is there an additional obstacle for accepting uncountable domains?
I wonder about this point because if you introduce the quantifier, because you can't write down an infinitely long sentence, for example a $\forall$-claim about the element of $\mathbb Z$, then there is not so much difference anymore to the problem which arises with $\mathbb R$. Sure, they are not countable - but you can still name many of it's elements (even if you can't even specify some). You can only handle all of them via $\forall$, and that is true not matter what infinite cardinality you speak about.
Several things should be mentioned here. First, the replacement of quantifiers by conjunctions and disjunctions requires not only that the domain of discourse be finite but that its size and in fact all its elements be explicitly known. For example, a law saying "all serfs must give their feudal lord a quarter of all the grain they grow" can be stated in this generality only by using quantifiers, not as a conjunction of separate laws for each serf (and each kernel of grain). A conjunction formulation would have to be rewritten every time the lord acquired a new serf.
Now concerning Weyl's statement, I don't think he was claiming that the mere use of quantifiers originated in finite situations and is inappropriately extended to the infinite. Rather, he objected to some of the logical laws governing statements involving quantifiers (and connectives). A typical example would be the law of classical logic that $$ (\forall x\,\phi(x))\lor(\exists x\,\neg\phi(x)). $$ If $x$ ranges over a finite set, this law is (relatively) unproblematic. Either all the $x$'s satisfy $\phi$ or we can (in principle) go through all the possible values of $x$, one after another, and eventually find one that doesn't satisfy $\phi$. With infinitely many (or, worse, uncountably many) possible values for $x$, the idea of going through them all is no longer so convincing.
At this point, it becomes important to be clear about the intended meaning of the existential quantifier. Weyl and other constructivists advocate reading $\exists x$ as meaning that we can (at least in principle) find an appropriate value for $x$. Classical mathematics interprets $\exists x$ as merely asserting existence of an $x$, with no claim about our ability to find anything. This disagreement about what $\exists$ should mean will obviously lead to disagreement about the validity of formulas like the one displayed above. Classical mathematicians will say it's obviously correct; constructivists will say it's an arrogant statement about our omniscience; and extremists on each side will think the other side is crazy.
Let me also comment on your question whether uncountable domains are worse than countably infinite ones. Some of the issues, like those I described above, are the same in both cases. Nevertheless, there are differences, which, as far as I understand them, seem to boil down to the following idea. Even though we cannot "go through" all elements of a countable domain, they way we can with a finite domain, we can at least envision a process which, if continued forever, would go through the whole domain. In the case of uncountable domains, even that "potential exhaustion" of the domain is unavailable. There is a book, by Gregory Moore, on the history of the Axiom of Choice, in which he reproduces some correspondence between leading French mathematicians, from just after the Axiom of Choice was proposed, in which they discuss to what extent it is acceptable. If I remember correctly, Hadamard found the full Axiom of Choice acceptable, while the others, including Lebesgue and Baire, argued for accepting only versions that permit countably many choices. A cynic would say that's because they had proved theorems that depend on the countable axiom of choice, but the reasons they give in these letters suggest a genuine intuitive difference between the countable and uncountable cases.