Let $S = \left\{x \in \mathbb{Q} \mid 1 \leqslant {x}^2 \leqslant 29 \right\}$
What can we say about the supremum and infimum of this set? Would it be non-existent?
Would it be correct to say the following?
Suppose $ \sup S < \sqrt{29} $ then $ \exists x \in S $ such that $ x > \sup S$
Therfore $ \sqrt{29} \leqslant \sup S$
But on the other hand $\sup S > \sqrt{29}$ then $\exists x \in \mathbb{Q}$ such that $ x < \sup S$
Therefore $\sup S \leqslant \sqrt{29}$
Therefore $\sup S $ can only be equal to $\sqrt{29}$
However $\sqrt{29} \notin \mathbb{Q}$ therefore $\sqrt{29} \notin S$
Therefore there can not be a supremum to this set.
(I am assuming the supremum of a set must belong to the set. Is this correct?)
The supremum, or least upper bound, of a set need not be elements of the set (and for open sets they never are).
Example. Let $T = (0,1)$. Then $\sup T = 1 \not \in S$. That's it.
So in your set, $\sup S = \sqrt{29} \not \in S$. That's it.
....
Okay, but listen up, this is important. If your universal space is $\mathbb Q$ or some other space. Then $\sqrt{29}$ will not exist in your space. So we would say in the space of the rationals $S$ does not have a least upper bound.
We say $\mathbb Q$ does not have the "least upper bound property" because it is possible for there to exist sets that are bounded above but that do not have a supremum. However if your space is a different set of points and is such a space where every set that is bounded above must have a least upper bound. Then we say that space has the "least upper bound property".
Now the entire point of the real numbers and the entire reason for the existence of irrational number is that $\mathbb Q$ does not have the least upper bound property, but $\mathbb R \supset \mathbb Q$ is an extension of $\mathbb Q$ that DOES have the least upper bound property.
And the irrational numbers are nothing more or less than the least upper bounds of bounded sets of rational numbers that do not have a rational least upper bound.
So your set $S$ does not have a rational least upper bound. So it must have an irrational least upper bound. And it does. It is $\sqrt{29}$.
And every irrational number (indeed every real number) is the least upper bound of some set of rational numbers.
.....
Indeed we can actually say: Let $x \in \mathbb R$ and let $S =\{q\in \mathbb Q| q<x\}$; then $\sup S = x$.
Period. That is always true.