For $x \to \infty$: the number of squares $n^2 \leq x$ is $\sqrt{x} + O(1)$.
From here (page 6). More specifically, do they mean that... I'm confused now. I'm really not sure what they mean though I just finished a similar problem.
I know that if '$f$ is $O(g)$' then the limit $\limsup_{x\to \infty} \frac{|f(x)|}{g(x)}$ exists.
Call the number of squares $N(x)$. The statement $N(x)=\sqrt{x}+O(1)$ means $N(x)-\sqrt{x}=O(1)$, which is then defined the way that you know, i.e. that $N(x)-\sqrt{x}$ is bounded above and below as $x \to \infty$.
Alternately, you could say that there exists $f$ such that $N(x)=\sqrt{x}+f(x)$ and $f(x)=O(1)$ as $x \to \infty$. This would be useful if somehow the $O(1)$ term entered into the right side in a complicated way, such that you couldn't isolate it.