I'm working through Rudin, and the first instance I see this notation used is Definition 3.16. The definition states:
Let $\{s_n\}$ be a sequence of real numbers. Let $E$ be the set of numbers $x$ (in the extended real number system) such that $s_{n_x}\rightarrow x$ for some subsequence $\{s_{n_k}\}$. This set $E$ contains all subsequential limits as defined in definition 3.5, plus possibly the numbers $+\infty$ and $-\infty$
We now recall Definitions 1.8 and 1.23 and put:
$$s^* = \sup E$$ $$s_* = \inf E$$.
The numbers $s^*$ are called the upper and lower limits of $\{s_n\}$; we use the notation
$$\lim_{n\to\infty}\sup s_n=s^*, \lim_{n\to\infty}\inf s_n=s_*$$
The concept of $\inf$ and $\sup$ made sense to me in chapter 1/2 in the context of sets, and the first pair of definitions, with regards to the set $E$ makes sense. Based off of those definitions, I interpret $s^*$ as the largest convergent value you can create from a subsequence of $\{s_n\}$; similarly, $s_*$ is the smallest convergent value you can create from a subsequence of $\{s_n\}$ (although those definitions might be inaccurate).
The lower notation, on the other hand, confuses me. As you're taking the limit, It seems to me that you are no longer dealing with a set, just individual set elements. In that context, I can't distiguish $\lim\sup s_n$ or $\lim\inf s_n$ from simply $s_n$. How does this pair of definitions for $s^*$ and $s_*$ make sense?
Even though $\limsup$ and $\liminf$ are written with spaces, they are single symbols.
They should be read $$ \limsup_{n\to\infty} s_n = s^* $$ and not $$ \lim_{n\to\infty} \Big( \sup s_n \Big ) = s^*$$ which doesn't really make sense (it's trying to take the supremum of a single number at a time, which has no defined mening).
However, if you consider "$\limsup$" to be a single symbol with a definition separate from the meanings of $\lim$ and $\sup$ by their own, then it's just notation, and what you have there is a definition of what that notation means.