I know that in infinite dimensional space, the inequality for L norms in discrete cases don't always work. For example, L-infinity norm can be greater than any other L-norm in special cases.
Now, I wonder if L2 norm is always smaller than L1 norm in infinite dimensional space? When p is less than infinity, does the general inequality ‖∗‖q≤‖∗‖p whenever p≤q holds?
In a geometrical sense, L2 norm should be always smaller than L1 norm though. By the way, Lq space $\in$ Lp space whenever q≤p right?
No. For instance, $f(x):=\frac{1}{\sqrt{x}}\in L^1(0,1)\setminus L^2(0,1)$, hence $\|f\|_{L^2}=\infty \not \leq \|f\|_{L^1}<\infty$.
In rough terms, when increasing the value of $p$, the $\|\cdot\|_{L^p}$ norm of function $f$ will be less sensitive to the rate of decrease of $f$ at infinity, but more sensitive to its rate of increase near any singularities. Therefore the inequality $L^p\subset L^q$ if $p\leq q$ is only true when functions cannot have singularities, such as in the case of $\ell^p=L^p(\mathbb{N})$. Conversely, when the domain of the functions has finite measure (and hence there are no issues with decrease at infinity), the inclusions are reversed, i.e. $L^q\subset L^p$ if $p\leq q$.