After learning about finite dimensional vector spaces, the time came for learning about infinite dimensional ones. However, these seem much less intuitive to me, and proof of that is the question I wanted to ask here.
Let's consider a infinite dimensional vector space $(V, +, \cdot)$, with no topology or any other structure associated to it - not even a norm or inner product.
Let $V=L(S)$ ($L$ is the span operator) with $S=\{e_1, e_2,...\}$ where:
$$e_1=(1,0,0,0,...)\\ e_2=(0,1,0,0,...)\\ e_3=(0,0,1,0,...)$$
And so on. Also, let
$$v_a=(1,1,1,1,1,1,...)\\ v_b=(1,2,3,4,5,6,...)\\ v_c=(3,1,4,1,5,9,...)$$
Where in $v_c$ each coordinate is the n-th digit of $\pi$.
The questions
- Is $v_a$ in $V$? Intuitively, I would think it is not, since in order to represent $v_a$ as a linear combination of elements in our basis $S$, one would need to perform a sum of infinitely many summands
$$\sum_{i=1}^\infty e_i$$
which, since it's not a finite sum, it is not defined in $(V,+,\cdot)$.
In case $v_a$ was not in $V$, let $W = L(S\cup v_a)$. Would $v_b$ or $v_c$ also be in $W$? If so, what would its coordinates be? Again intuitively, if $v_a$ were not part of $V$, it would also not be possible to create a finite linear combination of vectors from $S \cup v_a$ that would yield $v_b$. Is this correct? Then, how can we construct a basis that can generate $v_b$ and $v_c$?
Does $V$ only contain vectors with a finite number of non-zero coordinates? If so, how can we create a basis for a vector space which contains all these other vectors with "infinitely long" coordinates?
No, $v_a$ is not in $V$ because you can't write it as a finite linear combination of $e_i$.
Even if you add $v_a$ to the set of generators, still $v_b$ and $v_c$ don't belong to $W$, because you still need an infinite number of elements of the basis.
Yes, $V$ only contains vectors with a finite number of non-zero elements. In the same way, $W$ contains only vectors which are constant except that for a finite number of elements. You can't always "see" the basis of a vector space. The theorem of existence of a basis guarantees its existence, but it doesn't tell you how it is. Also, you use Zorn's Lemma in this proof (equivalent to Axiom of Choice).
The idea of the theorem of existence of the basis is that of gradually adding vectors to a starting set, ensuring that the new vectors are not in the span of the existing set, ensuring the set remains linearly independent. This process continues until the set spans the entire vector space, at which point it becomes a basis. Zorn's Lemma is used to guarantee the existence of a maximal linearly independent set. So, this theorem is not constructive, you don't know at the end how the basis is done.
Usually, on infinite-dimensional vector spaces you want to add more structure (a scalar product for instance) and use more flexible and usable notions of basis (Hilbert basis for instance, which means writing elements as infinite lineare combinations of basis elements Orthonormal basis).