I guess this is right and try to prove it by using the fact that the polynomial ring $K[t]$ has a countable basis $1,x,x^2,\cdots$. But How to use this fact?
Aside, if this statement is true. Is the following one also true?
Let $\{L_i\}$ be a direct system of algebraic extension of $K$ and $L$ be the direct limit of them. Then $[L:K]=\underrightarrow{\lim}[L_i:K]$, where the degrees can be taken to be infinite.
Of course this is true for Galois extensions as in that case, one has \[G(L/K)=\underleftarrow{\lim}G(L_i/K).\] But how about algebraic extensions?
Edit: The statement is wrong. But I still want a proof for local fields, i.e fields with complete valuation and finite residue fields.
No!
Consider a set $I$ of indices and the field of rational functions $K=k(X_i|i\in I)$ over an arbitrary field $k$.
The extension field $K\subset L=k(\sqrt X_i|i\in I)$ is algebraic (since it is generated by algebraic elements), of degree $[L:K]\geq \operatorname {card} I$ because the elements $\sqrt X_i$ are linearly independent over $K$.
Thus by taking $I$ non countable you obtain an algebraic extension $K\subset L$ of non countable degree.