Let $A$ be a unital Banach algebra. For $a\in A$, we define $$\exp(a):= \sum_{n=0}^\infty \frac{a^n}{n!}$$
Consider the function $$f: \Bbb{R} \to A: t \mapsto \exp(ta) = \sum_{n=0}^\infty \frac{t^n a^n}{n!}$$
In the book I'm reading, it is claimed that $f'(t) = af(t)$ by differentiating term by term. How can we justify the differentiation term by term? Or what is another way to show that $f$ is differentiable with $f'(t) = af(t)$. Maybe some argument with functionals?
Here is an elementary proof inspired on the classical proof for power series.
For $t \in \Bbb{R}$, put $$g(t):= \sum_{k=1}^\infty k\frac{t^{k-1}a^{k}}{k!}$$ $$S_n(t) := \sum_{k=0}^n \frac{t^ka^k}{k!}$$ $$R_n(t) := \sum_{k=n+1}^\infty \frac{t^ka^k}{k!}$$
All these series converge since $A$ is a Banach space.
Fix $t \in \Bbb{R}$ and let $\epsilon > 0$.
Note first that $\lim_n S_n'(t) = g(t)$, so there is $N_1$ such that $$n \geq N_1 \implies \Vert S_n'(t)-g(t)\Vert < \epsilon/3$$
Also, choose $N_2$ such that $$n \geq N_2 \implies \sum_{k=n+1}^\infty\frac{\Vert a \Vert^k}{k!} k (|t|+1)^{k-1} < \epsilon/3$$
Put $n:= \max \{N_1, N_2\}$. Choose $\delta> 0$ such that $$0 < |s-t| < \delta \implies \left\Vert \frac{S_n(s)-S_n(t)}{s-t}- S_n'(t)\right\Vert< \epsilon/3$$
Then for any $s \neq t$ with $|s-t| < \delta \land 1$, we have $$\left \Vert\frac{f(s)-f(t)}{s-t}- g(t)\right\Vert$$ $$\leq \left\Vert\frac{S_n(s)-S_n(t)}{s-t}-S_n'(t)\right\Vert+\Vert S_n'(t)-g(t)\Vert + \frac{\Vert R_n(s)-R_n(t)\Vert}{|s-t|}$$
But $$\left|\frac{s^k-t^k}{s-t}\right|= |t^{k-1}+ t^{k-2}s + \dots + ts^{k-2} + s^{k-1}| \leq k (|t|+1)^{k-1}$$ Hence $$\frac{\Vert R_n(s)-R_n(t)\Vert}{|s-t|}=\frac{\Vert \sum_{k=n+1}^\infty \frac{s^k-t^k}{k!} a^k\Vert}{|s-t|}\leq \sum_{k=n+1}^\infty \left|\frac{s^k-t^k}{s-t}\right|\Vert a\Vert^k/k! < \epsilon/3$$ and we conclude $$\left \Vert\frac{f(s)-f(t)}{s-t}- g(t)\right\Vert < \epsilon/3 + \epsilon/3 + \epsilon/3 = \epsilon$$
We thus have shown that $f'(t) = g(t) = a f(t)$ and the proof is done.
Reference: Conway's "Functions of one complex variable I" (I modified the proof I saw there).