For a continuous function, $f:[0,b] \to \Bbb{R}$ show that: $$ \lim_{\lambda\to\infty} \int^b_0 f(t) \frac{\sin(\lambda t)}{t}\,dt = \frac{\pi}{2}\,f(0) $$
I know it has something to do with the Riemann-Lebesgue lemma about Fourier series, but $\frac{f(t)}{t}$ is not an integrable function.
I tried to define $g(t) = \frac{2f(t)\sin(\frac{t}{2})}{t} $ which tends to $f(0)$ as $t\to0$ and $g(t)$ is integrable in $[0,b]$ so we get:
$$ \lim_{\lambda\to\infty} \int^b_0 f(t) \frac{\sin(\lambda t)}{t} \,dt= \lim_{\lambda\to\infty} \frac{1}{2}\int^b_0 g(t) \frac{\sin(\lambda t)}{\sin(\frac{t}{2})}\,dt $$ which kind of reminds $g(x)*\mathit{Dn}(0)$ ($\mathit{Dn}=$Dirichlet kernel), but it's not the same.
I guess it can be solved with the $\mathrm{Si}(x)$ function but I'm trying to solve it with Fourier series.
You can't prove this because it's false. (It's true if you assume just a tiny bit more smoothness than just continuity; see below.)
First, $$\lim_{\lambda\to\infty}\int_0^b\frac{|\sin(\lambda t)|}{t}\,dt =\lim_{\lambda\to\infty}\int_0^{\lambda b}\frac{|\sin(t)|}{t}\,dt=\infty.$$
But the $L^1$ norm of $\sin(\lambda t)/t$ is the same as its norm as a linear functional on $C([0,b])$. So the Uniform Boundededness Principle shows that there exists $f\in C([0,b])$ such that $$\sup_{n\in\Bbb N}\left|\int_0^bf(t)\frac{\sin(nt)}{t}\right|\,dt=\infty.$$
Below On the other hand it's easily seen to be true if you assume that $f$ satisfies $$|f(t)-f(0)|\le ct^\alpha$$for some $\alpha>0$.
First, it's true for $f=1$, since as has been pointed out $$\int_0^b\frac{\sin(\lambda t)}{t}\,dt=\int_0^{\lambda b}\frac{\sin(t)}{t}\,dt\to\frac\pi2.$$ So we may assume $f(0)=0$, and now $|f(t)|\le ct^\alpha$.
Let $\epsilon>0$. Choose $\delta>0$ so that $$\int_0^\delta\frac{ct^\alpha}{t}\,dt<\epsilon.$$So we have $$\int_0^\delta|f(t)|\frac{|\sin(\lambda t)|}{t}\,dt<\epsilon$$for every $\lambda$. And $$\left|\int_\delta^bf(t)\frac{\sin(\lambda t)}{t}\,dt\right|<\epsilon$$if $\lambda$ is large enough, by the Riemannn-Lebesgue lemma (note that $f(t)/t$ is integrable on $[\delta,b]$.)