Drawn from Real Analysis: Measure Theory, Integration, and Hilbert Spaces by Elias M. Stein & Rami Shakarchi page 314 Exercise 9.
The exercise states the following,
Let $C([a,b])$ denote the vector space of continuous functions on the closed and bounded interval $[a,b]$. Suppose we are given a Borel measure $\mu$ on this interval, with $\mu([a,b])<\infty$. Then \begin{align*} f\longmapsto\ell(f)=\int_{a}^{b}f(x)\,d\mu(x) \end{align*} is a linear functional on $C([a,b])$, with $\ell$ positive in the sense that $\ell(f)\geq 0 $ if $f\geq 0$.
Prove that, conversely, for any linear functional on $C([a,b])$ that is positive in the above sense, there is a unique finite Borel measure $\mu$ so that \begin{align*} \ell(f)=\int_{a}^{b}f(x)\,d\mu(x) \end{align*} for $f\in C([a,b])$. Otherwise known as The Riesz-Markov Theorem.
[Hint: Suppose $a = 0$ and $u\geq0$. Define $F(u)$ by $F(u) = \lim_{\epsilon\rightarrow 0}\ell(f_\epsilon)$ where \begin{align*} f_\epsilon(x)=\begin{cases} 1,&\text{ if } x\in[0,u]\\ \text{linear},&\text{ if }t\in[u,u+\epsilon]\\ 0,&\text{ if }t\in[u+\epsilon,\infty) \end{cases} \end{align*} Then $F$ is increasing and right-continuous, and $\ell(f)$ can be written $\ell(f)=\int_{a}^{b}f(x)\,dF(x)$ via Theorem $3.5$.]
Theorem 3.5 Let $F$ be an increasing function on $\mathbb{R}$ that is right-continuous. Then there is a unique measure $\mu$ (also denoted by $\,dF$) on the Borel sets $\mathcal{B}$ on $\mathbb{R}$ such that $\mu((a,b]) = F(b)-F(a)$ if $a<b$.
Question: I am not sure how to use the hint to get from the fact that $\mu((a,b]) = F(b)-F(a)$ to the integral $\int_{a}^{b}f(x)\,dF(x)$. Moreover, I very much suspect that the dominated convergence theorem will play a role in proving that $\ell(f)=\int_{a}^{b}f(x)\,dF(x)$ however to me, it not clear how. Could someone provide some insight as to the purpose of the $f_\epsilon$ function? Or an outline as to prove it with Theorem $3.5$?
Remark: I am aware there are other proofs to this theorem on stack however my question is geared towards proving it in the direction of this hint.
I assume that you know how to prove $F$ is increasing and right-continuous.
The challenging part is to prove $\ell(f)=\int_a^b f dF$.
Below is a sketch of a proof.