I searched the backlog of this website for something along the lines of my question to no avail. Not to mention a myriad of PDFs online which just drop the definition and allege more details can be found in Clifford's paper published in the 1873 Proceedings of the London Mathematical Society which is conveniently hidden behind a paywall.
It is easy to see what motivates the development of complex numbers $\mathbb{C}$, the inability of real numbers $\mathbb{R}$ to provide a solution in $x^2 + 1 = 0$ which leads to defining the indeterminate $i^2 = -1$. Naturally, extending or changing algebraic rules doesn't necessarily have to be motivated by the inability of the current abstraction to provide a solve to a particular, previously unconsidered equation.
What troubles me is that I am not sure how Clifford or Study (or anyone else in between) struck upon defining $\epsilon^2 = \epsilon^n = 0$ beyond just taking complex numbers, stating $i^n = p$ and throwing $p$s at the wall until one sticks. I understand the results, such as the way dual numbers lend themselves to various useful constructs such as encoding the first derivative in the "dual part" after evaluating a function extended to the realm of dual numbers... Or the notion of dual quaternions which extend quaternions to handle translations in addition to rotations (applicable to rigid body kinematics). But not what led Clifford to them, discounting divine providence.
Fundamentally, did Clifford just poke at the work of Hamilton and those before him, seeing what sticks or did he have a problem in mind which led him to the notion of dual numbers when he was working on the "preliminary sketch of biquaternions"?
Actually, complex numbers were not considered because we were so eager to have a square root of $-1$. But they turned out to be useful to solve cubic equations, and they gave meaningful and correct answers that were real numbers (see Wikipedia).
So I guess the same might be true with dual numbers. They turned out to be useful, that is why they are teached and used.
I should note that I'm no expert on dual numbers, but maybe you can think about $\epsilon$ like the algebraic version of $\epsilon$ in analysis. It is so small, that if you multiply it with itself it yields zero.