Firstly, for a finite such tower, say $n$ deep, assuming there are no divisions by $0$ to get in the way
$$\frac{\mathrm{d}x}{d\frac{\mathrm{d}x}{d\frac{\mathrm{d}x}{d ...}}} = \frac{\mathrm{d}x}{\mathrm{d}t}\Big(\frac d{\mathrm{d}t}\big(\frac{\mathrm{d}x}{d\frac{\mathrm{d}x}{d\frac{\mathrm{d}x}{d ...}}}\big)\Big)^{-1} = \frac{\frac{\mathrm{d}x}{\mathrm{d}t}}{\frac d{\mathrm{d}t}\Big(\frac{\frac{\mathrm{d}x}{\mathrm{d}t}}{\frac d{\mathrm{d}t}\Big(\frac{\frac{\mathrm{d}x}{\mathrm{d}t}}{\frac d{\mathrm{d}t}(...)}\Big)}\Big)}$$
The bottom of this tower is
$$ \frac{\mathrm{d}x}{d \frac{\mathrm{d}x}{\mathrm{d}t}} = \frac{\mathrm{d}x}{\mathrm{d}t}\frac{\mathrm{d}t}{d\frac{\mathrm{d}x}{\mathrm{d}t}} = \frac{x'}{x''}$$
and we can, at least in principle, work back up to the top to have the whole tower expressed as upto $n^{th}$ derivatives. I did write out what the next layers would look like but I couldn't see any nice pattern.
Ok so now my question is whether it would be in any sense meaningful to consider the infinite tower, in which case the following analysis happens:
Writing $F = \frac{\mathrm{d}x}{d\frac{\mathrm{d}x}{d\frac{\mathrm{d}x}{d ...}}}$, we have
$$F = \frac{\frac{\mathrm{d}x}{\mathrm{d}t}}{\frac{dF}{\mathrm{d}t}} \implies F = \sqrt{2x + c}$$
If $x$ and $y$ are smooth real functions "in $t$", the derivative $\frac{dx}{dy}(t_0)$ makes sense only for those $t_0$ such that $y$ is a diffeomorphism in a neighborhood of $t_0$ that is contained in the domain of $x$. (I.e., when $y$ is locally a chart for a $1$-dimensional manifold around $t_0$ on which $x$ is defined.) In this case, we have the rule(**) $$\frac{dx}{dy} = \frac{dx/dt}{dy/dt}$$ Note that a real function $y$ defined on an interval is everywhere locally a diffeomorphism iff it is smooth and strictly monotone.
I can see only one way to define the infinitely iterated derivative $$\frac{dx}{d\frac{dx}{d\frac{dx}{\ddots}}}$$ which as you suggest is by a limit of a sequence $$(d_nx)_{n \geq 0}=t,\frac{dx}{dt},\frac{dx}{d\frac{dx}{dt}},\frac{dx}{d\frac{dx}{d\frac{dx}{dt}}},\ldots$$
There are multiple questions:
... and partial answers:
(**) Note how writing $dx/dt$ for $x'$ is compatible with the philosophy to view a derivative as the derivative of a function with respect to another function, here the identity mapping $\operatorname{id} : \mathbb R \to \mathbb R$, denoted $t$. Compare with partial derivatives in differential geometry, or already in multivariable calculus, where a partial derivative is the derivative with respect to a projection map onto a component of the cartesian product.
That is, a 'variable' is really a function, usually the identity map.
The cancellation law is just the chain rule: we define $dx/dy(t_0)$ by $$(x \circ y^{-1})'(y(t_0))=x'(t_0)\cdot(y^{-1})'(y(t_0))$$ where $(y^{-1})'(y(t_0))=1/y'(t_0)$ again by the chain rule applied to $(y\circ y^{-1})'(y(t_0))$