I'm trying to find general properties for a half derivative operator, yet I encountered what seems to be a paradox. Let $H$ be a linear operator such that $H^2f = Df$ where $D$ is the first derivative. Then we have the following consequences
$$H0=0$$ $$H^31=DH1=HD1 \Rightarrow DH1 = H0=0 \Rightarrow H1 = c $$ $$H^2 x = 1 \Rightarrow H^3 x = c \Rightarrow Hx = cx + d \tag{1}\label{eq1}$$ where $c$ and $d$ are some constant functions. Consequently $$1 = H(Hx) = cHx + cd = c\left(Hx + d\right)\tag{2}\label{eq2}$$ $$\Rightarrow Hx = \frac{1}{c}-d\tag{3}\label{eq3}$$ By \eqref{eq3}, $c \neq 0$. However, by \eqref{eq1} and \eqref{eq3}, $c = 0$, which is contradiction.
So does this mean that $H1$ does not exist? Or is there something wrong with my calculations?
My understanding is that $H1=0$. But I don't think my explanation here is directly related to what you truely want to do.
The formula $H^2=D$ is a correct definition. However the domain of $H$ can be tricky.
If we consider the Fourier transform $(Df)^\wedge(\xi)=i\xi\hat f(\xi)$ (or $2\pi i\hat f(\xi)$ depending on the conventions). A standard fractional derivative is $(Hf)^\wedge(\xi)=\sqrt{i\xi}\hat f(\xi)$ where you can choose a branch of the square root for $\xi>0$ and $\xi<0$.
In this setting $\hat 1=\delta_0$ is the Dirac measure, it makes sense to say $\sqrt{|\xi|}\cdot\delta_0(\xi)=0$ as if you take any smooth approximation $f_\epsilon(\xi)\to\sqrt{|\xi|}$ and $g_\epsilon\to\delta_0$ (in the sense of measures) we always have $f_\epsilon(\xi)g_\epsilon(\xi)\to0$ in the sense of distributions.
On the other hand $\hat x=\delta_0'$ is the derivative of Dirac measure, and $\sqrt{i\xi}\cdot\delta_0'(\xi)$ is not defined because the similar approximation fails.
If you consider this way, that is to say $x\notin\operatorname{Dom}H$. Basically you cannot use the function $x$ in the argument.
In general if one define "function spaces with fractional derivative", we tend not to use such $H$, instead we use something like $(1-D^2)^{1/4}$ because its Fourier transform is smooth at 0. This is called Bessel potential, which works on all polynomials. By contrast, the Riesz potential $(-D)^{1/2}$ (not $D^{1/2}$) may have a domain problem.