Fractional Order Derivative

Question

A friend and I were talking about derivatives, and he asked an interesting question. Since both of us have not taken our calculus courses yet, neither of us were sure of the answer. His question has two parts: 1. can you have a fractional order derivative i.e. could you have $\frac{d^ny(x)}{dx^n}$ where, for example, $n=\frac{1}{2}$? And, 2. can you have a variable as the order of a derivative i.e. $\frac{d^ny(x)}{dx^n}$ where n=some variable? I have doubts as to whether either are even possible, but I decided to post the qestion to find out for sure.

Answer 1

Yes. Fractional derivatives exist.

See for example, this Wikipedia entry on Fractional Calculus. As I mention in a comment above; there are eight "related" posts about fractional calculus.

Indeed, the order of a derivative need not be in $\mathbb N$. Rational orders of a derivative exist, as you were suspecting in your post.

And even irrational numbers can be an orders of a derivative.

Answer 2

Oh boy, this is a fun one to answer. First, yes, these things exist and they fall under a thing called fractional calculus.

---

To start, let's assume that the functions we are looking at are smooth so that all the normal derivatives exist.

Secondly, we'll also want $\frac{d^a}{dx^a}=D_x^a$, the $a$th derivative w.r.t. $x$.

Third, we want $D_x^aD_x^b=D_x^{a+b}$. Specifically, $D^{1/2}D^{1/2}=D^1$.

Now, one approach would be to use the limit definition of the derivative:

$$D_x^1f(x)=\lim_{h\to0}\frac{f(x+h)-f(x)}h$$

As we've assumed all these derivatives exist, it suffices to replace these limits with one-sided limits:

$$^+D_x^1f(x)=\lim_{h\to0^+}\frac{f(x+h)-f(x)}h$$

Take the derivative again and you'll get

$$^+D_x^2f(x)=\lim_{h\to0^+}\frac{f(x+2h)-2f(x+h)+f(x)}{h^2}$$

One can then derive the following formula with induction:

$$^+D_x^nf(x)=\lim_{h\to0^+}\frac1{h^n}\sum_{k=0}^n(-1)^k\binom nkf(x+(n-k)h)$$

Since $\binom nk=0$ for every $n-k\in\mathbb N_{>0}$, we have

$$^+D_x^nf(x)=\lim_{h\to0^+}\frac1{h^n}\sum_{k=0}^\infty(-1)^k\binom nkf(x+(n-k)h)$$

Let $h=1/N$ and this becomes

$$^+D_x^nf(x)=\lim_{N\to\infty}N^n\sum_{k=0}^\infty(-1)^k\binom nkf\left(x+\frac{n-k}N\right)$$

This allows an extension to fractional derivatives, where we use generalized binomial coefficients:

$$^+D_x^af(x)=\lim_{N\to\infty}N^a\sum_{k=0}^\infty(-1)^k\binom akf\left(x+\frac{a-k}N\right)$$

However, the above sum has the annoying attitude to be divergent for negative values, hence, we may include an additional parameter to fix that:

$$_b^+D_x^af(x)=\lim_{N\to\infty}N^a\sum_{k=0}^{bN}(-1)^k\binom akf\left(x+\frac{a-k}N\right)$$

This is an extended version of the Grunwald-Letnikov derivative, and as I have previously shown, the above extends to integrals via Riemann sums:

$$_1^+D_x^{-1}f(x)=\lim_{N\to\infty}\frac1N\sum_{k=1}^Nf\left(x-\frac kN\right)=\int_{x-1}^xf(t)~\mathrm dt$$

Pretty cool, right?

---

Now, the above limit is quite horrendous and truthfully hard to evaluate at any non-integer value. While the following definition for fractional derivatives aren't much simpler, they are usually more direct for solving. To begin, we instead look at fractional integrals.

Let us have $_uJ_x^a$ be the $a$th integral w.r.t. $x$ around the point $u$. That is,

$$_uJ_x^af(x) = \int_u^x \int_u^{\sigma_1} \cdots \int_u^{\sigma_{n-1}} f(\sigma_{a}) \, \mathrm{d}\sigma_{a} \cdots \, \mathrm{d}\sigma_2 \, \mathrm{d}\sigma_1$$

Note that $u$ has an impact on the integral. It is, perhaps, a curious thing, that we have the following formula:

$$_uJ_x^nf(x)=\frac1{(n-1)!}\int_u^x(x-t)^{n-1}f(t)~\mathrm dt$$

which may be proven by induction. Here, $n!$ is the factorial, where define it through the Gamma function,

$$x!=\int_0^\infty t^xe^{-t}~\mathrm dt,\quad x>-1$$

Quite obviously, the above formula extends to non-integer values. By repeatedly differentiating, you will find with the help of the fundamental theorem of calculus that

$$D_x^a~_uJ_x^bf(x)\stackrel?=D_x^{a-b}f(x)$$

Unfortunately, the right side doesn't have a $u$, which might be a problem, so we need to include an additional parameter:

$$_uD_x^a~_uJ_x^bf(x)=~_uD_x^{a-b}f(x)$$

Also note that the order is necessary, since

$$f(x)=\frac d{dx}\int_u^xf(t)~\mathrm dt\ne\int_u^x\frac d{dt}f(t)~\mathrm dt=f(x)-f(0)$$

That is, we need to take the integral first, then the derivative. This leads to a natural fractional derivative:

$$_uD_x^af(x)=\begin{cases}\frac1{(-\{a\})!}\frac{d^{\lceil a\rceil}}{dx^{\lceil a\rceil}}\int_u^x(x-t)^{-\{a\}}f(t)~\mathrm dt,&a\ge0\\\frac1{(a-1)!}\int_u^x(x-t)^{a-1}f(t)~\mathrm dt,&a<0\end{cases}$$

Where $\{a\}$ is the fractional part of $a$. For example,

$\{\pi\}=0.1415926\dots$

$\{-2.7\}=0.3$

And $\lceil a\rceil$ is the ceiling of $a$. For example,

$\lceil\pi\rceil=4$

$\lceil-2.7\rceil=-2$

Using this definition, you may find that

$$_0D_x^ax^b=\frac{b!}{(b-a)!}x^{b-a}$$

as a mere example. Particularly, we have things like

$$_0D_x^{1/2}\sqrt x=\frac{\sqrt\pi}2$$

---

Of course, there are many many other fractional derivatives out there (indeed, no two fractional derivatives are necessarily the same), so I suggest you browse the Wikipedia more if you are interested, and if you feel ready to do some crazy integrals, try some research.

Answer 3

Another way to define fractional derivatives

Recall that the exponential function $e^{ax}$ is very easy to derive: $$\frac{d^n}{dx^n} e^{ax} = a^n e^{ax}$$

Assume that $f$ can be written as a sum or an integral of exponentials (I will here only go for the integral case): $$f(x) = \int a(\xi) e^{c \xi x} \, d\xi$$

Taking ordinary derivatives and assuming that the derivatives can be moved inside the integral then gives $$f^{(n)}(x) = \int a(\xi) (c\xi)^n e^{c \xi x} \, d\xi$$

This formula directly generalizes to fractional $n$.

Example

Probably you haven't heard about it yet, but there is something called the Fourier transform. It can be thought of as splitting a function into frequencies (using $e^{i \omega t}$): $$f(t) = \int \hat f(\omega) e^{i \omega t} \, d\omega$$ The derivatives then become $$f^{(n)}(t) = \int (i\omega)^n \hat f(\omega) e^{i \omega t} \, d\omega$$ There are some technicalities with defining $i^n$ for rational $n$, but the problems can be overcome.