Why isn't there a contravariant derivative? (Or why are all derivatives covariant?)

Question

Question: If there exists a covariant derivative, then why doesn't there also exist a "contravariant derivative"? Why are all or most forms of differentiation "covariant", or rather why do all or most forms of differentiation transform covariantly? What aspect of differentiation makes it intrinsically "covariant" and intrinsically "not contravariant"? Why isn't the notion of differentiation agnostic to "co/contra-variance"?

Motivation:
To me it is unclear (on an intuitive, i.e. stupid/lazy, level) how notions of differentiation could be restrained to being either "covariant" or "contravariant", since any notion of differentiation should be linear*, and the dual of any vector space is exactly as linear as the original vector space, i.e. vector space operations in the dual vector space still commute with linear functions and operators, they same way they commute with such linear objects in the original vector space.

So to the extent that the notion of linearity is "agnostic" to whether we are working with objects from a vector space or from its dual vector space, so I would have expected any notion of differentiation to be similarly "agnostic". Perhaps a better word would be "symmetric" -- naively, I would have expected that if a notion of "covariant differentiation" exists, then a notion of "contravariant differentiation" should also exist, because naively I would have expected one to exist if and only if the other exists.

However, it appears that no such thing as "contravariant derivative" exists (see here on Math.SE, also these two posts [a][b] on PhysicsForums), whereas obviously a notion of "covariant derivative" is used very frequently and profitably in differential geometry. Even differential operators besides the so-called "covariant derivative" seemingly transform covariantly, see this post for a discussion revolving around this property for the gradient. I don't understand why this is the case.

(* I think)

Answer 1

The reason why the covariant derivative makes a $(p,q+1)$-type tensor field out of a $(p,q)$ type tensor field is because for a tensor field $T$, $\nabla T$ is defined as $$ \nabla T(X,\text{filled arguments})=\nabla_XT(\text{filled arguments}), $$ and $\nabla_XT$ is $C^\infty(M)$-linear in $X$, so this relation defines a covariant tensor field - one that acts on vector fields. But why does it need be so?

The geometric answer is that a covariant derivative is essentially a representation for a Koszul or principal connection, a device that allows for parallel transport of bundle data along curves. The reason it takes in vectors is because vectors are intrinsically tied to curves on your manifold. If your covariant derivative took in 1-forms as the directional argument instead of vectors, it would not represent a connection, because there is no way to canonically tie together curves and 1-forms without a tool like a metric tensor or a symplectic form.

Answer 2

The "covariant" in "covariant derivative" should really be "invariant". It is a misnomer, but we are stuck with it. It is not the same "covariant" as that of a "covariant vector", and therefore, there is no "contravariant derivative". Armed with this, Wikipedia should fill in the rest for you :)

Answer 3

The "contravariant derivative" is usually called the gradient; for functions $f$, $$\langle \nabla f, v\rangle = df(v) = \nabla_v f$$ where $\nabla$ on the left is the gradient and on the right is the covariant derivative; here the gradient is still coordinate-free but transforms contravariantly (lives in tangent space, and not cotangent space).

You can define an analogous $(2,0)$ tensor that is the contravariant derivative of a vector field.

Answer 4

Let $S = C^\infty(X, \mathbb{R})$ be the $\mathbb{R}$-algebra of all smooth functions on the manifold X. There is a purely algebraic notion of Kähler differentials: there is an $S$-module $\Omega_{S/\mathbb{R}}$ presented by generators and relations as

• For every $f \in S$, add a generator $\mathrm{d}f$
• For every $r \in \mathbb{R}$, add the relation $\mathrm{d}r = 0$
• For every $f,g \in S$, add the relation $\mathrm{d}(f+g) = \mathrm{d}f + \mathrm{d}g$
• For every $f,g \in S$, add the relation $\mathrm{d}(fg) = f \mathrm{d}g + g \mathrm{d}f$

There are a few other ways to define it, but it's clear that $\Omega_{S / \mathbb{R}}$ is the "universal" way to differentiate things in $S$, if we presume that differentiation must be $\mathbb{R}$-linear and satisfy the Leibniz rule.

There is an obvious map $\Omega_{S / \mathbb{R}}$ to the global sections of $T^*X$, sending $\mathrm{d}f$ to $\mathrm{d}f$.

However, the Kähler differentials seem too big. However, for each point $P$, I will define an "evaluation map". Let $\Omega_{S/\mathbb{R}, P}$ be the $\mathbb{R}$-vector space you get by adding the further relations $f \mathrm{d}g = f(P) \mathrm{d}g$ for every pair of functions $f,g \in S$, and write $\mathrm{d}f|_P$ for the image of $\mathrm{d}f$ in this space.

Then, following the idea of this Mathoverflow answer, we can quickly show that $\Omega_{S / \mathbb{R}, x_0}$ is precisely the cotangent space at $x_0$. For any smooth $f$, we take the differential of a Taylor polynomial and get $$ \mathrm{d}f(x)|_{x_0} = f'(x_0) \mathrm{d} x|_{x_0}$$ (where $f'(x_0)$ is the linear functional $v \mapsto \nabla_v f(x_0)$) at which point it's clear that $\Omega_{S / \mathbb{R}, x_0} \cong T^*_{x_0} X$.

It's not hard to pass from $\mathbb{R}^n$ to manifolds. Consequently, we conclude that the exterior derivative is the "universal" way to differentiate smooth scalar fields in such a way that the derivative is completely determined by its "values" at points.

---

Reading more of the answers, I think they claim further that $\Omega_{S / \mathbb{R}}^{**}$ is isomorphic to the global sections of the cotangent bundle as $S$-modules (and that this implies the global sections have what is maybe a nicer but less general universal property) but I haven't followed the argument.

Answer 5

This is really hand-wavy, and maybe not even correct, but this is what I just thought of based on a new fact that I recently learned. Maybe the idea helps someone else.

On any differentiable manifold (it doesn't even have to be Riemannian), we have a canonical symplectic form on the cotangent bundle, see here or here. (This isn't something I knew previously, but is something I learned due to a comment by Moishe Cohen -- all credit goes to them.)

Anyway, this symplectic form on the cotangent bundle gives us a volume form on the cotangent bundle (I think, see here, I might be misinterpreting). Thus, canonically from the definition, any differentiable manifold has a volume form on its cotangent bundle, thus a notion of signed distance, signed area, signed volume, ..., i.e. volume+orientation, on the cotangent bundle.

These are exactly the ingredients we need for a meaningful notion of integration, and it occurs on the cotangent bundle, and not the tangent bundle, because the differentiable structure induces a symplectic form on the cotangent bundle, but not on the tangent bundle.

Thus the natural place for integration to occur on a differentiable manifold is in the cotangent bundle. And corresponding to any notion of integration should be a notion of differentiation, and since the former develops naturally only on the cotangent bundle, the latter should only develop naturally on the cotangent bundle. Thus why differential forms act on covectors, and why all derivatives are covariant, not contravariant -- because all integrals are covariant.