How to compare the entropy of copulas?

77 Views Asked by At

Three different bivariate copulas are shown below with increasing degrees of dependence (parameter $\theta$).

Differential entropy is a measure of disorder in a probability density like the copula. Without calculating the formula at the bottom, and based on the images alone, which of the three has the most and least entropy? how can you tell, and how do $\theta$ and maximum value $4.8$ factor into the guess of entropy ranking?

enter image description here enter image description here enter image description here

We can calculate the differential entropy of each copula using

$$H(c(u,v))=-\int_{[0,1]^2} c(u,v) \ln c(u,v) \hspace{1mm} du \hspace{1mm} dv$$

where the copula density is

$$\begin{align} c\left(u,v ; \theta\right) = (1+\theta)(u \cdot v)^{-1-\theta}(u^{-\theta}+v^{-\theta}-1)^{-\frac{1}{\theta}-2} \end{align}$$

(This link shows a 3d rendition of what the Clayton copula looks like)