Kronecker product and the vec operator: confusion on proof of vec(AXB) = (transpose(B) ⊗ A) vec(X)

1.8k Views Asked by At

I was reading up on Kronecker products and vec operator from couple of sources and landed on the equation:

vec(AXB) = (transpose(B) ⊗ A) vec(X)

suppose A is [0 1 0; 1 0 1; 0 1 0] (3x3 matrix), B is [0 1 1 0; 1 0 1 0; 1 1 0 1; 0 0 1 0] (4x4 matrix),

then X must be a (3x4) matrix for a valid matrix multiplication right?

so AXB results in a (3x4) matrix vec(AXB) results in vectors of (4x1)

(transpose(B) ⊗ A) results in (12x12) matrix and vec(X) is a (4x1) matrix. I dont see how is this possible. Again, if we pad it with 0's even then the resulting matrix has a bigger dimension.

Am I missing something here? Any answers would be much appreciated.

2

There are 2 best solutions below

2
On

Cleared my confusions reading this paper. So the point is that vec(.) operator stacks ALL the rows into one long column and not just a row. Thus, in the above case, it would create a 12x1 vector making it possible for the multiplication.

0
On

Given a set of three matrices $$A \in \mathbb{R}^{m\times n}, X\in \mathbb{R}^{n\times p}, B \in \mathbb{R}^{p\times l}$$

Their product $$C = AXB \in \mathbb{R}^{m\times l}$$

The $\text{vec}(.)$ operator is a transformation that simply converts (reshapes) a given matrix into a column vector, by stacking its columns into one long column.

So

$$\text{vec}(C) = \text{vec}(AXB) = (B^T \otimes A)\text{vec}(X)$$ or $$c = (B^T \otimes A)x$$ where $$c \in \mathbb{R}^{ml\times 1}, \ x \in \mathbb{R}^{np\times 1}$$ are two column vectors.