Let’s say there are two matrices $A$ and $B$ where $$A=\begin{bmatrix}a&b\\b&a\end{bmatrix}$$ $$B=\begin{bmatrix}c&d\\d&c\end{bmatrix}$$
$A$ and $B$ together make up a third matrix $C$ where $$C=\begin{bmatrix}A&B\\B&A\end{bmatrix}=\begin{bmatrix}\begin{bmatrix}a&b\\b&a\end{bmatrix}&\begin{bmatrix}c&d\\d&c\end{bmatrix}\\\begin{bmatrix}c&d\\d&c\end{bmatrix}&\begin{bmatrix}a&b\\b&a\end{bmatrix}\end{bmatrix}$$
My question is of syntax. Specifically, did I define $C$ using $A$ and $B$ properly? It seems ambiguous to me in the sense of $C$ being a matrix of matrices and not of $A$ and $B$ ‘s elements; when I in fact want $C$ to be a matrix of the elements and not of the matrices.
Edit: it looks like I have described a block matrix.
Let $R$ be a ring.
Let $M=\mathcal M_{2\times 2}(R)$ be the ring of $2\times 2$ matrices over $R$.
Let $A,B$ be in $M$. Then we can associate and write both follwing matrices. (The person writing the matrices has to give the one or the other sense.)
The matrix $$\begin{bmatrix}A & B \\ B & A\end{bmatrix}\in\mathcal M_{2\times 2}(M)\ .$$
The block matrix $$\left[\begin{array}{c|c}A & B \\\hline B & A\end{array}\right]\in\mathcal M_{4\times 4}(R)\ .$$
(There are obvious ring homomorphisms between the two spaces of matrices. Using this, the "multiplication of block matrices" is possible.)
Later edit:
I decided to insert some explicit examples after the discussion in the comments. In my oppinion, the usage of block matrix multiplication is underestimated, it should be a standard tool in the school. Here, to have an easy game of inserting examples, i will use sage. Here is my dialog with sage.
Now to the above $2\times 2$ block matrix named $M$ we associate a plain matrix named $X$.
The question in the comment has now the following answer.
The $(1,1)$ entry in $M$ is the $2\times 2$ matrix $A$.
The $(1,2)$ entry in $M$ is the $2\times 2$ matrix $B$.
The $(1,1)$ entry in $X$ is the number $1$.
The $(1,2)$ entry in $X$ is the number $5$.
We want now to see the utility of block matrices. For this note that we can multiply the blocks "as if" they were numbers. (Well, here, they are indeed "numbers" in a ring, the ring of $2\times 2$ matrices over $\Bbb Z$. But also more general patterns of block matrices are allowed / make sense. Let us understand but the present situation.)
We have formally $$M = \left[\begin{array}{c|c}A & B \\\hline C & D\end{array}\right]\in\mathcal M_{2\times 2}\ .$$ Then we can for instance compute $$ M^2 = \left[\begin{array}{c|c}A & B \\\hline C & D\end{array}\right] \left[\begin{array}{c|c}A & B \\\hline C & D\end{array}\right] = \left[\begin{array}{c|c}AA+BC & AC+BD \\\hline CA+DC & CB+DD\end{array}\right] \ . $$ In our example:
Sage has a rather mathematically oriented thinking, so i hope the above can be easily digested.