There are some number blocks given as follows:

The aim is placing these blocks in such a way that the resulting 4X4 matrix is symmetrical. Blocks cannot be rotated, they must be used as given.
My question is, can this somehow be solved by linear programming? If yes, how should I model it?
For a more complicated version, here is a similar question, this time for 5X5 matrix:

I don't think you can use a linear programming model, but you can solve it with integer programming. (You can also solve it using constraint programming.)
I will use $N$ for the dimension of the square matrix (4 or 5 in your examples), $K$ for the number of blocks (6 in the first example, 11 in the second) and $m_i$ and $n_i$ for the row and column dimensions of block $i.$ (In your example, one of the dimensions of each block is 1, but we do not need to require that.) I'm going to use a coordinate system that puts the upper left cell of the matrix at $(1, 1)$ and the lower right cell at $(N, N).$ Finally, I will use $B^b$ to denote the $m_b \times n_b$ block $b.$
The integer programming model I tested uses two sets of variables. $x_{b,r,c}$ is a binary variable taking value 1 if block $b$ has its upper left corner in cell $(r, c)$ and 0 if not. $y_{r,c}$ is a continuous variable (which will end up being integer valued in your sample matrices) containing the value that ends up in cell $(r, c)$ of the assembled matrix.
I'll need two sets of predefined constants. $\alpha_{b, r, c, i, j}$ will be 1 if putting the upper left corner of block $b$ at position $(r, c)$ means that it covers cell $(i, j)$ and 0 if not. $\beta_{b, r, c, i, j}$ will be $B^b_{i-r + 1, j-c + 1}$ if putting block $b$ at $(r, c)$ covers $(i, j)$ (i.e., if $\alpha_{b, r, c, i, j} = 1$) and 0 if not. If block $b$ at $(r, c)$ covers $(i, j),$ $\beta_{b, r, c, i, j}$ will be the entry in cell $(i, j)$ of the final matrix.
On to the constraints.