Let the matrix A be: $$A(n,k): \text{If } n=k \; \text{ then } 1+\frac{1}{n^{\frac{1}{4} (3+2 i t)} k^{\frac{1}{4} (3+2 i t)}}\text{ else }\frac{1}{n^{\frac{1}{4} (3+2 i t)} k^{\frac{1}{4} (3+2 i t)}}$$
which is equivalent to: $$A(n,k): \text{If } n=k \; \text{ then } 1+\frac{1}{n^{\frac{1}{2} (3+2 i t)}}\text{ else }\frac{1}{n^{\frac{1}{4} (3+2 i t)} k^{\frac{1}{4} (3+2 i t)}}$$
which is equivalent to $A=M+I$ where $M$ equals:
$M(n,k)=\frac{1}{n^{\frac{1}{4} (3+2 i t)} k^{\frac{1}{4} (3+2 i t)}}$
and $I$ is the identity matrix in linear algebra:
$$I(n,k): \text{If } n=k \; \text{ then } 1 \text{ else } 0$$
The first few determinants starting at the upper left corner of the infinite matrix $A$ are:
The $1$x$1$ matrix: $$2$$ The $2$x$2$ matrix: $$2^{1+\frac{1}{2} (-3-2 i t)}-2^{\frac{1}{2} (-3-2 i t)}+2$$ The $3$x$3$ matrix: $$2^{1+\frac{1}{2} (-3-2 i t)}-2^{\frac{1}{2} (-3-2 i t)}+3^{\frac{1}{2} (-3-2 i t)}+2$$ ...
The plot of the determinant of the $10$ x $10$ matrix looks like this:
where the vertical lines are at the Riemann zeta zeros on the critical line.
Compare this to the actual Riemann zeta function on the critical line:

Is there a infinite sized matrix, which is not totally degenerate, such that the determinant is the Riemann zeta function?
Associated Mathematica program:
(*start*)
Clear[n, k, nn, t, x];
nn = 10;
A = Table[
Table[If[n == k, 1 + 1/n^(1/4 (3 + 2 I t))/k^(1/4 (3 + 2 I t)),
1/n^(1/4 (3 + 2 I t))/k^(1/4 (3 + 2 I t))], {k, 1, nn}], {n, 1,
nn}];
pol = Det[A];
Show[Plot[Re[pol], {t, 0, 60}],
Graphics[
Table[Line[{{Im[ZetaZero[n]], -30}, {Im[ZetaZero[n]], 30}}], {n, 1,
12}]], ImageSize -> Large]
Plot[Re[Zeta[1/2 + I*t]], {t, 0, 60}, ImageSize -> Large]
(*end*)

Mathematica:
Output:
{1, 1 + 2^-s, 1 + 2^-s + 3^-s, 1 + 2^-s + 3^-s + 4^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s + 7^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s + 7^-s + 8^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s + 7^-s + 8^-s + 9^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s + 7^-s + 8^-s + 9^-s + 10^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s + 7^-s + 8^-s + 9^-s + 10^-s + 11^-s, 1 + 2^-s + 3^-s + 4^-s + 5^-s + 6^-s + 7^-s + 8^-s + 9^-s + 10^-s + 11^-s + 12^-s}
https://oeis.org/A143142