suppose I have vectors $(x_i,y_i)_{i=1}^n$ where $x_i \in [0,1]^n$ and $y_i \in [0,1]^m$. I know that $Ax_i = y_i$
In this case, is there any way or any paper that I can recover matrix operator $A$?
I have checked out some papers discussing about low rank matrix recovery, but it seems I am dealing with a different question.
Let $X$ denote the matrix whose columns are $x_1, \dots, x_n$, and let $Y$ denote the matrix whose columns are $y_1,\dots,y_n$. You can rewrite your statement on the $x_i$ and $y_i$ as $$ A X = Y $$ In your case, the matrix $X$ has $n$ columns and $n$ rows. This equation will allow you to recover $A$ if and only if the columns $x_i$ are linearly independent; in this case we can compute $$ A = YX^{-1} $$ More generally, we can cover $A$ as long as the vectors $x_i$ span $\Bbb R^n$, even if there are more than $n$ of them.