Say I want to determine a matrix solution $A^*$ to the minimization problem $$\min_{A \in \mathbb{R}^{n\times n}} f(A)$$ with the constraint that this solution $A^*$ must have rank $k$, where $k \ll n$. How would one go about this? I'm particularly interested a solution that is immediately applicable in a black-box autodifferentiator (like TensorFlow) rather than theoretical approaches. For example, would it be possible to perform some kind of rank factorization of $A$, like $A = CF$ where $C$ is an $n\times k$ matrix and $F$ is a $k\times n$ matrix, and then optimize over these variables? In my case, the indices of the trivial and nontrivial eigenvalues are known, so would it be as easy as thresholding the eigenvalues? Do there exist assumptions about $A$ which make this type of constraint trivial?
2026-04-01 13:28:26.1775050106
How to obtain a rank-5 solution to an optimization problem
27 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail AtRelated Questions in OPTIMIZATION
- Optimization - If the sum of objective functions are similar, will sum of argmax's be similar
- optimization with strict inequality of variables
- Gradient of Cost Function To Find Matrix Factorization
- Calculation of distance of a point from a curve
- Find all local maxima and minima of $x^2+y^2$ subject to the constraint $x^2+2y=6$. Does $x^2+y^2$ have a global max/min on the same constraint?
- What does it mean to dualize a constraint in the context of Lagrangian relaxation?
- Modified conjugate gradient method to minimise quadratic functional restricted to positive solutions
- Building the model for a Linear Programming Problem
- Maximize the function
- Transform LMI problem into different SDP form
Related Questions in MATRIX-RANK
- Bases for column spaces
- relation between rank of power of a singular matrix with the algebraic multiplicity of zero
- How to determine the rank of the following general $\mathbb{R}$-linear transformation.
- How to prove the dimension identity of subspace? i.e. $\dim(V_1) + \dim(V_2) = \dim(V_1 + V_2) + \dim(V_1 \cap V_2)$
- How can I prove that $[T]_B$ is a reversible matrix?
- can I have $\det(A+B)=0$ if $\det(A)=0$ and $\det(B) \neq 0$?
- Let $A$ be a diagonalizable real matrix such as $A^3=A$. Prove that $\mbox{rank}(A) = \mbox{tr}(A^2)$
- Row permuation of a matrix for a non-zero diagonal
- Tensor rank as a first order formula
- Rank of Matrix , Intersection of 3 planes
Related Questions in CONSTRAINTS
- Optimization - If the sum of objective functions are similar, will sum of argmax's be similar
- Find all local maxima and minima of $x^2+y^2$ subject to the constraint $x^2+2y=6$. Does $x^2+y^2$ have a global max/min on the same constraint?
- Constrained eigenvalue problem
- Constrained optimization where the choice is a function over an interval
- MILP constraints with truth table
- Convexify this optimization problem with one nonlinear (bilinear) constraint
- Second-order cone constraints
- Matching position and rotation of moving target.
- Existence of global minimum $f(x,y,z) = x + y + z$ under the constraint $x^2+xy+2y^2-z=1$
- Constrained Optimization: Lagrange Multipliers
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Find $E[XY|Y+Z=1 ]$
- Refuting the Anti-Cantor Cranks
- What are imaginary numbers?
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- How do we know that the number $1$ is not equal to the number $-1$?
- What are the Implications of having VΩ as a model for a theory?
- Defining a Galois Field based on primitive element versus polynomial?
- Can't find the relationship between two columns of numbers. Please Help
- Is computer science a branch of mathematics?
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- Generator of inertia group in function field extension
Popular # Hahtags
second-order-logic
numerical-methods
puzzle
logic
probability
number-theory
winding-number
real-analysis
integration
calculus
complex-analysis
sequences-and-series
proof-writing
set-theory
functions
homotopy-theory
elementary-number-theory
ordinary-differential-equations
circles
derivatives
game-theory
definite-integrals
elementary-set-theory
limits
multivariable-calculus
geometry
algebraic-number-theory
proof-verification
partial-derivative
algebra-precalculus
Popular Questions
- What is the integral of 1/x?
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- Is a matrix multiplied with its transpose something special?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- How to tell if a set of vectors spans a space?
- Calculus question taking derivative to find horizontal tangent line
- How to determine if a function is one-to-one?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- Is this Batman equation for real?
- How to find perpendicular vector to another vector?
- How to find mean and median from histogram
- How many sides does a circle have?