Suppose $\mathcal{Z} = \{z_1, \dots, z_n\}$ is the set of points in $d$-dimensional Euclidean space. The aim is to partition the dataset into $(K\leq n)$ distinct clusters $R_1,\dots, R_K$ where $R_i\cap R_j = \emptyset$, for $i\neq j$, and $\cup_{j=1}^{K} R_j = \mathcal{Z}$ such that some empirical loss function is minimized. A frequently used loss function is given as $$ \sum_{j=1}^{K}\sum_{\mathbf{z}\in R_j}\|\mathbf{z} - \mathbf{c}_{j}\|^2, $$ where $\mathbf{c}_j$ is a cluster center or centroid of $R_j$. The k-means algorithm starts with a fixed centroid vector and i) assigns each datapoint to the cluster whose centroid is closest, ii) using the assignment in the previous step, finds new centroids by averaging the datapoints in each cluster. The repetition of i and ii guarantees convergence to the local optimum. Is there any way I can bound the maximum number of the local minima in the clustering problem given $K,n$ and the dimension of centroid vectors $d$?
2026-03-04 19:33:38.1772652818
Maximum number of local minima in k-means
15 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail AtRelated Questions in OPTIMIZATION
- Optimization - If the sum of objective functions are similar, will sum of argmax's be similar
- optimization with strict inequality of variables
- Gradient of Cost Function To Find Matrix Factorization
- Calculation of distance of a point from a curve
- Find all local maxima and minima of $x^2+y^2$ subject to the constraint $x^2+2y=6$. Does $x^2+y^2$ have a global max/min on the same constraint?
- What does it mean to dualize a constraint in the context of Lagrangian relaxation?
- Modified conjugate gradient method to minimise quadratic functional restricted to positive solutions
- Building the model for a Linear Programming Problem
- Maximize the function
- Transform LMI problem into different SDP form
Related Questions in NUMERICAL-OPTIMIZATION
- Modified conjugate gradient method to minimise quadratic functional restricted to positive solutions
- Bouncing ball optimization
- Minimization of a convex quadratic form
- What is the purpose of an oracle in optimization?
- What do you call iteratively optimizing w.r.t. various groups of variables?
- ProxASAGA: compute and use the support of $\Delta f$
- Can every semidefinite program be solved in polynomial time?
- In semidefinite programming we don't have a full dimensional convex set to use ellipsoid method
- How to generate a large PSD matrix $A \in \mathbb{R}^{n \times n}$, where $\mathcal{O}(n) \sim 10^3$
- Gram matrices in the Rayleigh-Ritz algorithm
Related Questions in DISCRETE-OPTIMIZATION
- Optimization - If the sum of objective functions are similar, will sum of argmax's be similar
- Simultaneously multiple copies of each of a set of substrings of a string.
- Do these special substring sets form a matroid?
- What does it mean to dualize a constraint in the context of Lagrangian relaxation?
- How to solve this binary optimization problem?
- What exactly the Ellipsoid method does?
- Give the cutting-plane proof of $\sum\limits_{i,j = 1}^4 x_{ij} \leq 9$.
- Relation with the perfect partition problem and the single machine task schedule problem
- What is the name of following optimization problem and algorithms to solve them
- Integrality gap of maximum weighted clique
Related Questions in SET-PARTITION
- Existence of a denumerble partition.
- Given N sets of partitions, find a partition such that it satisfies a criterion
- Given a decreasing family of sets and partitions with a refinement condition, is there a monotonous choice function from the partitions?
- Partition of an $n$-element set such that the smallest component has at least $k$ elements?
- Number of equivalence relations on a set with $kn$ elements with the condition that each equivalence class has n elements
- Is there a similar notion of cycle type commonly in use for finite partitions, where instead of cycle sizes one counts the block sizes?
- Is it possible to construct two subsequences of a sequence X with specific properties such that the two subsequence sums are the same?
- Coloring $\mathbb{R}^2$ and single-colored paths
- A homework problem about set theory
- Canonical name for the partition that a partition of a set induces on its subsets
Related Questions in CLUSTERING
- clustering over sphere surface
- what is mean "Number of connected Triplets of vertices" in global clustering
- Algorithm To Disjointly Divide a Graph
- Which statistical test to use to chose how to assign a subgroup to one of two other groups.
- How do I compute the updates to the EM algorithm in Quantum Clustering?
- Cluster algorithm which minimizes a distance while fulfilling a constraint
- Detect clusters in an RGB space
- Prime Number Spiral Clusters
- Clustering via Pattern Formation
- What defines a convex Cluster and how it differentiates from other types?
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Find $E[XY|Y+Z=1 ]$
- Refuting the Anti-Cantor Cranks
- What are imaginary numbers?
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- How do we know that the number $1$ is not equal to the number $-1$?
- What are the Implications of having VΩ as a model for a theory?
- Defining a Galois Field based on primitive element versus polynomial?
- Can't find the relationship between two columns of numbers. Please Help
- Is computer science a branch of mathematics?
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- Generator of inertia group in function field extension
Popular # Hahtags
second-order-logic
numerical-methods
puzzle
logic
probability
number-theory
winding-number
real-analysis
integration
calculus
complex-analysis
sequences-and-series
proof-writing
set-theory
functions
homotopy-theory
elementary-number-theory
ordinary-differential-equations
circles
derivatives
game-theory
definite-integrals
elementary-set-theory
limits
multivariable-calculus
geometry
algebraic-number-theory
proof-verification
partial-derivative
algebra-precalculus
Popular Questions
- What is the integral of 1/x?
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- Is a matrix multiplied with its transpose something special?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- How to tell if a set of vectors spans a space?
- Calculus question taking derivative to find horizontal tangent line
- How to determine if a function is one-to-one?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- Is this Batman equation for real?
- How to find perpendicular vector to another vector?
- How to find mean and median from histogram
- How many sides does a circle have?