arXiv:2504.20883cs.DScs.LG2025-04

提出高效求解约束子空间近似的统一框架,提升公平聚类等任务性能。

Guessing Efficiently for Constrained Subspace Approximation

  • 用核心集+猜测+求解三阶段框架处理各类约束子空间近似问题。
  • 对多种约束场景实现(1+ε)倍或ε加性近似,优于已有方法。
  • 适用于公平子空间近似、k均值聚类等,特别适合需控制分布的场景。

本文研究约束子空间近似问题:给定ℝᵈ中n个点{a₁,…,aₙ},目标是寻找一个k维子空间,使各点到该子空间的欧氏距离的p次幂和最小(p≥1)。在约束子空间近似(CSA)中,投影矩阵P还需满足额外约束,如属于某个集合𝒮。本文提出通用框架coreset-guess-solve,可对多种约束实现(1+ε)-乘法或ε-加性近似。该方法在分区约束子空间近似上取得新进展,应用于公平子空间近似、k均值聚类及投影非负矩阵分解等。虽恢复了欧式空间下k均值聚类的最佳已知界,但对其他问题显著改进了现有结果。

原文摘要 · Abstract (English)

In this paper we study constrained subspace approximation problem. Given a set of $n$ points $\{a_1,\ldots,a_n\}$ in $\mathbb{R}^d$, the goal of the {\em subspace approximation} problem is to find a $k$ dimensional subspace that best approximates the input points. More precisely, for a given $p\geq 1$, we aim to minimize the $p$th power of the $\ell_p$ norm of the error vector $(\|a_1-\bm{P}a_1\|,\ldots,\|a_n-\bm{P}a_n\|)$, where $\bm{P}$ denotes the projection matrix onto the subspace and the norms are Euclidean. In \emph{constrained} subspace approximation (CSA), we additionally have constraints on the projection matrix $\bm{P}$. In its most general form, we require $\bm{P}$ to belong to a given subset $\mathcal{S}$ that is described explicitly or implicitly. We introduce a general framework for constrained subspace approximation. Our approach, that we term coreset-guess-solve, yields either $(1+\varepsilon)$-multiplicative or $\varepsilon$-additive approximations for a variety of constraints. We show that it provides new algorithms for partition-constrained subspace approximation with applications to {\it fair} subspace approximation, $k$-means clustering, and projected non-negative matrix factorization, among others. Specifically, while we reconstruct the best known bounds for $k$-means clustering in Euclidean spaces, we improve the known results for the remainder of the problems.

子空间近似约束优化聚类公平学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。