提出首个多项式时间求解非平方欧氏距离k-主成分的方法
$k$-PCA for (non-squared) Euclidean Distances: Polynomial Time Approximation
- 用确定性算法近似非平方欧氏距离的k-子空间中位数
- 逼近比为√d,运行时间多项式级,不随k指数增长
- 适合处理噪声、异常值和稀疏数据的高维分析场景
给定整数k≥1和ℝ^d中的n个点集P,经典k-PCA通过最小化点到k维仿射子空间的平方欧氏距离(ℓ₂,₂范数)之和来近似其均值。而k-子空间中位数则最小化点到子空间的非平方欧氏距离(ℓ₂,₁混合范数)之和,即中位数。中位数子空间通常更稀疏且对噪声和异常值更鲁棒,但因其在k<d-1时非凸,逼近难度远高于均值。本文首次提出一个多项式时间的确定性算法,其运行时间和逼近比均不随k指数增长:乘法逼近比为√d,输入规模下运行时间多项式。我们预期该技术可推广至ℓ₂,𝑧范数(z≠1,2,如z=∞)等其他问题,并有效处理异常值与稀疏性。论文附开源代码及真实数据集实验结果。
原文摘要 · Abstract (English)
Given an integer $k\geq1$ and a set $P$ of $n$ points in $\REAL^d$, the classic $k$-PCA (Principle Component Analysis) approximates the affine \emph{$k$-subspace mean} of $P$, which is the $k$-dimensional affine linear subspace that minimizes its sum of squared Euclidean distances ($\ell_{2,2}$-norm) over the points of $P$, i.e., the mean of these distances. The \emph{$k$-subspace median} is the subspace that minimizes its sum of (non-squared) Euclidean distances ($\ell_{2,1}$-mixed norm), i.e., their median. The median subspace is usually more sparse and robust to noise/outliers than the mean, but also much harder to approximate since, unlike the $\ell_{z,z}$ (non-mixed) norms, it is non-convex for $k<d-1$. We provide the first polynomial-time deterministic algorithm whose both running time and approximation factor are not exponential in $k$. More precisely, the multiplicative approximation factor is $\sqrt{d}$, and the running time is polynomial in the size of the input. We expect that our technique would be useful for many other related problems, such as $\ell_{2,z}$ norm of distances for $z\not \in \br{1,2}$, e.g., $z=\infty$, and handling outliers/sparsity. Open code and experimental results on real-world datasets are also provided.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。