用KNN距离剔除异常点,轻松实现鲁棒聚类
Simple KNN-Based Outlier Detection Achieves Robust Clustering
- 基于最近邻距离筛选异常点,无需额外中心或过度删点
- 理论证明可达到与先进方法相当的聚类优化效果
- 适合追求简单高效且对异常点敏感的聚类场景
在实际应用中,聚类算法对异常点的鲁棒性至关重要。在鲁棒k均值问题(即含异常点的k均值)中,目标是移除z个异常点,并最小化剩余点的k均值代价。尽管鲁棒k均值与异常点检测密切相关,但经典异常点检测启发式方法在理论和实证上的有效性仍不明确。本文证明,在对最优簇大小做合理假设的前提下,仅通过移除具有较大K近邻距离的点,即可在近似保证上达到与现有方法相当的性能:将鲁棒k均值问题转化为标准k均值问题,实现常数倍的代价降低,且无需引入额外中心或丢弃过多异常点。实验证明,该方法在真实数据集上,聚类代价和运行时间均优于或等同于更复杂的算法。结果表明,简单的KNN启发式方法在鲁棒聚类中出人意料地有效,为异常点检测与聚类技术的融合开辟了新路径。
原文摘要 · Abstract (English)
Being robust to the presence of outliers is crucial for applying clustering algorithms in practice. In the $\textit{robust $k$-Means}$ problem (i.e., $k$-Means with outliers), the goal is to remove $z$ outliers and minimize the $k$-Means cost on the remaining points. Despite the close connection between robust $k$-Means and outlier detection, both theoretical and empirical understanding of the effectiveness of $\textit{classic outlier detection heuristics}$ for robust $k$-Means remains limited. In this paper, we prove that under a practical assumption on the optimal cluster sizes, simply removing points with large $K$-Nearest-Neighbor distances achieves performance comparable to prior work in terms of approximation guarantees: it yields a constant-factor reduction from robust $k$-Means to standard $k$-Means, without introducing additional centers or discarding extra outliers, as is commonly required by existing approaches. Empirically, experiments on real-world datasets show that our method outperforms or matches several more sophisticated algorithms in terms of clustering cost and runtime. These results demonstrate that simple KNN-based heuristics can be surprisingly effective for robust clustering, highlighting new opportunities to bridge techniques from outlier detection and clustering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。