提出简单有效框架,解决公平聚类与最优传输中的关键难题
Relax and Merge: A Simple Yet Effective Framework for Solving Fair $k$-Means and $k$-sparse Wasserstein Barycenter Problems
- 通过松弛约束再合并的思路,高效求解公平聚类问题
- 理论保证逼近比优于现有最优方法,实测聚类成本显著降低
- 适用于需要公平性保障的机器学习场景,如群体均衡分析
聚类算法的公平性在机器学习等领域受到广泛关注。本文研究欧氏空间中的公平k-均值聚类问题:给定包含多个群体的数据集,公平约束要求每个簇中各群体点的比例需在指定上下界之间。由于该约束,确定最优的k个中心位置极具挑战。本文提出一种新颖的「松弛与合并」框架,可获得(1+4ρ+O(ε))近似解,其中ρ为现成k-均值算法的近似比,O(ε)可任意小。若使用k-均值的PTAS,可实现(5+O(ε))逼近比,仅轻微违反公平约束,优于当前最优结果。此外,该框架还可用于求解k-稀疏Wasserstein中心问题,得到(1+4ρ+O(ε))近似解;对严格公平的k-均值问题,可得(2+6ρ)近似解,均优于现有方法。实验表明,所提算法在聚类代价上显著优于基线方法。
原文摘要 · Abstract (English)
The fairness of clustering algorithms has gained widespread attention across various areas, including machine learning, In this paper, we study fair $k$-means clustering in Euclidean space. Given a dataset comprising several groups, the fairness constraint requires that each cluster should contain a proportion of points from each group within specified lower and upper bounds. Due to these fairness constraints, determining the optimal locations of $k$ centers is a quite challenging task. We propose a novel ``Relax and Merge'' framework that returns a $(1+4ρ+ O(ε))$-approximate solution, where $ρ$ is the approximate ratio of an off-the-shelf vanilla $k$-means algorithm and $O(ε)$ can be an arbitrarily small positive number. If equipped with a PTAS of $k$-means, our solution can achieve an approximation ratio of $(5+O(ε))$ with only a slight violation of the fairness constraints, which improves the current state-of-the-art approximation guarantee. Furthermore, using our framework, we can also obtain a $(1+4ρ+O(ε))$-approximate solution for the $k$-sparse Wasserstein Barycenter problem, which is a fundamental optimization problem in the field of optimal transport, and a $(2+6ρ)$-approximate solution for the strictly fair $k$-means clustering with no violation, both of which are better than the current state-of-the-art methods. In addition, the empirical results demonstrate that our proposed algorithm can significantly outperform baseline approaches in terms of clustering cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。