无需假设分布形式,用核方法实现自适应聚类
Nonparametric Kernel Clustering with Bandit Feedback
- 基于核嵌入将非参数聚类转化为RKHS中的距离判断
- 算法在未知信噪比下仍能保证聚类正确性,采样次数与问题难度相关
- 适合真实数据中复杂分布的主动聚类,如推荐系统和众包场景
带反馈的聚类问题指在无法直接观测数据的情况下,通过序列化查询项目并获取噪声观测来完成分组。该问题可形式化为:根据一个N臂随机奖励模型中各臂的潜在分布进行聚类,若两臂分布相同则归为一组,且仅依赖于自适应收集的样本。传统方法通常假设分布为次高斯型,导致仅适用于线性可分聚类,实际应用受限。本文提出非参数带反馈聚类框架,不限制分布形式,适用于真实数据集的主动聚类。采用核方法,将聚类问题转化为在再生核希尔伯特空间(RKHS)中对核均值嵌入进行聚类。在此基础上,提出KABC算法,具备理论正确性保证,并分析其采样预算。引入一种依赖最大均值差异(MMD)和RKHS中方差的信噪比概念,算法无需预知该量即可实现实例相关性能保证。
原文摘要 · Abstract (English)
Clustering with bandit feedback refers to the problem of partitioning a set of items, where the clustering algorithm can sequentially query the items to receive noisy observations. The problem is formally posed as the task of partitioning the arms of an N-armed stochastic bandit according to their underlying distributions, grouping two arms together if and only if they share the same distribution, using samples collected sequentially and adaptively. This setting has gained attention in recent years due to its applicability in recommendation systems and crowdsourcing. Existing works on clustering with bandit feedback rely on a strong assumption that the underlying distributions are sub-Gaussian. As a consequence, the existing methods mainly cover settings with linearly-separable clusters, which has little practical relevance. We introduce a framework of ``nonparametric clustering with bandit feedback'', where the underlying arm distributions are not constrained to any parametric, and hence, it is applicable for active clustering of real-world datasets. We adopt a kernel-based approach, which allows us to reformulate the nonparametric problem as the task of clustering the arms according to their kernel mean embeddings in a reproducing kernel Hilbert space (RKHS). Building on this formulation, we introduce the KABC algorithm with theoretical correctness guarantees and analyze its sampling budget. We introduce a notion of signal-to-noise ratio for this problem that depends on the maximum mean discrepancy (MMD) between the arm distributions and on their variance in the RKHS. Our algorithm is adaptive to this unknown quantity: it does not require it as an input yet achieves instance-dependent guarantees.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。