在双曲空间中直接聚类,提升开放世界分类的准确性
Comparing Euclidean and Hyperbolic K-Means for Generalized Category Discovery
- 嵌入与聚类均在双曲空间中完成,避免坐标转换损失
- 双曲K-Means比欧氏方法在多个数据集上更准确
- 对标签粒度变化更鲁棒,适合层级结构数据
双曲表示学习被广泛用于挖掘数据中的隐含层次结构,近期也被引入开放世界分类任务——广义类别发现(GCD)。然而,以往的双曲GCD方法仅在双曲空间中进行表示学习,聚类时仍转回欧氏空间。我们假设这并非最优。为此提出双曲聚类GCD(HC-GCD),在洛伦兹双曲面模型中学习嵌入,并使用双曲K-Means算法在双曲空间中直接聚类。我们在语义偏移基准数据集上验证了该方法,结果表明其性能与当前最优双曲GCD方法相当。进一步实验显示,双曲K-Means优于欧氏K-Means。消融实验表明:对欧氏嵌入施加范数裁剪会降低未见类聚类准确率,但提升已见类准确率,整体表现依赖数据集。此外,双曲K-Means在不同标签粒度下表现出更一致的聚类效果。
原文摘要 · Abstract (English)
Hyperbolic representation learning has been widely used to extract implicit hierarchies within data, and recently it has found its way to the open-world classification task of Generalized Category Discovery (GCD). However, prior hyperbolic GCD methods only use hyperbolic geometry for representation learning and transform back to Euclidean geometry when clustering. We hypothesize this is suboptimal. Therefore, we present Hyperbolic Clustered GCD (HC-GCD), which learns embeddings in the Lorentz Hyperboloid model of hyperbolic geometry, and clusters these embeddings directly in hyperbolic space using a hyperbolic K-Means algorithm. We test our model on the Semantic Shift Benchmark datasets, and demonstrate that HC-GCD is on par with the previous state-of-the-art hyperbolic GCD method. Furthermore, we show that using hyperbolic K-Means leads to better accuracy than Euclidean K-Means. We carry out ablation studies showing that clipping the norm of the Euclidean embeddings leads to decreased accuracy in clustering unseen classes, and increased accuracy for seen classes, while the overall accuracy is dataset dependent. We also show that using hyperbolic K-Means leads to more consistent clusters when varying the label granularity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。