arXiv:2506.18533cs.CV2025-06被引 2

提出自适应双曲距离度量,更好建模多样层级结构。

Geometry-aware Distance Measure for Diverse Hierarchical Structures in Hyperbolic Spaces

  • 为每对数据点动态生成投影与曲率,定制化映射到双曲空间。
  • 在少样本学习上提升超5%,图像分类任务均优于固定距离方法。
  • 适合需要捕捉复杂层级关系的数据,如生物分类、知识图谱。

双曲空间学习因其对数据层级结构的建模优势而受到关注。现有方法多采用固定距离度量,假设所有数据点具有统一层级结构,但真实世界中的层级多样性使其过于受限。本文提出一种几何感知的双曲距离度量,可动态适应不同层级结构。通过为每对数据点生成定制化的投影和曲率,将它们映射至合适的双曲空间。引入改进的低秩分解方案与硬样本挖掘机制,在不损失精度的前提下降低成对距离计算开销。基于Talagrand集中不等式,给出了低秩近似误差的上界,保证理论鲁棒性。在标准图像分类(MNIST、CIFAR-10、CIFAR-100)、五层层级分类(5-level CIFAR-100)及少样本学习任务(mini-ImageNet、tiered-ImageNet)上的大量实验表明,该方法持续优于使用固定距离度量的方法,尤其在少样本学习中取得超过5%的提升。可视化显示类边界更清晰,原型分离更优,证明自适应距离度量能更好捕捉多样化层级结构。

原文摘要 · Abstract (English)

Learning in hyperbolic spaces has attracted increasing attention due to its superior ability to model hierarchical structures of data. Most existing hyperbolic learning methods use fixed distance measures for all data, assuming a uniform hierarchy across all data points. However, real-world hierarchical structures exhibit significant diversity, making this assumption overly restrictive. In this paper, we propose a geometry-aware distance measure in hyperbolic spaces, which dynamically adapts to varying hierarchical structures. Our approach derives the distance measure by generating tailored projections and curvatures for each pair of data points, effectively mapping them to an appropriate hyperbolic space. We introduce a revised low-rank decomposition scheme and a hard-pair mining mechanism to mitigate the computational cost of pair-wise distance computation without compromising accuracy. We present an upper bound on the low-rank approximation error using Talagrand's concentration inequality, ensuring theoretical robustness. Extensive experiments on standard image classification (MNIST, CIFAR-10 and CIFAR-100), hierarchical classification (5-level CIFAR-100), and few-shot learning tasks (mini-ImageNet, tiered-ImageNet) demonstrate the effectiveness of our method. Our approach consistently outperforms learning methods that use fixed distance measures, with notable improvements on few-shot learning tasks, where it achieves over 5\% gains on mini-ImageNet. The results reveal that adaptive distance measures better capture diverse hierarchical structures, with visualization showing clearer class boundaries and improved prototype separation in hyperbolic spaces.

双曲学习层级结构自适应距离少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。