arXiv:2511.09921cs.AI2025-11AAAI

提出可自适应调节曲率的双曲核,更好建模层次结构数据。

Adaptive Hyperbolic Kernels: Modulated Embedding in de Branges-Rovnyak Spaces

  • 基于de Branges-Rovnyak空间构建可调曲率的再生核希尔伯特空间
  • 新核函数在视觉与语言任务上优于现有双曲核方法
  • 适合需要精确建模层级关系的任务,如文本分类、社交网络分析

层次化数据广泛存在于自然语言处理、计算机视觉和社会网络分析等机器学习应用中。具有负曲率的双曲空间因其能以最小失真嵌入层次结构而展现出巨大潜力。已有研究表明,核方法可进一步提升双曲表示能力,但现有双曲核仍存在轻微几何失真或缺乏适应性。本文提出一种曲率感知的de Branges-Rovnyak空间,该空间与庞加莱球体等距。设计可调节乘子,实现对任意曲率双曲空间的自适应选择。在此基础上,构建一族自适应双曲核,包括新颖的自适应双曲径向核,其可学习参数以任务感知方式调制双曲特征。在视觉与语言基准上的大量实验表明,所提核函数在建模层次依赖关系方面优于现有双曲核。

原文摘要 · Abstract (English)

Hierarchical data pervades diverse machine learning applications, including natural language processing, computer vision, and social network analysis. Hyperbolic space, characterized by its negative curvature, has demonstrated strong potential in such tasks due to its capacity to embed hierarchical structures with minimal distortion. Previous evidence indicates that the hyperbolic representation capacity can be further enhanced through kernel methods. However, existing hyperbolic kernels still suffer from mild geometric distortion or lack adaptability. This paper addresses these issues by introducing a curvature-aware de Branges-Rovnyak space, a reproducing kernel Hilbert space (RKHS) that is isometric to a Poincare ball. We design an adjustable multiplier to select the appropriate RKHS corresponding to the hyperbolic space with any curvature adaptively. Building on this foundation, we further construct a family of adaptive hyperbolic kernels, including the novel adaptive hyperbolic radial kernel, whose learnable parameters modulate hyperbolic features in a task-aware manner. Extensive experiments on visual and language benchmarks demonstrate that our proposed kernels outperform existing hyperbolic kernels in modeling hierarchical dependencies.

双曲嵌入核方法层次结构可学习核

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。