arXiv:2606.18520stat.MLcs.CG2026-06

提出可压缩的层次图几何表示,实现小维度下的精确可达性建模。

Compact Geometric Representations of Hierarchies

  • 基于图结构参数构造低维嵌入,树形图仅需3维
  • 对宽为t的图,嵌入维数为O(t log n),优于传统方法
  • 适用于真实数据集,在高召回率下显著降低维度

计算数据的几何表示是现代机器学习的核心,通常通过训练双编码器将查询和文档映射到共享嵌入空间来实现。近期工作将该方法扩展至层次检索,其中相关性由有向无环图(DAG)中的祖先-后代关系决定。尽管已有研究证明当后代数量较少时存在有效嵌入,但深度层次结构下的维度要求会急剧上升,可能高达节点总数。本文研究更一般图类的紧凑可达性嵌入,并提供理论保证:对于任意有向树,存在常数维(3维)的可达性嵌入,与树的大小或深度无关;对于树宽为t的图,可构造维数为O(t log n)的嵌入。同时给出匹配或近似匹配的下界:一般DAG需要Ω(n)维,树宽为t的图至少需要Ω(t/log(n/t))维。还给出了基于交叉边数量的边界。实验表明,本方法可在真实数据集上构造嵌入,在高召回率下相比已有理论保证方法显著降低维度。

原文摘要 · Abstract (English)

Computing geometric representations of data is a cornerstone of modern machine learning, typically achieved by training dual encoders which map queries and documents into a shared embedding space. Recent work of You et al. [NeurIPS '25] has extended this approach to hierarchical retrieval, where relevance is determined by the ancestor-descendant relationships in a Directed Acyclic Graph (DAG). While previous work has shown that valid embeddings exist when the number of descendants is small, these bounds degrade significantly for deep hierarchies, requiring dimensions as large as the total number of nodes. In this paper, we investigate compact reachability embeddings for more general graph classes and provide theoretical guarantees for representing hierarchies using embeddings whose dimension depends on structural graph parameters. We prove that for any directed tree, there exists a reachability embedding in constant dimension 3, independent of the tree's size or depth. We generalize this result to graphs characterized by treewidth $t$, constructing embeddings of dimension $O(t \log n)$, where $n$ is the number of nodes. Complementing these upper bounds, we provide matching or near-matching lower bounds, showing that dimension $Ω(n)$ is necessary for general DAGs and $Ω(t/\log(n/t))$ is required for graphs of treewidth $t$. We also obtain upper and lower bounds parameterized by the number of cross-edges in the DAG. We additionally show that our embeddings can be constructed on real world datasets, and that they give much smaller dimensions in high recall regimes compared to prior embeddings with theoretical guarantees.

几何嵌入层次检索图结构低维表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。