arXiv:2511.11045cs.CV2025-11中稿 · AAAI被引 2

用双曲空间提升文本-3D检索的层次表达与关键特征识别能力

Hyperbolic Hierarchical Alignment Reasoning Network for Text-3D Retrieval

  • 在双曲空间中建模文本与3D数据的层级关系,保留抽象到具体的距离
  • 新提出层次约束损失与贡献感知聚合模块,使匹配项更聚焦、噪声更抑制
  • 适用于细粒度文物与复杂室内场景的跨模态检索,适合多层级结构数据

随着互联网3D数据激增,文本-3D检索日益重要。现有方法面临两大挑战:层次表示坍塌(HRC)与冗余引发显著性稀释(RISD)。HRC导致欧氏嵌入压缩抽象到具体、整体到部分的层级结构;RISD则因平均噪声片段而模糊关键语义,削弱模型区分困难负样本的能力。为此,我们提出双曲层级对齐推理网络(H²ARN),将文本与3D数据嵌入Lorentz模型双曲空间,利用指数体积增长天然保持层级距离。通过层次排序损失构建每个文本向量的收缩蕴含锥,确保匹配3D实例位于锥内;实例级对比损失联合促使非匹配样本分离。为应对RISD,设计贡献感知双曲聚合模块,基于洛伦兹距离评估局部特征相关性,实现由双曲几何引导的加权聚合,在不依赖额外监督下增强判别区域并抑制冗余。我们还发布了扩展版T3DR-HIT v2基准,包含8,935个文本-3D配对,规模为原版的2.6倍,涵盖细粒度文化文物与复杂室内场景。代码已开源。

原文摘要 · Abstract (English)

With the daily influx of 3D data on the internet, text-3D retrieval has gained increasing attention. However, current methods face two major challenges: Hierarchy Representation Collapse (HRC) and Redundancy-Induced Saliency Dilution (RISD). HRC compresses abstract-to-specific and whole-to-part hierarchies in Euclidean embeddings, while RISD averages noisy fragments, obscuring critical semantic cues and diminishing the model's ability to distinguish hard negatives. To address these challenges, we introduce the Hyperbolic Hierarchical Alignment Reasoning Network (H$^{2}$ARN) for text-3D retrieval. H$^{2}$ARN embeds both text and 3D data in a Lorentz-model hyperbolic space, where exponential volume growth inherently preserves hierarchical distances. A hierarchical ordering loss constructs a shrinking entailment cone around each text vector, ensuring that the matched 3D instance falls within the cone, while an instance-level contrastive loss jointly enforces separation from non-matching samples. To tackle RISD, we propose a contribution-aware hyperbolic aggregation module that leverages Lorentzian distance to assess the relevance of each local feature and applies contribution-weighted aggregation guided by hyperbolic geometry, enhancing discriminative regions while suppressing redundancy without additional supervision. We also release the expanded T3DR-HIT v2 benchmark, which contains 8,935 text-to-3D pairs, 2.6 times the original size, covering both fine-grained cultural artefacts and complex indoor scenes. Our codes are available at https://github.com/liwrui/H2ARN.

文本-3D检索双曲嵌入层次建模特征聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。