arXiv:2604.18019cs.CV2026-04

通过分层图网络提升手绘草图的3D形状检索效果

Multi-View Hierarchical Graph Neural Network for Sketch-Based 3D Shape Retrieval

论文配图:Multi-View Hierarchical Graph Neural Network for Sketch-Based 3D Shape Retrieval
图 1 · 摘自论文原文
  • 构建视图间几何关系图,分层聚合多视角特征
  • 在两个公开数据集上均超越现有方法,零样本场景表现优异
  • 适合需要跨类别检索与泛化能力的研究者

手绘草图的3D形状检索(SBSR)旨在找到与输入草图类别一致的3D形状。核心挑战在于:现有方法通常对独立编码的多视角3D特征采用简化聚合策略,忽略视图间的几何关系和多层级细节,导致3D表示能力弱;同时传统方法受可见类别限制,在零样本场景下性能差。为此,我们提出多视图分层图神经网络(MV-HGNN),构建视图级图,通过局部图卷积与全局注意力捕捉邻近几何依赖和跨视图信息传递。引入视图选择器实现分层图粗化,逐步扩大感受野,减少冗余视图干扰,生成更具判别性的层次化3D表示。为实现类别无关对齐并缓解对已见类别的过拟合,利用CLIP文本嵌入作为语义原型,将草图与3D特征投影至共享语义空间。采用两阶段训练策略完成类别级检索,一阶段策略实现零样本检索,模型架构统一。在两个公开基准上的大量实验表明,MV-HGNN在类别级与零样本设置下均优于现有最先进方法。

原文摘要 · Abstract (English)

Sketch-based 3D shape retrieval (SBSR) aims to retrieve 3D shapes that are consistent with the category of the input hand-drawn sketch. The core challenge of this task lies in two aspects: existing methods typically employ simplified aggregation strategies for independently encoded 3D multi-view features, which ignore the geometric relationships between views and multi-level details, resulting in weak 3D representation. Simultaneously, traditional SBSR methods are constrained by visible category limitations, leading to poor performance in zero-shot scenarios. To address these challenges, we propose Multi-View Hierarchical Graph Neural Network (MV-HGNN), a novel framework for SBSR. Specifically, we construct a view-level graph and capture adjacent geometric dependencies and cross-view message passing via local graph convolution and global attention. A view selector is further introduced to perform hierarchical graph coarsening, enabling a progressively larger receptive field for graph convolution and mitigating the interference of redundant views, which leads to more discriminate discriminative hierarchical 3D representation. To enable category agnostic alignment and mitigate overfitting to seen classes, we leverage CLIP text embeddings as semantic prototypes and project both sketch and 3D features into a shared semantic space. We use a two-stage training strategy for category-level retrieval and a one-stage strategy for zero-shot retrieval under the same model architecture. Under both category-level and zero-shot settings, extensive experiments on two public benchmarks demonstrate that MV-HGNN outperforms state-of-the-art methods.

3D检索草图生成图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。