arXiv:2605.26949cs.CVcs.GR2026-05

用视觉模型提炼语义先验,提升3D形状补全的泛化能力。

DinoComplete: 3D Shape Completion with Distilled Semantic Priors and State Space Models

论文配图:DinoComplete: 3D Shape Completion with Distilled Semantic Priors and State Space Models
图 1 · 摘自论文原文
  • 从DINO特征中蒸馏语义先验,与几何信息对齐融合
  • 在未见类别上优于现有方法,参数少、推理快
  • 适合需要高效鲁棒补全的工业场景应用

从部分扫描中完成3D形状仍面临未见类别和真实世界噪声的挑战,仅靠几何信息常不足以推断缺失结构。我们提出DinoComplete,一种确定性且高效的形状补全框架,通过将来自DINO特征的体素对齐语义先验补充几何重建。首先,构建与ShapeNet数据对齐的多视图DINO特征体,并训练学生网络直接从不完整形状预测密集语义特征。这些预测特征捕捉全局结构与部件感知的语义上下文,同时保持与底层几何的一致性。随后将这些蒸馏特征融入补全网络,通过体素状态空间建模融合几何与语义体素表示。为实现高效长程推理而不牺牲分辨率,引入多尺度体素Mamba模块,结合全网格与分块序列建模以优化融合特征。在未见ShapeNet类别和ScanNet物体上的实验表明,DinoComplete在补全质量上超越先前确定性与生成式方法,同时参数更少、内存更低、推理更快。结果证明,从视觉基础模型蒸馏语义先验可提升3D形状补全的泛化性与鲁棒性。

原文摘要 · Abstract (English)

3D shape completion from partial scans remains challenging for unseen categories and noisy real-world observations, where geometry alone is often insufficient for inferring missing structure. We present DinoComplete, a deterministic and efficient shape completion framework that augments geometric reconstruction with voxel-aligned semantic priors distilled from DINO features. First, we construct multi-view DINO feature volumes aligned with ShapeNet data and train a student network to predict dense semantic features directly from incomplete shapes. These predicted features capture global structure and part-aware semantic context while remaining aligned with the underlying geometry. We then integrate these distilled features into a completion network, where geometric and semantic voxel representations are fused through voxel state-space modeling. To enable efficient long-range reasoning without sacrificing resolution, we introduce a multi-scale voxel Mamba module that refines the fused features by combining full-grid and chunk-wise sequence modeling. Experiments on unseen ShapeNet categories and ScanNet objects show that DinoComplete achieves stronger completion quality than prior deterministic and generative based completion methods while using fewer parameters, requiring lower memory, and achieving faster inference. Our results demonstrate that distilling semantic priors from visual foundation models improves generalization and robustness in 3D shape completion.

3D补全语义先验状态空间模型DINO

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。