arXiv:2509.14958cs.CV2025-09ICCV被引 4

解决3D小样本增量学习中的几何错位与纹理偏差问题

Seeing 3D Through 2D Lenses: 3D Few-Shot Class-Incremental Learning via Cross-Modal Geometric Rectification

  • 通过注意力融合对齐3D结构与2D视觉模型的层级空间先验
  • 在仅用少量新类样本情况下,显著提升几何一致性与抗纹理偏差能力
  • 适合需要持续学习新3D类别的开放世界场景应用

3D数字内容的快速增长要求系统具备开放世界下的可扩展识别能力。然而,现有3D少样本增量学习方法在极端数据稀缺下表现不佳,主要受几何错位和纹理偏差影响。尽管近期方法将3D数据与2D基础模型(如CLIP)结合,但因纹理偏倚的投影和几何-纹理线索的盲目融合,导致语义模糊、决策原型不稳定及灾难性遗忘。为此,我们提出跨模态几何校正(CMGR)框架,通过利用CLIP的层次化空间语义增强3D几何保真度。具体包括:结构感知几何校正模块,通过注意力驱动的几何融合,分层对齐3D部件结构与CLIP中间空间先验;纹理增强模块,合成最小但具判别性的纹理以抑制噪声并强化跨模态一致性;以及基类-新类判别器,分离几何变化以稳定增量原型。大量实验表明,该方法在跨域与同域设置下均显著提升3D少样本增量学习性能,实现更优的几何连贯性与抗纹理偏差鲁棒性。

原文摘要 · Abstract (English)

The rapid growth of 3D digital content necessitates expandable recognition systems for open-world scenarios. However, existing 3D class-incremental learning methods struggle under extreme data scarcity due to geometric misalignment and texture bias. While recent approaches integrate 3D data with 2D foundation models (e.g., CLIP), they suffer from semantic blurring caused by texture-biased projections and indiscriminate fusion of geometric-textural cues, leading to unstable decision prototypes and catastrophic forgetting. To address these issues, we propose Cross-Modal Geometric Rectification (CMGR), a framework that enhances 3D geometric fidelity by leveraging CLIP's hierarchical spatial semantics. Specifically, we introduce a Structure-Aware Geometric Rectification module that hierarchically aligns 3D part structures with CLIP's intermediate spatial priors through attention-driven geometric fusion. Additionally, a Texture Amplification Module synthesizes minimal yet discriminative textures to suppress noise and reinforce cross-modal consistency. To further stabilize incremental prototypes, we employ a Base-Novel Discriminator that isolates geometric variations. Extensive experiments demonstrate that our method significantly improves 3D few-shot class-incremental learning, achieving superior geometric coherence and robustness to texture bias across cross-domain and within-domain settings.

3D学习增量学习跨模态几何校正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。