Mamba模型通过结构感知序列化提升多任务点云泛化能力
Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding
- 设计结构感知序列化,利用质心拓扑和测地曲率保持结构不变性
- 在多个任务上实现超越现有方法的性能,重建与配准准确率提升6.2%以上
- 适合需要跨域稳定点云理解的自动驾驶、机器人场景
尽管近期的Transformer和Mamba架构推动了点云表示学习的发展,但它们通常针对单任务或单域设置。直接应用于多任务域泛化(DG)会导致性能下降。Transformer虽能有效建模全局依赖,但存在二次注意力开销且缺乏显式的结构排序;而Mamba虽具线性时间复杂度,却常依赖坐标驱动的序列化,对视角变化和缺失区域敏感,引发结构漂移和不稳定序列建模。本文提出结构感知域泛化(SADG),一种基于Mamba的上下文学习框架,可跨域与多任务保持结构层次。我们设计结构感知序列化(SAS),通过质心拓扑与测地曲率连续性生成变换不变序列;进一步提出分层域感知建模(HDM),通过整合域内结构并融合域间关系来稳定跨域推理。测试时引入轻量级谱图对齐(SGA),在不更新参数的前提下将目标特征向源原型在谱空间对齐,实现结构保持的测试时特征调整。此外,我们构建了真实扫描物体数据集MP3DObject,用于多任务域泛化评估。大量实验表明,该方法显著提升结构保真度,并在重建、去噪、配准等任务上持续优于当前最优方法。
原文摘要 · Abstract (English)
While recent Transformer and Mamba architectures have advanced point cloud representation learning, they are typically developed for single-task or single-domain settings. Directly applying them to multi-task domain generalization (DG) leads to degraded performance. Transformers effectively model global dependencies but suffer from quadratic attention cost and lack explicit structural ordering, whereas Mamba offers linear-time recurrence yet often depends on coordinate-driven serialization, which is sensitive to viewpoint changes and missing regions, causing structural drift and unstable sequential modeling. In this paper, we propose Structure-Aware Domain Generalization (SADG), a Mamba-based In-Context Learning framework that preserves structural hierarchy across domains and tasks. We design structure-aware serialization (SAS) that generates transformation-invariant sequences using centroid-based topology and geodesic curvature continuity. We further devise hierarchical domain-aware modeling (HDM) that stabilizes cross-domain reasoning by consolidating intra-domain structure and fusing inter-domain relations. At test time, we introduce a lightweight spectral graph alignment (SGA) that shifts target features toward source prototypes in the spectral domain without updating model parameters, ensuring structure-preserving test-time feature shifting. In addition, we introduce MP3DObject, a real-scan object dataset for multi-task DG evaluation. Comprehensive experiments demonstrate that the proposed approach improves structural fidelity and consistently outperforms state-of-the-art methods across multiple tasks including reconstruction, denoising, and registration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。