将RWKV架构改进用于点云分类的域泛化,提升对未知场景的适应能力。
PointDGRWKV: Generalizing RWKV-like Architecture to Unseen Domains for Point Cloud Classification
- 引入自适应几何令牌偏移,增强局部结构建模能力。
- 通过跨域键特征分布对齐,缓解注意力漂移问题。
- 在多个基准上达到当前最优性能,保持线性计算效率。
领域泛化(DG)近期被用于提升点云分类(PCC)模型对未见领域的泛化能力。已有工作基于卷积网络、Transformer或Mamba架构,但普遍存在感受野有限、计算成本高或长程依赖建模不足的问题。RWKV作为一种新兴架构,具备线性复杂度、全局感受野和长程依赖建模优势。本文首次研究了RWKV在DG PCC中的泛化能力。发现直接应用RWKV于DG PCC面临两大挑战:固定方向的令牌偏移(如Q-Shift)在非结构化点云中引入空间畸变,削弱局部几何建模并降低鲁棒性;同时,RWKV中的Bi-WKV注意力通过指数加权放大跨域键分布微小差异,导致注意力漂移,影响泛化性能。为此,我们提出PointDGRWKV,首个专为DG PCC设计的RWKV框架。其包含两个关键模块:自适应几何令牌偏移,用于建模局部邻域结构以增强几何上下文感知;跨域键特征分布对齐,通过对齐不同域的键特征分布缓解注意力漂移。在多个基准上的大量实验表明,PointDGRWKV在DG PCC任务上达到当前最优性能。
原文摘要 · Abstract (English)
Domain Generalization (DG) has been recently explored to enhance the generalizability of Point Cloud Classification (PCC) models toward unseen domains. Prior works are based on convolutional networks, Transformer or Mamba architectures, either suffering from limited receptive fields or high computational cost, or insufficient long-range dependency modeling. RWKV, as an emerging architecture, possesses superior linear complexity, global receptive fields, and long-range dependency. In this paper, we present the first work that studies the generalizability of RWKV models in DG PCC. We find that directly applying RWKV to DG PCC encounters two significant challenges: RWKV's fixed direction token shift methods, like Q-Shift, introduce spatial distortions when applied to unstructured point clouds, weakening local geometric modeling and reducing robustness. In addition, the Bi-WKV attention in RWKV amplifies slight cross-domain differences in key distributions through exponential weighting, leading to attention shifts and degraded generalization. To this end, we propose PointDGRWKV, the first RWKV-based framework tailored for DG PCC. It introduces two key modules to enhance spatial modeling and cross-domain robustness, while maintaining RWKV's linear efficiency. In particular, we present Adaptive Geometric Token Shift to model local neighborhood structures to improve geometric context awareness. In addition, Cross-Domain key feature Distribution Alignment is designed to mitigate attention drift by aligning key feature distributions across domains. Extensive experiments on multiple benchmarks demonstrate that PointDGRWKV achieves state-of-the-art performance on DG PCC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。