arXiv:2606.10395cs.CV2026-06

用改进的RWKV模型高效学习点云的局部几何与空间关系。

Efficient RWKV-based Representation Learning for 3D Point Clouds

论文配图:Efficient RWKV-based Representation Learning for 3D Point Clouds
图 1 · 摘自论文原文
  • 设计P-RWKV模块,融合局部感知与空间增强,适配不规则3D点云
  • 在多个任务上达到媲美Transformer的性能,计算开销更低
  • 可插拔式模块,适用于单模态与跨模态场景

最近的接收加权键值(RWKV)模型结合了RNN式的循环结构,为建模全局依赖提供了一种线性复杂度的替代方案,相较于Transformer的二次自注意力。然而,当直接应用于点云时,原本为序列文本设计的RWKV难以有效捕捉局部几何结构和空间依赖。为此,我们提出P-RWKV模块,弥合序列建模与不规则3D几何之间的差距,同时保持RWKV的效率优势。该模块包含局部感知扩展(LPE)组件,用于沿时空序列扩展上下文感知;以及空间上下文增强(SCE)组件,以强化空间意识。为验证P-RWKV在点云理解中的有效性,我们构建了PointER——一个由堆叠P-RWKV块组成的单模态自监督表示学习框架。此外,我们将P-RWKV扩展至跨模态设置,并将其核心子模块集成到多种架构中,证明其具有强大的即插即用灵活性与架构通用性。大量实验表明,P-RWKV模块及其关键子模块在各类任务中均实现竞争力表现,且计算成本更低、推理延迟更小。代码将在接受后发布。

原文摘要 · Abstract (English)

The recent receptance weighted key value (RWKV) model combines RNN-style recurrence, offering a linear-complexity alternative to Transformers' quadratic self-attention for modeling global dependencies. However, when directly applied to point clouds, RWKV, originally developed for sequential text, struggles to capture local geometric structures and model spatial dependencies effectively. To address this, we propose the \textbf{P-RWKV} block, which bridges the gap between sequence modeling and irregular 3D geometry while preserving the efficiency advantages of RWKV. It consists of a Local Perception Expansion (LPE) component to expand contextual perception along the spatio-temporal sequence and a Spatial Context Enhancement (SCE) component to strengthen spatial awareness. To validate the effectiveness of P-RWKV for point cloud understanding, we construct PointER, a single-modality self-supervised representation learning framework whose encoder is composed of stacked P-RWKV blocks. Furthermore, we extend P-RWKV to a cross-modality setting and integrate the proposed core sub-modules into multiple architectures, demonstrating strong plug-and-play flexibility and architectural generality. Extensive experiments show that the P-RWKV block and its key sub-modules achieve competitive performance across various tasks with lower computational cost and inference latency. Code will be released upon acceptance.

点云处理RWKV自监督学习高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。