arXiv:2607.18794cs.RO2026-07

用线性注意力替代Transformer,提升开放词汇导航的路径规划能力

Beyond Transformers: Linear Attention Policy for Open-Vocabulary Object Goal Navigation

论文配图:Beyond Transformers: Linear Attention Policy for Open-Vocabulary Object Goal Navigation
图 1 · 摘自论文原文
  • 采用线性注意力机制构建策略网络,更结构化地更新内部状态
  • 在HM3D-OVON上达到36.4%成功率,比Transformer高6.3个百分点
  • 适合需要高效稳定状态更新的机器人导航任务

开放词汇物体目标导航(OVON)要求智能体在部分可观测环境下运行,有效的内部状态更新对导航性能至关重要。现有方法多采用基于Transformer的策略网络,通过上下文窗口内的自注意力整合时序信息,但我们的控制实验表明,其性能并不随上下文长度增加而提升,质疑了自注意力在导航中状态融合的适用性。为此,我们提出线性注意力导航(LANav),采用线性注意力(LA)作为策略主干,实现更结构化的状态更新。在相同设置下评估多种LA变体,LANav始终优于Transformer基线。性能随状态更新机制更结构化而提升,凸显状态更新设计的重要性。我们引入加权状态扩展线性注意力(WSLA),将每头注意力状态扩展为多个子状态,并使用可学习加权读出聚合子状态。配备WSLA的LANav在HM3D-OVON上达到36.4%平均成功率,宏观平均成功率高出6.3个百分点,同时保持计算效率。分距离结果表明长距离任务增益更显著;跨场景迁移与微调验证了鲁棒性。真实世界部署于Unitree Go2,在50次试验中取得82%成功率,支持LANav的实际可行性与仿真到现实的迁移能力。

原文摘要 · Abstract (English)

Open-Vocabulary Object Goal Navigation (OVON) requires agents to operate under partial observability, making effective internal state updates critical for navigation performance. This update is implemented by the policy network, where recent approaches adopt Transformer-based backbones with self-attention over a context window to integrate temporal information. However, our controlled experiments show that performance does not scale with context length under Transformer-based policies, questioning the suitability of self-attention for state integration in navigation. To this end, we propose Linear Attention-based Navigation (LANav), which adopts linear attention (LA) as the policy backbone to maintain a structured state update rather than self-attention over the context window. Across multiple LA variants evaluated under identical settings, LANav consistently outperforms Transformer-based baselines. Performance improves as state update mechanisms become more structured and regulated, highlighting the importance of state update design. To improve state update effectiveness, we introduce Weighted State-Expansion Linear Attention (WSLA), which expands each attention head's state into multiple sub-states and uses learnable weighted readout to aggregate expanded sub-states. Equipped with WSLA, LANav achieves 36.4% average success rate (SR) on HM3D-OVON, outperforming Transformer-based counterparts by 6.3 percentage points in macro-averaged SR, while maintaining computational efficiency. Distance-stratified results show larger gains in long-distance episodes, while HSSD transfer and fine-tuning demonstrate robustness across scene distributions. Real-world deployment on a Unitree Go2 further achieves an 82% success rate over 50 trials, supporting the practical feasibility and sim-to-real transfer of LANav.

导航算法线性注意力机器人视觉导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。