提出FASTer模型,高效处理长时序3D目标检测,提升精度与速度。
FASTer: Focal Token Acquiring-and-Scaling Transformer for Long-term 3D Object Detection
- 动态聚焦关键点,自适应压缩序列,降低计算复杂度。
- 在Waymo数据集上优于当前最佳方法,提升检测精度与效率。
- 适合需要高效长时序感知的自动驾驶3D检测任务。
基于激光雷达的先进时序3D目标检测器多采用区域生成范式:先生成粗略候选框,再编码融合区域特征。然而,无差别采样与融合常忽略点云贡献差异,导致输入帧数增加时计算复杂度呈指数级增长。此外,简单的结果拼接限制了全局信息提取。本文提出焦点令牌获取与缩放变压器(FASTer),通过动态选择关键令牌并自适应轻量级压缩序列,强调单个令牌贡献。提出一种简单但有效的自适应缩放机制,在筛选焦点点的同时捕捉几何上下文。仅在历史帧中自适应存储和处理焦点点,显著降低整体复杂度。此外,设计新型分组层次融合策略,逐步执行序列缩放与组内融合,促进全局时空信息交换。在Waymo Open Dataset上的实验表明,FASTer在性能与效率上均显著优于现有最先进检测器,同时展现出更强的灵活性与鲁棒性。代码已开源。
原文摘要 · Abstract (English)
Recent top-performing temporal 3D detectors based on Lidars have increasingly adopted region-based paradigms. They first generate coarse proposals, followed by encoding and fusing regional features. However, indiscriminate sampling and fusion often overlook the varying contributions of individual points and lead to exponentially increased complexity as the number of input frames grows. Moreover, arbitrary result-level concatenation limits the global information extraction. In this paper, we propose a Focal Token Acquring-and-Scaling Transformer (FASTer), which dynamically selects focal tokens and condenses token sequences in an adaptive and lightweight manner. Emphasizing the contribution of individual tokens, we propose a simple but effective Adaptive Scaling mechanism to capture geometric contexts while sifting out focal points. Adaptively storing and processing only focal points in historical frames dramatically reduces the overall complexity. Furthermore, a novel Grouped Hierarchical Fusion strategy is proposed, progressively performing sequence scaling and Intra-Group Fusion operations to facilitate the exchange of global spatial and temporal information. Experiments on the Waymo Open Dataset demonstrate that our FASTer significantly outperforms other state-of-the-art detectors in both performance and efficiency while also exhibiting improved flexibility and robustness. The code is available at https://github.com/MSunDYY/FASTer.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。