用轨迹引导的特征聚合,让稀疏雷达点云也能精准定位
TDFANet: Encoding Sequential 4D Radar Point Clouds Using Trajectory-Guided Deformable Feature Aggregation for Place Recognition
- 通过运动轨迹对齐多帧雷达特征,提升时序一致性
- 在真实场景中实现高鲁棒性定位,动态环境表现稳定
- 适合自动驾驶与机器人在恶劣天气下的定位需求
位置识别对自动驾驶和移动机器人实现闭环或全局定位至关重要。尽管2D相机和3D LiDAR在位置识别上已有进展,但如何利用日益普及的4D雷达进行位置识别仍待探索——其优势在于对恶劣天气和光照条件具有强鲁棒性。相比LiDAR点云,雷达数据更稀疏、噪声大且分辨率低,难以有效表征场景,给基于4D雷达的位置识别带来巨大挑战。本文通过融合多帧序列4D雷达扫描的多模态信息,有效提取并聚合时空特征。方法包括:(1) 基于速度特性去除动态点并估计自车速度;(2) 对清理后的点云进行鸟瞰图(BEV)特征编码;(3) 利用自车速度计算的运动轨迹对齐BEV特征图;(4) 提取并聚合对齐后BEV特征图的多尺度时空特征。真实世界实验验证了该方法的可行性,并展示了其在动态环境中的鲁棒性。源代码已公开。
原文摘要 · Abstract (English)
Place recognition is essential for achieving closed-loop or global positioning in autonomous vehicles and mobile robots. Despite recent advancements in place recognition using 2D cameras or 3D LiDAR, it remains to be seen how to use 4D radar for place recognition - an increasingly popular sensor for its robustness against adverse weather and lighting conditions. Compared to LiDAR point clouds, radar data are drastically sparser, noisier and in much lower resolution, which hampers their ability to effectively represent scenes, posing significant challenges for 4D radar-based place recognition. This work addresses these challenges by leveraging multi-modal information from sequential 4D radar scans and effectively extracting and aggregating spatio-temporal features.Our approach follows a principled pipeline that comprises (1) dynamic points removal and ego-velocity estimation from velocity property, (2) bird's eye view (BEV) feature encoding on the refined point cloud, (3) feature alignment using BEV feature map motion trajectory calculated by ego-velocity, (4) multi-scale spatio-temporal features of the aligned BEV feature maps are extracted and aggregated.Real-world experimental results validate the feasibility of the proposed method and demonstrate its robustness in handling dynamic environments. Source codes are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。