用Transformer学习雷达点云对应关系,提升低质量点云定位精度。
Learning Point Correspondences In Radar 3D Point Clouds For Radar-Inertial Odometry
- 基于Transformer注意力机制,自动寻找相邻帧间点的匹配对。
- 在真实无人机飞行中定位精度提升14%以上,在Coloradar数据集上提升19%。
- 自监督训练避免人工标注,适合低功耗雷达的实时定位场景。
在机器人里程计中使用3D点云通常需要在连续扫描间找到点对应关系。尽管高质量点云已有成熟方法,但当前技术在点云质量下降时仍表现不佳。本文提出一种基于学习的新框架,用于从轻量级、低功耗、低成本的SoC FMCW雷达传感器获取的噪声大、稀疏且无结构的3D点云中,预测鲁棒的点对应关系。网络基于Transformer架构,利用注意力机制发现连续扫描中相互关联性最强的点对。通过基于集合的多标签分类交叉熵损失进行自监督训练,真值匹配集通过求解线性和分配(LSA)优化问题获得,无需繁琐的人工标注。将损失计算设为多标签分类,可直接监督点对应关系,而非依赖难以处理的里程计误差。在公开的先进雷达惯性里程计(RIO)框架上,结合真实无人机飞行与广泛使用的Coloradar数据集进行评估,结果表明,所提方法平均分别提升定位精度14%和19%。开源代码与数据集见:https://github.com/aau-cns/radar_transformer。
原文摘要 · Abstract (English)
Using 3D point clouds in odometry estimation in robotics often requires finding a set of correspondences between points in subsequent scans. While there are established methods for point clouds of sufficient quality, state-of-the-art still struggles when this quality drops. Thus, this paper presents a novel learning-based framework for predicting robust point correspondences between pairs of noisy, sparse and unstructured 3D point clouds from a light-weight, low-power, inexpensive, consumer-grade System-on-Chip (SoC) Frequency Modulated Continuous Wave (FMCW) radar sensor. Our network is based on the transformer architecture which allows leveraging the attention mechanism to discover pairs of points in consecutive scans with the greatest mutual affinity. The proposed network is trained in a self-supervised way using set-based multi-label classification cross-entropy loss, where the ground-truth set of matches is found by solving the Linear Sum Assignment (LSA) optimization problem, which avoids tedious hand annotation of the training data. Additionally, posing the loss calculation as multi-label classification permits supervising on point correspondences directly instead of on odometry error, which is not feasible for sparse and noisy data from the SoC radar we use. We evaluate our method with an open-source state-of-the-art Radar-Inertial Odometry (RIO) framework in real-world Unmanned Aerial Vehicle (UAV) flights and with the widely used public Coloradar dataset. Evaluation shows that the proposed method improves the position estimation accuracy by over 14 % and 19 % on average, respectively. The open source code and datasets can be found here: https://github.com/aau-cns/radar_transformer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。