用事件相机稳定重建3D线条,提升感知鲁棒性
RoEL: Robust Event-based 3D Line Reconstruction
- 通过多时相事件数据融合,稳定追踪不同外观的线条轨迹
- 在多个数据集上显著提升事件相机建图与位姿优化性能
- 适用于多模态场景,可灵活适配点云或图像等观测数据
运动中的事件相机倾向于检测物体边界或纹理边缘,产生亮度变化的线条,尤其在人造环境中更为明显。尽管线条可作为一致观测的鲁棒中间表示,但其稀疏性会导致微小估计误差引发性能急剧下降。此前少数工作需依赖额外传感器,利用线条缓解事件传感器在域偏移和不可预测噪声下的问题。本文提出一种算法,通过观察多个时间切片的事件数据,稳定提取具有不同外观的线条轨迹,有效应对事件数据中的干扰因素。进一步设计几何代价函数,用于精炼3D线条地图与相机位姿,消除投影畸变和深度模糊。所生成的3D线条地图高度紧凑,可适配任意能检测或提取线条结构及其投影的观测数据,包括3D点云或图像。实验表明,该方法在多种数据集上显著提升事件感知建图与位姿优化性能,且可灵活应用于多模态场景。结果证实,该基于线条的框架是事件感知模块实际部署的有效且鲁棒的解决方案。
原文摘要 · Abstract (English)
Event cameras in motion tend to detect object boundaries or texture edges, which produce lines of brightness changes, especially in man-made environments. While lines can constitute a robust intermediate representation that is consistently observed, the sparse nature of lines may lead to drastic deterioration with minor estimation errors. Only a few previous works, often accompanied by additional sensors, utilize lines to compensate for the severe domain discrepancies of event sensors along with unpredictable noise characteristics. We propose a method that can stably extract tracks of varying appearances of lines using a clever algorithmic process that observes multiple representations from various time slices of events, compensating for potential adversaries within the event data. We then propose geometric cost functions that can refine the 3D line maps and camera poses, eliminating projective distortions and depth ambiguities. The 3D line maps are highly compact and can be equipped with our proposed cost function, which can be adapted for any observations that can detect and extract line structures or projections of them, including 3D point cloud maps or image observations. We demonstrate that our formulation is powerful enough to exhibit a significant performance boost in event-based mapping and pose refinement across diverse datasets, and can be flexibly applied to multimodal scenarios. Our results confirm that the proposed line-based formulation is a robust and effective approach for the practical deployment of event-based perceptual modules. Project page: https://gwangtak.github.io/roel/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。