自适应融合多传感器数据,提升复杂环境下的运动估计稳定性。
ADM-Fusion: Adaptive Deep Multi-Sensor Fusion for Robust Ego-Motion Estimation in Diverse Conditions

- 动态分配传感器权重,根据环境变化实时调整融合策略。
- 在KITTI和CARLA-LOC上表现稳定,劣化条件下仍保持高精度。
- 适合自动驾驶等对鲁棒性要求高的实际场景使用。
在复杂与退化环境中,可靠的多传感器融合对自主系统至关重要,因传感器可靠性会快速波动。不同模态的失效方式各异,有效融合应自适应平衡互补信息,而非依赖固定加权。这一自适应性对自身运动估计尤为关键,因准确更新依赖于互补传感器信息的一致整合。本文提出ADM-Fusion,一种基于端到端深度学习的多传感器融合方法,可适应环境变化与传感器退化。该方法采用内容感知路由的自适应混合专家框架,实时动态分配传感器输入权重;系统还包含独立的平移与旋转分支,通过跨任务注意力机制耦合,兼顾任务特异性与信息共享。ADM-Fusion在CARLA-LOC模拟数据集上训练,并在KITTI真实数据上微调,展现出良好的仿真到现实迁移能力。实验表明,该方法在传感器退化条件下仍具鲁棒性,性能优于现有方法。
原文摘要 · Abstract (English)
Robust multi-sensor fusion is essential for reliable autonomy in diverse and degraded environments, where sensor reliability can fluctuate rapidly. Because different modalities fail in distinct ways, effective fusion should adaptively balance complementary cues rather than rely on fixed weighting. This adaptability is particularly important for ego-motion estimation, since accurate updates depend on the consistent integration of complementary sensor information. We propose ADM-Fusion, an end-to-end deep learning based multi-sensor fusion method designed to adapt to environmental changes and sensor degradation. ADM-Fusion employs an adaptive sensor mixture-of-experts framework with content-aware routing to dynamically assign weights to sensor inputs in real time. The system further incorporates separate translation and rotation branches, coupled through a cross-task attention mechanism to preserve task-specific specialization while enabling information sharing. ADM-Fusion is trained on the CARLA-LOC simulated dataset and subsequently fine-tuned on KITTI real-world data, demonstrating effective simulation-to-real transfer. Experiments show that ADM-Fusion remains robust under degraded conditions while maintaining competitive performance against existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。