arXiv:2604.27499cs.CV2026-04

首个全天候越野红外数据集,助力夜间自动驾驶感知

Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark

论文配图:Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark
图 1 · 摘自论文原文
  • 用记忆注意力机制融合历史信息,解决帧间不一致问题
  • 在自建数据集上实现82.93% IoU和90.66% F1分数
  • 兼具红外与可见光泛化能力,适合夜间越野场景研究

越野夜间自动驾驶面临可见光感知不可靠的问题,红外模态对准确的自由空间检测至关重要。然而,受限于标注红外越野数据集稀缺及现有单帧方法固有的帧间不一致性,进展缓慢。为此,我们提出IRON数据集,据我们所知,这是首个大规模红外越野时序自由空间检测数据集,支持全天候条件下的夜间感知。该数据集包含24,314张密集标注的红外图像,并同步配以不同场景和光照条件下的RGB图像。基于此数据集,我们提出IRONet,一种无光流的时序自由空间检测框架,通过记忆注意力机制聚合历史上下文并设计精良的掩码解码器,有效缓解帧间不一致问题。在IRON数据集上,IRONet达到82.93%(+1.19%)的IoU和90.66%(+0.71%)的F1分数,实现实时推理。尤为突出的是,IRONet在ORFD和Rellis数据集上的可见光模态也表现出鲁棒泛化能力。本工作为可靠全天候越野自动驾驶奠定了基础,并推动红外时序感知研究发展。代码与数据集已公开于https://github.com/wsnbws/IRON。

原文摘要 · Abstract (English)

Off-road nighttime autonomous driving suffers from unreliable visible-light perception, making infrared modality crucial for accurate freespace detection. However, progress remains limited due to the scarcity of annotated infrared off-road datasets and the inter-frame inconsistencies inherent to current single-frame methods. To address these gaps, we present the IRON dataset, which, to our knowledge, is the first large-scale infrared dataset for off-road temporal freespace detection under all-day conditions, with strong support for nighttime perception. The dataset comprises 24,314 densely annotated infrared images with synchronized RGB images in diverse scenes and different light conditions. Building upon this dataset, we propose IRONet, a novel flow-free framework for temporal freespace detection that addresses inter-frame inconsistencies by aggregating historical context via a memory-attention mechanism and a carefully designed mask decoder. On our IRON dataset, IRONet achieves state-of-the-art performance, reaching 82.93%(+1.19%) IoU and 90.66%(+0.71%) F1 score at real-time inference. Remarkably, IRONet also exhibits robust generalization to RGB modalities on ORFD and Rellis datasets. Overall, our work establishes a foundation for reliable all-day off-road autonomous driving and future research in infrared temporal perception. The code and IRON dataset are available at https://github.com/wsnbws/IRON.

红外感知越野驾驶时序检测多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。