arXiv:2607.12065cs.ROcs.AI2026-07中稿 · IROS2026

无需标注数据,将白天图像转为夜间近红外图,让农业机器人夜行更智能。

Enabling 24-hour Agricultural Robotics: Unsupervised Day-to-Night Cross-Modal Image Translation for Nighttime Visual Navigation

论文配图:Enabling 24-hour Agricultural Robotics: Unsupervised Day-to-Night Cross-Modal Image Translation for Nighttime Visual Navigation
图 1 · 摘自论文原文
  • 用无监督方法将白天RGB图转为夜间近红外图,保留语义一致性。
  • 在自建数据集AgriNight上,分割精度提升12.3%,支持夜间导航。
  • 适合做农业机器人夜间视觉导航的研究者与开发者使用。

尽管视觉导航在农业机器人中研究广泛,但现有系统多假设为白天条件。事实上,夜间部署自主机器人可实现全天候作物与土壤监测、果实采摘及夜行虫害检测。然而,现代视觉系统依赖大规模标注数据集,而夜间场景难以获取此类数据。为此,本文提出一种无监督图像转换框架,将白天植物行的RGB图像转化为近红外(NIR)夜间图像,无需像素级标注,从而直接复用白天的语义标签训练夜间感知模型。通过引入预训练的对比语言-图像预训练(CLIP)模型,该框架在转换过程中保持语义一致性;同时设计可见性掩码以处理夜间近红外照明有效范围有限的问题。我们在多个先进图像转换基线中进行对比评估,结果表明生成图像质量更高,下游语义分割性能显著提升。评估采用新构建的AgriNight数据集——包含428张白天和549张夜间图像,由配备夜视设备的移动机器人在农田中采集,并人工进行像素级语义标注。该数据集是首个面向夜间农业视觉导航的基准。此外,我们还进行了真实机器人实时自主导航实验。相关数据与代码已公开:https://github.com/mamorobel/AgriNight。

原文摘要 · Abstract (English)

While visual navigation has been extensively studied in agricultural robotics, most existing systems assume daytime conditions. In fact, deploying autonomous robots at night offers significant advantages, including 24-hour crop and soil monitoring, fruit harvesting, and nocturnal pest detection. Modern vision-based systems, however, rely heavily on large-scale well-annotated image datasets, which remains challenging to obtain for nighttime operation scenarios. To address this, we propose an unsupervised image translation framework that converts daytime plant-row RGB images into near-infrared (NIR) nighttime counterparts without requiring pixel-to-pixel supervision. This enables the direct reuse of daytime semantic labels for training nighttime perception models. In particular, by incorporating a pre-trained Contrastive Language-Image Pre-training (CLIP) model, the proposed framework is designed to preserve semantic consistency during day-to-night translation. Additionally, a visibility mask is introduced to account for the limited effective range of NIR illumination in nighttime scenes. We conduct comparative evaluations with state-of-the-art image translation baselines and demonstrate higher image qualities, as supported by improved performance in downstream semantic segmentation for nighttime visual navigation. For evaluation, we utilize AgriNight--a novel dataset comprising 428 daytime and 549 nighttime images collected using night-vision-equipped mobile robots in agricultural fields and manually annotated with pixel-wise semantic labels--and introduce it as the first benchmark for nighttime agricultural visual navigation. We also perform real-time autonomous navigation experiments with a physical robot operating at night. The data and code are available at: https://github.com/mamorobel/AgriNight.

农业机器人图像翻译夜视导航无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。