arXiv:2511.13891cs.CV2025-11

用视觉语言模型弱监督检测农田临时沟壑,大幅降低标注成本。

Weakly Supervised Ephemeral Gully Detection In Remote Sensing Images Using Vision Language Models

  • 利用VLM预训练知识+师生模型,从噪声标签中学习。
  • 在18,000张遥感图像上实现优于纯VLM的检测性能。
  • 适合遥感、农业监测与弱监督学习研究者参考。

在土壤侵蚀问题中,临时沟壑是农业用地中最受关注的现象之一,其短暂的生命周期增加了传统计算机视觉与遥感方法自动检测的难度。同时,由于高质量标注数据稀缺且难以获取,现有机器学习方法仅限于难以落地的零样本方案。为此,本文首次提出一种弱监督的临时沟壑检测流程。该方法基于遥感图像,利用视觉语言模型(VLM)显著减少人工标注工作量。具体包括:1)利用VLM预训练中蕴含的知识;2)采用师生架构,教师模型从VLM生成的噪声标签中学习,学生模型则通过教师生成标签及噪声感知损失函数进行弱监督训练。我们还发布了首个面向半监督检测的临时沟壑遥感图像数据集,包含由多位土壤与植物科学家标注的若干区域,以及大量未标注区域,涵盖超过18,000张高分辨率遥感图像,时间跨度达13年。实验表明,在弱监督条件下,学生模型性能优于VLM和标签模型本身。相关代码与数据集已公开。

原文摘要 · Abstract (English)

Among soil erosion problems, Ephemeral Gullies are one of the most concerning phenomena occurring in agricultural fields. Their short temporal cycles increase the difficulty in automatically detecting them using classical computer vision approaches and remote sensing. Also, due to scarcity of and the difficulty in producing accurate labeled data, automatic detection of ephemeral gullies using Machine Learning is limited to zero-shot approaches which are hard to implement. To overcome these challenges, we present the first weakly supervised pipeline for detection of ephemeral gullies. Our method relies on remote sensing and uses Vision Language Models (VLMs) to drastically reduce the labor-intensive task of manual labeling. In order to achieve that, the method exploits: 1) the knowledge embedded in the VLM's pretraining; 2) a teacher-student model where the teacher learns from noisy labels coming from the VLMs, and the student learns by weak supervision using teacher-generate labels and a noise-aware loss function. We also make available the first-of-its-kind dataset for semi-supervised detection of ephemeral gully from remote-sensed images. The dataset consists of a number of locations labeled by a group of soil and plant scientists, as well as a large number of unlabeled locations. The dataset represent more than 18,000 high-resolution remote-sensing images obtained over the course of 13 years. Our experimental results demonstrate the validity of our approach by showing superior performances compared to VLMs and the label model itself when using weak supervision to train an student model. The code and dataset for this work are made publicly available.

遥感弱监督沟壑检测VLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。