用视觉语言模型零样本检测农田临时沟壑,准确率超70%
A Zero-Shot Learning Approach for Ephemeral Gully Detection from Remote Sensing using Vision Language Models
- 基于视觉语言模型的零样本分类框架,无需训练即可识别沟壑
- 在公开数据集上实现超过70%准确率和近80%的正类F1分数
- 首次构建专家标注的临时沟壑数据集,适合农业生态研究者
临时沟壑是土壤侵蚀的主要原因,其可靠、准确且早期的检测将显著提升全球农业系统的可持续性。现有研究尚未有效解决遥感图像中临时沟壑的自动化检测问题。本文首次提出并评估了三种成功的检测流水线,利用特定农业区域随时间获取的遥感图像,结合多种开源视觉语言模型(VLMs)进行零样本分类。实验表明,该方法在无标注数据场景下对临时沟壑的检测准确率超过70%,正类F1分数接近80%。此外,我们构建了首个由土壤与植物科学专家标注的临时沟壑公开数据集。通过对比零样本方法与迁移学习方案,系统验证了所提流水线的有效性,并分析了超参数变化对性能的影响。结果证明,该零样本框架在标注数据稀缺场景下具有高度可行性。
原文摘要 · Abstract (English)
Ephemeral gullies are a primary cause of soil erosion and their reliable, accurate, and early detection will facilitate significant improvements in the sustainability of global agricultural systems. In our view, prior research has not successfully addressed automated detection of ephemeral gullies from remotely sensed images, so for the first time, we present and evaluate three successful pipelines for ephemeral gully detection. Our pipelines utilize remotely sensed images, acquired from specific agricultural areas over a period of time. The pipelines were tested with various choices of Visual Language Models (VLMs), and they classified the images based on the presence of ephemeral gullies with accuracy higher than 70% and a F1-score close to 80% for positive gully detection. Additionally, we developed the first public dataset for ephemeral gully detection, labeled by a team of soil- and plant-science experts. To evaluate the proposed pipelines, we employed a variety of zero-shot classification methods based on State-of-the-Art (SOTA) open-source Vision-Language Models (VLMs). In addition to that, we compare the same pipelines with a transfer learning approach. Extensive experiments were conducted to validate the detection pipelines and to analyze the impact of hyperparameter changes in their performance. The experimental results demonstrate that the proposed zero-shot classification pipelines are highly effective in detecting ephemeral gullies in a scenario where classification datasets are scarce.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。