arXiv:2603.01932cs.CV2026-03被引 4

提出双流网络VISA,精准分割麦田杂草,适应不同光照和季节变化。

BAWSeg: A UAV Multispectral Benchmark for Barley Weed Segmentation

  • 双流设计分离辐射与指数特征,提升小杂草检测能力
  • 在BAWSeg数据集上达75.6% mIoU,杂草分割准确率达63.5%
  • 适用于跨地块、跨年份的鲁棒农业图像分割,适合智能农田管理

精确的谷物田杂草定位需基于无人机影像实现像素级分割,并具备跨田块、跨季节和光照变化的稳定性。现有多光谱方法常依赖阈值化植被指数,易受辐射漂移和作物-杂草混合像素影响;或采用单流卷积神经网络与变换器模型处理堆叠波段与指数,导致辐射信号与归一化指数信号干扰,降低对嵌入于作物冠层中的小型杂草簇的敏感性。本文提出VISA——一种双流分割网络,解耦辐射与指数线索,并在原始分辨率融合。辐射流利用校准的五波段反射率,通过局部残差卷积、通道重校准、空间门控与跳连解码,保留细纹理、行边界及微小杂草结构;指数流则在植被指数图上采用窗口自注意力建模局部结构,状态空间层实现无二次复杂度的全场上下文传播,槽注意力生成稳定区域描述符,增强冠层下稀疏杂草的区分能力。为支持监督训练与部署评估,本文构建了四年的西澳商业大麦田无人机多光谱数据集BAWSeg,包含蓝、绿、红、红边、近红外正射影像,衍生植被指数,以及无泄漏区块划分的密集作物、杂草与其他标签。在BAWSeg上,VISA以2280万参数实现75.6% mIoU与63.5%杂草IoU,较多光谱SegFormer-B1基线提升1.2 mIoU与1.9杂草IoU。跨地块与跨年评估下,分别保持71.2%与69.2% mIoU。

原文摘要 · Abstract (English)

Accurate weed mapping in cereal fields requires pixel-level segmentation from UAV imagery that remains reliable across fields, seasons, and illumination. Existing multispectral pipelines often depend on thresholded vegetation indices, which are brittle under radiometric drift and mixed crop--weed pixels, or on single-stream CNN and Transformer backbones that ingest stacked bands and indices, where radiance cues and normalized index cues interfere and reduce sensitivity to small weed clusters embedded in crop canopy. We propose VISA, a two-stream segmentation network that decouples these cues and fuses them at native resolution. The radiance stream learns from calibrated five-band reflectance using local residual convolutions, channel recalibration, spatial gating, and skip-connected decoding, which preserve fine textures, row boundaries, and small weed structures that are often weakened after ratio-based index compression. The index stream operates on vegetation-index maps with windowed self-attention to model local structure efficiently, state-space layers to propagate field-scale context without quadratic attention cost, and Slot Attention to form stable region descriptors that improve discrimination of sparse weeds under canopy mixing. To support supervised training and deployment-oriented evaluation, we introduce BAWSeg, a four-year UAV multispectral dataset collected over commercial barley paddocks in Western Australia, providing radiometrically calibrated blue, green, red, red edge, and near-infrared orthomosaics, derived vegetation indices, and dense crop, weed, and other labels with leakage-free block splits. On BAWSeg, VISA achieves 75.6% mIoU and 63.5% weed IoU with 22.8 M parameters, outperforming a multispectral SegFormer-B1 baseline by 1.2 mIoU and 1.9 weed IoU. Under cross-plot and cross-year protocols, VISA maintains 71.2% and 69.2% mIoU, respectively.

无人机杂草分割多光谱农业AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。