提出无人机农田杂草分割的采集感知评估方法,避免测试集泄露。
AAMBERS-UAV: Acquisition-Aware Multimodal Backbone Evaluation and Ranking for UAV Weedy Rice Segmentation

- 按采集批次划分数据,确保测试集来自全新航拍
- 融合多光谱后性能提升,但依赖模型架构和数据暴露程度
- 适合做遥感图像分割的评估设计与模型对比研究者
无人机图像序列具有时空关联性,但现有语义分割基准常在图像层面切分数据。这种做法可能导致同一航拍批次的样本同时出现在训练和测试集中,掩盖了模型在真实新场景下的迁移能力。基于734样本的WeedyRice-RGBMS-DB数据集,本文设定124张图像作为目标航拍测试集,并对比两种协议:目标保留(排除目标航拍用于开发)与目标暴露(允许其剩余图像参与开发)。在固定分割种子下,用SegFormer-B0评估RGB、四波段多光谱(MS)、七通道RGB+MS三种输入。在完全保留目标时,仅用RGB达到最高精度(IoU 0.7317±0.0201);而在目标暴露后,RGB+MS反超至0.7822±0.0269。固定分割的U-Net/ResNet18复现也显示所有输入均获益于暴露,但始终以RGB为最优。结果表明,采集暴露会普遍提高性能,而模态排序受模型结构影响。此外,拆分审计显示强近邻依赖,扰动实验表明早期融合对RGB-MS错位更敏感,远高于中等辐射校准。本研究支持在多模态无人机基准中引入采集感知的同测评估,作为图像级切分的必要补充。代码与数据将在论文接收后公开。
原文摘要 · Abstract (English)
UAV image collections contain spatially and temporally related frames, yet semantic-segmentation benchmarks commonly split them at image level. Such splitting can place samples from one acquisition in both model development and testing, obscuring transfer to a genuinely new survey. Using the 734-sample WeedyRice-RGBMS-DB, we fix a 124-image target-acquisition test set and compare two protocols with identical train, validation, and test counts: target-held-out, which excludes the target acquisition from development, and target-exposed, which admits its remaining images. SegFormer-B0 is evaluated with RGB, four-band multispectral (MS), and seven-channel RGB+MS input over two fixed-split seeds. RGB is strongest under complete acquisition holdout ($0.7317\pm0.0201$ IoU), whereas RGB+MS becomes strongest after target exposure ($0.7822\pm0.0269$). A fixed-split U-Net/ResNet18 replication confirms positive exposure gains for all three inputs, but retains RGB as the best modality under both protocols. Acquisition exposure therefore increases measured performance across both evaluated backbones, while its effect on modality ranking is architecture-dependent. A supplied-split audit reveals strong near-sequential dependence, and corruption tests show that early fusion is substantially more sensitive to RGB--MS displacement than to moderate radiometric scaling. These results support acquisition-aware same-test evaluation as a necessary complement to ordinary image-level splitting in multimodal UAV benchmarks. The code and supporting the findings of this study will be publicly released upon acceptance of the paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。