arXiv:2603.07819cs.CVcs.LG2026-03中稿 · CVPR被引 1

小数据下简单融合模块反而比复杂模型更准,关键在选好骨干网络。

Fusion Complexity Inversion: Why Simpler Cross View Modules Outperform SSMs and Cross View Attention Transformers for Pasture Biomass Regression

  • 用轻量级卷积做跨视角融合,比注意力和状态空间模型更有效。
  • 在357张图像上,最优模型R²达0.903,显著超越复杂模型。
  • 适合农业遥感小样本回归,指导如何选模型和特征。

从农业影像中准确估算牧场生物量对可持续放牧管理至关重要,但现有方法受限于真实监测中常见的小规模、不平衡且标注稀疏的数据集。本研究在包含357张双视角图像、具备实验室验证的五种生物量组分真值的CSIRO牧场生物量基准上,系统评估了视觉基础模型在农业回归任务中的适配性,涵盖四种骨干网络(EfficientNet-B3至DINOv3-ViT-L)、五种跨视角融合机制及4×2元数据因子设计的17种配置。发现反直觉规律——“融合复杂度倒置”:在稀缺农业数据下,两层门控深度卷积(R²=0.903)优于跨视角注意力转换器(0.833)、双向状态空间模型(0.819)和完整Mamba(0.793,低于无融合基线)。骨干预训练规模被证实单调主导所有架构选择,仅从DINOv2升级至DINOv3即带来+5.0 R²提升。仅训练元数据(物种、状态、NDVI)即可达到通用上限(R²≈0.829),使8.4点的融合差异缩小至0.1点。研究提出可操作指南:在稀疏农业基准下应优先考虑骨干质量,偏好局部模块而非全局结构,推理时不可用特征应剔除。

原文摘要 · Abstract (English)

Accurate estimation of pasture biomass from agricultural imagery is critical for sustainable livestock management, yet existing methods are limited by the small, imbalanced, and sparsely annotated datasets typical of real world monitoring. In this study, adaptation of vision foundation models to agricultural regression is systematically evaluated on the CSIRO Pasture Biomass benchmark, a 357 image dual view dataset with laboratory validated, component wise ground truth for five biomass targets, through 17 configurations spanning four backbones (EfficientNet-B3 to DINOv3-ViT-L), five cross view fusion mechanisms, and a 4x2 metadata factorial. A counterintuitive principle, termed "fusion complexity inversion", is uncovered: on scarce agricultural data, a two layer gated depthwise convolution (R^2 = 0.903) outperforms cross view attention transformers (0.833), bidirectional SSMs (0.819), and full Mamba (0.793, below the no fusion baseline). Backbone pretraining scale is found to monotonically dominate all architectural choices, with the DINOv2 -> DINOv3 upgrade alone yielding +5.0 R^2 points. Training only metadata (species, state, and NDVI) is shown to create a universal ceiling at R^2 ~ 0.829, collapsing an 8.4 point fusion spread to 0.1 points. Actionable guidelines for sparse agricultural benchmarks are established: backbone quality should be prioritized over fusion complexity, local modules preferred over global alternatives, and features unavailable at inference excluded.

农业遥感生物量估计小样本学习模型简化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。