arXiv:2608.01530cs.CV2026-08

用轻量适配器实现高效农业分割不确定性估计

ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation

论文配图:ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation
图 1 · 摘自论文原文
  • 从单次训练轨迹生成多样模型,仅微调低秩适配器
  • 参数减少至10%以下,精度与校准度媲美全模型集成
  • 适合需要高可靠性的农业视觉系统部署

数字农业中的可靠决策支持需要精确预测和良好校准的不确定性估计,尤其在语义分割等密集预测任务中。集成方法虽能提供强不确定性量化,但计算与内存开销大;单模型近似常以牺牲不确定性质量换效率。我们提出ST-LoRA,一种基于低秩适配(LoRA)与快照集成的参数高效集成框架,从单一训练轨迹构建多样化集成成员。各成员共享冻结的预训练主干,仅通过轻量级低秩适配器区分,将可训练参数降至全模型的10%以下,同时保持集成多样性。我们在两个农业数据集——GrowliFlower-L(西兰花,开放田地)和BUP20(甜椒,玻璃温室)上评估,使用SegFormer和Mask2Former,涵盖分布内性能、分布外下的校准能力及分布外检测。消融实验表明,前馈层而非注意力层是密集预测的关键适配目标,与语言模型惯例相反。ST-LoRA在两个数据集和架构上均达到或超过全秩集成的分割精度与校准性能,显著降低训练时间、推理延迟、内存占用与存储需求。相比高效基线(快照集成、MC Dropout、Deep Deterministic Uncertainty),ST-LoRA在图像/像素级分布外检测、分布偏移下的校准稳定性及跨种子方差方面持续表现更优,参数更少,计算更低。结果表明,LoRA高效集成适配是不确定性感知农业视觉系统的有效且实用方案。

原文摘要 · Abstract (English)

Reliable decision-support in digital agriculture requires accurate predictions and well-calibrated uncertainty estimates, particularly for dense prediction tasks such as semantic segmentation. Ensemble methods provide strong uncertainty quantification, but their computational and memory demands limit practical use, while single-model approximations often trade off uncertainty quality for efficiency. We propose ST-LoRA, a parameter-efficient ensemble framework that builds diverse ensemble members from a single training trajectory by combining Low-Rank Adaptation (LoRA) with snapshot ensembling. Each member shares a frozen pretrained backbone and differs only in lightweight low-rank adapters, reducing trainable parameters to under 10% of the full model while preserving ensemble diversity. We evaluate across two agricultural datasets - GrowliFlower-L (cauliflower, open field) and BUP20 (sweet pepper, glasshouse) - using SegFormer and Mask2Former, covering in-distribution performance, calibration under distribution shift, and out-of-distribution detection. Ablations show feed-forward layers, not attention layers, are the critical LoRA target for dense prediction, contrary to the attention-only convention from language models. ST-LoRA matches or exceeds full-rank ensembles in segmentation accuracy and calibration across both datasets and architectures, while substantially reducing training time, inference latency, memory footprint, and storage requirements. Against efficient baselines - Snapshot Ensemble, MC Dropout, and Deep Deterministic Uncertainty - ST-LoRA consistently matches or outperforms them in image/pixel-level OoD detection, calibration stability under shift, and cross-seed variance, with far fewer parameters and lower compute. These results show LoRA-efficient ensemble adaptation is a highly effective, practical approach for uncertainty-aware agricultural vision systems.

农业视觉不确定性估计轻量模型分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。