用扩散模型提升植物胁迫表型分割的鲁棒性与标注效率
Perturbation-Aware Diffusion-Guided Hybrid Segmentation for Robust and Annotation-Efficient Plant Stress Phenotyping

- 混合骨干网络+扩散模型精修粗分割结果
- 仅需少量标注即达71.83% mIoU,边界F1提升26.10%
- 对模糊、阴影等干扰有强鲁棒性,适合真实农业场景
农业图像语义分割常在域内条件下评估,但实际部署需应对外观扰动、标注有限和跨域迁移。本文提出一种扩散引导的混合分割框架,采用U-Net、DeepLabV3+和SegFormer生成粗掩码,再由去噪扩散概率模型(DDPM)、潜在扩散或语义引导扩散进行精修。在PlantSegV3上通过3×3架构筛选,结合边界约束优化、扰动引导重训练、低数据评估、超参数约束筛选及受控跨域适应。最佳混合模型在PlantSegV3上实现71.83%的精修平均交并比(mIoU)和26.10%的精修边界F1,且在标注大幅减少时仍保持稳定,体现强标注效率。扰动分析识别出灰度转换、雾化、粗粒度丢弃和阴影为最破坏性外观变化,相应增强策略显著提升重训练鲁棒性。适配模型在外部农业数据集上亦表现良好,说明扩散精修与边界感知优化提供了可迁移的结构先验。总体表明,合理匹配的骨干-精修组合配合扰动感知重训练,可在真实资源与分布约束下提升结构划分精度与鲁棒性。
原文摘要 · Abstract (English)
Semantic segmentation in agricultural imagery is often evaluated under in-domain protocols, yet practical deployment requires robustness to appearance perturbations, limited annotations, and cross domain shift. This paper presents a diffusion-guided hybrid segmentation framework in which U-Net, DeepLabV3+, and SegFormer backbones generate coarse masks that are refined by Denoising Diffusion Probabilistic Models (DDPM), latent diffusion, or semantic-guided diffusion. The framework is evaluated through a 3x3 architectural screening study on PlantSegV3, followed by boundary-constrained optimization, perturbation-guided retraining, low-data evaluation, constrained hyperparameter screening, and controlled cross-domain adaptation. On PlantSegV3, the best selected hybrid model achieves 71.83% refined mean Intersection-over-Union (mIoU) and 26.10% refined Boundary-F1, and the selected models remain stable under substantially reduced supervision, demonstrating strong annotation efficiency. Perturbation analysis identifies grayscale conversion, fog, coarse dropout, and shadow as the most disruptive appearance shifts, and the resulting augmentation policy substantially improves robustness during retraining. The adapted models further show effective transfer to external agricultural datasets under limited target supervision, indicating that diffusion refinement and boundary-aware optimization provide transferable structural priors. Overall, the results show that carefully matched backbone-refiner pairings, combined with perturbation-aware retraining, can improve structural delineation and robustness under realistic resource and distribution constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。