用语义与几何先验协同提升小麦病害少样本分割精度
Learning to Synergize Semantic and Geometric Priors for Limited-Data Wheat Disease Segmentation
- 融合DINOv2语义先验与SAM几何先验,动态生成病害定位提示
- 在仅30张图像的条件下,病害分割准确率超90%
- 适合农业图像少样本分割任务,尤其适用于生长阶段变化大的场景
小麦病害分割对精准农业至关重要,但受生长阶段导致的显著类内时序外观变化影响,从头构建代表性数据集既费力又不现实。为此,我们提出SGPer框架,将少样本小麦病害分割视为疾病特异性语义感知与边界定位的耦合任务。核心思想是利用预训练DINOv2提供鲁棒的类别感知语义先验,将其转换为粗略空间提示以引导SAM实现病害边界的精确定位。SGPer设计了多疾病友好滤波器的敏感适配器,插入DINOv2与SAM中,对齐其预训练表征与病害特征。通过将DINOv2特征转化为密集类别特定点提示,确保所有病害区域的空间全覆盖;再结合SAM迭代掩码置信度与DINOv2提供的类别一致性,动态过滤冗余提示,最终提炼出高信息量提示以激活SAM的几何先验,实现对时序外观变化不变的精确分割。大量实验表明,SGPer在小麦病害与器官分割基准上持续达到最先进性能,尤其在数据受限场景下表现优异。
原文摘要 · Abstract (English)
Wheat disease segmentation is fundamental to precision agriculture but faces severe challenges from significant intra-class temporal variations across growth stages. Such substantial appearance shifts make collecting a representative dataset for training from scratch both labor-intensive and impractical. To address this, we propose SGPer, a Semantic-Geometric Prior Synergization framework that treats wheat disease segmentation under limited data as a coupled task of disease-specific semantic perception and disease boundary localization. Our core insight is that pretrained DINOv2 provides robust category-aware semantic priors to handle appearance shifts, which can be converted into coarse spatial prompts to guide SAM for the precise localization of disease boundaries. Specifically, SGPer designs disease-sensitive adapters with multiple disease-friendly filters and inserts them into both DINOv2 and SAM to align their pretrained representations with disease-specific characteristics. To operationalize this synergy, SGPer transforms DINOv2-derived features into dense, category-specific point prompts to ensure comprehensive spatial coverage of all disease regions. To subsequently eliminate prompt redundancy and ensure highly accurate mask generation, it dynamically filters these dense candidates by cross-referencing SAM's iterative mask confidence with the category-specific semantic consistency derived from DINOv2. Ultimately, SGPer distills a highly informative set of prompts to activate SAM's geometric priors, achieving precise and robust segmentation that remains strictly invariant to temporal appearance changes. Extensive evaluations demonstrate that SGPer consistently achieves state-of-the-art performance on wheat disease and organ segmentation benchmarks, especially in data-constrained scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。