根据多重因素动态分配数据增强强度,提升分割模型性能
Difficulty-Aware Sample Allocation for Adaptive Data Augmentation in Semantic Segmentation

- 融合预测模糊、损失值、类别稀有度和边界复杂度生成难度分
- 在Oxford-IIIT Pet上将DeepLabV3的mIoU从0.633提升至0.740
- 适用于需要高精度分割的场景,尤其对难样本敏感的任务
数据增强是现代语义分割流程的标准组件,但多数增强方法对所有训练样本均匀分配变换,或仅基于单一难度信号(如损失)进行自适应。这忽略了分割难度的多因素性:模糊预测、持续优化误差、罕见类别和复杂物体边界均可能以不同方式使样本具有信息量。本文提出难度感知样本分配(DASA),一种与架构无关的框架,通过估计样本难度来分配更强的增强。DASA将预测模糊性、训练损失、类别稀有度和边界复杂度整合为归一化难度分数,并在迭代训练中映射为样本特定的增强强度。在Oxford-IIIT Pet和二分类Pascal VOC数据集上,使用U-Net、DeepLabV3和SegFormer-B0进行实验表明,DASA优于标准训练,且在多数情况下超越或媲美单信号自适应基线。在Oxford-IIIT Pet上,DASA将DeepLabV3的mIoU从0.633提升至0.740;在二分类Pascal VOC上,三种架构的前景IoU均达到最优。结果验证了多因子难度评估作为增强引导机制的实用性。
原文摘要 · Abstract (English)
Data augmentation is a standard component of modern semantic segmentation pipelines, but most augmentation techniques allocate transformations uniformly across training samples or adapt to a single difficulty signal such as loss. This ignores the fact that segmentation difficulty is multi-factorial, since ambiguous predictions, persistent optimization errors, rare classes, and complex object boundaries can each make a sample informative in different ways. This paper introduces Difficulty-Aware Sample Allocation (DASA), an architecture-agnostic framework that assigns stronger augmentation to samples estimated to be more difficult. DASA combines prediction ambiguity, training loss, class rarity, and boundary complexity into a normalized difficulty score, then maps that score to sample-specific augmentation strength during iterative training. Experiments on Oxford-IIIT Pet and binary Pascal VOC segmentation with U-Net, DeepLabV3, and SegFormer-B0 show that DASA improves over standard training and is competitive with or stronger than single-signal adaptive baselines. On Oxford-IIIT Pet, DASA improves DeepLabV3 from 0.633 to 0.740 mIoU. On binary Pascal VOC, DASA obtains the best foreground IoU for all three evaluated architectures. These results attest to the value of multi-factor difficulty estimation as a practical mechanism for directing augmentation where it is most useful.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。