用数据增强提升模型泛化,让分割模型更好适应工业场景新数据。
An Augmentation-based Model Re-adaptation Framework for Robust Image Segmentation
- 基于数据增强设计重适配框架,提升小样本复杂纹理下的分割能力。
- 微调后FCN与U-Net在两项指标上分别超越基线3%至8%,优于SAM模型。
- 适合工业质检中需快速适配新数据集的场景,兼顾效率与精度。
图像分割是计算机视觉中的关键任务,广泛应用于工业领域。尽管近期涌现了大量关注,但如通用抗伪码等工业检测任务仍面临挑战。工业场景常存在样本少、纹理复杂等问题,且训练参数量不一导致计算成本差异大。为此,本文提出一种基于数据增强的模型重适配框架(AMRF)。该框架通过训练阶段的数据增强策略提升分割模型的泛化能力,使其可适应具有时间差异的新数据集。通过分析传统模型(FCN和U-Net)及预训练SAM模型的分割掩码,确定最优最小增强集合,在训练效率与性能间取得平衡。实验表明,微调后的FCN在两个时序连续数据集上,裁剪准确率提升3.29%和3.02%,分类准确率提升5.27%和4.04%;微调后的U-Net分别提升7.34%和4.94%(裁剪),8.02%和5.52%(分类)。两者平均在裁剪准确率上比顶级SAM模型(ViT-Large和ViT-Base)高出11.75%和9.01%,分类准确率高出2.93%和4.83%。
原文摘要 · Abstract (English)
Image segmentation is a crucial task in computer vision, with wide-ranging applications in industry. The Segment Anything Model (SAM) has recently attracted intensive attention; however, its application in industrial inspection, particularly for segmenting commercial anti-counterfeit codes, remains challenging. Unlike open-source datasets, industrial settings often face issues such as small sample sizes and complex textures. Additionally, computational cost is a key concern due to the varying number of trainable parameters. To address these challenges, we propose an Augmentation-based Model Re-adaptation Framework (AMRF). This framework leverages data augmentation techniques during training to enhance the generalisation of segmentation models, allowing them to adapt to newly released datasets with temporal disparity. By observing segmentation masks from conventional models (FCN and U-Net) and a pre-trained SAM model, we determine a minimal augmentation set that optimally balances training efficiency and model performance. Our results demonstrate that the fine-tuned FCN surpasses its baseline by 3.29% and 3.02% in cropping accuracy, and 5.27% and 4.04% in classification accuracy on two temporally continuous datasets. Similarly, the fine-tuned U-Net improves upon its baseline by 7.34% and 4.94% in cropping, and 8.02% and 5.52% in classification. Both models outperform the top-performing SAM models (ViT-Large and ViT-Base) by an average of 11.75% and 9.01% in cropping accuracy, and 2.93% and 4.83% in classification accuracy, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。