用扩散模型分数混合生成硬样本,提升人脸识别性能
ScoreMix: Synthetic Data Generation by Score Composition in Diffusion Models Improves Recognition
- 通过组合扩散模型的类别分数生成合成数据
- 在8个公开人脸数据集上最高提升7个百分点准确率
- 无需外部资源,适合受限环境下数据增强
合成数据生成在机器学习中广泛用于训练和数据增强。然而,现有方法通常依赖外部基础模型或数据集,在许多场景下因政策或法律限制而受限。我们提出ScoreMix,一种自包含的合成数据生成方法,通过利用扩散模型的分数可组合性,在反向扩散轨迹上混合类别条件分数,生成适用于识别任务的硬样本,实现无需外部资源的领域特定数据增强。我们系统研究了类别选择策略,发现混合判别器嵌入空间中距离较远的类别能带来更大增益,相比基于相近性的选择,平均性能提升高达3%。有趣的是,我们观察到在标准对齐度量下,条件空间与嵌入空间基本不相关,且生成器的条件空间对下游性能影响微乎其微。在8个公开人脸识别基准上,ScoreMix在无需超参数搜索的情况下,准确率最高提升7个百分点,展现出强鲁棒性与实用性。该方法仅使用现有数据集即可最大化判别器性能,无需依赖第三方资源。
原文摘要 · Abstract (English)
Synthetic data generation is increasingly used in machine learning for training and data augmentation. Yet, current strategies often rely on external foundation models or datasets, whose usage is restricted in many scenarios due to policy or legal constraints. We propose ScoreMix, a self-contained synthetic generation method to produce hard synthetic samples for recognition tasks by leveraging the score compositionality of diffusion models. The approach mixes class-conditioned scores along reverse diffusion trajectories, yielding domain-specific data augmentation without external resources. We systematically study class-selection strategies and find that mixing classes distant in the discriminator's embedding space yields larger gains, providing up to 3% additional average improvement, compared to selection based on proximity. Interestingly, we observe that condition and embedding spaces are largely uncorrelated under standard alignment metrics, and the generator's condition space has a negligible effect on downstream performance. Across 8 public face recognition benchmarks, ScoreMix improves accuracy by up to 7 percentage points, without hyperparameter search, highlighting both robustness and practicality. Our method provides a simple yet effective way to maximize discriminator performance using only the available dataset, without reliance on third-party resources. Paper website: https://parsa-ra.github.io/scoremix/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。