arXiv:2506.01368cs.CV2025-06CVPR被引 7

用预训练扩散模型生成食物图像,缓解长尾分布问题。

Synthetic Data Augmentation using Pre-trained Diffusion Models for Long-tailed Food Image Classification

  • 用正负提示词控制生成,增强类别间区分度。
  • 在两个食物数据集上提升分类准确率,优于现有方法。
  • 适合处理样本不均衡的食物识别任务。

基于深度学习的食物图像分类可实现精准的食物类别识别,进而支持精确的营养分析。然而,现实中的食物图像常呈现偏斜分布,某些食物类型数量远多于其他类型,导致类别不平衡,使模型偏向多数类,少数类性能下降。近年来,基于扩散生成模型的合成数据增强成为解决该问题的有前景方案。通过生成高质量合成图像,可平衡数据分布,提升分类表现。但现有方法存在不足:微调类方法需均匀分布的数据集,而基于预训练模型的方法常忽略合成数据的类别间分离性。本文提出一种两阶段合成数据增强框架,利用预训练扩散模型应对长尾食物分类问题。首先以目标类别正提示词生成参考集,再选择特征相似的类别作为负提示词;随后采用联合采样策略,结合正负提示词生成合成增强集,促进类内多样性与类间分离性。在两个长尾食物基准数据集上验证了该方法的有效性,其顶-1准确率优于此前工作。

原文摘要 · Abstract (English)

Deep learning-based food image classification enables precise identification of food categories, further facilitating accurate nutritional analysis. However, real-world food images often show a skewed distribution, with some food types being more prevalent than others. This class imbalance can be problematic, causing models to favor the majority (head) classes with overall performance degradation for the less common (tail) classes. Recently, synthetic data augmentation using diffusion-based generative models has emerged as a promising solution to address this issue. By generating high-quality synthetic images, these models can help uniformize the data distribution, potentially improving classification performance. However, existing approaches face challenges: fine-tuning-based methods need a uniformly distributed dataset, while pre-trained model-based approaches often overlook inter-class separation in synthetic data. In this paper, we propose a two-stage synthetic data augmentation framework, leveraging pre-trained diffusion models for long-tailed food classification. We generate a reference set conditioned by a positive prompt on the generation target and then select a class that shares similar features with the generation target as a negative prompt. Subsequently, we generate a synthetic augmentation set using positive and negative prompt conditions by a combined sampling strategy that promotes intra-class diversity and inter-class separation. We demonstrate the efficacy of the proposed method on two long-tailed food benchmark datasets, achieving superior performance compared to previous works in terms of top-1 accuracy.

食物分类扩散模型数据增强长尾分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。