arXiv:2509.15859cs.LGcs.CV2025-09中稿 · ICCV

用视觉模型生成合成数据,高效解决长尾分类问题

Efficient Long-Tail Learning in Latent Space by sampling Synthetic Data

  • 利用视觉基础模型的语义潜空间生成合成数据
  • 在CIFAR-100-LT上达到新最优,且仅训练线性分类器
  • 计算量极低,适合资源受限场景下的长尾学习

不平衡分类数据集给机器学习带来重大挑战,常导致模型对少数类表现不佳。随着基础模型的发展,近期研究聚焦于全量、部分及参数高效微调以应对长尾分类问题。尽管这些方法在基准数据集上表现优异,但仍未能缩小与平衡数据训练模型的性能差距,且即使对较小数据集也需大量计算资源。为强调计算效率与简洁性,本文提出一种新框架:利用视觉基础模型丰富的语义潜空间生成合成数据,并用真实与合成数据混合训练一个简单的线性分类器,用于长尾分类。该方法的计算效率提升源于可训练参数仅为线性模型的参数量。本方法在CIFAR-100-LT基准上达到新最优,在Places-LT上也表现强劲,凸显了该简单有效方法的有效性与适应性。

原文摘要 · Abstract (English)

Imbalanced classification datasets pose significant challenges in machine learning, often leading to biased models that perform poorly on underrepresented classes. With the rise of foundation models, recent research has focused on the full, partial, and parameter-efficient fine-tuning of these models to deal with long-tail classification. Despite the impressive performance of these works on the benchmark datasets, they still fail to close the gap with the networks trained using the balanced datasets and still require substantial computational resources, even for relatively smaller datasets. Underscoring the importance of computational efficiency and simplicity, in this work we propose a novel framework that leverages the rich semantic latent space of Vision Foundation Models to generate synthetic data and train a simple linear classifier using a mixture of real and synthetic data for long-tail classification. The computational efficiency gain arises from the number of trainable parameters that are reduced to just the number of parameters in the linear model. Our method sets a new state-of-the-art for the CIFAR-100-LT benchmark and demonstrates strong performance on the Places-LT benchmark, highlighting the effectiveness and adaptability of our simple and effective approach.

长尾学习合成数据视觉模型线性分类器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。