通过优化少数类偏好,让扩散分类器更准识别稀有样本。
Self-Improving Diffusion Classifiers with Minority Preference Optimization

- 用少数类偏好奖励微调预训练扩散模型,提升对稀疏区域的覆盖。
- 在五个数据集上实现零样本分类性能提升,尤其改善稀有类别识别。
- 仅需文本描述即可自适应生成稀疏区域样本,无需额外图像或模型。
先前研究显示,扩散分类器具备稳健的零样本分类能力,但其表现严重依赖预训练数据分布:在数据流形的多数、高密度区域表现良好,而在少数、低密度区域显著下降。尽管已有研究关注少数类采样以生成更多少数类图像,但采样在生成之外的作用仍不明确。本文揭示了生成中的少数类采样与扩散分类器感知能力之间的直接关系。具体而言,增强少数类采样可扩大数据流形上未充分覆盖区域的范围,从而提升基于扩散的识别能力。为此,我们提出「自我改进的扩散分类器」(MiPO),利用少数类偏好奖励对预训练扩散模型进行微调。仅使用任意文本描述,MiPO 生成候选样本,以更好覆盖少数区域为奖励目标,通过 LoRA 和组相对策略优化方法进行模型优化,无需额外图像数据、外部基础模型或外部奖励模型。该方法实现了稳定、提示自适应的少数类采样,并将低密度生成覆盖转化为更好的零样本扩散分类性能。总结而言,我们揭示了扩散分类器对多数区域的感知偏差,证明可通过少数类偏好优化缓解此偏差,并在五个标准数据集上评估了 MiPO。
原文摘要 · Abstract (English)
Prior studies have demonstrated that diffusion classifiers achieve robust zero-shot classification performance. However, their effectiveness is strongly tied to the pretraining data distribution: they perform well in majority, high-density regions of the data manifold, but are significantly less accurate in minority, low-density regions. Although prior works on minority sampling have focused on generating more minority-like images, what minority sampling fundamentally enables beyond generation remains underexplored. In this paper, we reveal a direct relationship between minority sampling in generation and the perception capability of diffusion classifiers. Specifically, we show that enhancing minority sampling broadens the coverage of underrepresented regions on the data manifold, thereby improving diffusion-based recognition. To exploit this connection, we propose \textit{Self-Improving Diffusion Classifiers with Minority Preference Optimization} (MiPO), which fine-tunes a pretrained diffusion model using minority preference rewards. Using only arbitrary caption data, MiPO generates candidate samples, rewards those that better cover minority regions, and optimizes the model with LoRA and Group Relative Policy Optimization, without additional image data, external foundation models, or external reward models. This enables stable, prompt-adaptive minority sampling and translates low-density generative coverage into improved zero-shot diffusion classification. To sum up, we show that diffusion classifier perception is biased toward majority regions, demonstrate that this bias can be alleviated through minority preference optimization, and evaluate MiPO on five standard datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。