arXiv:2605.25210cs.LGcs.AI2026-05

用少量标注数据训练扩散模型多目标生成,提升效率与泛化能力。

Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning

论文配图:Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning
图 1 · 摘自论文原文
  • 先训轻量专家模型,再通过伪样本蒸馏成通用模型。
  • 理论证明所需标注样本数仅与专家模型复杂度相关。
  • 适用于标注少、条件多的机器人控制与图像修复任务。

扩散模型在条件生成中应用广泛,但实际部署常需应对多个目标分布,如文本到图像生成中的多样提示域或机器人策略中的多环境场景,这自然形成多目标学习(MOL)问题。核心挑战在于:实现良好帕累托权衡通常需要容量远超单任务需求的通用模型,从而显著增加统计成本,因样本复杂度通常随模型复杂度上升。为缓解此矛盾,本文提出一种针对扩散模型的半监督多目标学习框架:标注样本稀缺而条件数据丰富。我们设计两阶段训练流程:首先利用有限标注数据训练轻量级专家模型;随后通过生成伪样本将专家模型知识蒸馏至通用模型。理论上,我们建立了泛化边界,表明所需标注样本数仅依赖于专家模型类的复杂度。进一步将理论扩展至序列决策中的扩散策略,以应对在线策略回放中的分布偏移。在机器人控制和图像修复任务上的大量实验验证了理论结果的有效性。

原文摘要 · Abstract (English)

Diffusion models are increasingly used as powerful conditional generators, yet real deployments often involve multiple target distributions arising from different tasks, e.g., diverse prompt domains in text-to-image generation, or multiple environments in robotics with diffusion policies. This naturally leads to a multi-objective learning (MOL) problem. A key challenge is that achieving good Pareto trade-offs can require a generalist model class with substantially larger capacity than what suffices for solving any individual task, thereby increasing statistical cost since sample complexity typically scales with the model complexity. To reconcile this, we develop a principled MOL framework for diffusion models with limited data: a semi-supervised regime where paired (labeled) samples are scarce, but (unlabeled) condition data are abundant. We propose a two-stage training procedure that first fits lightweight specialist models from limited paired data, and then distills them into a generalist model by generating pseudo-samples. We establish generalization bounds showing that the required number of paired samples only depends on the complexity of the specialist model classes. We further extend the theory to diffusion policies for sequential decision making to account for distribution shift in on-policy rollouts. Extensive experiments on robotic control and image restoration tasks are conducted to verify our theoretical results.

扩散模型多目标学习半监督机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。