用少量配对数据提升扩散桥的训练效率和泛化能力
Feedback Schrödinger Bridge Matching
- 引入半监督框架,仅需不足8%的配对数据作为反馈引导
- 在保持高效性的同时,显著加速训练并提升模型泛化性能
- 适合数据标注成本高、部分数据可对齐的分布传输任务
扩散桥在分布传输问题中广泛应用,但现有方法在可扩展性与最优配对可用性之间存在权衡。完全无监督方法假设少但计算成本高,而全监督方法虽提升可扩展性,却难以在多数场景实现。为平衡二者,我们提出反馈薛定谔桥匹配(FSBM),一种新型半监督匹配框架,仅使用少于整个数据集8%的预对齐样本作为状态反馈,指导非配对样本的传输映射,显著提升效率。该方法通过引入额外项的静态熵最优传输(EOT)问题,并将其重构为动态形式,以利用匹配框架的可扩展性。大量实验表明,FSBM通过利用配对数据的引导作用,加速训练并增强泛化能力,为部分对齐数据集上训练匹配框架开辟新路径。
原文摘要 · Abstract (English)
Recent advancements in diffusion bridges for distribution transport problems have heavily relied on matching frameworks, yet existing methods often face a trade-off between scalability and access to optimal pairings during training. Fully unsupervised methods make minimal assumptions but incur high computational costs, limiting their practicality. On the other hand, imposing full supervision of the matching process with optimal pairings improves scalability, however, it can be infeasible in many applications. To strike a balance between scalability and minimal supervision, we introduce Feedback Schrödinger Bridge Matching (FSBM), a novel semi-supervised matching framework that incorporates a small portion (less than 8% of the entire dataset) of pre-aligned pairs as state feedback to guide the transport map of non coupled samples, thereby significantly improving efficiency. This is achieved by formulating a static Entropic Optimal Transport (EOT) problem with an additional term capturing the semi-supervised guidance. The generalized EOT objective is then recast into a dynamic formulation to leverage the scalability of matching frameworks. Extensive experiments demonstrate that FSBM accelerates training and enhances generalization by leveraging coupled pairs guidance, opening new avenues for training matching frameworks with partially aligned datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。