arXiv:2510.03782cs.LG2025-10被引 1

通过融合模型与引导解码,实现更精准的多目标生成控制。

Merge and Guide: Unifying Model Merging and Guided Decoding for Controllable Multi-Objective Generation

  • 先融合多模型构建稳健基础模型,再合并引导信号统一控制。
  • 在多个任务上达到帕累托最优,生成质量与可控性双提升。
  • 适合需要灵活调整生成方向的对话、内容创作等场景。

在测试阶段适应多样用户需求是可控多目标生成的关键挑战。现有方法存在不足:基于融合的方法在参数层面间接控制,难以兼顾多目标影响;基于解码的引导虽更直接,但需聚合多个专家模型的logits,带来显著空间开销且依赖单个模型能力。为此,我们提出两阶段框架MAGE(Merge-And-GuidE),利用模型融合实现引导解码。第一阶段,针对引导与基础模型间的兼容性问题,动态构建更鲁棒的基础模型,融合一系列考虑多目标的骨干模型。第二阶段,将显式与隐式价值模型合并为统一引导代理,指导第一阶段基础模型的解码过程。实证分析验证了价值模型中的线性模式连通性(LMC),探讨了模型融合与预测集成的关系,并展示了所提方法带来的更强可控性。大量实验表明,该方法优于现有方法,在可控性、帕累托最优性能和适应性方面均表现更优。

原文摘要 · Abstract (English)

Adapting to diverse user needs at test time is a key challenge in controllable multi-objective generation. Existing methods are insufficient: merging-based approaches provide indirect, suboptimal control at the parameter level, often disregarding the impacts of multiple objectives. While decoding-based guidance is more direct, it typically requires aggregating logits from multiple expert models, incurring significant space overhead and relying heavily on individual model capacity. To address these issues, we introduce Merge-And-GuidE (MAGE), a two-stage framework that leverages model merging for guided decoding. We first identify a critical compatibility problem between the guidance and base models. In Stage 1, MAGE resolves this by dynamically constructing a more robust base model, merging a series of backbone models that account for multiple objectives. In Stage 2, we merge explicit and implicit value models into a unified guidance proxy, which then steers the decoding of the base model from Stage 1. Our analysis empirically validates Linear Mode Connectivity (LMC) in value models, explores the relationship between model merging and prediction ensembling, and demonstrates the enhanced controllability afforded by our approach. Extensive experiments show that our method outperforms existing approaches, achieving superior controllability, Pareto-optimal performance, and enhanced adaptability.

可控生成模型融合解码引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。