arXiv:2602.15727cs.CVcs.AI2026-02中稿 · ECCV被引 4

用可学习的LoRA基底动态组合,实现灵活的图像类比编辑。

Spanning the Visual Analogy Space with a Weight Basis of LoRAs

  • 构建可学习的LoRA基底,覆盖多样视觉变换空间。
  • 单次推理即生成新图像,性能超越现有方法。
  • 适合需要灵活图像编辑的研究与开发者。

视觉类比学习通过示范而非文字描述实现图像编辑,使用户能指定难以用语言表达的复杂变换。给定三元组{a, a', b},目标是生成b'使得a:a' :: b:b'。现有方法使用单一低秩适配(LoRA)模块,但受限于固定模块难以泛化。受启发于近期研究显示:在受限领域中,LoRA能构成有意义且可插值的语义空间,本文提出LoRWeB,可在单次推理中为每个类比任务动态适配模型。核心包括:(1) 可学习的LoRA基底以覆盖不同视觉变换空间;(2) 轻量编码器根据输入类比对动态加权这些基底。全面评估表明,该方法达到最先进性能,并显著提升对未见变换的泛化能力。结果表明,LoRA基分解是灵活图像操作的有前景方向。

原文摘要 · Abstract (English)

Visual analogy learning enables image editing via demonstration rather than textual description, allowing users to specify complex transformations difficult to articulate in words. Given a triplet $\{\mathbf{a}$, $\mathbf{a}'$, $\mathbf{b}\}$, the goal is to generate $\mathbf{b}'$ such that $\mathbf{a} : \mathbf{a}' :: \mathbf{b} : \mathbf{b}'$. Recent methods adapt text-to-image models with a single Low-Rank Adaptation (LoRA) module, but they face a fundamental limitation: attempting to capture the diverse space of visual transformations within a fixed module constrains generalization. Inspired by recent work showing that LoRAs in constrained domains span meaningful, interpolatable semantic spaces, we propose LoRWeB, which specializes the model for each analogy task in a single inference pass. LoRWeB dynamically composes learned transformation primitives, informally, choosing a point in a "space of LoRAs". We introduce two key components: (1) a learnable basis of LoRAs to span the space of different visual transformations, and (2) a lightweight encoder that dynamically weighs these basis LoRAs given the input analogy pair. Comprehensive evaluations demonstrate state-of-the-art performance and significantly improved generalization to unseen transformations. Our findings suggest LoRA basis decompositions are a promising direction for flexible visual manipulation tasks. See https://research.nvidia.com/labs/par/lorweb for code.

图像编辑LoRA类比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。