arXiv:2512.18930cs.CVcs.AI2025-12

用稀疏自编码器实现无需微调的可解释风格迁移。

LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer

  • 在生成模型隐空间上训练艺术专用稀疏自编码器,提取风格与构图概念。
  • 仅需少量参考图即可生成风格向量,速度比现有方法快1.7至20倍。
  • 风格可分解、可解释,适合需要可控风格生成的研究者使用。

生成式模型中的艺术风格迁移仍具挑战性,现有方法通常依赖模型微调、额外适配器或提示工程,计算开销大且易将风格与内容纠缠。本文提出一种轻量级、可解释的风格表示与迁移方法——LouvreSAE。该方法在生成图像模型的隐空间上构建艺术专用稀疏自编码器(SAE),基于艺术数据训练后,学习到一组大致解耦的风格与构图概念,涵盖笔触、纹理、色彩等风格元素及语义结构。我们利用此SAE构建风格档案:紧凑、可分解的控制向量,实现无需任何模型更新或优化的风格迁移。与以往基于概念的方法不同,本方法无需微调、无LoRA训练、无额外推理步骤,仅凭少量参考图即可直接操控艺术风格。在ArtBench10上验证,风格评估指标(VGG Style Loss、CLIP Score Style)达到或超过现有方法,同时提速1.7-20倍,且具备可解释性。

原文摘要 · Abstract (English)

Artistic style transfer in generative models remains a significant challenge, as existing methods often introduce style only via model fine-tuning, additional adapters, or prompt engineering, all of which can be computationally expensive and may still entangle style with subject matter. In this paper, we introduce a training- and inference-light, interpretable method for representing and transferring artistic style. Our approach leverages an art-specific Sparse Autoencoder (SAE) on top of latent embeddings of generative image models. Trained on artistic data, our SAE learns an emergent, largely disentangled set of stylistic and compositional concepts, corresponding to style-related elements pertaining brushwork, texture, and color palette, as well as semantic and structural concepts. We call it LouvreSAE and use it to construct style profiles: compact, decomposable steering vectors that enable style transfer without any model updates or optimization. Unlike prior concept-based style transfer methods, our method requires no fine-tuning, no LoRA training, and no additional inference passes, enabling direct steering of artistic styles from only a few reference images. We validate our method on ArtBench10, achieving or surpassing existing methods on style evaluations (VGG Style Loss and CLIP Score Style) while being 1.7-20x faster and, critically, interpretable.

风格迁移稀疏自编码器可解释性生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。