arXiv:2512.21174cs.CV2025-12

通过特征旋转对齐源与目标域,提升少样本图像生成效果

A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation

  • 在自旋转代理空间中进行可学习的特征旋转,实现双层级对齐
  • 在多个数据集上生成质量显著优于现有方法,尤其在样本极少时表现更优
  • 适合需要快速适配新领域的生成模型应用,如小样本图像合成

少样本图像生成旨在仅用少量训练图像将源生成模型有效适配到目标领域。现有方法通常通过实例级或分布级损失函数施加一致性约束,直接对齐源域与目标域在各自隐空间中的分布模式。然而,这些策略常因约束过强而放大领域差异,导致内容失真或无信息;约束过弱则难以充分利用源域知识。其根本原因在于源域与目标域底层分布结构的固有差异,而目标样本稀缺进一步阻碍了目标分布的准确估计。为此,我们提出等变特征旋转(EFR),一种新型适配策略,在自旋转代理特征空间中从两个互补层面实现源域与目标域的对齐。具体而言,通过参数化李群中的自适应旋转,将源域和目标域特征变换至等变代理空间,并在此空间中进行对齐优化。可学习的旋转矩阵在保留域内结构信息的同时,有效弥合领域差距,促进源域知识向目标域的高效迁移。在多个常用数据集上的全面实验表明,该方法显著提升了目标领域的生成性能。

原文摘要 · Abstract (English)

Few-shot image generation aims to effectively adapt a source generative model to a target domain using very few training images. Most existing approaches introduce consistency constraints-typically through instance-level or distribution-level loss functions-to directly align the distribution patterns of source and target domains within their respective latent spaces. However, these strategies often fall short: overly strict constraints can amplify the negative effects of the domain gap, leading to distorted or uninformative content, while overly relaxed constraints may fail to leverage the source domain effectively. This limitation primarily stems from the inherent discrepancy in the underlying distribution structures of the source and target domains. The scarcity of target samples further compounds this issue by hindering accurate estimation of the target domain's distribution. To overcome these limitations, we propose Equivariant Feature Rotation (EFR), a novel adaptation strategy that aligns source and target domains at two complementary levels within a self-rotated proxy feature space. Specifically, we perform adaptive rotations within a parameterized Lie Group to transform both source and target features into an equivariant proxy space, where alignment is conducted. These learnable rotation matrices serve to bridge the domain gap by preserving intra-domain structural information without distortion, while the alignment optimization facilitates effective knowledge transfer from the source to the target domain. Comprehensive experiments on a variety of commonly used datasets demonstrate that our method significantly enhances the generative performance within the targeted domain.

少样本生成特征对齐生成模型领域适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。