提出首个跨域图像合成框架,实现内容与风格解耦的自然融合。
Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing

- 分两阶段训练:先用对比学习解耦内容与风格,再通过注意力门控注入风格
- 在自建大规模数据集上超越现有方法,提升合成真实感与风格一致性
- 适合需要跨风格图像合成的研究者和设计师使用
图像合成旨在无缝将前景物体融入背景图像中。尽管扩散模型在同域合成(如自然图像)上已取得显著进展,但跨域合成仍面临挑战:需保持前景身份的同时适配背景风格。现有方法多依赖无训练的混合与优化策略,受限于缺乏大规模成对数据集,仅能实现色调级对齐,常导致风格不一致或过度风格化。为此,我们构建了ChameleonDataset——首个大规模跨域合成训练数据集及评估基准,基于可扩展的数据构建流程。在此基础上,提出Chameleon框架:第一阶段采用联合硬对比学习(JHCL)训练编码器,有效解耦风格与内容表征;第二阶段在扩散变换器中引入时空注意力门控(STAG),自适应调节第一阶段编码器生成的风格令牌在空间与时间维度的注入。该方法在合成合理性和风格保真度上均优于现有最优的同域与跨域模型、串行流水线及商用模型。
原文摘要 · Abstract (English)
Image compositing aims to seamlessly insert a foreground object into a background image, and recent advances in diffusion models have significantly enhanced the quality, especially when the foreground and background images come from the same domain (e.g., natural images). However, cross-domain compositing, where the foreground and background come from different domains, is relatively underexplored and remains challenging because the model must preserve the foreground object's identity while stylizing it to match the background domain. Existing cross-domain compositing approaches largely rely on training-free blending and refinement strategies. This is partly due to the lack of large-scale paired datasets for cross-domain compositing, limiting the development of training-based solutions. As a result, they are limited to tone-level alignment and often produce style-inconsistent or overstylized results. To overcome such limitations, we construct ChameleonDataset, the first large-scale training dataset for cross-domain compositing, with a comprehensive evaluation benchmark, built through a scalable data construction pipeline. Building on this, we propose Chameleon, a novel two-stage training-based cross-domain compositing framework. In the first stage, we propose Joint Hard Contrastive Learning (JHCL) to train ChameleonEncoder, which effectively disentangles style and content representations. In the second stage, we introduce Spatio-Temporal Attention Gating (STAG) into a diffusion transformer for effective stylization, adaptively regulating how style tokens from the first-stage encoder are injected across spatial and temporal dimensions. Our method outperforms state-of-the-art in-domain and cross-domain compositing models, sequential pipelines and commercial models, achieving improvements in both compositional plausibility and stylistic fidelity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。