arXiv:2503.06186cs.CV2025-03CVPR被引 9

无需训练即可生成隐藏图像的视觉错觉艺术,让参考图在文本场景中悄然显现。

PTDiffusion: Free Lunch for Generating Optical Illusion Hidden Pictures with Phase-Transferred Diffusion Model

  • 通过相位迁移机制,将参考图结构信息融合进文本描述的场景中。
  • 生成图像在语义一致性、视觉隐蔽性和上下文自然性上均优于现有方法。
  • 无需训练,适合艺术创作与视觉设计领域的快速创意实现。

视觉错觉隐藏图像是一个有趣的视知觉现象:一张图像被巧妙地嵌入另一张图像中,对观察者不立即显而易见。基于现成的文本到图像(T2I)扩散模型,我们提出一种全新的、无需训练的文本引导图像到图像(I2I)转换框架——相位转移扩散模型(PTDiffusion),用于生成隐藏艺术图像。PTDiffusion能将输入的参考图像和谐地嵌入任意文本提示描述的场景中,生成具有参考图像隐藏视觉线索的错觉图像。其核心是即插即用的相位迁移机制,动态且逐步地将去噪过程中参考图像的相位谱转移到生成图像的潜空间中,实现参考图像结构信息与文本语义信息在扩散模型潜空间中的深度融合。此外,我们提出异步相位迁移策略,以灵活控制隐藏内容的可辨识程度。该方法无需任何模型训练或微调,在图像生成质量、文本保真度、视觉可辨识性和上下文自然性方面显著优于相关文本引导的I2I方法,实验结果在定性和定量层面均得到验证。项目已公开于 https://xianggao1102.github.io/PTDiffusion_webpage/。

原文摘要 · Abstract (English)

Optical illusion hidden picture is an interesting visual perceptual phenomenon where an image is cleverly integrated into another picture in a way that is not immediately obvious to the viewer. Established on the off-the-shelf text-to-image (T2I) diffusion model, we propose a novel training-free text-guided image-to-image (I2I) translation framework dubbed as \textbf{P}hase-\textbf{T}ransferred \textbf{Diffusion} Model (PTDiffusion) for hidden art syntheses. PTDiffusion harmoniously embeds an input reference image into arbitrary scenes described by the text prompts, producing illusion images exhibiting hidden visual cues of the reference image. At the heart of our method is a plug-and-play phase transfer mechanism that dynamically and progressively transplants diffusion features' phase spectrum from the denoising process to reconstruct the reference image into the one to sample the generated illusion image, realizing deep fusion of the reference structural information and the textual semantic information in the diffusion model latent space. Furthermore, we propose asynchronous phase transfer to enable flexible control to the degree of hidden content discernability. Our method bypasses any model training and fine-tuning process, all while substantially outperforming related text-guided I2I methods in image generation quality, text fidelity, visual discernibility, and contextual naturalness for illusion picture synthesis, as demonstrated by extensive qualitative and quantitative experiments. Our project is publically available at \href{https://xianggao1102.github.io/PTDiffusion_webpage/}{this web page}.

视觉错觉扩散模型图像生成隐写艺术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。