arXiv:2410.03021cs.CVeess.IV2024-10被引 3

用像素重排实现高效图像风格迁移,效果媲美顶尖方法。

PixelShuffler: A Simple Image Translation Through Pixel Rearrangement

  • 通过重排风格图像素最大化与内容图的互信息来实现风格迁移。
  • 在LPIPS和FID指标上达到与主流方法相当的效果。
  • 方法极简高效,适合追求速度与易用性的开发者使用。

图像到图像翻译在计算机视觉中有广泛应用,如医学影像转换、图像着色、超分辨率、域适应及从草图或语义图生成逼真图像。风格迁移是其中重要应用,目标是合成融合一张图内容与另一张图风格的新图像。现有先进方法常依赖复杂神经网络(如扩散模型、语言模型),计算成本高且实现繁琐。本文提出一种新颖的像素重排方法,通过调整风格图像像素位置,使重排后图像与内容图像的互信息最大化,从而实现风格迁移。该方法天然保留风格图像色彩,同时确保内容图像结构细节被完整保留。实验表明,该方法在内容保真度(以LPIPS衡量)和风格相似性(以FID衡量)方面均达到与当前领先技术相当的水平。相比复杂模型,本方法显著降低计算复杂度,为高效图像风格迁移提供了新思路,并展现出在通用图像到图像翻译任务中的潜力。

原文摘要 · Abstract (English)

Image-to-image translation is a topic in computer vision that has a vast range of use cases ranging from medical image translation, such as converting MRI scans to CT scans or to other MRI contrasts, to image colorization, super-resolution, domain adaptation, and generating photorealistic images from sketches or semantic maps. Image style transfer is also a widely researched application of image-to-image translation, where the goal is to synthesize an image that combines the content of one image with the style of another. Existing state-of-the-art methods often rely on complex neural networks, including diffusion models and language models, to achieve high-quality style transfer, but these methods can be computationally expensive and intricate to implement. In this paper, we propose a novel pixel shuffle method that addresses the image-to-image translation problem generally with a specific demonstrative application in style transfer. The proposed method approaches style transfer by shuffling the pixels of the style image such that the mutual information between the shuffled image and the content image is maximized. This approach inherently preserves the colors of the style image while ensuring that the structural details of the content image are retained in the stylized output. We demonstrate that this simple and straightforward method produces results that are comparable to state-of-the-art techniques, as measured by the Learned Perceptual Image Patch Similarity (LPIPS) loss for content preservation and the Fréchet Inception Distance (FID) score for style similarity. Our experiments validate that the proposed pixel shuffle method achieves competitive performance with significantly reduced complexity, offering a promising alternative for efficient image style transfer, as well as a promise in usability of the method in general image-to-image translation tasks.

图像生成风格迁移像素重排轻量级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。