arXiv:2412.15185cs.CV2024-12CVPR被引 12

让扩散模型自动生成无缝拼接的图像瓦片,支持多种复杂拼接场景。

Tiled Diffusion

  • 扩展扩散模型,实现多图像无缝拼接生成
  • 支持自重复到多对多的多种瓦片连接模式
  • 适合数字艺术、游戏开发等需要连续纹理的场景

图像拼贴——将不同图像无缝连接以形成连贯视觉区域——在纹理生成、游戏资产开发和数字艺术等领域至关重要。传统方法依赖人工拼贴,存在可扩展性与灵活性差的问题。近期研究尝试用生成模型自动化该过程,但现有方法主要针对单一图像生成或纹理拼贴,无法原生支持跨多样领域的多图像互联拼贴。本文提出Tiled Diffusion,一种新方法,扩展扩散模型能力,实现多种图像合成领域中一致的拼贴图案生成。该方法支持从自重复到复杂多对多连接的广泛拼贴场景,实现多图无缝融合。Tiled Diffusion自动化拼贴流程,无需人工干预,提升数字艺术、现有图像无缝拼贴及360°合成等应用中的创作潜力。

原文摘要 · Abstract (English)

Image tiling -- the seamless connection of disparate images to create a coherent visual field -- is crucial for applications such as texture creation, video game asset development, and digital art. Traditionally, tiles have been constructed manually, a method that poses significant limitations in scalability and flexibility. Recent research has attempted to automate this process using generative models. However, current approaches primarily focus on tiling textures and manipulating models for single-image generation, without inherently supporting the creation of multiple interconnected tiles across diverse domains. This paper presents Tiled Diffusion, a novel approach that extends the capabilities of diffusion models to accommodate the generation of cohesive tiling patterns across various domains of image synthesis that require tiling. Our method supports a wide range of tiling scenarios, from self-tiling to complex many-to-many connections, enabling seamless integration of multiple images. Tiled Diffusion automates the tiling process, eliminating the need for manual intervention and enhancing creative possibilities in various applications, such as seamlessly tiling of existing images, tiled texture creation, and 360$^\circ$ synthesis.

图像生成扩散模型拼贴生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。