arXiv:2410.04799cs.CVcs.AI2024-10被引 15

用注意力机制+生成对抗网络,让老照片自动上色更真实。

Transforming Color: A Novel Image Colorization Method

  • 引入视觉变压器捕捉图像全局依赖关系
  • 在多个数据集上达到最佳视觉质量指标
  • 适合历史影像修复与数字复原场景

本文提出一种新型图像着色方法,结合颜色变压器与生成对抗网络(GAN),以解决传统方法难以捕捉长距离依赖、着色不真实的问题。该方法采用随机正态分布生成颜色特征,与灰度图像特征融合,增强整体表征能力。实验表明,所提网络显著优于现有先进着色技术,在多个基准数据集上表现优异,具备在数字修复与历史图像分析等领域的应用潜力。

原文摘要 · Abstract (English)

This paper introduces a novel method for image colorization that utilizes a color transformer and generative adversarial networks (GANs) to address the challenge of generating visually appealing colorized images. Conventional approaches often struggle with capturing long-range dependencies and producing realistic colorizations. The proposed method integrates a transformer architecture to capture global information and a GAN framework to improve visual quality. In this study, a color encoder that utilizes a random normal distribution to generate color features is applied. These features are then integrated with grayscale image features to enhance the overall representation of the images. Our method demonstrates superior performance compared with existing approaches by utilizing the capacity of the transformer, which can capture long-range dependencies and generate a realistic colorization of the GAN. Experimental results show that the proposed network significantly outperforms other state-of-the-art colorization techniques, highlighting its potential for image colorization. This research opens new possibilities for precise and visually compelling image colorization in domains such as digital restoration and historical image analysis.

图像着色扩散模型生成对抗网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。