通过颜色映射实现扩散模型中连续可控的色彩编辑
Controllable-Continuous Color Editing in Diffusion Model via Color Mapping
- 构建颜色映射模块，建立文本嵌入与图像RGB的显式对应关系
- 支持指定目标RGB范围，生成范围内连续变化的色彩图像
- 适合需要精细色彩控制的图像编辑场景
近年来，基于文本的图像编辑取得显著进展。然而，由于自然语言固有的模糊性和离散性，色彩编辑仍面临精度不足和难以实现连续控制的问题。尽管线性插值不同文本描述的嵌入向量可生成颜色渐变的图像序列，但该方法无法精确控制输出图像的颜色变化范围，且插值系数与实际颜色变化的关系未知且不可控。为此，我们引入一个颜色映射模块，显式建模文本嵌入空间与图像RGB值之间的对应关系。该模块可根据给定的RGB值预测对应的嵌入向量，从而在保持语义一致性的同时实现对生成图像的精准色彩控制。用户可指定目标RGB范围，生成该范围内连续变化的图像，实现更细粒度、连续且可控的色彩编辑。实验结果表明，该方法在色彩连续性和可控性方面表现良好。
原文摘要 · Abstract (English)
In recent years, text-driven image editing has made significant progress. However, due to the inherent ambiguity and discreteness of natural language, color editing still faces challenges such as insufficient precision and difficulty in achieving continuous control. Although linearly interpolating the embedding vectors of different textual descriptions can guide the model to generate a sequence of images with varying colors, this approach lacks precise control over the range of color changes in the output images. Moreover, the relationship between the interpolation coefficient and the resulting image color is unknown and uncontrollable. To address these issues, we introduce a color mapping module that explicitly models the correspondence between the text embedding space and image RGB values. This module predicts the corresponding embedding vector based on a given RGB value, enabling precise color control of the generated images while maintaining semantic consistency. Users can specify a target RGB range to generate images with continuous color variations within the desired range, thereby achieving finer-grained, continuous, and controllable color editing. Experimental results demonstrate that our method performs well in terms of color continuity and controllability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。