根据内容自适应调整颜色,让照片更自然地匹配用户风格偏好。
Content-Adaptive Image Retouching Guided by Attribute-Based Text Representation
- 用基础曲线和权重图实现内容感知的颜色映射
- 支持不同区域同色不同调,适配复杂色彩分布
- 通过文本描述风格,让非专业人士也能精准调色
图像修饰因能生成高质量视觉内容而受到广泛关注。现有方法多依赖全图统一的像素级色彩映射,忽略了图像内容引发的固有色彩差异,限制了对多样色彩分布和用户定义风格偏好的自适应处理能力。为此,我们提出一种基于属性文本表示的内容自适应图像修饰方法(CA-ATP)。具体而言,设计了一个内容自适应曲线映射模块,利用一组基线曲线建立多重色彩映射关系,并学习相应的权重图,实现内容感知的色彩调整。该模块可捕捉图像内容中的色彩多样性,使相同颜色值在不同空间上下文中获得不同变换。此外,提出一个属性文本预测模块,从多个图像属性生成文本表示,明确表达用户风格偏好。这些基于属性的文本表示随后通过多模态模型与视觉特征融合,为图像修饰提供友好引导。在多个公开数据集上的大量实验表明,该方法达到当前最优性能。
原文摘要 · Abstract (English)
Image retouching has received significant attention due to its ability to achieve high-quality visual content. Existing approaches mainly rely on uniform pixel-wise color mapping across entire images, neglecting the inherent color variations induced by image content. This limitation hinders existing approaches from achieving adaptive retouching that accommodates both diverse color distributions and user-defined style preferences. To address these challenges, we propose a novel Content-Adaptive image retouching method guided by Attribute-based Text Representation (CA-ATP). Specifically, we propose a content-adaptive curve mapping module, which leverages a series of basis curves to establish multiple color mapping relationships and learns the corresponding weight maps, enabling content-aware color adjustments. The proposed module can capture color diversity within the image content, allowing similar color values to receive distinct transformations based on their spatial context. In addition, we propose an attribute text prediction module that generates text representations from multiple image attributes, which explicitly represent user-defined style preferences. These attribute-based text representations are subsequently integrated with visual features via a multimodal model, providing user-friendly guidance for image retouching. Extensive experiments on several public datasets demonstrate that our method achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。