让图像风格主动传递情绪,实现情感化艺术创作。
EmoStyle: Emotion-Driven Image Stylization
- 构建情绪-内容-风格三元组数据集,支持情感化风格迁移。
- 提出情绪感知的风格查询机制,提升情感表达一致性。
- 可迁移到其他生成任务,适合创意设计与AI艺术领域。
艺术长久以来是情感表达的重要媒介。现有图像风格化方法虽能有效改变视觉外观,却常忽略风格所承载的情感影响。为此,我们提出情感驱动的图像风格化(Affective Image Stylization, AIS)任务,旨在通过艺术风格激发特定情绪并保持内容一致。我们提出EmoStyle框架,解决AIS中的核心挑战:缺乏训练数据与情绪-风格映射关系。首先,基于ArtEmis构建了包含内容-情绪-风格的三元组数据集EmoStyleSet;其次,提出情绪-内容推理器,将情绪线索与内容信息融合以生成连贯的风格查询;针对艺术风格的离散特性,进一步设计风格量化器,将连续风格特征映射为与情绪相关的代码本条目。大量定性和定量评估(包括用户研究)表明,EmoStyle在保持内容一致性的同时显著增强情感表现力。此外,学习到的情绪感知风格词典可适配至其他生成任务,展现广阔应用潜力。本工作为情感驱动的图像风格化奠定基础,拓展了AI生成艺术的创作可能。
原文摘要 · Abstract (English)
Art has long been a profound medium for expressing emotions. While existing image stylization methods effectively transform visual appearance, they often overlook the emotional impact carried by styles. To bridge this gap, we introduce Affective Image Stylization (AIS), a task that applies artistic styles to evoke specific emotions while preserving content. We present EmoStyle, a framework designed to address key challenges in AIS, including the lack of training data and the emotion-style mapping. First, we construct EmoStyleSet, a content-emotion-stylized image triplet dataset derived from ArtEmis to support AIS. We then propose an Emotion-Content Reasoner that adaptively integrates emotional cues with content to learn coherent style queries. Given the discrete nature of artistic styles, we further develop a Style Quantizer that converts continuous style features into emotion-related codebook entries. Extensive qualitative and quantitative evaluations, including user studies, demonstrate that EmoStyle enhances emotional expressiveness while maintaining content consistency. Moreover, the learned emotion-aware style dictionary is adaptable to other generative tasks, highlighting its potential for broader applications. Our work establishes a foundation for emotion-driven image stylization, expanding the creative potential of AI-generated art.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。