让一张图生成多种情绪一致的风格化改图,突破传统单一映射限制。
EmoAgent: A Multi-Agent Framework for Diverse Affective Image Manipulation
- 用三个协作智能体分阶段完成情绪编辑策略生成、执行与优化
- 在相同目标情绪下生成多幅视觉差异大但情感一致的图像
- 适合需要多样化创意输出的图像设计与情感表达场景
情感图像编辑(AIM)旨在通过修改图像中的视觉元素以引发观者特定情绪反应。然而,现有方法依赖于情绪与视觉线索之间的固定一对一映射,难以应对人类情感感知和表达的主观性与多样性。为此,我们提出全新的多样情感图像编辑(D-AIM)任务,目标是从同一源图像和目标情绪出发,生成多幅视觉上显著不同但情感一致的图像修改结果。我们构建了首个专为D-AIM设计的多智能体框架EmoAgent,其将编辑过程分解为三个由协作智能体完成的阶段:规划智能体生成多样化的编辑策略,编辑智能体精准执行策略,批评智能体通过迭代反馈确保情感准确性。该协同设计使EmoAgent能够建模‘一到多’的情绪-视觉映射关系,实现语义多样且情感忠实的图像修改。大量定量与定性评估表明,EmoAgent在情感保真度和语义多样性方面均显著优于当前最优方法,有效生成多幅传达相同目标情绪的视觉差异图像。
原文摘要 · Abstract (English)
Affective Image Manipulation (AIM) aims to alter visual elements within an image to evoke specific emotional responses from viewers. However, existing AIM approaches rely on rigid \emph{one-to-one} mappings between emotions and visual cues, making them ill-suited for the inherently subjective and diverse ways in which humans perceive and express emotion.To address this, we introduce a novel task setting termed \emph{Diverse AIM (D-AIM)}, aiming to generate multiple visually distinct yet emotionally consistent image edits from a single source image and target emotion. We propose \emph{EmoAgent}, the first multi-agent framework tailored specifically for D-AIM. EmoAgent explicitly decomposes the manipulation process into three specialized phases executed by collaborative agents: a Planning Agent that generates diverse emotional editing strategies, an Editing Agent that precisely executes these strategies, and a Critic Agent that iteratively refines the results to ensure emotional accuracy. This collaborative design empowers EmoAgent to model \emph{one-to-many} emotion-to-visual mappings, enabling semantically diverse and emotionally faithful edits.Extensive quantitative and qualitative evaluations demonstrate that EmoAgent substantially outperforms state-of-the-art approaches in both emotional fidelity and semantic diversity, effectively generating multiple distinct visual edits that convey the same target emotion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。