用参考图精准生成带情绪的美术作品,让风格、内容、情感三者统一。
ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation

- 分解文本为视觉维度,按主题、构图、笔触、情绪四维检索参考图。
- 在测试中达到1.00的属性对齐分,整体评分0.78,排名第二。
- 适合需要精确控制艺术情绪与细节的创作者或设计师使用。
情感感知的艺术图像生成要求模型同时满足语义内容、艺术风格和目标情绪。主要挑战在于艺术描述将这些维度混合成模糊的自由文本,难以具体定位笔触、构图和色调氛围等细粒度视觉特征。我们提出 ReART,一种参考引导的检索与精修框架。该方法将测试文本和 EmoArt 数据库中的每张图像标注分解为结构化视觉域,分别在主体、布局、笔触线和色调情绪四个维度进行逐域检索,获取能补充文本无法传达感知细节的角色化视觉参考;这些参考与结构化提示一同用于初始合成。当任意属性对齐得分(AAS)低于阈值时,系统启动 AAS 驱动的精修循环,诊断失败原因,制定包含保留项、修正错误和避免操作的约束修复计划,并按修复目的路由参考,在保持结构的前提下执行受控编辑。本系统在 AffectiveArt 2026 大赛第1赛道中排名第二,取得 1.00 的完美 AAS 和 0.78 的总体得分。代码已开源:https://github.com/oceanflowlab/ReART.git。
原文摘要 · Abstract (English)
Emotion-aware artistic image generation requires a model to satisfy semantic content, artistic style, and target emotion simultaneously. The key challenge is that artistic captions conflate these axes into underspecified free-form text, making fine-grained visual attributes such as brushwork, composition, and tonal atmosphere difficult to ground concretely. We present ReART, a reference-guided retrieval and refinement framework. Our method decomposes test captions and each image annotation in the EmoArt database into structured visual fields, and performs field-wise retrieval over subject, layout, brush-line, and tone-mood dimensions to retrieve role-specific visual references that supply the perceptual detail text alone cannot convey; these references are used alongside a structured prompt for initial synthesis. For samples where any Attribute Alignment Score (AAS) axis falls below threshold, an AAS-driven refinement loop diagnoses failures, constructs constrained repair plans specifying elements to keep, errors to fix, and operations to avoid, routes references by correction purpose, and performs controlled editing under structural preservation constraints. Our system ranks 2nd in Track 1 of the AffectiveArt 2026 Grand Challenge, achieving a perfect AAS of 1.00 and an overall score of 0.78. Code is available at https://github.com/oceanflowlab/ReART.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。