arXiv:2607.10165cs.CVcs.AI2026-07

让图像生成同时匹配风格、情绪和提示,靠推理预测情感并精准控制细节。

EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation

论文配图:EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation
图 1 · 摘自论文原文
  • 用大模型推断情绪特征,生成可注入的条件向量,直接调控中间特征。
  • 为每种艺术风格训练专用专家,实现情感表达与风格的精准匹配。
  • 适合需要情绪化艺术创作的设计师或生成式内容创作者。

情绪感知的艺术图像生成需使图像同时符合输入提示、指定艺术风格并传达目标情绪。其难点在于测试时无法获取训练中使用的视觉与情感属性。为此,我们提出 EmoStyle,一种基于 Z-Image 的框架,将输入提示转化为结构化生成状态。首先由大语言模型推理出情感线索(效价-唤醒度、主导情绪、治疗效果标签)及长宽比决策;不简单拼接为文本,而是将情感字段编码为条件向量,通过类似 AdaLN 的方式注入去噪模块,使推断出的控制变量直接指导中间特征生成。由于情感表达依赖风格,我们为每个艺术风格桶训练专属 LoRA 适配器,并在推理时选择对应专家,实现颜色、纹理、笔触、构图等风格化先验的针对性渲染。最后,通过轻量级 VLM 引导的候选筛选步骤,依据提示对齐度、风格一致性、情绪表达和视觉质量对生成图像排序。在 AffectiveArt Challenge 2026 Track 1 中,本团队提交方案获第一名。

原文摘要 · Abstract (English)

Emotion-aware artistic image generation requires an image to match the input prompt, follow the specified artistic style, and convey the target emotion. In this challenge, the main difficulty is that the visual and affective attributes available in the training data are not explicitly provided at test time. Without these attributes, the generator has to decide not only what to depict, but also how the target emotion should be expressed through color, lighting, brushwork, composition, line, and layout. This creates a control gap between the available test prompt and the fine-grained conditions needed for emotion-aware artistic generation. To bridge this gap, we propose EmoStyle, a Z-Image-based framework that converts the input prompt into a structured generation state. An LLM reasoner first predicts affective cues (valence-arousal, dominant emotion, and therapeutic-effect labels) and an aspect-ratio decision. Instead of using these predictions only as additional prompt text, we encode the affective fields into an affective condition vector and inject it into the denoising blocks through AdaLN-style modulation. This allows the inferred control variables to directly guide the generation of intermediate features. Since emotional expression is also style-dependent, we further train a dedicated LoRA adapter for each artistic style bucket and select the corresponding expert during inference, enabling the same affective cues to be rendered with bucket-specific priors for color, texture, brushwork, and composition. Finally, a lightweight VLM-guided candidate selection step ranks the generated images based on prompt alignment, style consistency, emotional expression, and visual quality. In Track 1 of the AffectiveArt Challenge 2026, our USTC\_PI\_LAB\_TEAM submission achieved first place.

图像生成情绪控制风格迁移LoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。