用带推理的智能体规划,让图像风格编辑更精准。
Agentic Planning with Reasoning for Image Styling via Offline RL
- 用工具链+分步推理分解复杂风格编辑任务
- 在10万级合成数据上训练,视觉质量显著提升
- 适合需要精细控制图像风格的研究者和开发者
直接提示编辑在复杂变换中常失败,因模糊提示难以捕捉图像应如何变化。本文提出一种基于工具的智能体规划框架,通过组合式编辑工具、结构化上下文表示与逐步推理,将复杂风格转换拆解为可解释的操作序列。构建了三套大规模合成数据集(每套约10,000条轨迹),包含推理链、规划路径和质量评分,填补现有数据空白。采用离线强化学习方法进行后训练,显著优于仅靠编辑的基线模型。在40亿与80亿参数的Qwen3-VL模型上评估,多数组合任务表现更优,经人工评测验证效果可靠。
原文摘要 · Abstract (English)
Direct prompt-based editing often fails on complex transformations because vague and subjective prompts often require nuanced understanding of what should be changed in the image. Our core intuition is that leveraging compositional image editing tools rather than direct prompting profits from structured agent-level planning with explicit reasoning, leading to better results. This structured planning framework enables efficient offline RL post-training on quality-scored trajectories to improve performance. We present a tool-based agentic RL post-training framework that addresses this through structured planning with chain-of-thought reasoning. Our key contributions include: (1) A tool-based agentic planning methodology that combines a compositional library of orthogonal primitive transformations, structured context representation, and explicit per-step reasoning to decompose complex styling into interpretable tool sequences. (2) A synthetic data generation pipeline producing three large-scale datasets (each $\sim$10K trajectories) with reasoning chains, plans, and quality scores, as no existing datasets provide such supervision. Our datasets and code are publicly available at the HuggingFace repository. (3) Offline RL training methods for learning planners with reasoning as our core algorithmic contributions, which consistently improve over the Edit-Only baseline in visual quality and instruction following. (4) Comprehensive evaluation across 4B and 8B parameter Qwen3-VL models showing that our methods outperform other baselines in the majority of compositional tasks, validated by human evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。