arXiv:2604.27375cs.CV2026-04International Conf…

轻量级可微分框架,让AI自动分析并修复照片缺陷。

VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouching

论文配图:VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouching
图 1 · 摘自论文原文
  • 用0.5B视觉语言模型制定修图计划,实现端到端可训练。
  • 在多个基准上表现超越现有方法,参数量极小适合移动端。
  • 自建百万级数据集+强化学习,提升审美判断能力。

推理式照片修图受到广泛关注,需模型分析图像缺陷、生成推理过程并执行精准修复。然而现有方法常依赖不可微分的外部软件,导致优化困难,且参数冗余高、泛化能力差。为此,我们提出VeraRetouch,一个轻量级全可微分多任务修图框架。采用0.5B视觉-语言模型(VLM)作为核心智能体,基于指令与场景语义生成修图方案。同时设计全可微分的修图渲染器,替代外部工具,通过解耦的光照、全局色和特定色彩控制潜变量实现像素级端到端训练。为缓解数据稀缺问题,构建首个百万级专业修图数据集AetherRetouch-1M+,采用新逆退化流程生成。此外提出DAPO-AE强化学习后训练策略,增强自主美学认知。大量实验表明,VeraRetouch在多个基准上达到领先性能,同时保持极小模型体积,支持移动部署。代码与模型已公开于https://github.com/OpenVeraTeam/VeraRetouch。

原文摘要 · Abstract (English)

Reasoning photo retouching has gained significant traction, requiring models to analyze image defects, give reasoning processes, and execute precise retouching enhancements. However, existing approaches often rely on non-differentiable external software, creating optimization barriers and suffering from high parameter redundancy and limited generalization. To address these challenges, we propose VeraRetouch, a lightweight and fully differentiable framework for multi-task photo retouching. We employ a 0.5B Vision-Language Model (VLM) as the central intelligence to formulate retouching plans based on instructions and scene semantics. Furthermore, we develop a fully differentiable Retouch Renderer that replaces external tools, enabling direct end-to-end pixel-level training through decoupled control latents for lighting, global color, and specific color adjustments. To overcome data scarcity, we introduce AetherRetouch-1M+, the first million-scale dataset for professional retouching, constructed via a new inverse degradation workflow. Furthermore, we propose DAPO-AE, a reinforcement learning post-training strategy that enhances autonomous aesthetic cognition. Extensive experiments demonstrate that VeraRetouch achieves state-of-the-art performance across multiple benchmarks while maintaining a significantly smaller footprint, enabling mobile deployment. Our code and models are publicly available at https://github.com/OpenVeraTeam/VeraRetouch.

图像修复可微分视觉语言模型轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。