arXiv:2603.19779cs.CV2026-03被引 1

统一图像质量与美学评估,按任务特性定制推理与奖励机制。

One Model, Two Minds: Task-Conditioned Reasoning for Unified Image Quality and Aesthetic Assessment

  • 根据任务差异设计不同推理路径:质量评估用简洁感知推理,美学评估用深度语义叙事。
  • 在8个基准上优于现有统一模型,在跨域设置下仍保持竞争力。
  • 适合需要高效统一评估的多任务视觉理解场景,如内容审核与推荐系统。

将图像质量评估(IQA)与图像美学评估(IAA)统一到一个双模态大语言模型中具有吸引力,但现有方法采用无任务区分的策略,对两类任务使用相同的推理方式和奖励机制。本文指出这存在根本性错配:IQA依赖低层客观感知线索,宜用聚焦失真的简洁推理;而IAA需要深层语义判断,点对点分数回归效果差。我们通过受控探针实证了推理错配与优化错配。为此提出TATAR(任务感知思维与非对称奖励),共享视觉-语言主干网络,但在后训练阶段根据任务特性进行条件化设计。TATAR包含三部分:快-慢任务特异性推理结构(分别对应简洁感知理由与审美叙事);两阶段SFT+GRPO学习(先建立任务感知行为先验,再通过奖励优化);非对称奖励机制(IQA使用高斯分数塑形,IAA采用Thurstone风格完成排序)。在八个基准上的实验表明,TATAR在领域内与跨领域设置下均持续优于现有统一基线,性能接近专用模型,且美学评估训练更稳定。结果确立任务条件化后训练为统一感知评分的合理范式。代码已开源。

原文摘要 · Abstract (English)

Unifying Image Quality Assessment (IQA) and Image Aesthetic Assessment (IAA) in a single multimodal large language model is appealing, yet existing methods adopt a task-agnostic recipe that applies the same reasoning strategy and reward to both tasks. We show this is fundamentally misaligned: IQA relies on low-level, objective perceptual cues and benefits from concise distortion-focused reasoning, whereas IAA requires deliberative semantic judgment and is poorly served by point-wise score regression. We identify these as a reasoning mismatch and an optimization mismatch, and provide empirical evidence for both through controlled probes. Motivated by these findings, we propose TATAR (Task-Aware Thinking with Asymmetric Rewards), a unified framework that shares the visual-language backbone while conditioning post-training on each task's nature. TATAR combines three components: fast--slow task-specific reasoning construction that pairs IQA with concise perceptual rationales and IAA with deliberative aesthetic narratives; two-stage SFT+GRPO learning that establishes task-aware behavioral priors before reward-driven refinement; and asymmetric rewards that apply Gaussian score shaping for IQA and Thurstone-style completion ranking for IAA. Extensive experiments across eight benchmarks demonstrate that TATAR consistently outperforms prior unified baselines on both tasks under in-domain and cross-domain settings, remains competitive with task-specific specialized models, and yields more stable training dynamics for aesthetic assessment. Our results establish task-conditioned post-training as a principled paradigm for unified perceptual scoring. Our code is publicly available at https://github.com/yinwen2019/TATAR.

图像评估多任务学习大模型推理机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。