arXiv:2602.21655cs.CVcs.AI2026-02中稿 · CVPR被引 3

用双奖励强化学习让图像描述更完整准确

CCCaption: Dual-Reward Reinforcement Learning for Complete and Correct Image Captioning

  • 通过拆解图像为多个视觉问题,奖励回答更多问题的描述
  • 通过验证子句真实性,惩罚幻觉内容,提升描述正确性
  • 适合追求高质量图像描述的研究者和开发者

图像描述仍是视觉语言理解的基础任务,但当前仍主要依赖人工标注参考。由于人工标注具有主观性和局限性,真实标签常不完整甚至错误,限制了模型性能。我们提出应从两个客观维度评估描述质量:完整性(是否涵盖所有显著视觉事实)和正确性(描述是否与图像一致)。为此,我们提出CCCaption:一种基于双奖励强化学习的框架,配备专门微调语料库,显式优化这两个属性以生成完整且正确的描述。针对完整性,利用多种视觉语言模型将图像分解为一组视觉查询,奖励回答更多查询的描述,并采用动态查询采样策略提升训练效率。针对正确性,通过验证从描述中分解出的子句查询的真实性,惩罚包含幻觉的内容。对称的双奖励优化联合最大化完整性和正确性,引导模型生成更符合客观标准的描述。在多个标准基准上的实验表明,该方法持续提升性能,为超越人类标注模仿提供了原则性路径。

原文摘要 · Abstract (English)

Image captioning remains a fundamental task for vision language understanding, yet ground-truth supervision still relies predominantly on human-annotated references. Because human annotations reflect subjective preferences and expertise, ground-truth captions are often incomplete or even incorrect, which in turn limits caption models. We argue that caption quality should be assessed by two objective aspects: completeness (does the caption cover all salient visual facts?) and correctness (are the descriptions true with respect to the image?). To this end, we introduce CCCaption: a dual-reward reinforcement learning framework with a dedicated fine-tuning corpus that explicitly optimizes these properties to generate \textbf{C}omplete and \textbf{C}orrect \textbf{Captions}. For completeness, we use diverse LVLMs to disentangle the image into a set of visual queries, and reward captions that answer more of these queries, with a dynamic query sampling strategy to improve training efficiency. For correctness, we penalize captions that contain hallucinations by validating the authenticity of sub-caption queries, which are derived from the caption decomposition. Our symmetric dual-reward optimization jointly maximizes completeness and correctness, guiding models toward captions that better satisfy these objective criteria. Extensive experiments across standard captioning benchmarks show consistent improvements, offering a principled path to training caption models beyond human-annotation imitation.

图像描述强化学习双奖励幻觉检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。