arXiv:2511.13924cs.CV2025-11被引 2

通过渐进式训练提升视觉定位中的推理能力,解决长文本导致性能下降问题。

Start Small, Think Big: Curriculum-based Relative Policy Optimization for Visual Grounding

  • 按推理长度和gIoU奖励逐步引入难易样本进行训练
  • 在RefCOCO上最高提升12.52 mAP,少样本下仍表现稳定
  • 适合处理模糊复杂描述的视觉定位任务

链式思维(CoT)提示在自然语言和计算机视觉任务中展现出显著潜力,但我们在研究中发现,基于强化学习微调的CoT推理在视觉定位任务中可能因输出过长或复杂反而降低性能。此外,数据集规模增大并不总能提升效果,因数据复杂度差异所致。为此,我们提出基于课程的相对策略优化(CuRPO),利用CoT长度和广义交并比(gIoU)作为复杂度指标,将训练样本从简单到困难逐步排序。在RefCOCO、RefCOCO+、RefCOCOg和LISA数据集上的实验表明,CuRPO持续优于现有方法,包括Visual-RFT,尤其在RefCOCO上实现高达+12.52 mAP的提升。该方法兼具高效性与鲁棒性,在少样本场景下仍能保持优异定位性能,特别适用于描述模糊且复杂的任务。代码已开源于https://github.com/qyoung-yan/CuRPO。

原文摘要 · Abstract (English)

Chain-of-Thought (CoT) prompting has recently shown significant promise across various NLP and computer vision tasks by explicitly generating intermediate reasoning steps. However, we find that reinforcement learning (RL)-based fine-tuned CoT reasoning can paradoxically degrade performance in Visual Grounding tasks, particularly as CoT outputs become lengthy or complex. Additionally, our analysis reveals that increased dataset size does not always enhance performance due to varying data complexities. Motivated by these findings, we propose Curriculum-based Relative Policy Optimization (CuRPO), a novel training strategy that leverages CoT length and generalized Intersection over Union (gIoU) rewards as complexity indicators to progressively structure training data from simpler to more challenging examples. Extensive experiments on RefCOCO, RefCOCO+, RefCOCOg, and LISA datasets demonstrate the effectiveness of our approach. CuRPO consistently outperforms existing methods, including Visual-RFT, with notable improvements of up to +12.52 mAP on RefCOCO. Moreover, CuRPO exhibits exceptional efficiency and robustness, delivering strong localization performance even in few-shot learning scenarios, particularly benefiting tasks characterized by ambiguous and intricate textual descriptions.The code is released on https://github.com/qyoung-yan/CuRPO.

视觉定位强化学习链式思维少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。