arXiv:2508.08189cs.CV2025-08综述被引 6

综述视觉强化学习前沿,梳理大模型与智能体的协同演化路径。

Reinforcement Learning for Large Model: A Survey

  • 从RLHF到群体相对优化,系统梳理策略迭代方法
  • 整合200+论文,构建多模态大模型、生成与统一框架四大支柱
  • 聚焦训练效率、对齐性与安全部署,适合研究者快速导航领域

近期视觉智能与强化学习的交叉进展,使智能体不仅能感知复杂视觉场景,还能推理、生成并行动。本综述提供该领域的批判性与最新合成分析。首先形式化视觉强化学习问题,追溯策略优化方法从RLHF到可验证奖励范式,以及从近端策略优化到群体相对策略优化的演进。随后,将200余篇代表性工作归纳为四大主题:多模态大语言模型、视觉生成、统一模型框架、视觉-语言-动作模型。针对每个主题,分析算法设计、奖励工程与基准进展,提炼出课程驱动训练、偏好对齐扩散和统一奖励建模等趋势。最后,回顾涵盖集合级保真度、样本级偏好与状态级稳定的评估协议,并识别出样本效率、泛化能力与安全部署等开放挑战。目标是为研究者与实践者提供视觉强化学习快速扩张领域的清晰地图,突出未来研究方向。资源见:https://github.com/weijiawu/Awesome-Visual-Reinforcement-Learning。

原文摘要 · Abstract (English)

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and up-to-date synthesis of the field. We first formalize visual RL problems and trace the evolution of policy-optimization strategies from RLHF to verifiable reward paradigms, and from Proximal Policy Optimization to Group Relative Policy Optimization. We then organize more than 200 representative works into four thematic pillars: multi-modal large language models, visual generation, unified model frameworks, and vision-language-action models. For each pillar we examine algorithmic design, reward engineering, benchmark progress, and we distill trends such as curriculum-driven training, preference-aligned diffusion, and unified reward modeling. Finally, we review evaluation protocols spanning set-level fidelity, sample-level preference, and state-level stability, and we identify open challenges that include sample efficiency, generalization, and safe deployment. Our goal is to provide researchers and practitioners with a coherent map of the rapidly expanding landscape of visual RL and to highlight promising directions for future inquiry. Resources are available at: https://github.com/weijiawu/Awesome-Visual-Reinforcement-Learning.

强化学习大模型视觉生成综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。