arXiv:2605.01324cs.CV2026-05被引 1

轻量级视频推理模型易依赖数据偏见,该研究提出因果去偏方法提升泛化能力。

Beyond Perceptual Shortcuts: Causal-Inspired Debiasing Optimization for Generalizable Video Reasoning in Lightweight MLLMs

论文配图:Beyond Perceptual Shortcuts: Causal-Inspired Debiasing Optimization for Generalizable Video Reasoning in Lightweight MLLMs
图 1 · 摘自论文原文
  • 通过因果分析发现强化学习会让轻量模型依赖视觉捷径
  • 设计两阶段去偏框架,用反向目标驱使模型远离错误逻辑
  • 在小数据和跨规模对比中均超越现有模型,适合边缘部署

尽管强化学习显著提升了大型多模态语言模型的推理能力,但在适用于边缘部署的轻量级模型中效果受限。我们通过因果分析与实验揭示了感知偏见的深层机制:基于强化学习的微调促使轻量模型优先采用由数据偏见引发的感知捷径,而非发展真正的推理能力。受此启发,我们提出 VideoThinker 框架,通过两阶段去偏过程培养轻量模型的鲁棒推理能力。第一阶段,偏见感知训练构建专用的‘偏见模型’以表征这些捷径行为;第二阶段,采用创新的排斥性目标函数(CDPO)对主模型进行微调,主动将其推离偏见模型的错误逻辑,同时拉向正确且可泛化的解。所提模型 VideoThinker-R1 在视频推理效率上达到新标杆:同规模对比下,无需监督微调、仅使用1份训练数据进行强化学习,即在多个主流基准上平均领先 VideoRFT-3B 3.2%,在 VideoMME 上领先7%;跨规模对比中,优于更大规模的 Video-UTR-7B 模型,在 MVBench 上提升2.1%,在 TempCompass 上提升3.8%。代码已开源于 https://github.com/falonss703/VideoThinker。

原文摘要 · Abstract (English)

Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue, we leverage causal analysis and experiment to reveal the underlying phenomenon of perceptual bias, demonstrating that RL-based fine-tuning compels lightweight models to preferentially adopt perceptual shortcuts induced by data biases, rather than developing genuine reasoning abilities. Motivated by this insight, we propose VideoThinker, a causal-inspired framework that cultivates robust reasoning in lightweight models through a two-stage debiasing process. First, the Bias Aware Training stage forges a dedicated "bias model" to embody these shortcut behaviors. Then, the Causal Debiasing Policy Optimization (CDPO) algorithm fine-tunes the primary model, employing an innovative repulsive objective to actively push it away from the bias model's flawed logic while simultaneously pulling it toward correct, generalizable solutions. Our model, VideoThinker-R1, establishes a new state-of-the-art in video reasoning efficiency. For same-scale comparison, requiring no Supervised Fine-Tuning (SFT) and using only 1 of the training data for RL, it surpasses VideoRFT-3B with a 3.2% average gain on widely-used benchmarks and a 7% lead on VideoMME. For cross-scale comparison, it outperforms the larger Video-UTR-7B model on multiple benchmarks, including a 2.1% gain on MVBench and a 3.8% gain on TempCompass. Code is available at https://github.com/falonss703/VideoThinker.

视频推理轻量模型因果去偏强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。