arXiv:2602.18990cs.CV2026-02被引 1

用强化学习动态选模型,视频人物识别更省算力还更准

IDSelect: A RL-Based Cost-Aware Selection Agent for Video-based Multi-Modal Person Recognition

  • 基于强化学习的轻量选择器,按视频内容动态选最优模型
  • 在CCVID上少92.4%计算量,准确率还高1.8个百分点
  • 适合追求高效推理的视频识别系统部署

基于视频的人体识别通过融合人脸、躯干和步态信息实现鲁棒识别。然而,现有系统无论输入复杂度如何,均固定使用重型集成模型处理所有模态,造成计算资源浪费。为此,我们提出IDSelect——一种基于强化学习的成本感知选择器,可为每段视频的每个模态选择一个预训练模型,以优化准确率与效率的权衡。核心思想是:输入条件化的选择器能发现互补的模型组合,超越固定集成模型,同时显著降低资源消耗。IDSelect采用带预算感知优化的演员-评论家强化学习框架进行端到端训练,奖励函数平衡识别准确率与计算成本,熵正则化防止过早收敛。推理时,策略基于概率选择各模态最优模型,并融合模态特定相似度生成最终得分。在多个挑战性视频数据集上的实验表明,IDSelect具有显著优越性:在CCVID上,实现95.9%的Rank-1准确率,计算量比强基线减少92.4%,准确率提升1.8%;在MEVID上,计算量降低41.3%,性能保持竞争力。

原文摘要 · Abstract (English)

Video-based person recognition achieves robust identification by integrating face, body, and gait. However, current systems waste computational resources by processing all modalities with fixed heavyweight ensembles regardless of input complexity. To address these limitations, we propose IDSelect, a reinforcement learning-based cost-aware selector that chooses one pre-trained model per modality per-sequence to optimize the accuracy-efficiency trade-off. Our key insight is that an input-conditioned selector can discover complementary model choices that surpass fixed ensembles while using substantially fewer resources. IDSelect trains a lightweight agent end-to-end using actor-critic reinforcement learning with budget-aware optimization. The reward balances recognition accuracy with computational cost, while entropy regularization prevents premature convergence. At inference, the policy selects the most probable model per modality and fuses modality-specific similarities for the final score. Extensive experiments on challenging video-based datasets demonstrate IDSelect's superior efficiency: on CCVID, it achieves 95.9% Rank-1 accuracy with 92.4% less computation than strong baselines while improving accuracy by 1.8%; on MEVID, it reduces computation by 41.3% while maintaining competitive performance.

视频识别强化学习多模态高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。