arXiv:2605.07177cs.LGcs.AI2026-05被引 9

让多模态搜索并行执行,减少冗余调用,提升效率与准确率。

HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents

论文配图:HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents
图 1 · 摘自论文原文
  • 将视觉定位与检索合并为原子动作,实现多实体并发搜索。
  • 在六项基准上准确率高出9.9%,工具调用轮次减少5.3倍。
  • 专为效率设计的双粒度强化学习,适合高要求多模态应用。

现有多模态搜索代理按顺序处理目标实体,每实体调用一次工具,当查询可分解为独立子检索时会产生冗余交互轮次。我们主张高效多模态代理应更广而非更长:在一轮内并行发起多个有依据的查询。为此,我们提出 HyperEyes,一个并行多模态搜索代理,将视觉定位与检索融合为单一原子动作,支持跨多个实体的并发搜索,同时将推理效率作为首要训练目标。HyperEyes 采用两阶段训练:冷启动阶段,我们构建了适用于并行的合成数据流水线,覆盖视觉多实体与文本多约束查询,通过渐进式拒绝采样生成注重效率的轨迹;核心贡献是双粒度效率感知强化学习框架。宏观层面,提出 TRACE(工具使用参考自适应成本效率)轨迹级奖励,其参考值在训练中单调收紧,抑制多余工具调用而不限制真实的多跳搜索;微观层面,采用在线策略蒸馏,从外部教师模型获取失败回溯中的密集词元级修正信号,缓解稀疏结果奖励带来的信用分配缺陷。由于现有基准仅以准确率为评估指标,忽略推理成本,我们引入 IMEB,一个包含300个实例的人工标注基准,联合评估搜索能力与效率。在六个基准上,HyperEyes-30B 相比最强开源代理准确率提升9.9%,平均工具调用轮次减少5.3倍。

原文摘要 · Abstract (English)

Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective multimodal agents should search wider rather than longer: dispatching multiple grounded queries concurrently within a round. To this end, we present HyperEyes, a parallel multimodal search agent that fuses visual grounding and retrieval into a single atomic action, enabling concurrent search across multiple entities while treating inference efficiency as a first-class training objective. HyperEyes is trained in two stages. For cold-start supervision, we develop a Parallel-Amenable Data Synthesis Pipeline covering visual multi-entity and textual multi-constraint queries, curating efficiency-oriented trajectories via Progressive Rejection Sampling. Building on this, our central contribution, a Dual-Grained Efficiency-Aware Reinforcement Learning framework, operates at two levels. At the macro level, we propose TRACE (Tool-use Reference-Adaptive Cost Efficiency), a trajectory-level reward whose reference is monotonically tightened during training to suppress superfluous tool calls without restricting genuine multi-hop search. At the micro level, we adapt On-Policy Distillation to inject dense token-level corrective signals from an external teacher on failed rollouts, mitigating the credit-assignment deficiency of sparse outcome rewards. Since existing benchmarks evaluate accuracy as the sole metric, omitting inference cost, we introduce IMEB, a human-curated benchmark of 300 instances that jointly evaluates search capability and efficiency. Across six benchmarks, HyperEyes-30B surpasses the strongest comparable open-source agent by 9.9% in accuracy with 5.3x fewer tool-call rounds on average.

多模态搜索并行推理强化学习效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。