通过影响引导提升零样本人机协作性能
Beyond Partner Diversity: An Influence-Based Team Steering Framework for Zero-Shot Human-Machine Teaming

- 用影响塑造激励智能体发现多样化高绩效协作模式
- 在三智能体场景下性能超越基线,支持跨团队迁移
- 适合研究零样本协作与人机协同的学者参考
尽管人工智能代理正从孤立工具演变为交互式合作者,但数据驱动的人机协作方法仍依赖大量跨领域、跨队友和跨团队规模的人类交互数据,成本高昂。零样本协调(ZSC)通过模拟多样化伙伴群体来近似未知伙伴的行为,缓解这一瓶颈。然而,仅靠伙伴多样性不足以应对团队规模扩大和通信质量下降的问题。为此,我们提出基于影响引导的团队引导框架(IBTS),利用影响塑造激励智能体发现多样且高性能的团队互动模式,并进一步引导正在进行的协作轨迹向更优的已学协调模式靠拢。我们在Overcooked-AI中测试了双智能体与三智能体场景,验证所学协调结构是否可超越二元交互实现迁移。评估包含模拟伙伴、合成风格变异,以及目前已知首个包含两名真实人类队友与一名机器队友的30名参与者实验。结果表明,IBTS在各项评测中均优于对比基线,凸显了在稀疏奖励环境下,结合稀疏奖励协调机制与伙伴多样性覆盖的规模化零样本协调的重要性。
原文摘要 · Abstract (English)
While AI agents are rapidly advancing from isolated tools to interactive collaborators, data-driven human-machine teaming (HMT) methods remain costly in their reliance on human interaction data across domains, teammates, and team sizes. Zero-shot coordination (ZSC) addresses this bottleneck by simulating diverse partner populations to approximate how unseen partners might behave. However, partner coverage alone is insufficient as team settings scale and communication becomes degraded. To remedy this deficiency, we propose Influence-Based Team Steering (IBTS), a framework that uses influence shaping to incentivize agents to discover diverse, high-performing team interaction patterns and further steers ongoing trajectories toward stronger learned coordination modes. We assess IBTS on Overcooked-AI in both two-agent and three-agent settings, allowing us to test whether learned coordination structure transfers beyond dyadic interaction. Our evaluation includes simulated partners, synthetic partner-style variation, and, to our knowledge, the first 30-subject Overcooked-AI HMT study involving two real human teammates and one machine teammate. Across these evaluations, IBTS improves team performance against competing baselines, highlighting the need for scaled ZSC to combine sparse-reward coordination mechanisms with partner-variation coverage rather than relying on diversity alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。