用贝叶斯方法推断多智能体博弈中未知目标,提升决策安全性。
Bayesian Inverse Games with High-Dimensional Multi-Modal Observations
- 基于变分自编码器与可微纳什求解器,实现贝叶斯逆博弈推断。
- 相比最大似然法,后验分布更准确,降低下游决策风险。
- 支持多模态观测,轨迹缺失时仍能减少不确定性,适合自动驾驶等场景。
许多多智能体交互场景可自然建模为非合作博弈,其中每个智能体的决策依赖于其他智能体的未来行动。然而,部署博弈论规划器需明确所有智能体的目标函数。为克服这一难题,现有方法采用最大似然技术从交互数据中推断未知目标。但这些方法仅提供点估计,无法量化估计不确定性,导致下游规划可能过度自信地采取危险动作。本文提出一种近似贝叶斯推断框架解决逆博弈问题,可融合多模态观测数据,并在有限传感器观测下实时生成隐藏目标函数的后验样本。具体而言,该框架在交互数据集上训练带有可微纳什求解器的结构化变分自编码器,无需真实目标标签。大量实验表明,该方法成功学习先验与后验分布,在推断质量上优于基于最大似然的逆博弈方法,并在不牺牲效率的前提下实现更安全的下游决策。当轨迹信息不充分或不可用时,多模态推断通过利用额外观测模态进一步降低不确定性。
原文摘要 · Abstract (English)
Many multi-agent interaction scenarios can be naturally modeled as noncooperative games, where each agent's decisions depend on others' future actions. However, deploying game-theoretic planners for autonomous decision-making requires a specification of all agents' objectives. To circumvent this practical difficulty, recent work develops maximum likelihood techniques for solving inverse games that can identify unknown agent objectives from interaction data. Unfortunately, these methods only infer point estimates and do not quantify estimator uncertainty; correspondingly, downstream planning decisions can overconfidently commit to unsafe actions. We present an approximate Bayesian inference approach for solving the inverse game problem, which can incorporate observation data from multiple modalities and be used to generate samples from the Bayesian posterior over the hidden agent objectives given limited sensor observations in real time. Concretely, the proposed Bayesian inverse game framework trains a structured variational autoencoder with an embedded differentiable Nash game solver on interaction datasets and does not require labels of agents' true objectives. Extensive experiments show that our framework successfully learns prior and posterior distributions, improves inference quality over maximum likelihood estimation-based inverse game approaches, and enables safer downstream decision-making without sacrificing efficiency. When trajectory information is uninformative or unavailable, multimodal inference further reduces uncertainty by exploiting additional observation modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。