arXiv:2512.08233cs.RO2025-12

用视觉语言模型学习人类对风险的连续判断,让机器人更安全地模仿人类行为。

Semantic-Metric Bayesian Risk Fields: Learning Robot Safety from Human Videos with a VLM Prior

  • 基于视觉语言模型先验,用贝叶斯框架建模空间可变的风险分布
  • 从人类示范视频中学习,生成像素级风险图,支持新物体和场景泛化
  • 适用于机器人规划与轨迹优化,提升动作的人类一致性

人类对安全的理解并非二元判断,而是依赖上下文和空间位置的连续风险感知。本工作提出一种框架,通过预训练视觉语言模型(VLM)提供先验,结合人类安全示范视频,学习隐含的人类风险模型。采用贝叶斯公式:以VLM生成的特征为先验,通过一个可学习的ViT作为似然函数,输出像素级的风险值。输入为RGB图像与目标物体名称,输出为像素密集型风险图,可用于机器人规划中的价值预测,或投影至3D用于传统轨迹优化,生成类人运动。该方法支持新物体和新场景的泛化,且可快速适应新增观测或常识规则。实验表明,该模型生成的风险评估与人类偏好高度一致,并在多个下游任务中验证有效性。代码与结果见https://riskbayesian.github.io/bayesian_risk/。

原文摘要 · Abstract (English)

Humans interpret safety not as a binary signal but as a continuous, context- and spatially-dependent notion of risk. While risk is subjective, humans form rational mental models that guide action selection in dynamic environments. This work proposes a framework for extracting implicit human risk models by introducing a novel, semantically-conditioned and spatially-varying parametrization of risk, supervised directly from safe human demonstration videos and VLM common sense. Notably, we define risk through a Bayesian formulation. The prior is furnished by a pretrained vision-language model. In order to encourage the risk estimate to be more human aligned, a likelihood function modulates the prior to produce a relative metric of risk. Specifically, the likelihood is a learned ViT that maps pretrained features, to pixel-aligned risk values. Our pipeline ingests RGB images and a query object string, producing pixel-dense risk images. These images that can then be used as value-predictors in robot planning tasks or be projected into 3D for use in conventional trajectory optimization to produce human-like motion. This learned mapping enables generalization to novel objects and contexts, and has the potential to scale to much larger training datasets. In particular, the Bayesian framework that is introduced enables fast adaptation of our model to additional observations or common sense rules. We demonstrate that our proposed framework produces contextual risk that aligns with human preferences. Additionally, we illustrate several downstream applications of the model; as a value learner for visuomotor planners or in conjunction with a classical trajectory optimization algorithm. Our results suggest that our framework is a significant step toward enabling autonomous systems to internalize human-like risk. Code and results can be found at https://riskbayesian.github.io/bayesian_risk/.

机器人安全贝叶斯模型视觉语言模型风险建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。