arXiv:2511.11323cs.AI2025-11

用强化学习融合规则模型,让机器人导航更符合人类社交习惯。

RLSLM: A Hybrid Reinforcement Learning Framework Aligning Rule-Based Social Locomotion Model with Human Social Norms

  • 将心理学规则生成的舒适度场嵌入奖励函数,指导智能体行为。
  • 在虚拟现实中测试显示,用户体验优于现有规则模型。
  • 兼顾可解释性与适应性,适合真实场景的社交导航任务。

在人群环境中导航而不引起不适,是社交感知智能体的关键能力。规则方法虽具可解释性,但泛化能力差;数据驱动方法虽能学习复杂行为,却效率低、不透明且难以契合人类直觉。为此,我们提出RLSLM——一种将基于实证行为实验的规则化社交移动模型嵌入强化学习奖励函数的混合框架。该模型生成方向敏感的社交舒适度场,量化空间中的人类舒适度,使智能体以最少训练实现社会对齐导航。RLSLM联合优化机械能耗与社交舒适度,有效避免侵入个人或群体空间。基于沉浸式VR的人机交互实验表明,该方法在用户体验上超越现有最优规则模型。消融与敏感性分析进一步证明其相比传统数据驱动方法显著提升可解释性。本工作提供了一种可扩展、以人为本的方法,有效融合认知科学与机器学习,适用于真实世界的社交导航。

原文摘要 · Abstract (English)

Navigating human-populated environments without causing discomfort is a critical capability for socially-aware agents. While rule-based approaches offer interpretability through predefined psychological principles, they often lack generalizability and flexibility. Conversely, data-driven methods can learn complex behaviors from large-scale datasets, but are typically inefficient, opaque, and difficult to align with human intuitions. To bridge this gap, we propose RLSLM, a hybrid Reinforcement Learning framework that integrates a rule-based Social Locomotion Model, grounded in empirical behavioral experiments, into the reward function of a reinforcement learning framework. The social locomotion model generates an orientation-sensitive social comfort field that quantifies human comfort across space, enabling socially aligned navigation policies with minimal training. RLSLM then jointly optimizes mechanical energy and social comfort, allowing agents to avoid intrusions into personal or group space. A human-agent interaction experiment using an immersive VR-based setup demonstrates that RLSLM outperforms state-of-the-art rule-based models in user experience. Ablation and sensitivity analyses further show the model's significantly improved interpretability over conventional data-driven methods. This work presents a scalable, human-centered methodology that effectively integrates cognitive science and machine learning for real-world social navigation.

社交导航强化学习规则融合人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。