arXiv:2512.14757cs.CVcs.RO2025-12被引 6

小模型+专家路由,让机器人更懂社交礼仪地导航

SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuning

  • 用小型视觉语言模型+专家混合架构,兼顾效率与智能
  • 在SNEI数据集上实现高精度导航,推理延迟显著降低
  • 适合资源受限的机器人平台,尤其关注社交行为的部署

在人流量密集环境中,机器人导航的安全性与社交合规性同样重要,但以往研究多聚焦于安全。考虑人类舒适度、社会规范和情境适宜性的社交合规导航仍缺乏深入探索。视觉语言模型(VLM)在此任务中展现潜力,但大型模型带来巨大计算开销,导致推理延迟高、能耗大,难以在资源受限的机器人平台上实时部署。为此,我们提出SocialNav-MoE——一种基于强化微调(RFT)的小型混合专家视觉语言模型,用于社交合规导航。引入语义相似性奖励(SSR),有效提升决策能力。进一步对比了Phi、Qwen、StableLM等小型语言模型,不同路由策略及视觉编码器(CLIP vs. SigLIP,冻结或微调)的效果。在SNEI数据集上的实验表明,SocialNav-MoE在导航准确率与效率间取得优异平衡,且SSR优于硬级别和字符级奖励。代码将在论文接受后公开。

原文摘要 · Abstract (English)

For robots navigating in human-populated environments, safety and social compliance are equally critical, yet prior work has mostly emphasized safety. Socially compliant navigation that accounts for human comfort, social norms, and contextual appropriateness remains underexplored. Vision language models (VLMs) show promise for this task; however, large-scale models incur substantial computational overhead, leading to higher inference latency and energy consumption, which makes them unsuitable for real-time deployment on resource-constrained robotic platforms. To address this issue, we investigate the effectiveness of small VLM and propose SocialNav-MoE, an efficient Mixture-of-Experts vision language model for socially compliant navigation with reinforcement fine-tuning (RFT). We further introduce a semantic similarity reward (SSR) to effectively leverage RFT for enhancing the decision-making capabilities. Additionally, we study the effectiveness of different small language model types (Phi, Qwen, and StableLM), routing strategies, and vision encoders (CLIP vs. SigLIP, frozen vs. fine-tuned). Experiments on the SNEI dataset demonstrate that SocialNav-MoE achieves an excellent balance between navigation accuracy and efficiency. The proposed SSR function is more effective than hard-level and character-level rewards. Source code will be released upon acceptance.

机器人导航视觉语言模型混合专家强化微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。