用智能选择方法让小模型学会大模型的社交导航能力。
SOPD-SocialNav: Selective On-Policy Distillation for Vision-Language Social Navigation

- 根据教师模型不确定度挑选关键决策令牌进行知识迁移。
- 在两个基准上表现优于监督微调和传统蒸馏方法。
- 适合资源受限机器人实现有社交意识的自主导航。
视觉语言模型凭借对复杂环境和人类行为的丰富语义理解,在社交机器人导航中展现出巨大潜力。然而,大规模视觉语言模型难以部署在资源受限的机器人平台上,而轻量级模型又往往缺乏足够的社交推理能力。为解决此问题,我们提出SOPD-SocialNav,一种基于选择性在线策略蒸馏(SOPD)的方法,将大型教师模型中的社交导航知识迁移到轻量级学生模型。SOPD引入基于熵的令牌选择机制,利用教师模型的不确定性识别具有社会意义的决策令牌,同时抑制低熵令牌(对应平凡导航状态)的梯度。随后,采用温度控制的Jensen-Shannon散度目标函数,对选定令牌上的学生与教师分布进行对齐。在SNEI和MUSON基准上的实验表明,SOPD在动作预测、感知一致性及推理一致性方面均持续优于监督微调、离线蒸馏和标准在线蒸馏基线。真实机器人平台(Scout Mini)上的部署进一步验证了蒸馏模型在对话和排队场景下能生成更符合社交规范的导航行为。结果表明,SOPD是构建轻量但具备社交意识的视觉语言模型导航系统的一种有效策略。
原文摘要 · Abstract (English)
Vision-language models have shown strong potential for social robot navigation by leveraging rich semantic understanding of complex environments and human behaviors. However, large scale VLMs are difficult to deploy on resource-constrained robotic platforms, while lightweight VLMs often lack sufficient social reasoning capability. To address this problem, we propose SOPD-SocialNav, a selective on-policy distillation (SOPD) method that transfers social navigation knowledge from a large teacher VLM to a lightweight student VLM. SOPD introduces an entropy-based token selection mechanism that uses teacher uncertainty to identify socially informative decision tokens, while suppressing gradients from low-entropy tokens corresponding to trivial navigation states. A temperature-controlled Jensen-Shannon divergence objective is then used to align the student and teacher distributions on the selected tokens. Experiments on the SNEI and MUSON benchmarks demonstrate that SOPD consistently outperforms supervised fine-tuning, off-policy distillation, and standard on-policy distillation baselines in action prediction, perception consistency, and reasoning consistency. Real-world deployment on a Scout Mini robot further shows that the distilled model can generate more socially appropriate navigation behaviors in conversational and queuing scenarios. These results suggest that SOPD is an effective strategy for building lightweight yet socially aware VLM-based navigation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。