测试智能体在日常任务中是否能主动遵守隐性社会规范。
NormAct: Benchmarking Embodied Agents' Proactive Compliance with Unspoken Social Norms

- 设计550个场景,同一目标可合规或违规完成。
- 无提示时合规率仅24.7%,提示后显著提升至67.4%。
- 视觉线索比通用规范知识更关键,适合评估智能体社会适应性。
基于多模态大语言模型的具身智能体虽能从视觉观察中完成日常任务,但目标达成并不反映其是否主动遵守未明说的社会规范。现有基准多评测显式规范判断或受限行为,极少测试智能体在普通任务中推断并应用情境相关规范的能力。我们提出NormAct,包含550个TongSim场景,相同目标下存在合规与违规的动作序列。规范相关证据嵌入场景,但规则不包含在任务指令中。通过逐步增加规范引导而固定目标和场景,测试合规行为是自主产生还是仅在提示后出现。在三个MLLM规划器上,无引导时目标达成率远高于合规率(67.4% vs 24.7%),且通用与特定规则引导均提升合规性,表明规划器在提示下可合规但难以自发实现。固定规划器下,通用规范检索效果不如场景描述或生成的规范提示,说明识别视觉证据比获取通用规范知识更具挑战。因此,NormAct有助于推动具身智能体在追求日常目标时主动遵守隐性社会规范。
原文摘要 · Abstract (English)
Embodied agents driven by multimodal large language models (MLLMs) can often complete everyday tasks from visual observations, but goal achievement does not establish whether they proactively respect unstated social norms. Existing benchmarks assess explicit norm judgments or constrained behavior, but rarely test whether agents infer and apply scene-relevant norms during ordinary tasks. We introduce NormAct, a benchmark of 550 TongSim scenarios in which the same goal permits norm-compliant or norm-violating action sequences. Norm-relevant evidence is embedded in each scenario while the applicable rule is omitted from the goal instruction. By progressively increasing normative guidance while holding the goal and scene fixed, NormAct tests whether compliant behavior emerges autonomously or only after prompting. Across three MLLM planners, goal achievement substantially exceeds norm compliance without guidance (67.4% versus 24.7%), while both broad and rule-specific guidance improve compliance, indicating that planners can often comply when prompted but not reliably on their own. With a fixed planner, general-norm retrieval is less effective than norm-relevant scene descriptions or generated norm cues, suggesting that identifying relevant visual evidence is a greater challenge than accessing general norm knowledge. NormAct therefore supports the development of embodied agents that pursue everyday goals while proactively respecting unstated social norms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。