arXiv:2602.14048cs.ROcs.CV2026-02被引 1

让机器人提前预判社交意图,实现自然流畅的主动互动。

ProAct: A Dual-System Framework for Proactive Embodied Social Agents

  • 双系统架构:快速反应模块与慢速推理模块分离,兼顾实时性与深度思考。
  • 引入控制网络的流匹配模型,将高层意图无缝转化为连续动作。
  • 实测显示用户更认可其主动性与社交存在感,适合人机交互研究。

具身社交智能体在生成同步语音与手势方面已取得进展,但多数交互系统仍为被动响应型,仅基于短时感官输入做出反应。主动社交行为需对积累的上下文进行推敲并推断意图,这与实时交互的严格延迟要求相冲突。本文提出双系统框架 ProAct,通过将低延迟的行为系统(用于流式多模态交互)与较慢的认知系统(执行长期社交推理并生成高层主动意图)解耦,调和时间尺度矛盾。为将推理出的意图转化为不中断流畅性的连续非语言行为,我们引入一种以意图为条件的控制网络流匹配模型。该机制支持异步意图注入,可在单一动作流中无缝切换反应式与主动式手势。我们在物理人形机器人上部署 ProAct,评估了动作质量与交互有效性。真实世界交互实验表明,参与者与观察者一致认为,相比反应式变体,ProAct 在主动性感知、社交存在感与整体参与度上表现更优,证明双系统主动控制在具身社交交互中的优势。

原文摘要 · Abstract (English)

Embodied social agents have recently advanced in generating synchronized speech and gestures. However, most interactive systems remain fundamentally reactive, responding only to current sensory inputs within a short temporal window. Proactive social behavior, in contrast, requires deliberation over accumulated context and intent inference, which conflicts with the strict latency budget of real-time interaction. We present \emph{ProAct}, a dual-system framework that reconciles this time-scale conflict by decoupling a low-latency \emph{Behavioral System} for streaming multimodal interaction from a slower \emph{Cognitive System} which performs long-horizon social reasoning and produces high-level proactive intentions. To translate deliberative intentions into continuous non-verbal behaviors without disrupting fluency, we introduce a streaming flow-matching model conditioned on intentions via ControlNet. This mechanism supports asynchronous intention injection, enabling seamless transitions between reactive and proactive gestures within a single motion stream. We deploy ProAct on a physical humanoid robot and evaluate both motion quality and interactive effectiveness. In real-world interaction user studies, participants and observers consistently prefer ProAct over reactive variants in perceived proactivity, social presence, and overall engagement, demonstrating the benefits of dual-system proactive control for embodied social interaction.

具身智能主动交互双系统人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。