arXiv:2512.11620cs.ROcs.SY2025-12被引 1

用现成模型组合构建可解释的智能机器人系统,避免大模型训练

Architecting Large Action Models for Human-in-the-Loop Intelligent Robots

  • 用现成感知模型+逻辑驱动核心,组合成大型动作模型
  • 通过生成PDDL代码实现人类可验证的动作执行,减少幻觉
  • 适合希望快速构建安全可控机器人的研发人员

实现自主运行并与人类或人工智能交互的智能机器人,需融合环境感知、推理与行动。传统符号方法在计算和内存成本上已遇瓶颈;近十年来大语言模型虽展现惊人能力,但控制性、可解释性差。大型动作模型旨在扩展大语言模型以覆盖完整的感知-推理-行动闭环,但通常需大规模训练且可靠性不足。本文表明,可通过组合现成的基础模型构建有效的大规模动作模型,并通过符号包装器及输出验证提升控制性、可解释性与可验证性,实现神经符号融合的智能机器人解决方案。多模态机器人实验显示,无需海量端到端训练,仅需高效感知模型结合逻辑核心即可实现智能;通过生成规划领域定义语言(PDDL)代码,可引入人类在环验证阶段,有效缓解动作幻觉。该成果为跨行业机器人大型动作模型的设计开发提供支持,并揭示了保障安全性仍需解决的关键挑战。

原文摘要 · Abstract (English)

The realization of intelligent robots, operating autonomously and interacting with other intelligent agents, human or artificial, requires the integration of environment perception, reasoning, and action. Classic Artificial Intelligence techniques for this purpose, focusing on symbolic approaches, have long-ago hit the scalability wall on compute and memory costs. Advances in Large Language Models in the past decade (neural approaches) have resulted in unprecedented displays of capability, at the cost of control, explainability, and interpretability. Large Action Models aim at extending Large Language Models to encompass the full perception, reasoning, and action cycle; however, they typically require substantially more comprehensive training and suffer from the same deficiencies in reliability. Here, we show it is possible to build competent Large Action Models by composing off-the-shelf foundation models, and that their control, interpretability, and explainability can be effected by incorporating symbolic wrappers and associated verification on their outputs, achieving verifiable neuro-symbolic solutions for intelligent robots. Our experiments on a multi-modal robot demonstrate that Large Action Model intelligence does not require massive end-to-end training, but can be achieved by integrating efficient perception models with a logic-driven core. We find that driving action execution through the generation of Planning Domain Definition Language (PDDL) code enables a human-in-the-loop verification stage that effectively mitigates action hallucinations. These results can support practitioners in the design and development of robotic Large Action Models across novel industries, and shed light on the ongoing challenges that must be addressed to ensure safety in the field.

机器人大模型可解释神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。