用模块化AI解魔方,无需示范数据,成功率79%。
Structured Task Solving via Modular Embodied Intelligence: A Case Study on Rubik's Cube
- 分三模块:知识库解数学逻辑,视觉模型识场景,大模型生成控制代码。
- 真实机械臂上79%成功率,比传统方法少几步且更安全。
- 适合智能制造、机器人教学,代码开源可复用。
本文提出Auto-RubikAI,一种基于模块化自主规划的框架,融合符号知识库(KB)、视觉语言模型(VLM)和大语言模型(LLM),用于解决结构化操作任务,以魔方复原为例。不同于依赖预设脚本或大规模示范数据的传统机器人系统,Auto-RubikAI实现可解释的多步执行,仅需极少数据且无需先验示范。知识库模块解决群论层面的复原步骤,弥补LLM在符号推理上的不足;VLM解析RGB-D输入构建语义3D场景表示;LLM通过提示链生成结构化机器人控制代码。该三模块架构在空间不确定性下仍具鲁棒性。我们在仿真与真实世界中部署于7-DOF机械臂,实现无需重训练的仿真到现实迁移。实验表明,在随机配置下端到端任务成功率达79%。相较于CFOP、DeepCubeA和Two-Phase基线方法,本方法在减少平均求解步数的同时保持可解释性与安全性。Auto-RubikAI为智能制造、机器人教育及自主执行场景提供低成本、模块化任务规划基础。代码、提示与硬件模块将在发表后公开。
原文摘要 · Abstract (English)
This paper presents Auto-RubikAI, a modular autonomous planning framework that integrates a symbolic Knowledge Base (KB), a vision-language model (VLM), and a large language model (LLM) to solve structured manipulation tasks exemplified by Rubik's Cube restoration. Unlike traditional robot systems based on predefined scripts, or modern approaches relying on pretrained networks and large-scale demonstration data, Auto-RubikAI enables interpretable, multi-step task execution with minimal data requirements and no prior demonstrations. The proposed system employs a KB module to solve group-theoretic restoration steps, overcoming LLMs' limitations in symbolic reasoning. A VLM parses RGB-D input to construct a semantic 3D scene representation, while the LLM generates structured robotic control code via prompt chaining. This tri-module architecture enables robust performance under spatial uncertainty. We deploy Auto-RubikAI in both simulation and real-world settings using a 7-DOF robotic arm, demonstrating effective Sim-to-Real adaptation without retraining. Experiments show a 79% end-to-end task success rate across randomized configurations. Compared to CFOP, DeepCubeA, and Two-Phase baselines, our KB-enhanced method reduces average solution steps while maintaining interpretability and safety. Auto-RubikAI provides a cost-efficient, modular foundation for embodied task planning in smart manufacturing, robotics education, and autonomous execution scenarios. Code, prompts, and hardware modules will be released upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。