让机器人在复杂环境中按逻辑指令自动规划动作,还能直接从示范中学习规则。
Differentiable SpaTiaL: Symbolic Learning and Reasoning with Geometric Temporal Logic for Manipulation Tasks
- 用可微分的几何运算替代传统离散求解,实现符号逻辑与物理空间的无缝连接。
- 支持并行优化轨迹并满足精确的时空约束,计算效率提升显著。
- 适合需要高精度规划的机器人操作任务,尤其适合从演示中学习逻辑规则。
在杂乱环境中执行复杂操作需同时满足耦合的几何与时间约束。尽管时空逻辑(SpaTiaL)提供了规范化的描述框架,但其在梯度优化中的应用受限于非可微的几何操作。现有可微时序逻辑仅关注机器人内部状态,忽略物体与环境的交互;而捕捉此类交互的空间逻辑方法依赖离散几何引擎,破坏计算图,无法实现精确梯度传播。为此,我们提出 Differentiable SpaTiaL,一个全张量化的可微分符号时空逻辑工具箱,直接在多边形集合上构建平滑、支持自动求导的几何原语。据我们所知,这是首个端到端可微的符号时空逻辑工具箱。通过解析推导关键空间谓词的可微松弛——包括有向距离、相交、包含和方向关系——实现了从高层语义规范到低层几何配置的端到端可微映射,无需调用外部离散求解器。该全可微形式解锁两大核心能力:(i) 在严格时空约束下进行大规模并行轨迹优化,(ii) 通过反向传播直接从示范中学习空间逻辑参数。实验验证了该框架的有效性与可扩展性。
原文摘要 · Abstract (English)
Executing complex manipulation in cluttered environments requires satisfying coupled geometric and temporal constraints. Although Spatio-Temporal Logic (SpaTiaL) offers a principled specification framework, its use in gradient-based optimization is limited by non-differentiable geometric operations. Existing differentiable temporal logics focus on the robot's internal state and neglect interactive object-environment relations, while spatial logic approaches that capture such interactions rely on discrete geometry engines that break the computational graph and preclude exact gradient propagation. To overcome this limitation, we propose Differentiable SpaTiaL, a fully tensorized toolbox that constructs smooth, autograd-compatible geometric primitives directly over polygonal sets. To the best of our knowledge, this is the first end-to-end differentiable symbolic spatio-temporal logic toolbox. By analytically deriving differentiable relaxations of key spatial predicates--including signed distance, intersection, containment, and directional relations--we enable an end-to-end differentiable mapping from high-level semantic specifications to low-level geometric configurations, without invoking external discrete solvers. This fully differentiable formulation unlocks two core capabilities: (i) massively parallel trajectory optimization under rigorous spatio-temporal constraints, and (ii) direct learning of spatial logic parameters from demonstrations via backpropagation. Experimental results validate the effectiveness and scalability of the proposed framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。