arXiv:2603.29533cs.RO2026-03

无需环境交互,用离线数据实现零样本信号时序逻辑规划。

GraSP-STL: A Graph-Based Framework for Zero-Shot Signal Temporal Logic Planning via Offline Goal-Conditioned Reinforcement Learning

  • 基于图搜索构建状态可达性图,利用离线数据学习目标条件价值函数。
  • 在多个未见的STL任务上实现零样本规划,支持长时序任务分解执行。
  • 适合需要快速适配新任务的机器人控制场景,如自主导航与行为合成。

本文研究在无环境交互、无动态模型的前提下,基于离线数据进行零样本信号时序逻辑(STL)规划。仅依赖由任务无关行为策略生成的状态-动作-状态转移数据集,不进行任务特定训练或进一步交互。目标是为任意未见过的STL规范合成满足要求的控制策略。为此,提出GraSP-STL框架:从离线数据学习目标条件价值函数,构建有限时域可达性度量;基于该度量构造有向图,节点代表典型状态,边编码可行短时域转移;将规划问题转化为路径搜索,使用算术-几何平均鲁棒性及其区间语义评估序列,并通过学习的目标条件策略执行。该框架将可复用的可达性学习与任务相关规划分离,实现对未见STL任务的零样本泛化及通过组合短时域行为完成长时序规划。实验验证了其在多种离线STL规划任务中的有效性。

原文摘要 · Abstract (English)

This paper studies offline, zero-shot planning under Signal Temporal Logic (STL) specifications. We assume access only to an offline dataset of state-action-state transitions collected by a task-agnostic behavior policy, with no analytical dynamics model, no further environment interaction, and no task-specific retraining. The objective is to synthesize a control strategy whose resulting trajectory satisfies an arbitrary unseen STL specification. To this end, we propose GraSP-STL, a graph-search-based framework for zero-shot STL planning from offline trajectories. The method learns a goal-conditioned value function from offline data and uses it to induce a finite-horizon reachability metric over the state space. Based on this metric, it constructs a directed graph abstraction whose nodes represent representative states and whose edges encode feasible short-horizon transitions. Planning is then formulated as a graph search over waypoint sequences, evaluated using arithmetic-geometric mean robustness and its interval semantics, and executed by a learned goal-conditioned policy. The proposed framework separates reusable reachability learning from task-conditioned planning, enabling zero-shot generalization to unseen STL tasks and long-horizon planning through the composition of short-horizon behaviors from offline data. Experimental results demonstrate its effectiveness on a range of offline STL planning tasks.

强化学习时序逻辑零样本规划离线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。