让机器人在动态环境中安全执行复杂任务,自动学习任务规范。
Learning specifications for reactive synthesis with safety constraints
- 用概率确定性有限自动机建模任务,结合安全约束学习
- 生成满足安全与偏好权衡的最优策略集合(帕累托前沿)
- 适用于需兼顾安全与效率的机器人自主控制场景
本文提出一种从示范中学习的新方法,使机器人能在动态环境中自主执行复杂任务。将潜在任务建模为概率形式语言,引入定制化的反应式合成框架,平衡机器人成本与用户任务偏好。方法聚焦于安全约束下的学习,推断任务规范为概率确定性有限自动机(PDFA)。我们改进现有基于证据的状态合并算法,并在整个学习过程中融入安全要求,确保所学PDFA始终满足安全约束。此外,提出多目标反应式合成算法,生成保证满足PDFA任务的确定性策略,同时优化用户偏好与机器人成本之间的权衡,得到帕累托最优解集。将交互建模为机器人与环境间的双人博弈,考虑动态变化。设计可计算的值迭代算法生成帕累托前沿及对应确定性策略。大量实验结果表明,所提算法在多种机器人和任务上均有效,所学PDFA从不包含不安全行为,合成策略始终完成任务并同时满足机器人成本与用户偏好要求。
原文摘要 · Abstract (English)
This paper presents a novel approach to learning from demonstration that enables robots to autonomously execute complex tasks in dynamic environments. We model latent tasks as probabilistic formal languages and introduce a tailored reactive synthesis framework that balances robot costs with user task preferences. Our methodology focuses on safety-constrained learning and inferring formal task specifications as Probabilistic Deterministic Finite Automata (PDFA). We adapt existing evidence-driven state merging algorithms and incorporate safety requirements throughout the learning process to ensure that the learned PDFA always complies with safety constraints. Furthermore, we introduce a multi-objective reactive synthesis algorithm that generates deterministic strategies that are guaranteed to satisfy the PDFA task while optimizing the trade-offs between user preferences and robot costs, resulting in a Pareto front of optimal solutions. Our approach models the interaction as a two-player game between the robot and the environment, accounting for dynamic changes. We present a computationally-tractable value iteration algorithm to generate the Pareto front and the corresponding deterministic strategies. Comprehensive experimental results demonstrate the effectiveness of our algorithms across various robots and tasks, showing that the learned PDFA never includes unsafe behaviors and that synthesized strategies consistently achieve the task while meeting both the robot cost and user-preference requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。