通过稀疏事件结构建模,提升手术机器人长程操作的成功率。
S2-HWM: Sparse Event-Structured Hierarchical World Model for Long-Horizon Surgical Robot Manipulation

- 分层设计:事件级管理器与基础步执行者协同工作。
- 成功率达98.7%,比基线高22.7个百分点。
- 适合需要长程规划的复杂机器人任务研究者。
长时序手术机器人操作因任务奖励稀疏,且有意义的交互变化发生不规律而极具挑战。现有世界模型通常以基础步骤分辨率进行想象,隐含了变量时长的任务进展。人工设定阶段虽可提供中间结构,但其任务边界难以与状态依赖的交互转换对齐。本文提出S2-HWM,一种从基础潜空间轨迹中学习稀疏事件证据的分层世界模型,协调事件级管理器与基础步执行者。事件证据调度管理器目标更新,每个选定的潜目标则指导执行者的动作,直至下一次更新。学习到的事件证据还构成可变时长片段,用于事件转移模型(ETM),预测下一边界随机状态、片段持续时间及累计奖励。链式事件级预测可实现超越基础想象时域的可变时长延续,供管理器学习,而执行者仍保持基础步的演员-评论家学习。在基于SurRoL的钉转移任务上,S2-HWM成功率达98.7%,优于平面型GAS DreamerV3基线22.7个百分点。
原文摘要 · Abstract (English)
Long-horizon surgical robot manipulation is challenging because task rewards are sparse, while meaningful interaction changes occur at irregular intervals. Existing world-model agents typically imagine at primitive-step resolution, leaving variable-duration task progress implicit. Manually specified stages can provide intermediate structure, but their task specific boundaries are difficult to align with state-dependent interaction transitions. We propose S2-HWM, a Sparse Event-Structured Hierarchical World Model that learns sparse event evidence from primitive latent trajectories to coordinate an event-level manager and a primitive-step worker. The event evidence schedules manager goal updates, and each selected latent goal conditions the worker's primitive actions until the next update. The learned event evidence also forms variable-duration segments for an Event Transition Model (ETM), which predicts the next?boundary stochastic state, segment duration, and accumulated segment reward. Chaining these event-level predictions provides a variable-duration continuation beyond the primitive imagination horizon for manager learning, while the worker retains primitive-step actor-critic learning. On a SurRoL-based PegTransfer task, S2-HWM achieves a success rate of 98.7%, outperforming the flat GAS DreamerV3 baseline by 22.7 percentage points.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。