arXiv:2602.14255cs.RO2026-02被引 2

解决工业机器人视觉动作策略的延迟问题,让动作更顺滑准确。

A Latency-Aware Framework for Visuomotor Policy Learning on Industrial Robots

  • 用时间戳调度动作,实现异步推理与执行
  • 在100-500毫秒延迟下保持动作平滑与任务进度一致
  • 适合高延迟环境下部署视觉动作策略的工程师

工业机器人在建筑和制造任务中广泛应用,但视觉动作策略的部署受观测、推理和执行延迟带来的观测-执行间隙影响。由于高层控制接口和较慢的闭环动态,这种间隙在工业机械臂上尤为显著,导致执行时机成为关键系统问题。本文提出一种面向工业机械臂的系统级延迟感知框架,集成延迟校准的多模态感知、数据同步、统一通信管道及遥操作界面,用于收集专家示范。框架内形式化了一种延迟感知的执行策略,为策略预测的动作序列分配时间戳,并根据预期执行时间仅调度时序可行的动作,实现无需修改策略架构或训练流程的异步推理与执行。在接触丰富的装配任务上评估该框架,系统性地改变推理延迟,并使用相同策略和感知模态对比延迟感知执行与阻塞式、简单异步基线方法。结果表明,在100–500毫秒推理延迟范围内,延迟感知执行能保持平滑运动、符合示范的柔顺接触行为及任务进展;任务时长和运动平滑度分别维持在示范参考值的13%以内和9%以内,避免了阻塞执行的延迟依赖性减速和简单异步执行的大接触力超调。

原文摘要 · Abstract (English)

Industrial robots are increasingly deployed in construction and manufacturing tasks, where the deployment of end-to-end visuomotor policies is challenged by the observation-execution gap induced by observation, inference, and execution latencies. This gap is often significant on industrial robotic arms due to high-level control interfaces and slower closed-loop dynamics, making execution timing a dominant system-level concern. This paper presents a system-level, latency-aware framework for deploying and evaluating visuomotor policies on industrial robotic arms. The framework integrates latency-calibrated multimodal sensing, data synchronization, a unified communication pipeline, and a teleoperation interface for collecting expert demonstrations. Within this framework, we formalize a latency-aware execution strategy that assigns timestamps to policy-predicted action sequences and schedules only temporally feasible actions according to their intended execution time, enabling asynchronous inference and execution without modifying policy architectures or training procedures. We evaluate the framework on a contact-rich assembly task while systematically varying inference latency and compare latency-aware execution against blocking and naive asynchronous baselines using identical policies and sensing modalities. Results show that latency-aware execution preserves smooth motion, compliant contact behavior, and task progression consistent with demonstrations across inference latencies of 100-500 ms. Latency-aware execution maintained task duration and motion smoothness within 13% and 9% of the demonstration reference, respectively, while avoiding the latency-dependent slowdown observed under blocking execution and the large contact-force overshoots produced by naive asynchronous execution.

机器人控制延迟感知视觉动作策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。