用事件相机和帧图像混合追踪变形长条物体,实时且精度高。
MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objects

- 结合事件流与帧图像,利用运动一致性理论优化跟踪
- 12毫秒更新率,点到曲线误差低至0.43毫米
- 适合需要精准动态抓取的机器人操作场景
可靠追踪移动的可变形线性物体(DLOs),同时保证鲁棒性、精度和时序一致性,仍是机器人感知中的基本挑战。我们提出MotionDLO,一种专为解决时序连续性和延迟问题而设计的实时追踪框架。该方法利用事件相机的高时间分辨率和稀疏性,结合分割与相干点漂移(CPD)算法,在运动一致性理论指导下实现时序一致的形状估计,同时保持低计算开销。现有事件追踪方法通常计算高效但精度低于基于帧的方法,或牺牲事件稀疏性以获得良好性能。为解决这一权衡,我们提出一种混合事件-帧追踪架构,保留两种传感模态的优势:事件流提供高频运动更新,帧信息则稳定空间精度与物体身份。实验表明,该框架能可靠地跨视频序列关联DLO实例,支持机器人操作任务中的鲁棒感知。结果验证了12毫秒更新率下的实时性能,点到曲线误差最低达0.43毫米,支持动态路径适应。源代码与演示数据集已公开。
原文摘要 · Abstract (English)
Reliably tracking moving deformable linear objects (DLOs) while simultaneously ensuring robustness, accuracy, and temporally consistent state estimation remains a fundamental challenge in robot perception. We introduce MotionDLO, a real-time tracking framework specifically designed to overcome these limitations in temporal continuity and latency. The method exploits the high temporal resolution and sparsity of event-based cameras and combines segmentation with the Coherent Point Drift (CPD) algorithm under the principles of Motion Coherence Theory. This integration enables temporally consistent shape estimation while maintaining a low computational overhead. Existing event-based tracking methods are typically computationally efficient but exhibit reduced accuracy compared to frame-based approaches, or alternatively compromise event sparsity to achieve competitive performance. To resolve this trade-off, we propose a hybrid event- and frame-based tracking architecture that preserves the complementary strengths of both sensing modalities. The event stream ensures high-frequency motion updates, while frame-based information stabilizes spatial accuracy and object identity. We demonstrate that the proposed framework reliably associates DLO instances across video sequences, enabling robust perception for robotic manipulation tasks. Experimental results validate real-time performance at 12 ms update rates and accurate shape tracking with an point-to-curve error as measurement of accuracy of up to 0.43 mm, supporting dynamic path adaptation during manipulation. The source code and demonstration datasets are publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。