一套通用框架,让机器人视觉动作模型快速适配不同硬件,提速2-3倍且性能几乎不变。
Device-Conditioned Neural Architecture Search for Efficient Robotic Manipulation
- 用统一超网络结合设备条件量化训练,一次搜索适配多种硬件。
- 在边缘设备、消费级显卡和云平台均实现2-3倍加速,任务成功率下降极小。
- 适合需要快速部署到异构机器人硬件的开发者,尤其擅长低精度稳定执行。
视觉动作策略的复杂性给异构机器人硬件部署带来挑战。现有方法多依赖特定设备与模型,泛化能力差,且需耗时的设备专属优化。本文提出统一框架DC-QFA,通过设备条件量化感知训练与硬件约束架构搜索,大幅降低部署成本。我们构建一个覆盖多种网络结构与混合精度位宽的超网络,并引入延迟与内存感知正则化,由各设备查表引导优化。针对目标平台,只需一次‘一次算全’的轻量搜索即可选出最优子网,无需重复优化,显著提升跨硬件泛化能力与部署效率。为增强低精度下的长时稳定性,进一步引入多步策略内蒸馏,缓解闭环执行中的误差累积。在DiffusionPolicy-T、MDT-V与OpenVLA-OFT等三类典型策略骨干上验证,DC-QFA在边缘设备、消费级GPU与云平台均实现2-3倍加速,任务成功率几乎无损。真实世界测试中,搭载力/扭矩传感器的Inovo机器人在严重量化下仍保持稳定、高接触率操作。
原文摘要 · Abstract (English)
The growing complexity of visuomotor policies poses significant challenges for deployment with heterogeneous robotic hardware constraints. However, most existing model-efficient approaches for robotic manipulation are device- and model-specific, lack generalizability, and require time-consuming per-device optimization during the adaptation process. In this work, we propose a unified framework named \textbf{D}evice-\textbf{C}onditioned \textbf{Q}uantization-\textbf{F}or-\textbf{A}ll (DC-QFA) which amortizes deployment effort with the device-conditioned quantization-aware training and hardware-constrained architecture search. Specifically, we introduce a single supernet that spans a rich design space over network architectures and mixed-precision bit-widths. It is optimized with latency- and memory-aware regularization, guided by per-device lookup tables. With this supernet, for each target platform, we can perform a once-for-all lightweight search to select an optimal subnet without any per-device re-optimization, which enables more generalizable deployment across heterogeneous hardware, and substantially reduces deployment time. To improve long-horizon stability under low precision, we further introduce multi-step on-policy distillation to mitigate error accumulation during closed-loop execution. Extensive experiments on three representative policy backbones, such as DiffusionPolicy-T, MDT-V, and OpenVLA-OFT, demonstrate that our DC-QFA achieves $2\text{-}3\times$ acceleration on edge devices, consumer-grade GPUs, and cloud platforms, with negligible performance drop in task success. Real-world evaluations on an Inovo robot equipped with a force/torque sensor further validates that our low-bit DC-QFA policies maintain stable, contact-rich manipulation even under severe quantization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。