让机器人视觉任务高效透明地在本地或边缘执行,大幅省电提帧率。
vAccSOL: Efficient and Transparent AI Vision Offloading for Mobile Robots
- 用编译器生成轻量推理库,支持跨平台部署。
- 边缘卸载后机器人耗电降80%,帧率提升24倍。
- 无需改程序,适合移动机器人与边缘计算场景。
移动机器人广泛用于巡检、巡逻和搜救任务,依赖计算机视觉实现感知、导航与自主决策。然而,受限于计算资源和严格能耗约束,本地运行现代视觉负载颇具挑战。尽管部分平台配备嵌入式加速器,但多绑定专有软件栈,用户自定义任务仍需在资源受限的辅助计算单元上运行。本文提出vAccSOL框架,实现跨异构机器人与边缘平台的AI视觉任务高效透明执行。vAccSOL由两部分组成:SOL为神经网络编译器,生成低运行时依赖的优化推理库;vAccel为轻量级执行框架,透明调度推理任务在机器人本地或邻近边缘设施执行。该组合实现硬件优化推理与灵活部署,且无需修改机器人应用。我们在商用四足机器人测试平台上评估了12个深度学习模型(涵盖图像分类、视频分类与语义分割)。相比PyTorch编译基线,SOL性能相当或更优;通过边缘卸载,vAccSOL使机器人侧功耗降低最多80%,边缘侧降低60%,同时将视觉流水线帧率提升至24倍,显著延长电池供电机器人的续航时间。
原文摘要 · Abstract (English)
Mobile robots are increasingly deployed for inspection, patrol, and search-and-rescue operations, relying on computer vision for perception, navigation, and autonomous decision-making. However, executing modern vision workloads onboard is challenging due to limited compute resources and strict energy constraints. While some platforms include embedded accelerators, these are typically tied to proprietary software stacks, leaving user-defined workloads to run on resource-constrained companion computers. We present vAccSOL, a framework for efficient and transparent execution of AI-based vision workloads across heterogeneous robotic and edge platforms. vAccSOL integrates two components: SOL, a neural network compiler that generates optimized inference libraries with minimal runtime dependencies, and vAccel, a lightweight execution framework that transparently dispatches inference locally on the robot or to nearby edge infrastructure. This combination enables hardware-optimized inference and flexible execution placement without requiring modifications to robot applications. We evaluate vAccSOL on a real-world testbed with a commercial quadruped robot and twelve deep learning models covering image classification, video classification, and semantic segmentation. Compared to a PyTorch compiler baseline, SOL achieves comparable or better inference performance. With edge offloading, vAccSOL reduces robot-side power consumption by up to 80% and edge-side power by up to 60% compared to PyTorch, while increasing vision pipeline frame rate by up to 24x, extending the operating lifetime of battery-powered robots.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。