arXiv:2512.19726cs.LGcs.AI2025-12被引 1

让边缘设备用小模型快速决策,降低延迟和算力消耗。

Tiny, On-Device Decision Makers with the MiniConv Library

  • 将视觉编码器放本地,用GPU着色器高效压缩图像数据。
  • 在树莓派等设备上实现更低决策延迟,传输量减少60%以上。
  • 适合资源受限的实时控制场景,如机器人、无人机部署。

强化学习在视觉策略部署中面临计算成本高与通信延迟的问题。为解决此问题,本文提出一种分层策略架构:在边缘设备上运行轻量级编码器(基于OpenGL片段着色器,兼容多种嵌入式GPU),将观测图像压缩为紧凑特征张量,再发送至远程策略头进行决策。该设计将通信开销转化为闭环决策延迟,而非单次请求延迟。实验在NVIDIA Jetson Nano、Raspberry Pi 4B和Raspberry Pi Zero 2 W上验证,结果表明该方法显著降低传输数据量,在带宽受限环境下减少决策延迟,并降低服务器每请求的计算负担。单次训练基准测试中,最终100集平均回报与全端到端模型相当,仅略有下降。同时提供了完整的训练、部署与测量代码开源。

原文摘要 · Abstract (English)

Reinforcement learning (RL) has achieved strong results, but deploying visual policies on resource-constrained edge devices remains challenging due to computational cost and communication latency. Many deployments therefore offload policy inference to a remote server, incurring network round trips and requiring transmission of high-dimensional observations. We introduce a split-policy architecture in which a small on-device encoder, implemented as OpenGL fragment-shader passes for broad embedded GPU support, transforms each observation into a compact feature tensor that is transmitted to a remote policy head. In RL, this communication overhead manifests as closed-loop decision latency rather than only per-request inference latency. The proposed approach reduces transmitted data, lowers decision latency in bandwidth-limited settings, and reduces server-side compute per request, whilst achieving broadly comparable learning performance by final return (mean over the final 100 episodes) in single-run benchmarks, with modest trade-offs in mean return. We evaluate across an NVIDIA Jetson Nano, a Raspberry Pi 4B, and a Raspberry Pi Zero 2 W, reporting learning results, on-device execution behaviour under sustained load, and end-to-end decision latency and scalability measurements under bandwidth shaping. Code for training, deployment, and measurement is released as open source.

边缘计算强化学习轻量化模型低延迟决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。