arXiv:2601.07476cs.ROcs.SE2026-01中稿 · publication in the…

NanoCockpit让纳米无人机实现零延迟控制,提升精度与成功率。

NanoCockpit: Performance-optimized Application Framework for AI-based Autonomous Nanorobotics

  • 用协程实现多任务流水线,优化图像采集到无线传输的全流程
  • 实测闭环控制误差降低30%,任务成功率从40%提至100%
  • 专为资源受限的微型飞控设计,简化开发且适配真实场景

基于视觉的微型机器学习(TinyML)模型驱动的自主纳米无人机是新兴技术,具有广泛应用前景,推动了资源受限嵌入式系统的发展。其微小体积(约几十克)限制了机载计算资源,仅支持低于100mW的微控制器单元(MCUs)。Bitcraze Crazyflie纳米无人机是行业标准,具备可编程MCU、多核处理和无线通信能力。然而,由于缺乏高效简洁的软件层,机器人开发者常无法充分利用这些宝贵资源,导致多缓冲图像采集、多核计算、内部数据交换和Wi-Fi流传输等环节串行化,产生延迟,影响控制性能。本文提出的NanoCockpit框架旨在填补这一空白,通过时间最优流水线设计提升吞吐量、降低系统延迟,并借助协程实现多任务调度,简化开发体验。在三个真实世界TinyML纳米机器人应用中的实地实验表明,该框架实现了理想端到端延迟(即无串行开销),使闭环控制性能显著提升:平均位置误差降低30%,任务成功率从40%提高到100%。

原文摘要 · Abstract (English)

Autonomous nano-drones, powered by vision-based tiny machine learning (TinyML) models, are a novel technology gaining momentum thanks to their broad applicability and pushing scientific advancement on resource-limited embedded systems. Their small form factor, i.e., a few tens of grams, severely limits their onboard computational resources to sub-100mW microcontroller units (MCUs). The Bitcraze Crazyflie nano-drone is the de facto standard, offering a rich set of programmable MCUs for low-level control, multi-core processing, and radio transmission. However, roboticists very often underutilize these onboard precious resources due to the absence of a simple yet efficient software layer capable of time-optimal pipelining of multi-buffer image acquisition, multi-core computation, intra-MCUs data exchange, and Wi-Fi streaming, leading to sub-optimal control performances. Our NanoCockpit framework aims to fill this gap, increasing the throughput and minimizing the system's latency, while simplifying the developer experience through coroutine-based multi-tasking. In-field experiments on three real-world TinyML nanorobotics applications show our framework achieves ideal end-to-end latency, i.e. zero overhead due to serialized tasks, delivering quantifiable improvements in closed-loop control performance (-30% mean position error, mission success rate increased from 40% to 100%).

纳米机器人TinyML实时控制嵌入式系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。