arXiv:2412.09289cs.LGcs.SE2024-12被引 45

在32KB内存下实现高精度室内定位,适配低功耗设备。

Optimising TinyML with Quantization and Distillation of Transformer and Mamba Models for Indoor Localisation on Edge Devices

  • 用量化与知识蒸馏压缩Transformer和Mamba模型
  • 64KB内存下仍保持高定位精度,32KB可用时Mamba直接运行
  • 适合医疗健康等需低功耗、高隐私的边缘场景

本文提出适用于资源受限边缘设备的小型高效机器学习模型(TinyML),用于设备端室内定位。传统方法依赖远程集中处理可穿戴设备传输的数据,而将计算移至边缘可提升电池寿命、增强隐私保护、降低延迟与运营成本,尤其适用于健康监测等场景。研究聚焦模型压缩技术,包括量化与知识蒸馏,在大幅缩小模型尺寸的同时保持高预测性能。基于先进的Transformer模型,探索其在低功耗MCU上的部署;同时引入状态空间架构Mamba作为更紧凑的替代方案。结果表明,量化后的Transformer模型在64 KB RAM约束下表现良好,实现了模型大小与定位精度的有效平衡;而紧凑的Mamba模型在更严苛的32 KB RAM限制下无需压缩即可运行,适用于资源更有限的环境。本框架证明了先进室内定位模型在低功耗MCU上的可行性。这些TinyML模型在医疗健康领域的应用有望通过提供精准实时位置数据,同时最小化功耗、提升隐私、降低延迟与基础设施成本,革新患者监测方式。

原文摘要 · Abstract (English)

This paper proposes small and efficient machine learning models (TinyML) for resource-constrained edge devices, specifically for on-device indoor localisation. Typical approaches for indoor localisation rely on centralised remote processing of data transmitted from lower powered devices such as wearables. However, there are several benefits for moving this to the edge device itself, including increased battery life, enhanced privacy, reduced latency and lowered operational costs, all of which are key for common applications such as health monitoring. The work focuses on model compression techniques, including quantization and knowledge distillation, to significantly reduce the model size while maintaining high predictive performance. We base our work on a large state-of-the-art transformer-based model and seek to deploy it within low-power MCUs. We also propose a state-space-based architecture using Mamba as a more compact alternative to the transformer. Our results show that the quantized transformer model performs well within a 64 KB RAM constraint, achieving an effective balance between model size and localisation precision. Additionally, the compact Mamba model has strong performance under even tighter constraints, such as a 32 KB of RAM, without the need for model compression, making it a viable option for more resource-limited environments. We demonstrate that, through our framework, it is feasible to deploy advanced indoor localisation models onto low-power MCUs with restricted memory limitations. The application of these TinyML models in healthcare has the potential to revolutionize patient monitoring by providing accurate, real-time location data while minimizing power consumption, increasing data privacy, improving latency and reducing infrastructure costs.

TinyML室内定位模型压缩边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。