arXiv:2409.12112cs.LGcs.AI2024-09被引 2

用最少数据实现高效机器学习,适配嵌入式设备

Pareto Data Framework: Steps Towards Resource-Efficient Decision Making Using Minimum Viable Data (MVD)

  • 通过最小可行数据筛选,优化传感器与传输策略
  • 采样率降75%、位深和截取长度各降50%,性能仍达95%
  • 适合资源受限的物联网、移动设备等场景

本文提出帕累托数据框架,旨在为嵌入式系统、移动设备和物联网设备等资源受限平台,识别并选择实现机器学习应用所需的最小可行数据(MVD)。该框架通过战略性数据压缩,在不牺牲性能的前提下显著降低带宽、能耗、计算和存储成本。针对物联网应用中常见的传感器过度配置、信号过精度和过度采样问题,提出可扩展的最优传感器选择、信号提取与传输、数据表示方案。实验表明,经下采样、量化和截断处理后,音频数据在采样率降低75%、位深与片段长度均减少50%的情况下,性能仍可保持在95%以上,大幅降低资源消耗。研究成果对约束环境系统的设计具有重要启示,并有望推动先进AI技术在农业、交通、制造等领域的普及,提升数据驱动决策的可及性与效益。

原文摘要 · Abstract (English)

This paper introduces the Pareto Data Framework, an approach for identifying and selecting the Minimum Viable Data (MVD) required for enabling machine learning applications on constrained platforms such as embedded systems, mobile devices, and Internet of Things (IoT) devices. We demonstrate that strategic data reduction can maintain high performance while significantly reducing bandwidth, energy, computation, and storage costs. The framework identifies Minimum Viable Data (MVD) to optimize efficiency across resource-constrained environments without sacrificing performance. It addresses common inefficient practices in an IoT application such as overprovisioning of sensors and overprecision, and oversampling of signals, proposing scalable solutions for optimal sensor selection, signal extraction and transmission, and data representation. An experimental methodology demonstrates effective acoustic data characterization after downsampling, quantization, and truncation to simulate reduced-fidelity sensors and network and storage constraints; results shows that performance can be maintained up to 95\% with sample rates reduced by 75\% and bit depths and clip length reduced by 50\% which translates into substantial cost and resource reduction. These findings have implications on the design and development of constrained systems. The paper also discusses broader implications of the framework, including the potential to democratize advanced AI technologies across IoT applications and sectors such as agriculture, transportation, and manufacturing to improve access and multiply the benefits of data-driven insights.

数据效率物联网边缘计算最小数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。