arXiv:2605.26523cs.DCcs.AI2026-05中稿 · ACM MobiSys 2026

StreamSplit让边缘设备实时学音频表示,省带宽又保精度。

StreamSplit: Continuous Audio Representation Learning via Uncertainty-Guided Adaptive Splitting

论文配图:StreamSplit: Continuous Audio Representation Learning via Uncertainty-Guided Adaptive Splitting
图 1 · 摘自论文原文
  • 用动态分块和混合损失,让小批次也能保持模型质量。
  • 实时根据资源与嵌入模糊度调整计算分配,延迟降4.7倍、带宽减77.1%。
  • 适合资源波动大的边缘场景,如手机、树莓派等设备部署。

大规模对比学习(CL)是现代表示学习的基础,但与边缘设备的资源波动性天然冲突:小批量降低模型质量,上云又带来高延迟和高带宽开销。现有方案多依赖静态压缩,无法适应运行时变化。为此,我们提出 StreamSplit,一个面向异构 ARM 客户端平台的流式对比学习框架。该框架解决环境音频的连续性与 CLAP、COLA 等模型离散批处理需求之间的矛盾。提出两点创新:(1) 基于分布的流式框架,通过可计算的混合损失解耦表征质量与本地批大小,实现稀疏更新下的高质量表征;(2) 不确定性引导的自适应分割器,采用轻量级强化学习策略,结合实时资源监控与嵌入模糊度,动态划分计算任务。实验覆盖从树莓派4到苹果M2的多种硬件。结果表明,相比中心化服务器方案,StreamSplit将每样本延迟降低最多4.7倍,带宽减少77.1%,能耗降低52.3%,且准确率仅比服务器模型低2.2%,证明自适应分布式学习是边缘生态可行路径。

原文摘要 · Abstract (English)

Large-batch Contrastive Learning (CL), the foundation of modern representation learning, is fundamentally incompatible with the volatile resource constraints of edge devices. This conflict creates a dilemma: small on-device batches degrade model fidelity, while offloading to the cloud incurs unacceptable latency and bandwidth costs. Existing solutions often resort to static model compression, which fails to adapt to the runtime volatility of edge environments. To bridge this gap, we present StreamSplit, a novel framework that makes streaming CL practical across heterogeneous ARM client platforms. StreamSplit resolves the conflict between the continuous nature of ambient audio and the discrete batch requirements of models like CLAP and COLA. We introduce: (1) A distribution-based streaming framework that decouples representation quality from local batch size, using a tractable Hybrid Loss to maintain fidelity despite sparse updates; and (2) An Uncertainty-Guided Adaptive Splitter that uses a lightweight Reinforcement Learning (RL) policy to dynamically partition computation. Uniquely, this policy integrates real-time resource monitoring with embedding ambiguity to optimize the accuracy-latency trade-off on the fly. We evaluate StreamSplit on diverse hardware, from the resource-constrained Raspberry Pi 4 to the high-performance Apple M2. Results demonstrate that StreamSplit reduces per-sample latency by up to 4.7x and cuts bandwidth by 77.1% and energy by 52.3% compared to server-centric baselines. Crucially, it maintains accuracy within 2.2% of server-centric models, proving that adaptive, distributed learning is a viable path for the modern edge ecosystem.

边缘计算音频表示自适应学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。