arXiv:2507.07879cs.SDeess.AS2025-07

轻量工业声音模型可在边缘设备实时监测机床异常。

LISTEN: Lightweight Industrial Sound-representable Transformer for Edge Notification

  • 用知识蒸馏从大模型压缩出轻量版,仅微调浅层头。
  • 仅需少量标注数据即可达到与大模型相当的精度。
  • 整套系统可部署在低成本边缘设备上实时运行。

基于深度学习的机器听觉正拓展工业声学分析的应用范围,但其在实际产线的广泛应用受限于每项新任务都需要大量特定标注数据。尽管通用声音基础模型旨在降低数据依赖,但在工业场景中仍面临严峻挑战:计算开销大,且对谐波、宽带噪声和瞬态故障事件响应不佳,难以实现实时现场部署。为此,本文提出 LISTEN(轻量级工业声音表示变压器),首个专为工业声音设计的轻量基础模型。通过从大规模教师模型 IMPACT(工业机械听觉认知变压器)进行知识蒸馏,LISTEN 在资源受限的边缘环境中优化。通过冻结主干网络,仅在极少量目标工艺数据上训练浅层头部,而非全量微调或重训练,其性能几乎与 IMPACT 相当,覆盖多种制造流程。本研究进一步展示了完整的实时机械监控系统,包括基于工业物联网(IIoT)设备的数据采集、利用极少标注数据快速模型适配,以及在低成本边缘设备上的实时监控。通过在真实CNC机床上验证,本工作首次实现了轻量工业声音基础模型在活跃工业环境中的端到端可行部署。

原文摘要 · Abstract (English)

Deep learning-based machine listening is broadening the scope of industrial acoustic analysis, yet its widespread implementation on live shop floors is hindered by the reliance on large, task-specific annotated datasets for every new task. While emerging general-purpose sound foundation models aim to alleviate data dependency, they reveal critical dilemmas in practice. General-purpose sound foundation models are computationally expensive and fail in industrial scenarios characterized by tonal harmonics, broadband noise, and transient fault events, making instant, on-site deployment impractical. These challenges combined mean that a practical, end-to-end system for deploying a sound foundation model on a live shop floor has remained elusive. To address this challenge, this study introduces LISTEN (Lightweight Industrial Sound-representable Transformer for Edge Notification), the first lightweight foundation model specialized for industrial sound. Through Knowledge Distillation (KD) from the large-scale teacher model IMPACT (Industrial Machine Perception via Acoustic Cognitive Transformer), we construct LISTEN optimized for resource-constrained edge environments. By freezing the backbone and training only a shallow head on minimal target-process data, rather than performing full fine-tuning or retraining, LISTEN achieves nearly identical performance to IMPACT across diverse manufacturing processes. This study further demonstrates a complete system for real-time machine monitoring, encompassing data acquisition with Industrial Internet of Things (IIoT) devices, rapid model adaptation using minimal annotated data, and real-time monitoring on a low-cost edge device. By validating the entire system on a live CNC machine, this work establishes the first feasible end-to-end system for deploying a lightweight industrial sound foundation model in an active industrial environment.

工业听觉边缘计算知识蒸馏轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。