arXiv:2509.24601cs.LGeess.SP2025-09

CURA用紧凑架构实现跨领域通用推理,参数少2500倍仍保持高精度。

CURA: Size Isnt All You Need -- A Compact Universal Architecture for On-Device Intelligence

  • 借鉴模拟音频电路设计,用统一结构处理多种任务
  • 参数量比基线少2500倍,准确率相当;在4个NLP数据集上F1达90%
  • 适合资源受限设备,尤其需多任务轻量部署的场景

现有资源受限环境下的设备端AI架构存在两大瓶颈:参数量随任务复杂度线性增长,且泛化能力差,仅适用于特定领域(如回归模型无法用于自然语言处理)。本文提出CURA,一种受模拟音频信号处理电路启发的紧凑通用架构,可在多个领域实现轻量级机器学习。其优势包括:(1) 紧凑性:无论任务复杂度如何,所需参数显著减少;(2) 泛化能力:可无缝适配回归、分类、复杂NLP与计算机视觉任务;(3) 复杂模式识别:在极低模型复杂度下捕捉精细数据模式。在多样数据集与领域上评估表明:在紧凑性方面,达到等效准确率时参数量最多减少2500倍;在泛化性方面,在4个NLP基准和1个计算机视觉数据集上表现稳定,几乎媲美专用模型(最高F1-score达90%);在复杂模式预测中,平均绝对误差降低1.6倍,均方误差降低2.1倍。

原文摘要 · Abstract (English)

Existing on-device AI architectures for resource-constrained environments face two critical limitations: they lack compactness, with parameter requirements scaling proportionally to task complexity, and they exhibit poor generalizability, performing effectively only on specific application domains (e.g., models designed for regression tasks cannot adapt to natural language processing (NLP) applications). In this paper, we propose CURA, an architecture inspired by analog audio signal processing circuits that provides a compact and lightweight solution for diverse machine learning tasks across multiple domains. Our architecture offers three key advantages over existing approaches: (1) Compactness: it requires significantly fewer parameters regardless of task complexity; (2) Generalizability: it adapts seamlessly across regression, classification, complex NLP, and computer vision tasks; and (3) Complex pattern recognition: it can capture intricate data patterns while maintaining extremely low model complexity. We evaluated CURA across diverse datasets and domains. For compactness, it achieved equivalent accuracy using up to 2,500 times fewer parameters compared to baseline models. For generalizability, it demonstrated consistent performance across four NLP benchmarks and one computer vision dataset, nearly matching specialized existing models (achieving F1-scores up to 90%). Lastly, it delivers superior forecasting accuracy for complex patterns, achieving 1.6 times lower mean absolute error and 2.1 times lower mean squared error than competing models.

轻量化模型通用架构设备端智能多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。