arXiv:2604.14156cs.CL2026-04

让大模型按需运行,动态压缩计算路径,提速降耗。

Compressed-Sensing-Guided, Inference-Aware Structured Reduction for Large Language Models

论文配图:Compressed-Sensing-Guided, Inference-Aware Structured Reduction for Large Language Models
图 1 · 摘自论文原文
  • 用压缩感知技术探测模型激活路径,动态生成稀疏执行结构。
  • 推理时自动识别关键计算单元,支持任务与输入词动态调整。
  • 兼顾推理速度与精度,适合部署在硬件受限的场景使用。

大型语言模型虽生成性能强,但参数量大、内存占用高、解码延迟高。已有研究显示,剪枝与结构化稀疏性可在大幅压缩下保持精度,而提示压缩通过去除冗余输入令牌降低延迟。然而,这两类方法长期分离:多数压缩方法为静态离线优化,未利用不同提示和解码步骤激活不同潜藏计算路径的特性;提示压缩缩短序列长度,却未自适应调整执行模型子结构。本文提出一种统一的压缩感知引导框架,实现动态大模型推理。随机测量算子探测潜在模型使用情况,稀疏恢复估计任务相关的、词元自适应的支持集,并将恢复出的支持集编译为块、注意力头、通道及前馈子结构上的硬件高效稀疏执行路径。该框架包含五项关键贡献:任务相关测量,使不同提示引发不同稀疏支持;词元自适应恢复,使活跃子结构在解码中持续重估;在限制等距或互不相干假设下的正式样本复杂度边界;编译至硬件约束,仅限于GPU高效结构;以及联合目标,统一提示压缩与模型压缩。整体上,将大模型推理重构为具有显式近似保证与面向部署加速约束的测量-恢复问题。

原文摘要 · Abstract (English)

Large language models deliver strong generative performance but at the cost of massive parameter counts, memory use, and decoding latency. Prior work has shown that pruning and structured sparsity can preserve accuracy under substantial compression, while prompt-compression methods reduce latency by removing redundant input tokens. However, these two directions remain largely separate. Most model-compression methods are static and optimized offline, and they do not exploit the fact that different prompts and decoding steps activate different latent computational pathways. Prompt-compression methods reduce sequence length, but they do not adapt the executed model subnetwork. We propose a unified compressed-sensing-guided framework for dynamic LLM execution. Random measurement operators probe latent model usage, sparse recovery estimates task-conditioned and token-adaptive support sets, and the recovered supports are compiled into hardware-efficient sparse execution paths over blocks, attention heads, channels, and feed-forward substructures. The framework introduces five key contributions: task-conditioned measurements, so different prompts induce different sparse supports; token-adaptive recovery, so active substructures are re-estimated during decoding; formal sample-complexity bounds under restricted isometry or mutual incoherence assumptions; compile-to-hardware constraints that restrict recovery to GPU-efficient structures; and a joint objective that unifies prompt compression with model reduction. Together, these components recast LLM inference as a measurement-and-recovery problem with explicit approximation guarantees and deployment-oriented speedup constraints.

大模型压缩稀疏推理动态执行压缩感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。