arXiv:2605.06628eess.IVcs.LG2026-05

轻量级神经编码器,高效压缩多模态数据,适合低功耗设备实时运行。

LiVeAction: a Lightweight, Versatile, and Asymmetric Neural Codec Design for Real-time Operation

论文配图:LiVeAction: a Lightweight, Versatile, and Asymmetric Neural Codec Design for Real-time Operation
图 1 · 摘自论文原文
  • 采用类FFT结构降低编码器复杂度,适配资源受限设备。
  • 用方差率惩罚替代对抗损失,提升跨模态通用性。
  • 在多种数据上实现更优码率-失真表现,适合可穿戴与远程传感场景。

现代传感器生成丰富且高保真的数据,但可穿戴或远程传感设备受带宽和功耗限制。传统编解码器如JPEG、MPEG针对人类感知设计,难以用于机器感知任务或空间音频、高光谱图像、3D医学影像等非传统模态。基于标量量化或分辨率降低的通用压缩方案虽适用广泛,但无法有效利用信号冗余,导致码率-失真性能不佳。近期生成式神经编解码器虽能建模复杂依赖关系,但参数过多、需大量数据,难在资源受限环境部署。本文提出轻量、通用、非对称神经编解码架构LiVeAction:(1) 通过引入类FFT结构并减少神经网络分析变换的整体规模与深度,降低编码器复杂度;(2) 以基于方差的率惩罚替代对抗与感知损失,简化训练并支持任意信号模态。实验表明,该设计在保持低资源开销的同时,优于现有生成式令牌化器的码率-失真表现。代码与实验已开源于https://github.com/UT-SysML/liveaction。

原文摘要 · Abstract (English)

Modern sensors generate rich, high-fidelity data, yet applications operating on wearable or remote sensing devices remain constrained by bandwidth and power budgets. Standardized codecs such as JPEG and MPEG achieve efficient trade-offs between bitrate and perceptual quality but are designed for human perception, limiting their applicability to machine-perception tasks and non-traditional modalities such as spatial audio arrays, hyperspectral images, and 3D medical images. General-purpose compression schemes based on scalar quantization or resolution reduction are broadly applicable but fail to exploit inherent signal redundancies, resulting in suboptimal rate-distortion performance. Recent generative neural codecs, or tokenizers, model complex signal dependencies but are often over-parameterized, data-hungry, and modality-specific, making them impractical for resource-constrained environments. We introduce a Lightweight, Versatile, and Asymmetric neural codec architecture (LiVeAction), that addresses these limitations through two key ideas. (1) To reduce the complexity of the encoder to meet the resource constraints of the execution environments, we impose an FFT-like structure and reduce the overall size and depth of the neural-network-based analysis transform. (2) To allow arbitrary signal modalities and simplify training, we replace adversarial and perceptual losses with a variance-based rate penalty. Our design produces codecs that deliver superior rate-distortion performance compared to state-of-the-art generative tokenizers, while remaining practical for deployment on low-power sensors. We release our code, experiments, and python library at https://github.com/UT-SysML/liveaction .

神经编码轻量模型多模态压缩边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。