arXiv:2605.28992eess.IV2026-05被引 1

用投影搜索编码器实现高效可变率图像压缩,支持纯CPU实时编码。

FRAPPE: Full Input, Residual Output Autoencoding with Projection Pursuit Encoder

论文配图:FRAPPE: Full Input, Residual Output Autoencoding with Projection Pursuit Encoder
图 1 · 摘自论文原文
  • 输入全量信息预测残差输出,编码路径并行化处理
  • 0.1 bpp时比AVIF感知质量更高,编码速度提升47倍
  • 适合低功耗设备的实时图像压缩,无需昂贵GPU

媒体压缩标准在率失真复杂度权衡上已达到瓶颈,限制了机器人、可穿戴设备和远程感知等场景中将高成本AI感知任务卸载至云端的能力。基于深度神经网络的编码器虽提升了压缩效率,但存在难以适应比特率大幅变化的问题,且实时编码需依赖高功耗的GPU,无法在低成本或资源受限平台使用。为此,我们提出一种新型自编码框架FRAPPE,通过投影搜索编码器以完整输入预测残差输出。该框架的编码目标自然地按重要性排序潜在通道,支持零开销可变率编码。与依赖前一重构残差的RNN类学习编码器,或必须顺序应用码本的RVQ风格编码器不同,FRAPPE的分析路径是独立输入投影构成的惊人并行有向无环图(DAG)。基于FRAPPE,我们构建了一个可变率的RGB图像编码器(FRAPPE-Image),并评估其在率失真复杂度权衡方面相对于标准图像编码器的表现。在高压缩比(约0.1 bpp)下,FRAPPE-Image提供的感知质量优于AVIF,编码速度提升47倍,实现了纯CPU支持的1080p、30fps实时编码。代码与预训练模型已公开:https://github.com/UT-SysML/FRAPPE。

原文摘要 · Abstract (English)

Media compression standards have reached a plateau in terms of the rate-distortion-complexity trade-off, limiting the ability to offload expensive AI perception to the cloud in applications like robotics, wearables, and remote sensing. DNN-based codecs improve compression efficiency, but at a cost: they cannot easily adapt to large changes in available bitrate, and real-time encoding requires expensive, power-hungry GPUs that prohibit use on low-cost or resource-constrained platforms. To address these limitations, we propose a novel autoencoding framework (FRAPPE) that uses the Full input to predict the Residual output via a Projection Pursuit Encoder. FRAPPE's encoding objective naturally sorts latent channels by importance, allowing zero-overhead variable-rate coding. Unlike RNN-based learned codecs, whose encoder consumes the previous reconstruction's residual, or RVQ-style codecs, whose codebooks must be applied sequentially, FRAPPE's analysis path is an embarrassingly parallel DAG of independent input projections. Using FRAPPE, we build a variable-rate RGB image codec (FRAPPE-Image), and evaluate its rate-distortion-complexity trade-off against standard image codecs. At high compression ratios (approx. 0.1 bpp) FRAPPE-Image provides higher perceptual quality than AVIF with 47 times faster encoding, making it capable of real-time 1080p, 30fps CPU-only encoding. Our code and pre-trained models are available: https://github.com/UT-SysML/FRAPPE .

图像压缩自编码器可变率编码轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。