arXiv:2606.03940eess.IVcs.CV2026-06

用可学习的JPEG变换实现高效视觉压缩,兼顾速度与兼容性。

SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction

论文配图:SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction
图 1 · 摘自论文原文
  • 将传感器嵌入式自编码器与一次性转码结合,平衡压缩效率与算力消耗。
  • 200:1压缩比下,编码快7倍、解码快3.5倍,图像识别准确率提升8%。
  • 保留JPEG基础设施兼容性,适合边缘机器人等资源受限场景使用。

在机器人系统中,低成本低功耗硬件可轻松捕获高分辨率视觉数据,但受限于带宽和本地计算资源,传统编码格式(如JPEG/MPEG)难以充分利用。尽管新一代编码器(如AV1/AVIF)改善了率失真性能,但编码资源需求过高,无专用ASIC难以应用。近期非对称自编码器虽能在极端功耗与带宽约束下实现高质量重建,但解码成本高昂且使用定制格式,无法兼容长期建立的JPEG等标准体系。为此,我们提出面向云机器人的压缩框架SEAOTTER:通过传感器-云-终端三阶段差异化资源预算,结合学习到的紧凑潜在表示与标准JPEG文件的广泛可用性。针对直接转码导致性能下降的问题,设计可学习的JPEG色彩与量化变换,提升全局、密集及视觉语言感知任务精度。基于预训练冻结编码器,构建通用与任务感知的转码流水线。在200:1压缩比下,相比AVIF,编码速度提升7倍,解码速度提升3.5倍,ImageNet top-1准确率提高8%,同时保持对JPEG基础设施的兼容性。代码已开源:https://github.com/UT-SysML/seaotter。

原文摘要 · Abstract (English)

In robotics systems, vast amounts of visual data are easily captured at high resolution using low-cost, low-power hardware. Yet, limited bandwidth and on-device compute resources prevent full utilization when transmitted via conventional codecs like JPEG/MPEG. Newer codecs, like AV1/AVIF, improve the rate-distortion trade-off, but demand far more resources for encoding, impractical without custom ASICs. Recent asymmetric autoencoders deliver high quality under extreme power and bandwidth constraints, but add prohibitive decoding cost and use bespoke formats that ignore decades of infrastructure built around standards like JPEG. To address these limitations, we introduce a compression framework for cloud robotics based on a Sensor Embedded Autoencoder paired with a One-Time Transcode for Efficient Reconstruction (SEAOTTER). Because the sensor, cloud, and consumer stages face very different power and bandwidth budgets, SEAOTTER combines the compactness of a learned latent with the broad usability of a standard JPEG file. Since naive transcoding degrades performance, we propose a learnable JPEG color and quantization transform that enables increased accuracy for global, dense, and vision-language-based perception. Using SEAOTTER, we train both general-purpose and task-aware transcoding pipelines for a pre-trained, frozen encoder. At a compression ratio of 200:1 and compared to AVIF, we observe 7 times faster encoding, 3.5 times faster decoding, and +8% ImageNet top-1 accuracy, while retaining compatibility with JPEG infrastructure. Our code is available at https://github.com/UT-SysML/seaotter .

视觉压缩边缘计算自编码器JPEG优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。