为机器间视频通信设计新编码标准，提升效率并保护隐私。
Emerging Standards for Machine-to-Machine Video Coding
- 提出特征级压缩的FCM与任务感知的VCM编码框架
- FCM在保持边缘推理精度的同时降低码率，优于传统方案
- 现有硬件支持下，HEVC可替代VVC且性能相近
机器正日益成为视觉数据的主要消费者，但当前多数机器间系统仍依赖面向人类感知优化的像素级视频编码进行远程推理，导致带宽开销大、可扩展性差，并暴露原始图像给第三方。为此，Moving Picture Experts Group（MPEG）重新设计了机器间通信流程：视频编码用于机器（VCM）在像素域应用任务感知编码工具，特征编码用于机器（FCM）压缩神经中间特征，以降低码率、保护隐私并支持计算卸载。实验表明，FCM可在接近边缘推理精度的前提下显著降低码率。对FCM中使用的内层编码器（H.26X）分析显示，H.265/HEVC与H.266/VVC在机器任务性能上几乎相同，替换时平均BD-Rate仅增加1.39%；而H.264/AVC相比VVC平均增加32.28%。对于跟踪任务，编解码器选择影响较小，其中HEVC表现优于VVC，BD-Rate分别为-1.81%和8.79%，说明现有已部署编码器硬件可支撑机器间通信且不损害性能。
原文摘要 · Abstract (English)
Machines are increasingly becoming the primary consumers of visual data, yet most deployments of machine-to-machine systems still rely on remote inference where pixel-based video is streamed using codecs optimized for human perception. Consequently, this paradigm is bandwidth intensive, scales poorly, and exposes raw images to third parties. Recent efforts in the Moving Picture Experts Group (MPEG) redesigned the pipeline for machine-to-machine communication: Video Coding for Machines (VCM) is designed to apply task-aware coding tools in the pixel domain, and Feature Coding for Machines (FCM) is designed to compress intermediate neural features to reduce bitrate, preserve privacy, and support compute offload. Experiments show that FCM is capable of maintaining accuracy close to edge inference while significantly reducing bitrate. Additional analysis of H.26X codecs used as inner codecs in FCM reveals that H.265/High Efficiency Video Coding (HEVC) and H.266/Versatile Video Coding (VVC) achieve almost identical machine task performance, with an average BD-Rate increase of 1.39% when VVC is replaced with HEVC. In contrast, H.264/Advanced Video Coding (AVC) yields an average BD-Rate increase of 32.28% compared to VVC. However, for the tracking task, the impact of codec choice is minimal, with HEVC outperforming VVC and achieving BD Rate of -1.81% and 8.79% for AVC, indicating that existing hardware for already deployed codecs can support machine-to-machine communication without degrading performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。