解决深度学习压缩系统因硬件差异导致的不可复现问题。
Towards Reproducible Learning-based Compression
- 提出约束误差范围的保护机制,确保跨设备解码一致
- 实验验证在图像与点云压缩中有效防止解码崩溃
- 保护开销可随误差容忍度降低而动态缩减,适合部署
深度学习系统常因硬件或软件实现细节导致不可复现,影响技术可信度与实际部署。本文分析了在不同厂商设备间运行时,基于深度学习的压缩系统(如学习型熵编码器)因单比特差异引发解码崩溃的问题。针对资源有限的模块,提出仅当误差匹配被限定在一定范围内时,才能保证可复现性,并设计了一种防护机制。该方法可在重建层或特定解码层提供不同程度保护,且随着误差容忍度降低,保护开销可相应减小。实验表明,该方法在图像压缩和点云压缩中均有效提升了系统的稳定性和可复现性。
原文摘要 · Abstract (English)
A deep learning system typically suffers from a lack of reproducibility that is partially rooted in hardware or software implementation details. The irreproducibility leads to skepticism in deep learning technologies and it can hinder them from being deployed in many applications. In this work, the irreproducibility issue is analyzed where deep learning is employed in compression systems while the encoding and decoding may be run on devices from different manufacturers. The decoding process can even crash due to a single bit difference, e.g., in a learning-based entropy coder. For a given deep learning-based module with limited resources for protection, we first suggest that reproducibility can only be assured when the mismatches are bounded. Then a safeguarding mechanism is proposed to tackle the challenges. The proposed method may be applied for different levels of protection either at the reconstruction level or at a selected decoding level. Furthermore, the overhead introduced for the protection can be scaled down accordingly when the error bound is being suppressed. Experiments demonstrate the effectiveness of the proposed approach for learning-based compression systems, e.g., in image compression and point cloud compression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。