arXiv:2505.16679cs.CVcs.AI2025-05被引 1

用自然语言存储3D物体语义,实现105倍压缩且保持高质量。

Semantic Compression of 3D Objects for Open and Collaborative Virtual Worlds

  • 以自然语言为存储格式,忽略几何细节,聚焦核心概念。
  • 在Objaverse数据集上实现最高105倍压缩率,100倍时质量更优。
  • 适合元宇宙、协作虚拟世界等需高效共享的场景。

传统3D对象压缩仅处理顶点、多边形和纹理等结构信息,在压缩率超过10倍时会出现纹理伪影、多边形数量过少和网格间隙等问题。相比之下,语义压缩忽略结构信息,直接对核心概念进行编码,可实现极端压缩。该方法采用自然语言作为存储格式,具备天然的人类可读性,适用于大规模协同的增强现实与虚拟现实应用。它主动弱化位置、尺寸、朝向等几何信息,并利用先进的深度生成模型重建缺失内容。本文构建了基于公开生成模型的3D语义压缩流水线,探索了3D对象压缩的质量-压缩率边界。在Objaverse数据集上的实验表明,该方法实现了高达105倍的压缩率,且在约100倍压缩率的关键质量保留区域优于传统方法。

原文摘要 · Abstract (English)

Traditional methods for 3D object compression operate only on structural information within the object vertices, polygons, and textures. These methods are effective at compression rates up to 10x for standard object sizes but quickly deteriorate at higher compression rates with texture artifacts, low-polygon counts, and mesh gaps. In contrast, semantic compression ignores structural information and operates directly on the core concepts to push to extreme levels of compression. In addition, it uses natural language as its storage format, which makes it natively human-readable and a natural fit for emerging applications built around large-scale, collaborative projects within augmented and virtual reality. It deprioritizes structural information like location, size, and orientation and predicts the missing information with state-of-the-art deep generative models. In this work, we construct a pipeline for 3D semantic compression from public generative models and explore the quality-compression frontier for 3D object compression. We apply this pipeline to achieve rates as high as 105x for 3D objects taken from the Objaverse dataset and show that semantic compression can outperform traditional methods in the important quality-preserving region around 100x compression.

3D压缩语义编码元宇宙生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。