提出通用方法INRet,实现对3D形状隐式神经表示的精准相似性检索。
INRet: A General Framework for Accurate Retrieval of INRs for Shapes
- 基于统一框架计算不同架构的隐式神经表示相似性
- 支持八叉树、三平面等多类结构,精度高于现有方法
- 适合需要高效检索3D形状数据的研究者和开发者
隐式神经表示(INRs)已成为编码3D物体、场景、图像和视频等数据的重要方法,尤其在3D内容重建、生成与补全方面表现优异。随着3D数据以INR格式大量生成,亟需支持对存储于数据仓库中的INRs进行有效组织与检索。关键挑战在于定义不同INRs间的相似性,以实现通过查询INR检索相似的存储INR。本文提出INRet,一种针对形状类INRs的相似性度量方法,可实现准确检索。该方法灵活适配多种架构(如八叉树网格、三平面、哈希网格)及函数类型(符号/非符号距离场、占据场)。实验表明,相比仅支持简单MLP且要求查询与存储模型结构一致的现有方法,INRet更具通用性和准确性;相较于将INRs转换为点云或多视图图像的方案,INRet在保持更高检索精度的同时避免了转换开销。
原文摘要 · Abstract (English)
Implicit neural representations (INRs) have become an important method for encoding various data types, such as 3D objects or scenes, images, and videos. They have proven to be particularly effective at representing 3D content, e.g., 3D scene reconstruction from 2D images, novel 3D content creation, as well as the representation, interpolation, and completion of 3D shapes. With the widespread generation of 3D data in an INR format, there is a need to support effective organization and retrieval of INRs saved in a data store. A key aspect of retrieval and clustering of INRs in a data store is the formulation of similarity between INRs that would, for example, enable retrieval of similar INRs using a query INR. In this work, we propose INRet, a method for determining similarity between INRs that represent shapes, thus enabling accurate retrieval of similar shape INRs from an INR data store. INRet flexibly supports different INR architectures such as INRs with octree grids, triplanes, and hash grids, as well as different implicit functions including signed/unsigned distance function and occupancy field. We demonstrate that our method is more general and accurate than the existing INR retrieval method, which only supports simple MLP INRs and requires the same architecture between the query and stored INRs. Furthermore, compared to converting INRs to other representations (e.g., point clouds or multi-view images) for 3D shape retrieval, INRet achieves higher accuracy while avoiding the conversion overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。