融合可见光与X射线数据，实现物体内外结构的统一3D重建。
InsideOut: Integrated RGB-Radiative Gaussian Splatting for Comprehensive 3D Object Representation
- 将RGB与X射线数据通过层级拟合对齐，构建统一3D表示
- 引入X射线参考损失，确保内部结构一致性
- 适用于医疗、文物修复等需内外结构同步的场景
我们提出InsideOut，一种扩展的3D高斯点阵（3DGS）方法，弥合了高保真可见光表面细节与次表层X射线结构之间的差距。该方法在医学诊断、文化遗产修复和制造领域具有重要价值。我们采集了新的成对RGB与X射线数据，采用分层拟合对齐RGB与X射线辐射高斯点阵，并提出一种X射线参考损失以保证内部结构的一致性。InsideOut有效应对了两种模态间数据表示差异大、配对数据稀缺的挑战，显著拓展了3DGS的应用范围，提升了可视化、仿真与无损检测能力。
原文摘要 · Abstract (English)
We introduce InsideOut, an extension of 3D Gaussian splatting (3DGS) that bridges the gap between high-fidelity RGB surface details and subsurface X-ray structures. The fusion of RGB and X-ray imaging is invaluable in fields such as medical diagnostics, cultural heritage restoration, and manufacturing. We collect new paired RGB and X-ray data, perform hierarchical fitting to align RGB and X-ray radiative Gaussian splats, and propose an X-ray reference loss to ensure consistent internal structures. InsideOut effectively addresses the challenges posed by disparate data representations between the two modalities and limited paired datasets. This approach significantly extends the applicability of 3DGS, enhancing visualization, simulation, and non-destructive testing capabilities across various domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。