解决肠镜移动光源导致的光照失真问题，提升三维重建精度。
Moving Light Adaptive Colonoscopy Reconstruction via Illumination-Attenuation-Aware 3D Gaussian Splatting
- 引入双因子光照衰减模型，模拟真实肠镜光照变化
- 在标准数据集上实现更优的视角合成与深度误差表现
- 适合需要高保真肠镜三维重建的研究者使用
3D高斯点阵（3DGS）实现了肠镜的实时视角合成，但其假设光照恒定，无法应对移动光源和相机引起的强烈光度变化。这种不匹配导致现有方法通过破坏结构的高斯点补偿光照衰减，降低几何保真度。先前工作仅考虑距离相关的衰减，忽略了肠镜照明的物理特性。本文提出ColIAGS，一种改进的3DGS框架用于肠镜成像。为模拟不同光照下的真实外观，我们引入包含两种光照衰减因子的照明模型。为满足该模型的近似并有效集成到3DGS框架中，我们设计了改进的几何建模以增强几何细节，以及改进的外观建模以隐式优化光照衰减解。在标准基准上的实验结果表明，ColIAGS支持高质量的新视角合成和准确的几何重建，在渲染保真度和深度均方误差（Depth MSE）上优于现有最优方法。代码已公开于https://github.com/haowang020110/ColIAGS。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) enables real-time view synthesis in colonoscopy but assumes static illumination, making it incompatible with the strong photometric variations caused by the moving light source and camera. This mismatch leads existing methods to compensate for illumination attenuation with structure-violating Gaussians, degrading geometric fidelity. Prior work considers only distance-based attenuation and overlooks the physical characteristics of colonscopic lighting. In this paper, we propose ColIAGS, an improved 3DGS framework for colonoscopy. To mimic realistic appearance under varying illumination, we introduce a lighting model with two types of illumination attenuation factors. To satisfy this lighting model's approximation and effectively integrate it into the 3DGS framework, we design Improved Geometry Modeling to strengthen geometry details and Improved Appearance Modeling to implicitly optimize illumination attenuation solutions. Experimental results on standard benchmarks demonstrate that ColIAGS supports both high-quality novel-view synthesis and accurate geometry reconstruction, outperforming state-of-the-art methods in rendering fidelity and Depth MSE. Our code is available at https://github.com/haowang020110/ColIAGS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。