arXiv:2503.00308cs.CV2025-03被引 1

通过约束图像矩阵实现相机连续移动下的精确视觉不确定性分析

Abstract Rendering: Computing All that is Seen in Gaussian Splat Scenes

  • 用约束矩阵表示无限视角渲染,支持严格不确定性传播
  • 可处理75万高斯点,比现有方法快2-14倍且保持精度
  • 适合自动驾驶等安全关键系统的视觉系统验证

我们提出抽象渲染,一种从连续变化的相机位置渲染一组图像的方法。生成的抽象图像编码了无限多可能的渲染结果,通过图像矩阵上的约束进行表示,从而实现渲染过程中的严格不确定性传播。该能力对基于视觉的自主系统和其它安全关键应用至关重要。我们的方法作用于高斯点云场景,这是一种新兴的计算机视觉与机器人表示方式。通过高效的分段线性边界传播,我们实现了对基本渲染操作的抽象,同时解决了矩阵求逆和深度排序这两个难以直接近似的难题。为此,我们开发了新的线性关系抽象方法,在保证精度的同时确保计算效率。这些抽象不仅支撑了我们的抽象渲染算法,还为其他渲染问题提供了通用工具。我们的实现AbstractSplat具备良好的可扩展性,能处理高达75万高斯点,并通过分块与批处理机制平衡内存与运行时间。相比现有唯一针对网格场景的抽象图像方法,AbstractSplat在保持精度的前提下实现2-14倍加速。

原文摘要 · Abstract (English)

We introduce abstract rendering, a method for computing a set of images by rendering a scene from a continuously varying range of camera positions. The resulting abstract image-which encodes an infinite collection of possible renderings-is represented using constraints on the image matrix, enabling rigorous uncertainty propagation through the rendering process. This capability is particularly valuable for the formal verification of vision-based autonomous systems and other safety-critical applications. Our approach operates on Gaussian splat scenes, an emerging representation in computer vision and robotics. We leverage efficient piecewise linear bound propagation to abstract fundamental rendering operations, while addressing key challenges that arise in matrix inversion and depth sorting-two operations not directly amenable to standard approximations. To handle these, we develop novel linear relational abstractions that maintain precision while ensuring computational efficiency. These abstractions not only power our abstract rendering algorithm but also provide broadly applicable tools for other rendering problems. Our implementation, AbstractSplat, is optimized for scalability, handling up to 750k Gaussians while allowing users to balance memory and runtime through tile and batch-based computation. Compared to the only existing abstract image method for mesh-based scenes, AbstractSplat achieves 2-14x speedups while preserving precision. Our results demonstrate that continuous camera motion, rotations, and scene variations can be rigorously analyzed at scale, making abstract rendering a powerful tool for uncertainty-aware vision applications.

抽象渲染高斯点云不确定性分析视觉验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。