提出快速无监督体素场景流估计方法,大幅降低计算时间且保持高精度。
Floxels: Fast Unsupervised Voxel Based Scene Flow Estimation
- 基于体素网格设计新模型,替代传统MLP提升效率与效果。
- 引入多帧损失函数,增强对动态场景的建模能力。
- 在Argoverse 2上比EulerFlow快60-140倍,仅需10分钟/序列。
场景流估计是机器人应用中的基础任务,如动态物体检测、自动标注和传感器同步。现有方法分为两类:监督式方法速度快、精度高,但依赖大量标注数据且易受领域差异影响;无监督测试时优化方法避免了领域差距问题,但通常计算耗时长、存在伪影或无法收敛。本文针对优化类方法的局限性,提出两点改进:1)设计一种基于体素网格的简化模型,优于标准MLP在多个维度的表现;2)提出新的多帧损失函数。二者结合形成新方法Floxels。在Argoverse 2基准上,Floxels虽略逊于EulerFlow(无监督方法中最佳),但性能相当而计算成本极低。相比EulerFlow,Floxels实现超过60-140倍加速,单序列推理时间从一天缩短至10分钟;相较更快但精度较低的基线NSFP,仍提升约14倍速度。
原文摘要 · Abstract (English)
Scene flow estimation is a foundational task for many robotic applications, including robust dynamic object detection, automatic labeling, and sensor synchronization. Two types of approaches to the problem have evolved: 1) Supervised and 2) optimization-based methods. Supervised methods are fast during inference and achieve high-quality results, however, they are limited by the need for large amounts of labeled training data and are susceptible to domain gaps. In contrast, unsupervised test-time optimization methods do not face the problem of domain gaps but usually suffer from substantial runtime, exhibit artifacts, or fail to converge to the right solution. In this work, we mitigate several limitations of existing optimization-based methods. To this end, we 1) introduce a simple voxel grid-based model that improves over the standard MLP-based formulation in multiple dimensions and 2) introduce a new multiframe loss formulation. 3) We combine both contributions in our new method, termed Floxels. On the Argoverse 2 benchmark, Floxels is surpassed only by EulerFlow among unsupervised methods while achieving comparable performance at a fraction of the computational cost. Floxels achieves a massive speedup of more than ~60 - 140x over EulerFlow, reducing the runtime from a day to 10 minutes per sequence. Over the faster but low-quality baseline, NSFP, Floxels achieves a speedup of ~14x.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。