修复3D语义地图错误,不改动原有结构
VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps

- 基于图模型,利用邻域信息修正体素标签
- 在OccuFly数据集上提升平均交并比4.23~5.00个百分点
- 适用于飞行机器人等场景的语义地图后期优化
语义3D地图正通过将学习到的语义预测整合到3D表示中实现自动化构建。尽管避免了昂贵的手动标注,但感知与建图流程中的误差仍会残留在最终地图中,影响下游自主任务的可靠性。现有方法或依赖原始观测、或将占据视为预测问题的一部分,或对已完成的地图应用非学习的局部正则化。本文研究后处理语义修正,探讨是否可在保持地图几何和占据不变的前提下,直接从完成的地图中恢复语义准确性。我们提出 extit{VoxelFix},一种基于图的模型,根据局部几何与邻近语义信息修正体素标签。为获取训练样本,我们按上游地图中观察到的类别混淆方式,对标注的OccuFly地图连续区域进行污染。我们在四个独立训练的2D分割模型生成的完成版OccuFly地图上评估 extit{VoxelFix},结果表明其在所有测试场景中持续提升mIoU 4.23–5.00个百分点,各类别提升广泛分布,尤其在树、屋顶和墙类表现突出。在独立重建的分布外航空场景上的实验进一步表明,所学修正能力可跨环境迁移。
原文摘要 · Abstract (English)
Semantic 3D maps are increasingly constructed automatically for aerial robotics by integrating learned semantic predictions into 3D representations. While this avoids costly manual 3D annotation, errors in the perception and mapping pipeline can persist in the resulting map, reducing its reliability for downstream autonomous tasks. Existing 3D semantic map refinement methods either rely on the original observations, treat occupancy as part of the prediction problem, or apply non-learned local regularization to completed maps. Instead, we study post-hoc semantic correction, asking whether semantic accuracy can be recovered directly from the completed map while keeping its geometry and occupancy fixed. We introduce \method, a graph-based model that corrects voxel labels based on local geometry and neighboring semantic information. To obtain training pairs, we corrupt contiguous regions of annotated OccuFly maps according to class confusions observed in upstream maps. We evaluate \method on completed OccuFly maps generated from predictions of four independently trained 2D segmentation models. \method consistently improves mIoU by 4.23--5.00 percentage points, with gains broadly distributed across the evaluated semantic classes and particularly strong improvements for tree, roof, and wall. Results on an independently reconstructed out-of-distribution aerial scene further suggest that the learned correction can transfer beyond the environments seen during training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。