3D点云分割中,简单交叉熵竟比复杂方法更稳,因损失地形限制了优化空间。
Loss Landscape Topology Reveals Why Simple Baselines are Competitive at 3D Point Cloud Segmentation Under Class Imbalance

- 通过分析损失地形几何结构,揭示极端不平衡下解空间狭窄、温和时平坦
- 标准交叉熵在641:1和56:1失衡比下均接近最优,差距仅0.8-3.3% mIoU
- 适合追求稳定基线的工程师,不推荐盲目使用复杂修正方法
3D点云语义分割面临严重类别失衡问题,但2D视觉中有效的失衡缓解方法在3D场景中的有效性尚不明确。本文系统评估了11种失衡缓解方法在极端(641:1)与中等(56:1)失衡比数据集上的表现,发现一个意外结果:标准交叉熵配合均匀加权在多数情况下性能与专门方法相当,通常仅落后0.8-3.3% mIoU,且跨架构与数据集表现稳健。通过误差模式、决策边界及优化景观的多维度机制分析,我们发现失衡程度塑造了损失地形拓扑——极端失衡下形成狭窄解盆地,中等失衡下则为平坦平台。这限制了损失层面修改的有效性,所有方法都需应对此类几何约束。研究建议,标准交叉熵应作为稳健基线;专用方法虽有0.8-3.3%提升,但其效果依赖于架构与数据集,且调参不当可能导致显著性能下降。本工作首次从机制上解释为何2D成功方法难以迁移到基于点的3D分割任务,并在两种代表性架构上验证。
原文摘要 · Abstract (English)
Semantic segmentation of 3D point clouds faces severe class imbalance, yet the effectiveness of specialized imbalance-aware methods from 2D computer vision remains unclear in 3D contexts. We systematically evaluate 11 imbalance mitigation approaches across datasets with extreme (641:1) and moderate (56:1) imbalance ratios, revealing a surprising finding: standard cross-entropy with uniform weighting achieves competitive performance, typically within 0.8-3.3% mIoU of specialized methods across architectures and datasets. Through multifaceted mechanistic analysis of error patterns, decision boundaries, and the geometry of the optimization landscape, our analyses suggest that imbalance severity shapes the topology, creating narrow solution basins under extreme imbalance and flat plateaus under moderate imbalance. This appears to constrain the effectiveness of loss-level modifications, as all methods must navigate these geometric constraints. Our findings offer practical guidance; standard cross-entropy provides a robust baseline, with specialized methods offering modest improvements (0.8-3.3% mIoU) that vary by architecture and dataset but risk substantial degradation if poorly tuned. This work provides the first mechanistic explanation for why techniques proven effective in 2D do not readily transfer to point-based 3D point cloud segmentation, validated across two representative architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。