一个模型搞定所有3D物体检测任务,跨域干扰问题有解。
One for All: Multi-Domain Joint Training for Point Cloud Based 3D Object Detection
- 用路由机制划分点云特征,缓解不同数据集间的干扰
- 引入文本模态统一标签空间,解决类别混淆问题
- 稀疏结构+无锚框设计,适配尺度差异大的点云
当前计算机视觉趋势是构建能应对多种任务的通用模型。实现这一目标需融合多领域数据进行联合训练以学习多种场景。然而,在基于点云的3D物体检测中,不同数据集间点云存在显著域差距,导致严重的域干扰问题。本文提出OneDet3D,一种统一框架下的全场景3D检测通用模型,仅用一套参数即可处理室内、室外等多种场景。通过基于路由机制的域感知特征分区策略缓解数据干扰,并引入文本模态实现语言引导分类,统一多数据集标签空间,减轻类别干扰。全稀疏结构与无锚框头设计进一步适应点云间显著的尺度差异。大量实验表明,OneDet3D仅凭单一训练模型即可有效应对几乎所有3D物体检测任务。
原文摘要 · Abstract (English)
The current trend in computer vision is to utilize one universal model to address all various tasks. Achieving such a universal model inevitably requires incorporating multi-domain data for joint training to learn across multiple problem scenarios. In point cloud based 3D object detection, however, such multi-domain joint training is highly challenging, because large domain gaps among point clouds from different datasets lead to the severe domain-interference problem. In this paper, we propose \textbf{OneDet3D}, a universal one-for-all model that addresses 3D detection across different domains, including diverse indoor and outdoor scenes, within the \emph{same} framework and only \emph{one} set of parameters. We propose the domain-aware partitioning in scatter and context, guided by a routing mechanism, to address the data interference issue, and further incorporate the text modality for a language-guided classification to unify the multi-dataset label spaces and mitigate the category interference issue. The fully sparse structure and anchor-free head further accommodate point clouds with significant scale disparities. Extensive experiments demonstrate the strong universal ability of OneDet3D to utilize only one trained model for addressing almost all 3D object detection tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。