解决点云补全中跨域适应难题,提升模型在不同场景下的泛化能力。
DAPoinTr: Domain Adaptive Point Transformer for Point Cloud Completion
- 通过领域查询与点标记对齐,实现全局与局部特征的域不变性
- 多专家投票机制提升预测一致性,增强模型鲁棒性
- 适用于真实场景下点云数据分布变化大的补全任务
点云补全中的点变换器(PoinTr)展现出巨大潜力,但跨域适应以提升目标域迁移能力仍缺乏探索。本文发现,仅对点变换器的CNN主干进行特征对齐效果有限,因无法保证变换器中序列级的域不变特征。为此,提出首个点云补全领域的自适应点变换器(DAPoinTr)框架。其包含三个核心组件:基于领域查询的特征对齐(DQFA)、点标记级特征对齐(PTFA)和投票预测一致性(VPC)。DQFA通过编码器与解码器中的领域代理与领域查询缩小全局域差距;PTFA通过点代理与动态查询对齐局部特征;VPC将多个解码器视为多专家(MoE),通过集成投票与伪标签生成提升性能。在多个跨域基准上的大量实验与可视化验证了DAPoinTr优于当前最优方法。代码将公开于 https://github.com/Yinghui-Li-New/DAPoinTr。
原文摘要 · Abstract (English)
Point Transformers (PoinTr) have shown great potential in point cloud completion recently. Nevertheless, effective domain adaptation that improves transferability toward target domains remains unexplored. In this paper, we delve into this topic and empirically discover that direct feature alignment on point Transformer's CNN backbone only brings limited improvements since it cannot guarantee sequence-wise domain-invariant features in the Transformer. To this end, we propose a pioneering Domain Adaptive Point Transformer (DAPoinTr) framework for point cloud completion. DAPoinTr consists of three key components: Domain Query-based Feature Alignment (DQFA), Point Token-wise Feature alignment (PTFA), and Voted Prediction Consistency (VPC). In particular, DQFA is presented to narrow the global domain gaps from the sequence via the presented domain proxy and domain query at the Transformer encoder and decoder, respectively. PTFA is proposed to close the local domain shifts by aligning the tokens, \emph{i.e.,} point proxy and dynamic query, at the Transformer encoder and decoder, respectively. VPC is designed to consider different Transformer decoders as multiple of experts (MoE) for ensembled prediction voting and pseudo-label generation. Extensive experiments with visualization on several domain adaptation benchmarks demonstrate the effectiveness and superiority of our DAPoinTr compared with state-of-the-art methods. Code will be publicly available at: https://github.com/Yinghui-Li-New/DAPoinTr
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。