让点云补全模型在测试时自适应调整,提升真实场景鲁棒性。
PointMAC: Meta-Learned Adaptation for Robust Test-Time Point Cloud Completion
- 用元学习优化辅助目标,实现无需标注的测试时自适应
- 在合成、模拟和真实数据上均达当前最佳性能
- 适合机器人、AR等需要高可靠3D感知的场景
点云补全对机器人、增强现实等安全关键应用中的鲁棒3D感知至关重要。现有模型采用静态推理,严重依赖训练时学习的归纳偏置,难以在测试时适应新结构模式和传感器畸变。为此,我们提出PointMAC,一种用于点云补全的元学习测试时自适应框架。该方法无需额外监督即可实现样本级精修。通过两个自监督辅助目标模拟结构与传感器层面的不完整,结合基于MAML的元辅助学习策略,确保辅助目标驱动的适应始终与主任务对齐。推理时,通过优化辅助损失在线调整共享编码器,解码器保持固定。为进一步稳定适应过程,引入元学习的自适应λ校准机制,动态平衡主任务与辅助目标的梯度。在合成、模拟及真实世界数据集上的大量实验表明,PointMAC通过逐样本精修实现了高质量补全,达到当前最优效果。据我们所知,这是首个将元辅助测试时自适应应用于点云补全的工作。
原文摘要 · Abstract (English)
Point cloud completion is essential for robust 3D perception in safety-critical applications such as robotics and augmented reality. However, existing models perform static inference and rely heavily on inductive biases learned during training, limiting their ability to adapt to novel structural patterns and sensor-induced distortions at test time. To address this limitation, we propose PointMAC, a meta-learned framework for robust test-time adaptation in point cloud completion. It enables sample-specific refinement without requiring additional supervision. Our method optimizes the completion model under two self-supervised auxiliary objectives that simulate structural and sensor-level incompleteness. A meta-auxiliary learning strategy based on Model-Agnostic Meta-Learning (MAML) ensures that adaptation driven by auxiliary objectives is consistently aligned with the primary completion task. During inference, we adapt the shared encoder on-the-fly by optimizing auxiliary losses, with the decoder kept fixed. To further stabilize adaptation, we introduce Adaptive $λ$-Calibration, a meta-learned mechanism for balancing gradients between primary and auxiliary objectives. Extensive experiments on synthetic, simulated, and real-world datasets demonstrate that PointMAC achieves state-of-the-art results by refining each sample individually to produce high-quality completions. To the best of our knowledge, this is the first work to apply meta-auxiliary test-time adaptation to point cloud completion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。