arXiv:2603.22070cs.CV2026-03

用贝叶斯融合文本与点云特征,实现测试时持续自适应

Adapting Point Cloud Analysis via Multimodal Bayesian Distribution Learning

  • 将文本和点云数据建模为高斯分布,通过贝叶斯平均融合
  • 在多个点云基准上实现超4%的性能提升,抗分布偏移更强
  • 适合需要在线适应的新场景点云分析任务

多模态3D视觉语言模型在多样化的3D任务中表现出强泛化能力,但在域偏移下性能仍显著下降。这推动了测试时自适应(TTA)的研究,使模型能利用测试数据在线调整。现有方法多采用缓存机制存储历史样本以优化预测,但仅保留有限信息,随测试流演进导致信息渐进丢失;且预测置信度融合方式依赖启发式规则,使适应过程不稳定。为此,本文提出贝叶斯多模态分布学习框架BayesMM,用于测试时点云分析。BayesMM将每类别的文本先验与动态到达的视觉特征分别建模为高斯分布:文本参数来自语义提示,视觉参数则随新样本在线更新。两模态通过贝叶斯模型平均融合,自动根据后验证据调整贡献权重,实现无需训练的持续自适应预测。在多个点云基准上的大量实验表明,BayesMM在分布偏移下保持鲁棒性,平均性能提升超过4%。

原文摘要 · Abstract (English)

Multimodal 3D vision-language models show strong generalization across diverse 3D tasks, but their performance still degrades notably under domain shifts. This has motivated recent studies on test-time adaptation (TTA), which enables models to adapt online using test-time data. Among existing TTA methods, cache-based mechanisms are widely adopted for leveraging previously observed samples in online prediction refinement. However, they store only limited historical information, leading to progressive information loss as the test stream evolves. In addition, their prediction logits are fused heuristically, making adaptation unstable. To address these limitations, we propose BayesMM, a Multimodal Bayesian Distribution Learning framework for test-time point cloud analysis. BayesMM models textual priors and streaming visual features of each class as Gaussian distributions: textual parameters are derived from semantic prompts, while visual parameters are updated online with arriving samples. The two modalities are fused via Bayesian model averaging, which automatically adjusts their contributions based on posterior evidence, yielding a unified prediction that adapts continually to evolving test-time data without training. Extensive experiments on multiple point cloud benchmarks demonstrate that BayesMM maintains robustness under distributional shifts, yielding over 4% average improvement.

点云分析测试时适应贝叶斯学习多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。