arXiv:2608.16225cs.CV2026-08

用提示引导增强点云密集预测,提升复杂场景下的精度与适应性。

PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds

论文配图:PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds
图 1 · 摘自论文原文
  • 引入提示引导分支,融合局部几何特征与全局正则化。
  • 在ShapeNetPart等三个数据集上显著提升分割性能,尤其在细粒度任务中。
  • 适合点云语义分割、实例分割等密集预测任务的研究与应用。

标准Transformer在点云分类中表现优异,但在复杂场景的密集预测任务中常因先验假设过弱而受限。为此,我们提出PCT-Prompt框架,通过引入提示引导特征分支,增强标准Transformer在密集预测中的表现。标准Transformer分支利用预训练模型提取全局特征,作为高层特征处理主干;提示引导分支包含两个关键组件:细粒度特征提取块,通过几何敏感抽象层捕捉多尺度几何特征,以及PnP-3D层,实现局部上下文与全局正则化的融合;另一组件为提示精炼特征学习块,生成并经交叉注意力机制优化提示令牌。此外,我们设计提示丢弃机制,逐层逐步移除提示信息,平衡局部细节与全局一致性。在ShapeNetPart、S3DIS和DALES数据集上的实验表明,PCT-Prompt显著提升了标准Transformer在密集预测任务中的适应性,在真实场景下实现强性能。

原文摘要 · Abstract (English)

Standard Transformers have proven effective in point cloud object classification, but their performance in dense prediction tasks within complex scenes is often hindered by weak prior assumptions. To address this challenge, we propose PCT-Prompt, a novel framework that enhances standard Transformers by introducing a prompt-guided feature branch to improve performance in dense prediction tasks. The standard Transformer branch leverages pre-trained models for global feature extraction from point cloud data, serving as the backbone for processing high-level features. Meanwhile, the prompt-guided feature branch consists of two key components: a fine-grained feature extraction block that captures multi-scale geometric features using geometry-sensitive abstraction layer, along with the PnP-3D layer to integrate local context with global regularization. The second component, the prompt-refined feature learning block generates prompt tokens, which are subsequently refined through cross-attention mechanisms. Additionally, we introduce a prompt drop mechanism that progressively removes prompt information across Transformer layers, balancing local details and global consistency. Experimental results on the ShapeNetPart, S3DIS, and DALES datasets demonstrate that PCT-Prompt significantly improves the adaptability of standard Transformers to dense prediction tasks, achieving strong performance in real-world scenarios.

点云提示引导稠密预测Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。