提出自适应采样框架,让模型更聪明地处理点云任务
MICAS: Multi-grained In-Context Adaptive Sampling for 3D Point Cloud Processing
- 根据任务特点动态选点,按查询优化提示
- 点云分割任务提升4.1%,多任务表现稳定
- 适合需要统一模型处理多种点云任务的场景
点云处理(PCP)涵盖重建、去噪、配准和分割等任务,通常需专用模型应对不同特性。尽管上下文学习(ICL)通过单一模型配合任务提示在跨任务中展现潜力,但其在点云处理中的应用暴露出显著局限性。我们识别出当前ICL方法在点云处理中存在跨任务与任务内敏感性问题,根源在于点与提示层面缺乏上下文自适应的采样策略。为此,我们提出MICAS——一种面向点云处理的多粒度自适应采样框架。该框架包含两个核心组件:任务自适应点采样,利用跨任务线索进行点级采样;查询特异性提示采样,为每个查询选择最优提示以缓解任务内敏感性。据我们所知,这是首个在ICL框架中引入针对点云特性定制化采样的方法。大量实验表明,MICAS不仅高效处理多种点云任务,且显著优于现有方法,在部分分割任务中实现4.1%的显著提升,并在各类点云应用中保持一致性能增益。
原文摘要 · Abstract (English)
Point cloud processing (PCP) encompasses tasks like reconstruction, denoising, registration, and segmentation, each often requiring specialized models to address unique task characteristics. While in-context learning (ICL) has shown promise across tasks by using a single model with task-specific demonstration prompts, its application to PCP reveals significant limitations. We identify inter-task and intra-task sensitivity issues in current ICL methods for PCP, which we attribute to inflexible sampling strategies lacking context adaptation at the point and prompt levels. To address these challenges, we propose MICAS, an advanced ICL framework featuring a multi-grained adaptive sampling mechanism tailored for PCP. MICAS introduces two core components: task-adaptive point sampling, which leverages inter-task cues for point-level sampling, and query-specific prompt sampling, which selects optimal prompts per query to mitigate intra-task sensitivity. To our knowledge, this is the first approach to introduce adaptive sampling tailored to the unique requirements of point clouds within an ICL framework. Extensive experiments show that MICAS not only efficiently handles various PCP tasks but also significantly outperforms existing methods. Notably, it achieves a remarkable $4.1\%$ improvement in the part segmentation task and delivers consistent gains across various PCP applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。