用强化学习优化点云补全的局部细节,提升几何精度。
RL-AD-Net: Reinforcement Learning Guided Adaptive Displacement in Latent Space for Refined Point Cloud Completion
- 在预训练编码器的隐空间中,用强化学习动态调整特征向量。
- 在ShapeNetCore-2048上,随机裁剪下仍比基线模型提升显著。
- 无需重训练,可适配多种补全模型,轻量且模块化。
当前点云补全模型(如基于Transformer、去噪等)虽能生成整体合理形状,但常存在局部几何不一致问题。本文提出RL-AD-Net,一种基于强化学习(RL)的隐空间精修框架,运行于预训练点云自编码器的隐空间中。自编码器将补全结果编码为紧凑全局特征向量(GFVs),由一个强化学习代理选择性地调整以提升几何保真度。为保证鲁棒性,引入轻量级非参数化PointNN选择器,评估原始补全与强化精修输出的几何一致性,保留更优结果。有真实标签时,使用Chamfer Distance和几何一致性指标联合指导精修。训练按类别独立进行,因无监督且动态的RL在高度多样类别间收敛困难。尽管如此,该框架未来可扩展至多类别精修。在ShapeNetCore-2048上的实验表明,基线模型在其训练式裁剪下表现尚可,但在随机裁剪场景中表现不佳;而RL-AD-Net在两种设置下均持续提升,凸显强化学习引导集成精修的有效性。该方法轻量、模块化、与模型无关,可直接应用于多种补全网络,无需重新训练。
原文摘要 · Abstract (English)
Recent point cloud completion models, including transformer-based, denoising-based, and other state-of-the-art approaches, generate globally plausible shapes from partial inputs but often leave local geometric inconsistencies. We propose RL-AD-Net, a reinforcement learning (RL) refinement framework that operates in the latent space of a pretrained point autoencoder. The autoencoder encodes completions into compact global feature vectors (GFVs), which are selectively adjusted by an RL agent to improve geometric fidelity. To ensure robustness, a lightweight non-parametric PointNN selector evaluates the geometric consistency of both the original completion and the RL-refined output, retaining the better reconstruction. When ground truth is available, both Chamfer Distance and geometric consistency metrics guide refinement. Training is performed separately per category, since the unsupervised and dynamic nature of RL makes convergence across highly diverse categories challenging. Nevertheless, the framework can be extended to multi-category refinement in future work. Experiments on ShapeNetCore-2048 demonstrate that while baseline completion networks perform reasonable under their training-style cropping, they struggle in random cropping scenarios. In contrast, RL-AD-Net consistently delivers improvements across both settings, highlighting the effectiveness of RL-guided ensemble refinement. The approach is lightweight, modular, and model-agnostic, making it applicable to a wide range of completion networks without requiring retraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。