用3D点云提升机器人穿衣服时的泛化能力,效果远超传统方法。
FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Prediction
- 基于预训练几何特征,分离感知与动作决策,提升泛化性。
- 在未见衣物上效率仅下降11.5%,覆盖率达89%,优于基线。
- 适合做服装抓取、折叠等需要跨款式通用的任务研究者。
针对机器人进行双臂服装平整操作时存在的类别级泛化难题,由于高维状态、复杂动力学及同类内差异,现有方法常因过拟合特定实例或无法预测协同双臂动作价值而失效。本文提出特征条件化的双臂价值网络(FCBV-Net),在3D点云上运行,通过冻结的密集几何特征实现对同类服装变化的鲁棒性。下游可训练模块利用这些静态特征学习任务特定策略。在使用CLOTH3D数据集的PyFlex仿真环境中,FCBV-Net展现出优越的类别级泛化能力:在未见衣物上仅产生11.5%效率下降(Steps80),远优于2D图像基线的96.2%;最终覆盖率达89%,高于采用相同几何特征但固定基元的3D对应基线的83%。结果表明,将几何理解与双臂动作价值学习解耦,能显著提升泛化性能。代码、视频及补充材料见项目主页:https://dabaspark.github.io/fcbvnet/。
原文摘要 · Abstract (English)
Category-level generalization for robotic garment manipulation, such as bimanual smoothing, remains a significant hurdle due to high dimensionality, complex dynamics, and intra-category variations. Current approaches often struggle, either overfitting with concurrently learned visual features for a specific instance or, despite Category-level perceptual generalization, failing to predict the value of synergistic bimanual actions. We propose the Feature-Conditioned bimanual Value Network (FCBV-Net), operating on 3D point clouds to specifically enhance category-level policy generalization for garment smoothing. FCBV-Net conditions bimanual action value prediction on pre-trained, frozen dense geometric features, ensuring robustness to intra-category garment variations. Trainable downstream components then learn a task-specific policy using these static features. In simulated PyFlex environments using the CLOTH3D dataset, FCBV-Net demonstrated superior category-level generalization. It exhibited only an 11.5% efficiency drop (Steps80) on unseen garments compared to 96.2% for a 2D image-based baseline, and achieved 89% final coverage, outperforming an 83% coverage from a 3D correspondence-based baseline that uses identical per-point geometric features but a fixed primitive. These results highlight that the decoupling of geometric understanding from bimanual action value learning enables better category-level generalization. Code, videos, and supplementary materials are available at the project website: https://dabaspark.github.io/fcbvnet/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。