arXiv:2606.12334cs.LGcs.RO2026-06被引 3

用傅里叶特征提升机器人操控的精度,让模型更好捕捉几何细节。

Fourier Features Let Agents Learn High Precision Policies with Imitation Learning

论文配图:Fourier Features Let Agents Learn High Precision Policies with Imitation Learning
图 1 · 摘自论文原文
  • 将点云从笛卡尔空间映射到高维傅里叶空间,增强高频特征表达
  • 在RoboCasa和ManiSkill3上显著提升操作成功率,真实机器人验证有效
  • 方法简单通用,适配多种网络结构,对超参数不敏感

高精度机器人操作需要精细的空间推理,而仅依赖RGB图像的策略常因深度模糊和视角尺度问题难以实现。基于点云的策略虽具备更强的几何先验,但性能仍高度依赖任务。我们假设此差异源于神经网络对低频函数的谱偏差,尤其影响依赖缓慢变化笛卡尔特征的架构。为此,我们提出将点云从笛卡尔空间映射至高维傅里叶空间,使点云编码器直接获取高频特征。我们在RoboCasa和ManiSkill3基准及真实机器人平台上验证了该方法的有效性。结果表明,尽管方法简单,傅里叶特征在多种编码器架构和任务中均带来显著性能提升,且对超参数鲁棒。这证明傅里叶特征能更有效地利用几何细节,具有作为点云模仿学习通用工具的潜力。代码与视频见项目页:https://fourier-il.github.io/fourier-il

原文摘要 · Abstract (English)

High-precision robotic manipulation requires fine-grained spatial reasoning that is often difficult to achieve with RGB-only policies due to depth ambiguity and perspective scale issues. Policies that leverage 3D information directly, such as those based on point clouds, offer a stronger geometric prior over purely image-based ones, yet their performance remains highly task-dependent. We hypothesize that this discrepancy may be due to the spectral bias of neural networks towards learning low frequency functions, which especially affects architectures conditioned on slow-moving Cartesian features. We thus propose to map point clouds from Cartesian space into high-dimensional Fourier space, effectively equipping the point cloud encoder with direct access to high-frequency features. We experimentally validate the use of Fourier features on challenging manipulation tasks from the RoboCasa and ManiSkill3 benchmarks and on a real robot setup. Despite their simplicity, we find that Fourier features provide significant benefits across diverse encoder architectures and benchmarks and are robust across hyperparameters. Our results indicate that Fourier features let policies leverage geometric details more effectively than Cartesian features, showing their potential as a general-purpose tool for point cloud-based imitation learning. We provide source code and videos on our project page: https://fourier-il.github.io/fourier-il

机器人操控点云处理傅里叶特征模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。