arXiv:2511.03126cs.CVcs.HC2025-11

将物理属性推理速度提升60倍以上,实现实时智能眼镜视觉认知。

Accelerating Physical Property Reasoning for Augmented Visual Cognition

  • 融合几何重建与并行视图编码,加速物理属性推理流程。
  • 端到端延迟从10-20分钟降至6秒以内,速度提升62.9至287.2倍。
  • 适用于真实场景下的智能眼镜,支持少视角鲁棒推理。

本文提出\sysname,一种加速视觉引导的物理属性推理系统,以实现增强型视觉认知。该系统通过算法与系统级优化相结合,包括快速三维几何重建、高效的语义特征融合以及并行视图编码,显著降低推理延迟。在端到端层面,推理时间由原先的10–20分钟缩短至不足6秒。在ABO数据集上的对比实验表明,\sysname实现了62.9×–287.2×的速度提升,且物体级物理属性估计(如质量)精度相当甚至更优,同时在材料分割和体素级推断上优于两个SOTA基线。进一步结合眼动追踪技术,\sysname可在杂乱的真实环境中定位关注对象,实现在智能眼镜上的高效推理。在IKEA家具店使用Meta Aria Glasses进行的案例研究显示,即使视图较少,系统仍能保持稳定高精度的属性估计性能。

原文摘要 · Abstract (English)

This paper introduces \sysname, a system that accelerates vision-guided physical property reasoning to enable augmented visual cognition. \sysname minimizes the run-time latency of this reasoning pipeline through a combination of both algorithmic and systematic optimizations, including rapid geometric 3D reconstruction, efficient semantic feature fusion, and parallel view encoding. Through these simple yet effective optimizations, \sysname reduces the end-to-end latency of this reasoning pipeline from 10--20 minutes to less than 6 seconds. A head-to-head comparison on the ABO dataset shows that \sysname achieves this 62.9$\times$--287.2$\times$ speedup while not only reaching on-par (and sometimes slightly better) object-level physical property estimation accuracy(e.g. mass), but also demonstrating superior performance in material segmentation and voxel-level inference than two SOTA baselines. We further combine gaze-tracking with \sysname to localize the object of interest in cluttered, real-world environments, streamlining the physical property reasoning on smart glasses. The case study with Meta Aria Glasses conducted at an IKEA furniture store demonstrates that \sysname achives consistently high performance compared to controlled captures, providing robust property estimations even with fewer views in real-world scenarios.

视觉认知物理推理智能眼镜实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。