arXiv:2608.21416cs.ROcs.AI2026-08

用眼科诊室照片构建可测试机器人任务的数字孪生环境

Operational digital twin clinics enable task-based evaluation of embodied AI

  • 用单张照片生成可编辑的仿真环境,支持机器人任务评估
  • 39个场景重建保持工作区结构,设备重定位影响接触可行性
  • 适合医疗机器人研发与临床部署前测试的团队使用

具身人工智能(AI)必须在实际临床环境中测试,但构建真实、可测试的机器人场景成本高且难扩展。本文展示如何将日常诊室图像转化为可操作的数字孪生环境,用于任务驱动的具身AI评估。基于39个眼科诊室场景,将单张照片转换为可编辑、适配仿真的环境,评估了重建质量、空间几何、网格对齐、多机器人可行性、扰动敏感性及闭环策略表现。重建场景保留了工作区结构,局部编辑实现设备可控重构。通过设备网格、碰撞代理和语义锚点,将视觉重建转化为具备接触感知能力的仿真场景。在三种机器人形态下,共享任务目标表现出不同的可达性与接触可行性差异。微小的设备平移与旋转导致任务相关的接触裕度变化,仅靠视觉相似性无法捕捉。数字孪生轨迹还支持局部策略学习与闭环评估。研究确立了‘可操作有效性’作为临床数字孪生的关键原则,为具身AI在医疗领域的离线开发与物理部署之间提供中间层。

原文摘要 · Abstract (English)

Embodied artificial intelligence (AI) must be tested in the clinical environments where it will operate, but building realistic, robot-testable settings is costly and difficult to scale. Here we show that routine clinic images can be transformed into operational digital twins for task-based evaluation of embodied AI. Using 39 ophthalmic clinic scenes, we converted single photographs into editable, simulator-ready environments and assessed reconstruction quality, room-scale geometry, mesh grounding, multi-robot feasibility, perturbation sensitivity and closed-loop policy performance. The reconstructed scenes preserved workspace structure, while local editing enabled controlled device reconfiguration. Device meshes, collision proxies and semantic anchors converted visual reconstructions into contact-aware simulation scenes. Across three robot embodiments, shared task targets showed different patterns of reachability and contact feasibility. Small device translations and rotations produced task-specific changes in contact margins that were not captured by visual similarity alone. Digital-twin trajectories also supported local policy learning and closed-loop evaluation. These findings establish operational validity as a key principle for clinical digital twins and provide an intermediate layer between offline development and physical deployment of embodied AI in healthcare.

数字孪生具身AI医疗机器人仿真评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。