打造高保真家电数据集，让仿真与真实说明书对齐
RealAppliance: Let High-fidelity Appliance Assets Controllable and Workable as Aligned Real Manuals
- 构建100个完整机械电子结构的高保真家电资产
- 涵盖说明书检索、零件定位等四大任务的评估基准
- 适合研究智能家电操作与人机交互的学者
现有家电资产存在渲染质量差、机制不全、与说明书不符等问题，导致仿真与现实间存在鸿沟，阻碍家电操作研究。本文提出RealAppliance数据集，包含100个高保真家电，其物理、电子机制及程序逻辑均与真实说明书对齐。基于此，我们构建RealAppliance-Bench评估基准，用于测试多模态大语言模型和具身操作规划模型在家电操作中的表现，涵盖说明书页检索、部件定位、开环操作规划、闭环调整四项核心任务。对模型在该基准上的分析为推进家电操作研究提供了关键洞见。
原文摘要 · Abstract (English)
Existing appliance assets suffer from poor rendering, incomplete mechanisms, and misalignment with manuals, leading to simulation-reality gaps that hinder appliance manipulation development. In this work, we introduce the RealAppliance dataset, comprising 100 high-fidelity appliances with complete physical, electronic mechanisms, and program logic aligned with their manuals. Based on these assets, we propose the RealAppliance-Bench benchmark, which evaluates multimodal large language models and embodied manipulation planning models across key tasks in appliance manipulation planning: manual page retrieval, appliance part grounding, open-loop manipulation planning, and closed-loop planning adjustment. Our analysis of model performances on RealAppliance-Bench provides insights for advancing appliance manipulation research
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。