构建30小时高质量3D人物交互数据集,解决动作穿模等关键问题。
InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation
- 整合21.81小时多源数据,统一标注并优化质量
- 通过接触不变性扩展至30.70小时,减少穿模与手部异常
- 定义6项基准任务,适配生成模型研究者
尽管大规模人体动作捕捉数据集推动了人体运动生成的发展,但动态3D人-物交互(HOI)建模与生成仍受限于数据集质量。现有数据常缺乏充足高质量动作与标注,存在接触穿模、漂浮及手部动作错误等问题。为此,我们提出InterAct,一个大规模3D HOI基准数据集,包含数据与方法双重创新:首先,整合并标准化来自多个来源的21.81小时HOI数据,并添加详细文本注释;其次,提出统一优化框架,通过接触不变性原则,在保持人-物关系的同时引入动作变化,有效减少伪影并修正手部动作,将数据量扩展至30.70小时;第三,定义六项基准任务,建立统一的生成建模范式,实现当前最优性能。大量实验验证了该数据集作为3D人-物交互生成基础资源的有效性。为支持持续研究,数据集已公开于https://github.com/wzyabcas/InterAct,将持续维护。
原文摘要 · Abstract (English)
While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack extensive, high-quality motion and annotation and exhibit artifacts such as contact penetration, floating, and incorrect hand motions. To address these issues, we introduce InterAct, a large-scale 3D HOI benchmark featuring dataset and methodological advancements. First, we consolidate and standardize 21.81 hours of HOI data from diverse sources, enriching it with detailed textual annotations. Second, we propose a unified optimization framework to enhance data quality by reducing artifacts and correcting hand motions. Leveraging the principle of contact invariance, we maintain human-object relationships while introducing motion variations, expanding the dataset to 30.70 hours. Third, we define six benchmarking tasks and develop a unified HOI generative modeling perspective, achieving state-of-the-art performance. Extensive experiments validate the utility of our dataset as a foundational resource for advancing 3D human-object interaction generation. To support continued research in this area, the dataset is publicly available at https://github.com/wzyabcas/InterAct, and will be actively maintained.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。